Sep 09 13:26:28.059455 ip-10-0-135-192 systemd[1]: Starting Kubernetes Kubelet...
Sep 09 13:26:28.469235 ip-10-0-135-192 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 13:26:28.469235 ip-10-0-135-192 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 09 13:26:28.469235 ip-10-0-135-192 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 13:26:28.469235 ip-10-0-135-192 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 09 13:26:28.469235 ip-10-0-135-192 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 13:26:28.470234 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.470124    2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 09 13:26:28.476134 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476108    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 13:26:28.476134 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476131    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 13:26:28.476134 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476135    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 13:26:28.476134 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476138    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 13:26:28.476134 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476142    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 13:26:28.476366 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476147    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 13:26:28.476366 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476151    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 13:26:28.476366 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476155    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 13:26:28.476366 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476158    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 13:26:28.476366 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476161    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 13:26:28.476366 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476165    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 13:26:28.476366 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476168    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 13:26:28.476366 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476184    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 13:26:28.476366 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476188    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 13:26:28.476366 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476191    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 13:26:28.476366 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476194    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 13:26:28.476366 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476196    2578 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 13:26:28.476366 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476199    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 13:26:28.476366 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476202    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 13:26:28.476366 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476205    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 13:26:28.476366 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476217    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 13:26:28.476366 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476221    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 13:26:28.476366 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476223    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 13:26:28.476366 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476226    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 13:26:28.476818 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476229    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 13:26:28.476818 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476232    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 13:26:28.476818 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476235    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 13:26:28.476818 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476244    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 13:26:28.476818 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476248    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 13:26:28.476818 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476251    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 13:26:28.476818 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476254    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 13:26:28.476818 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476256    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 13:26:28.476818 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476259    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 13:26:28.476818 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476262    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 13:26:28.476818 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476264    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 13:26:28.476818 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476267    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 13:26:28.476818 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476270    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 13:26:28.476818 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476272    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 13:26:28.476818 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476277    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 13:26:28.476818 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476280    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 13:26:28.476818 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476282    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 13:26:28.476818 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476285    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 13:26:28.476818 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476288    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 13:26:28.477316 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476291    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 13:26:28.477316 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476293    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 13:26:28.477316 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476296    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 13:26:28.477316 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476299    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 13:26:28.477316 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476301    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 13:26:28.477316 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476304    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 13:26:28.477316 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476306    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 13:26:28.477316 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476309    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 13:26:28.477316 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476312    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 13:26:28.477316 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476314    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 13:26:28.477316 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476317    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 13:26:28.477316 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476319    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 13:26:28.477316 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476322    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 13:26:28.477316 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476326    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 13:26:28.477316 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476329    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 13:26:28.477316 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476332    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 13:26:28.477316 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476337    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 13:26:28.477316 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476339    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 13:26:28.477316 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476342    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 13:26:28.477774 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476345    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 13:26:28.477774 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476347    2578 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 13:26:28.477774 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476350    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 13:26:28.477774 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476352    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 13:26:28.477774 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476355    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 13:26:28.477774 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476358    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 13:26:28.477774 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476360    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 13:26:28.477774 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476363    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 13:26:28.477774 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476367    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 13:26:28.477774 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476370    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 13:26:28.477774 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476372    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 13:26:28.477774 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476375    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 13:26:28.477774 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476377    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 13:26:28.477774 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476380    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 13:26:28.477774 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476384    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 13:26:28.477774 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476387    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 13:26:28.477774 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476390    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 13:26:28.477774 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476393    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 13:26:28.477774 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476395    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 13:26:28.478329 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476398    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 13:26:28.478329 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476400    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 13:26:28.478329 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476404    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 13:26:28.478329 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476407    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 13:26:28.478329 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476409    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 13:26:28.478329 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476412    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 13:26:28.478329 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476415    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 13:26:28.478329 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476417    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 13:26:28.478329 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476420    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 13:26:28.478329 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476422    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 13:26:28.478329 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476425    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 13:26:28.478329 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476427    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 13:26:28.478329 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476430    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 13:26:28.478329 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476432    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 13:26:28.478329 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476435    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 13:26:28.478329 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476437    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 13:26:28.478329 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476440    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 13:26:28.478329 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.476442    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 13:26:28.478329 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477146    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 13:26:28.478329 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477152    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 13:26:28.478844 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477156    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 13:26:28.478844 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477160    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 13:26:28.478844 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477163    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 13:26:28.478844 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477165    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 13:26:28.478844 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477168    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 13:26:28.478844 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477187    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 13:26:28.478844 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477191    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 13:26:28.478844 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477193    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 13:26:28.478844 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477196    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 13:26:28.478844 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477199    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 13:26:28.478844 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477201    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 13:26:28.478844 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477204    2578 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 13:26:28.478844 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477207    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 13:26:28.478844 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477210    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 13:26:28.478844 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477212    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 13:26:28.478844 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477215    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 13:26:28.478844 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477218    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 13:26:28.478844 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477221    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 13:26:28.478844 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477223    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 13:26:28.478844 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477226    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 13:26:28.479407 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477228    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 13:26:28.479407 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477231    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 13:26:28.479407 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477233    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 13:26:28.479407 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477236    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 13:26:28.479407 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477238    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 13:26:28.479407 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477241    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 13:26:28.479407 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477243    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 13:26:28.479407 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477246    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 13:26:28.479407 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477250    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 13:26:28.479407 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477253    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 13:26:28.479407 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477255    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 13:26:28.479407 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477258    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 13:26:28.479407 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477261    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 13:26:28.479407 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477264    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 13:26:28.479407 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477267    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 13:26:28.479407 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477269    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 13:26:28.479407 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477272    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 13:26:28.479407 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477275    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 13:26:28.479407 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477277    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 13:26:28.479407 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477279    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 13:26:28.479903 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477282    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 13:26:28.479903 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477284    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 13:26:28.479903 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477287    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 13:26:28.479903 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477289    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 13:26:28.479903 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477291    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 13:26:28.479903 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477294    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 13:26:28.479903 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477297    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 13:26:28.479903 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477300    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 13:26:28.479903 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477303    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 13:26:28.479903 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477305    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 13:26:28.479903 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477308    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 13:26:28.479903 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477310    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 13:26:28.479903 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477313    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 13:26:28.479903 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477317    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 13:26:28.479903 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477321    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 13:26:28.479903 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477324    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 13:26:28.479903 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477328    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 13:26:28.479903 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477330    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 13:26:28.479903 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477333    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 13:26:28.479903 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477336    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 13:26:28.480445 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477339    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 13:26:28.480445 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477342    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 13:26:28.480445 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477344    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 13:26:28.480445 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477347    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 13:26:28.480445 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477351    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 13:26:28.480445 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477354    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 13:26:28.480445 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477357    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 13:26:28.480445 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477360    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 13:26:28.480445 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477363    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 13:26:28.480445 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477366    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 13:26:28.480445 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477368    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 13:26:28.480445 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477371    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 13:26:28.480445 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477374    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 13:26:28.480445 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477376    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 13:26:28.480445 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477379    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 13:26:28.480445 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477382    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 13:26:28.480445 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477384    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 13:26:28.480445 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477389    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 13:26:28.480445 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477392    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 13:26:28.480919 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477394    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 13:26:28.480919 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477397    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 13:26:28.480919 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477401    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 13:26:28.480919 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477404    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 13:26:28.480919 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477406    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 13:26:28.480919 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477409    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 13:26:28.480919 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477412    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 13:26:28.480919 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477414    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 13:26:28.480919 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477417    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 13:26:28.480919 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477420    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 13:26:28.480919 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477422    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 13:26:28.480919 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477424    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 13:26:28.480919 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477427    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 13:26:28.480919 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477429    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 13:26:28.480919 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477432    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 13:26:28.480919 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477435    2578 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 13:26:28.480919 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477437    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 13:26:28.480919 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477440    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 13:26:28.480919 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477841    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 13:26:28.480919 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477846    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 13:26:28.481421 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477849    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 13:26:28.481421 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477853    2578 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 13:26:28.481421 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477855    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 13:26:28.481421 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477858    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 13:26:28.481421 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477861    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 13:26:28.481421 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477863    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 13:26:28.481421 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477866    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 13:26:28.481421 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477869    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 13:26:28.481421 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477871    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 13:26:28.481421 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477874    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 13:26:28.481421 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477877    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 13:26:28.481421 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477880    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 13:26:28.481421 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477884    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 13:26:28.481421 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477887    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 13:26:28.481421 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477890    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 13:26:28.481421 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477893    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 13:26:28.481421 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477896    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 13:26:28.481421 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477899    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 13:26:28.481421 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477901    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 13:26:28.481421 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477904    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 13:26:28.481900 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477906    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 13:26:28.481900 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477911    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 13:26:28.481900 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477914    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 13:26:28.481900 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477916    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 13:26:28.481900 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477918    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 13:26:28.481900 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477921    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 13:26:28.481900 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477924    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 13:26:28.481900 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477926    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 13:26:28.481900 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477928    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 13:26:28.481900 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477931    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 13:26:28.481900 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477934    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 13:26:28.481900 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477937    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 13:26:28.481900 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477939    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 13:26:28.481900 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477942    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 13:26:28.481900 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477945    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 13:26:28.481900 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477947    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 13:26:28.481900 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477950    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 13:26:28.481900 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477953    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 13:26:28.481900 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477955    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 13:26:28.481900 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477958    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 13:26:28.482384 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477960    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 13:26:28.482384 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477963    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 13:26:28.482384 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477965    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 13:26:28.482384 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477968    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 13:26:28.482384 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477970    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 13:26:28.482384 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477973    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 13:26:28.482384 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477977    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 13:26:28.482384 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477980    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 13:26:28.482384 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477983    2578 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 13:26:28.482384 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477987    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 13:26:28.482384 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477990    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 13:26:28.482384 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477993    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 13:26:28.482384 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.477996    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 13:26:28.482384 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478001    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 13:26:28.482384 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478004    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 13:26:28.482384 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478006    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 13:26:28.482384 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478009    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 13:26:28.482384 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478012    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 13:26:28.482384 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478015    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 13:26:28.482384 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478017    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 13:26:28.483361 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478020    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 13:26:28.483361 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478023    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 13:26:28.483361 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478025    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 13:26:28.483361 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478028    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 13:26:28.483361 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478030    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 13:26:28.483361 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478033    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 13:26:28.483361 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478036    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 13:26:28.483361 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478038    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 13:26:28.483361 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478042    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 13:26:28.483361 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478044    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 13:26:28.483361 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478047    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 13:26:28.483361 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478049    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 13:26:28.483361 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478054    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 13:26:28.483361 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478057    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 13:26:28.483361 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478059    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 13:26:28.483361 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478062    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 13:26:28.483361 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478064    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 13:26:28.483361 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478067    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 13:26:28.483361 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478069    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 13:26:28.483361 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478072    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 13:26:28.483839 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478075    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 13:26:28.483839 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478077    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 13:26:28.483839 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478080    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 13:26:28.483839 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478082    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 13:26:28.483839 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478085    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 13:26:28.483839 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478091    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 13:26:28.483839 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478094    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 13:26:28.483839 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478097    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 13:26:28.483839 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478101    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 13:26:28.483839 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478104    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 13:26:28.483839 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478107    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 13:26:28.483839 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478110    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 13:26:28.483839 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478114    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 13:26:28.483839 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478117    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 13:26:28.483839 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478119    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 13:26:28.483839 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478122    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 13:26:28.483839 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478125    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 13:26:28.483839 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478211    2578 flags.go:64] FLAG: --address="0.0.0.0"
Sep 09 13:26:28.483839 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478257    2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 09 13:26:28.483839 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478264    2578 flags.go:64] FLAG: --anonymous-auth="true"
Sep 09 13:26:28.484331 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478269    2578 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 09 13:26:28.484331 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478273    2578 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 09 13:26:28.484331 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478276    2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 09 13:26:28.484331 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478280    2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 09 13:26:28.484331 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478285    2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 09 13:26:28.484331 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478288    2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 09 13:26:28.484331 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478291    2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 09 13:26:28.484331 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478294    2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 09 13:26:28.484331 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478298    2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 09 13:26:28.484331 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478301    2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 09 13:26:28.484331 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478304    2578 flags.go:64] FLAG: --cgroup-root=""
Sep 09 13:26:28.484331 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478307    2578 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 09 13:26:28.484331 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478310    2578 flags.go:64] FLAG: --client-ca-file=""
Sep 09 13:26:28.484331 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478314    2578 flags.go:64] FLAG: --cloud-provider="external"
Sep 09 13:26:28.484331 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478317    2578 flags.go:64] FLAG: --cluster-dns="[]"
Sep 09 13:26:28.484331 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478321    2578 flags.go:64] FLAG: --cluster-domain=""
Sep 09 13:26:28.484331 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478324    2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 09 13:26:28.484331 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478328    2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 09 13:26:28.484331 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478332    2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 09 13:26:28.484331 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478336    2578 flags.go:64] FLAG: --container-log-max-files="5"
Sep 09 13:26:28.484331 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478340    2578 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 09 13:26:28.484331 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478343    2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 09 13:26:28.484331 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478346    2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 09 13:26:28.484882 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478349    2578 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 09 13:26:28.484882 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478353    2578 flags.go:64] FLAG: --contention-profiling="false"
Sep 09 13:26:28.484882 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478356    2578 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 09 13:26:28.484882 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478359    2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 09 13:26:28.484882 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478362    2578 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 09 13:26:28.484882 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478365    2578 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 09 13:26:28.484882 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478369    2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 09 13:26:28.484882 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478372    2578 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 09 13:26:28.484882 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478375    2578 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 09 13:26:28.484882 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478378    2578 flags.go:64] FLAG: --enable-load-reader="false"
Sep 09 13:26:28.484882 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478381    2578 flags.go:64] FLAG: --enable-server="true"
Sep 09 13:26:28.484882 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478383    2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 09 13:26:28.484882 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478393    2578 flags.go:64] FLAG: --event-burst="100"
Sep 09 13:26:28.484882 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478396    2578 flags.go:64] FLAG: --event-qps="50"
Sep 09 13:26:28.484882 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478399    2578 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 09 13:26:28.484882 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478402    2578 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 09 13:26:28.484882 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478405    2578 flags.go:64] FLAG: --eviction-hard=""
Sep 09 13:26:28.484882 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478409    2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 09 13:26:28.484882 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478412    2578 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 09 13:26:28.484882 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478415    2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 09 13:26:28.484882 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478418    2578 flags.go:64] FLAG: --eviction-soft=""
Sep 09 13:26:28.484882 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478421    2578 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 09 13:26:28.484882 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478424    2578 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 09 13:26:28.484882 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478428    2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 09 13:26:28.484882 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478431    2578 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 09 13:26:28.485539 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478434    2578 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 09 13:26:28.485539 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478437    2578 flags.go:64] FLAG: --fail-swap-on="true"
Sep 09 13:26:28.485539 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478440    2578 flags.go:64] FLAG: --feature-gates=""
Sep 09 13:26:28.485539 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478445    2578 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 09 13:26:28.485539 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478448    2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 09 13:26:28.485539 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478451    2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 09 13:26:28.485539 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478454    2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 09 13:26:28.485539 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478457    2578 flags.go:64] FLAG: --healthz-port="10248"
Sep 09 13:26:28.485539 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478461    2578 flags.go:64] FLAG: --help="false"
Sep 09 13:26:28.485539 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478464    2578 flags.go:64] FLAG: --hostname-override="ip-10-0-135-192.ec2.internal"
Sep 09 13:26:28.485539 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478468    2578 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 09 13:26:28.485539 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478471    2578 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 09 13:26:28.485539 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478474    2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 09 13:26:28.485539 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478477    2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 09 13:26:28.485539 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478480    2578 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 09 13:26:28.485539 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478483    2578 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 09 13:26:28.485539 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478486    2578 flags.go:64] FLAG: --image-service-endpoint=""
Sep 09 13:26:28.485539 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478489    2578 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 09 13:26:28.485539 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478492    2578 flags.go:64] FLAG: --kube-api-burst="100"
Sep 09 13:26:28.485539 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478494    2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 09 13:26:28.485539 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478497    2578 flags.go:64] FLAG: --kube-api-qps="50"
Sep 09 13:26:28.485539 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478500    2578 flags.go:64] FLAG: --kube-reserved=""
Sep 09 13:26:28.485539 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478503    2578 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 09 13:26:28.485539 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478507    2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 09 13:26:28.486111 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478510    2578 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 09 13:26:28.486111 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478512    2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 09 13:26:28.486111 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478515    2578 flags.go:64] FLAG: --lock-file=""
Sep 09 13:26:28.486111 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478518    2578 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 09 13:26:28.486111 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478521    2578 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 09 13:26:28.486111 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478524    2578 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 09 13:26:28.486111 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478529    2578 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 09 13:26:28.486111 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478533    2578 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 09 13:26:28.486111 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478537    2578 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 09 13:26:28.486111 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478540    2578 flags.go:64] FLAG: --logging-format="text"
Sep 09 13:26:28.486111 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478542    2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 09 13:26:28.486111 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478546    2578 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 09 13:26:28.486111 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478549    2578 flags.go:64] FLAG: --manifest-url=""
Sep 09 13:26:28.486111 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478552    2578 flags.go:64] FLAG: --manifest-url-header=""
Sep 09 13:26:28.486111 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478556    2578 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 09 13:26:28.486111 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478559    2578 flags.go:64] FLAG: --max-open-files="1000000"
Sep 09 13:26:28.486111 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478564    2578 flags.go:64] FLAG: --max-pods="110"
Sep 09 13:26:28.486111 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478567    2578 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 09 13:26:28.486111 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478570    2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 09 13:26:28.486111 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478573    2578 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 09 13:26:28.486111 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478576    2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 09 13:26:28.486111 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478579    2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 09 13:26:28.486111 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478582    2578 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 09 13:26:28.486111 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478585    2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 09 13:26:28.486111 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478593    2578 flags.go:64] FLAG: --node-status-max-images="50"
Sep 09 13:26:28.486730 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478596    2578 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 09 13:26:28.486730 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478599    2578 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 09 13:26:28.486730 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478602    2578 flags.go:64] FLAG: --pod-cidr=""
Sep 09 13:26:28.486730 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478605    2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 09 13:26:28.486730 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478611    2578 flags.go:64] FLAG: --pod-manifest-path=""
Sep 09 13:26:28.486730 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478614    2578 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 09 13:26:28.486730 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478617    2578 flags.go:64] FLAG: --pods-per-core="0"
Sep 09 13:26:28.486730 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478620    2578 flags.go:64] FLAG: --port="10250"
Sep 09 13:26:28.486730 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478623    2578 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 09 13:26:28.486730 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478626    2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0dac2fe7c594bfa38"
Sep 09 13:26:28.486730 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478629    2578 flags.go:64] FLAG: --qos-reserved=""
Sep 09 13:26:28.486730 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478632    2578 flags.go:64] FLAG: --read-only-port="10255"
Sep 09 13:26:28.486730 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478635    2578 flags.go:64] FLAG: --register-node="true"
Sep 09 13:26:28.486730 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478638    2578 flags.go:64] FLAG: --register-with-taints=""
Sep 09 13:26:28.486730 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478642    2578 flags.go:64] FLAG: --registry-burst="10"
Sep 09 13:26:28.486730 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478646    2578 flags.go:64] FLAG: --registry-qps="5"
Sep 09 13:26:28.486730 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478649    2578 flags.go:64] FLAG: --reserved-cpus=""
Sep 09 13:26:28.486730 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478652    2578 flags.go:64] FLAG: --reserved-memory=""
Sep 09 13:26:28.486730 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478655    2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 09 13:26:28.486730 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478658    2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 09 13:26:28.486730 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478661    2578 flags.go:64] FLAG: --rotate-certificates="false"
Sep 09 13:26:28.486730 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478664    2578 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 09 13:26:28.486730 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478666    2578 flags.go:64] FLAG: --runonce="false"
Sep 09 13:26:28.486730 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478669    2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 09 13:26:28.486730 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478673    2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 09 13:26:28.487333 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478677    2578 flags.go:64] FLAG: --seccomp-default="false"
Sep 09 13:26:28.487333 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478679    2578 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 09 13:26:28.487333 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478682    2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 09 13:26:28.487333 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478685    2578 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 09 13:26:28.487333 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478688    2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 09 13:26:28.487333 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478691    2578 flags.go:64] FLAG: --storage-driver-password="root"
Sep 09 13:26:28.487333 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478694    2578 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 09 13:26:28.487333 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478697    2578 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 09 13:26:28.487333 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478700    2578 flags.go:64] FLAG: --storage-driver-user="root"
Sep 09 13:26:28.487333 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478703    2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 09 13:26:28.487333 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478706    2578 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 09 13:26:28.487333 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478708    2578 flags.go:64] FLAG: --system-cgroups=""
Sep 09 13:26:28.487333 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478711    2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 09 13:26:28.487333 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478716    2578 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 09 13:26:28.487333 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478719    2578 flags.go:64] FLAG: --tls-cert-file=""
Sep 09 13:26:28.487333 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478722    2578 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 09 13:26:28.487333 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478726    2578 flags.go:64] FLAG: --tls-min-version=""
Sep 09 13:26:28.487333 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478728    2578 flags.go:64] FLAG: --tls-private-key-file=""
Sep 09 13:26:28.487333 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478731    2578 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 09 13:26:28.487333 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478734    2578 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 09 13:26:28.487333 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478737    2578 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 09 13:26:28.487333 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478740    2578 flags.go:64] FLAG: --v="2"
Sep 09 13:26:28.487333 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478744    2578 flags.go:64] FLAG: --version="false"
Sep 09 13:26:28.487333 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478749    2578 flags.go:64] FLAG: --vmodule=""
Sep 09 13:26:28.487333 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478753    2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 09 13:26:28.487937 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.478756    2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 09 13:26:28.487937 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478902    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 13:26:28.487937 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478906    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 13:26:28.487937 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478910    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 13:26:28.487937 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478914    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 13:26:28.487937 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478918    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 13:26:28.487937 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478922    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 13:26:28.487937 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478925    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 13:26:28.487937 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478928    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 13:26:28.487937 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478931    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 13:26:28.487937 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478936    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 13:26:28.487937 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478939    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 13:26:28.487937 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478942    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 13:26:28.487937 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478945    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 13:26:28.487937 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478948    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 13:26:28.487937 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478951    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 13:26:28.487937 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478954    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 13:26:28.487937 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478957    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 13:26:28.487937 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478959    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 13:26:28.487937 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478962    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 13:26:28.488454 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478965    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 13:26:28.488454 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478967    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 13:26:28.488454 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478970    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 13:26:28.488454 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478972    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 13:26:28.488454 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478975    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 13:26:28.488454 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478977    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 13:26:28.488454 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478980    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 13:26:28.488454 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478983    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 13:26:28.488454 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478985    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 13:26:28.488454 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478988    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 13:26:28.488454 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478991    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 13:26:28.488454 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478994    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 13:26:28.488454 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.478997    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 13:26:28.488454 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.479000    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 13:26:28.488454 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.479002    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 13:26:28.488454 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.479004    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 13:26:28.488454 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.479007    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 13:26:28.488454 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.479010    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 13:26:28.488454 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.479013    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 13:26:28.488454 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.479016    2578 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 13:26:28.488988 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.479018    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 13:26:28.488988 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.479021    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 13:26:28.488988 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.479024    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 13:26:28.488988 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.479026    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 13:26:28.488988 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.479029    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 13:26:28.488988 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.479031    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 13:26:28.488988 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.479034    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 13:26:28.488988 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.479037    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 13:26:28.488988 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.479041    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 13:26:28.488988 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.479044    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 13:26:28.488988 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.479047    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 13:26:28.488988 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.479049    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 13:26:28.488988 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.479053    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 13:26:28.488988 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.479055    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 13:26:28.488988 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.479058    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 13:26:28.488988 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.479061    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 13:26:28.488988 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.479064    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 13:26:28.488988 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.479066    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 13:26:28.488988 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.479069    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 13:26:28.488988 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.479072    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 13:26:28.489482 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.479074    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 13:26:28.489482 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.479078    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 13:26:28.489482 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.479081    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 13:26:28.489482 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.479084    2578 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 13:26:28.489482 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.479090    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 13:26:28.489482 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.479093    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 13:26:28.489482 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.479096    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 13:26:28.489482 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.479098    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 13:26:28.489482 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.479101    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 13:26:28.489482 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.479103    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 13:26:28.489482 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.479107    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 13:26:28.489482 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.479109    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 13:26:28.489482 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.479112    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 13:26:28.489482 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.479115    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 13:26:28.489482 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.479117    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 13:26:28.489482 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.479119    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 13:26:28.489482 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.479122    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 13:26:28.489482 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.479124    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 13:26:28.489482 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.479127    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 13:26:28.489938 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.479129    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 13:26:28.489938 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.479132    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 13:26:28.489938 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.479134    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 13:26:28.489938 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.479137    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 13:26:28.489938 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.479139    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 13:26:28.489938 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.479142    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 13:26:28.489938 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.479144    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 13:26:28.489938 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.479147    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 13:26:28.489938 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.479149    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 13:26:28.489938 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.479152    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 13:26:28.489938 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.479154    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 13:26:28.489938 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.479157    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 13:26:28.489938 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.479159    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 13:26:28.489938 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.479162    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 13:26:28.489938 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.479166    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 13:26:28.489938 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.479168    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 13:26:28.489938 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.479183    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 13:26:28.489938 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.479186    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 13:26:28.489938 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.479192    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 13:26:28.490422 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.479194    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 13:26:28.490422 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.479197    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 13:26:28.490422 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.479202    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 13:26:28.490422 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.486838    2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 09 13:26:28.490422 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.486854    2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 09 13:26:28.490422 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.487489    2578 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 09 13:26:28.490422 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.487497    2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 09 13:26:28.490422 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487554    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 13:26:28.490422 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487559    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 13:26:28.490422 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487563    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 13:26:28.490422 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487566    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 13:26:28.490422 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487569    2578 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 13:26:28.490422 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487572    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 13:26:28.490422 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487575    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 13:26:28.490422 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487578    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 13:26:28.490802 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487580    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 13:26:28.490802 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487583    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 13:26:28.490802 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487585    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 13:26:28.490802 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487588    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 13:26:28.490802 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487591    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 13:26:28.490802 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487593    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 13:26:28.490802 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487596    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 13:26:28.490802 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487598    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 13:26:28.490802 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487601    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 13:26:28.490802 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487603    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 13:26:28.490802 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487606    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 13:26:28.490802 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487608    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 13:26:28.490802 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487611    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 13:26:28.490802 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487613    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 13:26:28.490802 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487616    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 13:26:28.490802 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487618    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 13:26:28.490802 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487620    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 13:26:28.490802 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487623    2578 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 13:26:28.490802 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487625    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 13:26:28.490802 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487628    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 13:26:28.491306 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487630    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 13:26:28.491306 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487635    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 13:26:28.491306 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487638    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 13:26:28.491306 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487641    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 13:26:28.491306 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487643    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 13:26:28.491306 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487646    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 13:26:28.491306 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487649    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 13:26:28.491306 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487651    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 13:26:28.491306 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487654    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 13:26:28.491306 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487657    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 13:26:28.491306 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487659    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 13:26:28.491306 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487662    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 13:26:28.491306 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487664    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 13:26:28.491306 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487667    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 13:26:28.491306 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487669    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 13:26:28.491306 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487672    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 13:26:28.491306 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487674    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 13:26:28.491306 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487677    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 13:26:28.491306 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487679    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 13:26:28.491772 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487682    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 13:26:28.491772 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487685    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 13:26:28.491772 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487689    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 13:26:28.491772 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487693    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 13:26:28.491772 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487696    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 13:26:28.491772 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487699    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 13:26:28.491772 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487702    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 13:26:28.491772 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487704    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 13:26:28.491772 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487708    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 13:26:28.491772 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487712    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 13:26:28.491772 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487715    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 13:26:28.491772 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487717    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 13:26:28.491772 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487720    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 13:26:28.491772 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487722    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 13:26:28.491772 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487725    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 13:26:28.491772 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487728    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 13:26:28.491772 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487731    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 13:26:28.491772 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487734    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 13:26:28.491772 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487736    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 13:26:28.491772 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487739    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 13:26:28.492312 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487741    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 13:26:28.492312 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487744    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 13:26:28.492312 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487747    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 13:26:28.492312 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487750    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 13:26:28.492312 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487752    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 13:26:28.492312 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487755    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 13:26:28.492312 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487758    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 13:26:28.492312 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487760    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 13:26:28.492312 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487763    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 13:26:28.492312 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487765    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 13:26:28.492312 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487768    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 13:26:28.492312 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487770    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 13:26:28.492312 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487773    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 13:26:28.492312 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487775    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 13:26:28.492312 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487777    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 13:26:28.492312 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487780    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 13:26:28.492312 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487783    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 13:26:28.492312 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487785    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 13:26:28.492312 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487788    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 13:26:28.492312 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487790    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 13:26:28.492786 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487793    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 13:26:28.492786 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487796    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 13:26:28.492786 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487798    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 13:26:28.492786 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487801    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 13:26:28.492786 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487803    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 13:26:28.492786 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487806    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 13:26:28.492786 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487810    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 13:26:28.492786 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487814    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 13:26:28.492786 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487817    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 13:26:28.492786 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487820    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 13:26:28.492786 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487823    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 13:26:28.492786 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487825    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 13:26:28.492786 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.487831    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 13:26:28.492786 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487944    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 13:26:28.492786 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487949    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 13:26:28.493159 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487952    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 13:26:28.493159 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487955    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 13:26:28.493159 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487958    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 13:26:28.493159 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487961    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 13:26:28.493159 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487964    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 13:26:28.493159 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487966    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 13:26:28.493159 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487968    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 13:26:28.493159 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487971    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 13:26:28.493159 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487973    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 13:26:28.493159 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487976    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 13:26:28.493159 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487978    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 13:26:28.493159 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487981    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 13:26:28.493159 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487983    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 13:26:28.493159 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487986    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 13:26:28.493159 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487988    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 13:26:28.493159 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487991    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 13:26:28.493159 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487994    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 13:26:28.493159 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487996    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 13:26:28.493159 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.487999    2578 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 13:26:28.493159 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488002    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 13:26:28.493660 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488004    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 13:26:28.493660 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488007    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 13:26:28.493660 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488010    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 13:26:28.493660 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488014    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 13:26:28.493660 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488018    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 13:26:28.493660 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488020    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 13:26:28.493660 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488024    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 13:26:28.493660 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488026    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 13:26:28.493660 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488029    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 13:26:28.493660 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488032    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 13:26:28.493660 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488034    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 13:26:28.493660 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488037    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 13:26:28.493660 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488039    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 13:26:28.493660 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488041    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 13:26:28.493660 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488044    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 13:26:28.493660 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488047    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 13:26:28.493660 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488049    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 13:26:28.493660 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488052    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 13:26:28.493660 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488054    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 13:26:28.494125 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488057    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 13:26:28.494125 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488059    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 13:26:28.494125 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488062    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 13:26:28.494125 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488064    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 13:26:28.494125 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488067    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 13:26:28.494125 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488069    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 13:26:28.494125 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488072    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 13:26:28.494125 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488075    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 13:26:28.494125 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488079    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 13:26:28.494125 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488082    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 13:26:28.494125 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488084    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 13:26:28.494125 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488087    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 13:26:28.494125 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488089    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 13:26:28.494125 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488092    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 13:26:28.494125 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488094    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 13:26:28.494125 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488097    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 13:26:28.494125 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488100    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 13:26:28.494125 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488102    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 13:26:28.494125 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488105    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 13:26:28.494125 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488107    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 13:26:28.494726 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488110    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 13:26:28.494726 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488113    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 13:26:28.494726 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488115    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 13:26:28.494726 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488118    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 13:26:28.494726 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488120    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 13:26:28.494726 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488123    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 13:26:28.494726 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488125    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 13:26:28.494726 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488128    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 13:26:28.494726 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488130    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 13:26:28.494726 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488133    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 13:26:28.494726 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488135    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 13:26:28.494726 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488137    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 13:26:28.494726 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488140    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 13:26:28.494726 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488142    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 13:26:28.494726 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488145    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 13:26:28.494726 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488147    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 13:26:28.494726 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488150    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 13:26:28.494726 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488152    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 13:26:28.494726 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488155    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 13:26:28.494726 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488157    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 13:26:28.495211 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488163    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 13:26:28.495211 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488165    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 13:26:28.495211 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488168    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 13:26:28.495211 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488184    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 13:26:28.495211 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488189    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 13:26:28.495211 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488192    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 13:26:28.495211 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488195    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 13:26:28.495211 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488198    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 13:26:28.495211 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488201    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 13:26:28.495211 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488204    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 13:26:28.495211 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488206    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 13:26:28.495211 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488217    2578 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 13:26:28.495211 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488219    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 13:26:28.495211 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488225    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 13:26:28.495211 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488228    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 13:26:28.495211 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488231    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 13:26:28.495211 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488234    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 13:26:28.495211 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:28.488237    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 13:26:28.495630 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.488242    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 13:26:28.495630 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.488374    2578 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 09 13:26:28.495630 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.490958    2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 09 13:26:28.495630 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.492280    2578 server.go:1019] "Starting client certificate rotation"
Sep 09 13:26:28.495630 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.492382    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 09 13:26:28.495630 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.492422    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 09 13:26:28.495630 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.494617    2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 09 13:26:28.495838 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.495787    2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 09 13:26:28.504632 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.504610    2578 log.go:25] "Validated CRI v1 runtime API"
Sep 09 13:26:28.507732 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.507713    2578 log.go:25] "Validated CRI v1 image API"
Sep 09 13:26:28.508692 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.508671    2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 09 13:26:28.513087 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.513067    2578 fs.go:135] Filesystem UUIDs: map[7672598a-367f-42de-befc-4805504520fd:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 cec37cf3-d3ee-4e89-a0f3-71e705f543c8:/dev/nvme0n1p3]
Sep 09 13:26:28.513160 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.513085    2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 09 13:26:28.519355 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.519238    2578 manager.go:216] Machine: {Timestamp:2026-09-09 13:26:28.518118914 +0000 UTC m=+0.333643100 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098647 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2205e202833cb1aec635ea5e88e73e SystemUUID:ec2205e2-0283-3cb1-aec6-35ea5e88e73e BootID:25fa92b9-d7bc-423a-8494-b4297b0f29b9 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:0b:15:3a:f3:71 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:0b:15:3a:f3:71 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:06:8c:c8:1b:83:c6 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 09 13:26:28.519355 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.519352    2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 09 13:26:28.519462 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.519440    2578 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 09 13:26:28.522240 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.522217    2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 09 13:26:28.522390 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.522242    2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-192.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 09 13:26:28.523000 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.522991    2578 topology_manager.go:138] "Creating topology manager with none policy"
Sep 09 13:26:28.523031 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.523003    2578 container_manager_linux.go:309] "Creating device plugin manager"
Sep 09 13:26:28.523031 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.523015    2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 09 13:26:28.525241 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.525215    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 09 13:26:28.525622 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.525607    2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 09 13:26:28.526851 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.526841    2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 09 13:26:28.530418 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.530406    2578 state_mem.go:36] "Initialized new in-memory state store"
Sep 09 13:26:28.530533 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.530523    2578 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 09 13:26:28.530566 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.530552    2578 kubelet.go:486] "Attempting to sync node with API server"
Sep 09 13:26:28.530566 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.530563    2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 09 13:26:28.530616 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.530577    2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 09 13:26:28.530616 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.530587    2578 kubelet.go:398] "Adding apiserver pod source"
Sep 09 13:26:28.530616 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.530596    2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 09 13:26:28.531067 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.531053    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 09 13:26:28.531113 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.531078    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 09 13:26:28.533474 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.533457    2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 09 13:26:28.535506 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.535490    2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 09 13:26:28.535583 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.535527    2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 09 13:26:28.535713 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.535701    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 09 13:26:28.535777 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.535720    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 09 13:26:28.535777 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.535731    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 09 13:26:28.535777 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.535740    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 09 13:26:28.535777 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.535752    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 09 13:26:28.535777 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.535761    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 09 13:26:28.536165 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.536155    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 09 13:26:28.536251 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.536167    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 09 13:26:28.536251 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.536194    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 09 13:26:28.536251 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.536203    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 09 13:26:28.536251 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.536223    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 09 13:26:28.536251 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.536237    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 09 13:26:28.537018 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.537008    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 09 13:26:28.537065 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.537020    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 09 13:26:28.540656 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.540640    2578 server.go:1268] "Started kubelet"
Sep 09 13:26:28.540851 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.540726    2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 09 13:26:28.540899 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.540851    2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 09 13:26:28.540939 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.540911    2578 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 09 13:26:28.541751 ip-10-0-135-192 systemd[1]: Started Kubernetes Kubelet.
Sep 09 13:26:28.542074 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.542050    2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 09 13:26:28.542252 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:28.542228    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-192.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 09 13:26:28.542325 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.542292    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-192.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 09 13:26:28.542462 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:28.542441    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 09 13:26:28.543362 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.543344    2578 server.go:310] "Adding debug handlers to kubelet server"
Sep 09 13:26:28.546693 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:28.546660    2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 09 13:26:28.548196 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.548161    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 09 13:26:28.548565 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.548545    2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 09 13:26:28.549208 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.549192    2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 09 13:26:28.549208 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.549195    2578 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 09 13:26:28.549314 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.549216    2578 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 09 13:26:28.549407 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.549382    2578 reconstruct.go:97] "Volume reconstruction finished"
Sep 09 13:26:28.549407 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.549400    2578 reconciler.go:29] "Reconciler: start to sync state"
Sep 09 13:26:28.550031 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:28.548694    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-192.ec2.internal\" not found"
Sep 09 13:26:28.550885 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.550867    2578 factory.go:55] Registering systemd factory
Sep 09 13:26:28.550973 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.550911    2578 factory.go:223] Registration of the systemd container factory successfully
Sep 09 13:26:28.551136 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.551116    2578 factory.go:153] Registering CRI-O factory
Sep 09 13:26:28.551136 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.551134    2578 factory.go:223] Registration of the crio container factory successfully
Sep 09 13:26:28.551352 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:28.550290    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-192.ec2.internal.18d3a9febc35427f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-192.ec2.internal,UID:ip-10-0-135-192.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-192.ec2.internal,},FirstTimestamp:2026-09-09 13:26:28.540613247 +0000 UTC m=+0.356137432,LastTimestamp:2026-09-09 13:26:28.540613247 +0000 UTC m=+0.356137432,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-192.ec2.internal,}"
Sep 09 13:26:28.551352 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.551200    2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 09 13:26:28.551352 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.551219    2578 factory.go:103] Registering Raw factory
Sep 09 13:26:28.551352 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.551235    2578 manager.go:1196] Started watching for new ooms in manager
Sep 09 13:26:28.551638 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.551625    2578 manager.go:349] Starting recovery of all containers
Sep 09 13:26:28.559732 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:28.559707    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 09 13:26:28.559859 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:28.559801    2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-192.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 09 13:26:28.560970 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.560841    2578 manager.go:354] Recovery completed
Sep 09 13:26:28.563456 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.563436    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-85qwn"
Sep 09 13:26:28.565299 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.565286    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 13:26:28.567042 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.567027    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-192.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 13:26:28.567107 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.567054    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-192.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 13:26:28.567107 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.567065    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-192.ec2.internal" event="NodeHasSufficientPID"
Sep 09 13:26:28.567674 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.567654    2578 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 09 13:26:28.567674 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.567675    2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 09 13:26:28.567815 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.567696    2578 state_mem.go:36] "Initialized new in-memory state store"
Sep 09 13:26:28.567815 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.567717    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 13:26:28.568632 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.568612    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-192.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 13:26:28.568731 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.568671    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-192.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 13:26:28.568731 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.568687    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-192.ec2.internal" event="NodeHasSufficientPID"
Sep 09 13:26:28.570023 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.570010    2578 policy_none.go:49] "None policy: Start"
Sep 09 13:26:28.570023 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.570026    2578 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 09 13:26:28.570123 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.570036    2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 09 13:26:28.572097 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.572085    2578 policy_none.go:47] "Start"
Sep 09 13:26:28.573222 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.573207    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-85qwn"
Sep 09 13:26:28.577046 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:28.576963    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-192.ec2.internal.18d3a9febdc88693  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-192.ec2.internal,UID:ip-10-0-135-192.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-192.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-192.ec2.internal,},FirstTimestamp:2026-09-09 13:26:28.567041683 +0000 UTC m=+0.382565867,LastTimestamp:2026-09-09 13:26:28.567041683 +0000 UTC m=+0.382565867,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-192.ec2.internal,}"
Sep 09 13:26:28.605842 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.605817    2578 manager.go:337] "Starting Device Plugin manager"
Sep 09 13:26:28.627070 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:28.605856    2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 09 13:26:28.627070 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.605866    2578 server.go:87] "Starting device plugin registration server"
Sep 09 13:26:28.627070 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.606273    2578 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 09 13:26:28.627070 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.606286    2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 09 13:26:28.627070 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.606366    2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 09 13:26:28.627070 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.606450    2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 09 13:26:28.627070 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.606458    2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 09 13:26:28.627070 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:28.607018    2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 09 13:26:28.627070 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:28.607065    2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-192.ec2.internal\" not found"
Sep 09 13:26:28.653014 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.652986    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 09 13:26:28.654158 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.654138    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 09 13:26:28.654245 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.654215    2578 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 09 13:26:28.654245 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.654242    2578 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 09 13:26:28.654359 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:28.654343    2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 09 13:26:28.656856 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.656832    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 13:26:28.706829 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.706796    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 13:26:28.708336 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.708316    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-192.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 13:26:28.708428 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.708355    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-192.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 13:26:28.708428 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.708371    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-192.ec2.internal" event="NodeHasSufficientPID"
Sep 09 13:26:28.708428 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.708396    2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-192.ec2.internal"
Sep 09 13:26:28.718721 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.718698    2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-192.ec2.internal"
Sep 09 13:26:28.718798 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:28.718726    2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-192.ec2.internal\": node \"ip-10-0-135-192.ec2.internal\" not found"
Sep 09 13:26:28.745539 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:28.745472    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-192.ec2.internal\" not found"
Sep 09 13:26:28.754736 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.754714    2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-192.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-192.ec2.internal"]
Sep 09 13:26:28.754815 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.754787    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 13:26:28.756470 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.756456    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-192.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 13:26:28.756555 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.756487    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-192.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 13:26:28.756555 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.756501    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-192.ec2.internal" event="NodeHasSufficientPID"
Sep 09 13:26:28.758863 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.758849    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 13:26:28.758984 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.758969    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-192.ec2.internal"
Sep 09 13:26:28.759036 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.758998    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 13:26:28.759648 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.759632    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-192.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 13:26:28.759715 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.759655    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-192.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 13:26:28.759715 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.759665    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-192.ec2.internal" event="NodeHasSufficientPID"
Sep 09 13:26:28.759715 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.759634    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-192.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 13:26:28.759805 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.759735    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-192.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 13:26:28.759805 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.759746    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-192.ec2.internal" event="NodeHasSufficientPID"
Sep 09 13:26:28.761888 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.761872    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-192.ec2.internal"
Sep 09 13:26:28.761985 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.761901    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 13:26:28.762615 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.762600    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-192.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 13:26:28.762711 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.762628    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-192.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 13:26:28.762711 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.762641    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-192.ec2.internal" event="NodeHasSufficientPID"
Sep 09 13:26:28.777747 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:28.777719    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-192.ec2.internal\" not found" node="ip-10-0-135-192.ec2.internal"
Sep 09 13:26:28.781101 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:28.781081    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-192.ec2.internal\" not found" node="ip-10-0-135-192.ec2.internal"
Sep 09 13:26:28.846549 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:28.846521    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-192.ec2.internal\" not found"
Sep 09 13:26:28.850784 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.850769    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ef1facbd3538f7ab78cc8a4e7adbe86c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-192.ec2.internal\" (UID: \"ef1facbd3538f7ab78cc8a4e7adbe86c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-192.ec2.internal"
Sep 09 13:26:28.850847 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.850791    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef1facbd3538f7ab78cc8a4e7adbe86c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-192.ec2.internal\" (UID: \"ef1facbd3538f7ab78cc8a4e7adbe86c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-192.ec2.internal"
Sep 09 13:26:28.850847 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.850809    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d1c78154c3f34dfed8a9e280b4b66a37-config\") pod \"kube-apiserver-proxy-ip-10-0-135-192.ec2.internal\" (UID: \"d1c78154c3f34dfed8a9e280b4b66a37\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-192.ec2.internal"
Sep 09 13:26:28.947521 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:28.947488    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-192.ec2.internal\" not found"
Sep 09 13:26:28.951826 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.951812    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ef1facbd3538f7ab78cc8a4e7adbe86c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-192.ec2.internal\" (UID: \"ef1facbd3538f7ab78cc8a4e7adbe86c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-192.ec2.internal"
Sep 09 13:26:28.951895 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.951837    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef1facbd3538f7ab78cc8a4e7adbe86c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-192.ec2.internal\" (UID: \"ef1facbd3538f7ab78cc8a4e7adbe86c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-192.ec2.internal"
Sep 09 13:26:28.951895 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.951853    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d1c78154c3f34dfed8a9e280b4b66a37-config\") pod \"kube-apiserver-proxy-ip-10-0-135-192.ec2.internal\" (UID: \"d1c78154c3f34dfed8a9e280b4b66a37\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-192.ec2.internal"
Sep 09 13:26:28.951989 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.951896    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d1c78154c3f34dfed8a9e280b4b66a37-config\") pod \"kube-apiserver-proxy-ip-10-0-135-192.ec2.internal\" (UID: \"d1c78154c3f34dfed8a9e280b4b66a37\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-192.ec2.internal"
Sep 09 13:26:28.951989 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.951923    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef1facbd3538f7ab78cc8a4e7adbe86c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-192.ec2.internal\" (UID: \"ef1facbd3538f7ab78cc8a4e7adbe86c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-192.ec2.internal"
Sep 09 13:26:28.951989 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:28.951930    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ef1facbd3538f7ab78cc8a4e7adbe86c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-192.ec2.internal\" (UID: \"ef1facbd3538f7ab78cc8a4e7adbe86c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-192.ec2.internal"
Sep 09 13:26:29.048314 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:29.048219    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-192.ec2.internal\" not found"
Sep 09 13:26:29.080620 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:29.080594    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-192.ec2.internal"
Sep 09 13:26:29.083737 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:29.083719    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-192.ec2.internal"
Sep 09 13:26:29.148702 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:29.148662    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-192.ec2.internal\" not found"
Sep 09 13:26:29.248856 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:29.248819    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-192.ec2.internal\" not found"
Sep 09 13:26:29.351741 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:29.351660    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-192.ec2.internal\" not found"
Sep 09 13:26:29.366266 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:29.366236    2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 13:26:29.454169 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:29.454137    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-192.ec2.internal\" not found"
Sep 09 13:26:29.492438 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:29.492400    2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 09 13:26:29.492899 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:29.492582    2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 09 13:26:29.492899 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:29.492588    2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 09 13:26:29.555269 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:29.555229    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-192.ec2.internal\" not found"
Sep 09 13:26:29.575600 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:29.575559    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-08 13:21:29 +0000 UTC" deadline="2028-03-22 01:40:56.544935796 +0000 UTC"
Sep 09 13:26:29.575600 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:29.575592    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13428h14m26.969346973s"
Sep 09 13:26:29.632972 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:29.632949    2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 13:26:29.656069 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:29.656037    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-192.ec2.internal\" not found"
Sep 09 13:26:29.715348 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:29.715318    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 13:26:29.716572 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:29.716552    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-192.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 13:26:29.716681 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:29.716585    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-192.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 13:26:29.716681 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:29.716596    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-192.ec2.internal" event="NodeHasSufficientPID"
Sep 09 13:26:29.733943 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:29.733924    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 13:26:29.757201 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:29.757165    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-192.ec2.internal\" not found"
Sep 09 13:26:29.844972 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:29.844943    2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 13:26:29.849557 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:29.849540    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-192.ec2.internal"
Sep 09 13:26:29.865870 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:29.865813    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 09 13:26:29.866852 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:29.866838    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-192.ec2.internal"
Sep 09 13:26:29.889898 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:29.889873    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 09 13:26:30.534198 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.534140    2578 apiserver.go:52] "Watching apiserver"
Sep 09 13:26:30.542409 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.542377    2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 09 13:26:30.544597 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.543426    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-pg486","openshift-multus/network-metrics-daemon-l8p6d","openshift-network-diagnostics/network-check-target-7sgj5","kube-system/kube-apiserver-proxy-ip-10-0-135-192.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9vnn","openshift-image-registry/node-ca-stlfb","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-192.ec2.internal","openshift-multus/multus-52xr2","openshift-multus/multus-additional-cni-plugins-6kn8w","openshift-network-operator/iptables-alerter-dq6cj","openshift-ovn-kubernetes/ovnkube-node-qf468","kube-system/global-pull-secret-syncer-zqjnb","kube-system/konnectivity-agent-lqpm7","openshift-cluster-node-tuning-operator/tuned-nrp2k"]
Sep 09 13:26:30.547616 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.547597    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lqpm7"
Sep 09 13:26:30.549041 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.549014    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 09 13:26:30.549875 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.549857    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8p6d"
Sep 09 13:26:30.549986 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:30.549929    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8p6d" podUID="94d06480-f6e0-4f65-9567-c9b9760aeb8a"
Sep 09 13:26:30.552244 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.552219    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7sgj5"
Sep 09 13:26:30.552341 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:30.552295    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7sgj5" podUID="298d53a7-1f9e-450d-afef-b9d28c24ccb6"
Sep 09 13:26:30.554153 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.554126    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 09 13:26:30.554268 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.554164    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 09 13:26:30.554268 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.554169    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-5qtgs\""
Sep 09 13:26:30.554525 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.554507    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pg486"
Sep 09 13:26:30.556875 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.556859    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9vnn"
Sep 09 13:26:30.557645 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.557627    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 09 13:26:30.557732 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.557706    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-rg4zm\""
Sep 09 13:26:30.557906 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.557871    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 09 13:26:30.559351 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.559331    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-stlfb"
Sep 09 13:26:30.561749 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.561733    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nrp2k"
Sep 09 13:26:30.562940 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.562921    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4d6ead4a-74e5-40e3-a070-c1a9f49c78c8-agent-certs\") pod \"konnectivity-agent-lqpm7\" (UID: \"4d6ead4a-74e5-40e3-a070-c1a9f49c78c8\") " pod="kube-system/konnectivity-agent-lqpm7"
Sep 09 13:26:30.563020 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.562946    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4d6ead4a-74e5-40e3-a070-c1a9f49c78c8-konnectivity-ca\") pod \"konnectivity-agent-lqpm7\" (UID: \"4d6ead4a-74e5-40e3-a070-c1a9f49c78c8\") " pod="kube-system/konnectivity-agent-lqpm7"
Sep 09 13:26:30.563020 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.562965    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94d06480-f6e0-4f65-9567-c9b9760aeb8a-metrics-certs\") pod \"network-metrics-daemon-l8p6d\" (UID: \"94d06480-f6e0-4f65-9567-c9b9760aeb8a\") " pod="openshift-multus/network-metrics-daemon-l8p6d"
Sep 09 13:26:30.563020 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.562981    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzznn\" (UniqueName: \"kubernetes.io/projected/94d06480-f6e0-4f65-9567-c9b9760aeb8a-kube-api-access-dzznn\") pod \"network-metrics-daemon-l8p6d\" (UID: \"94d06480-f6e0-4f65-9567-c9b9760aeb8a\") " pod="openshift-multus/network-metrics-daemon-l8p6d"
Sep 09 13:26:30.564099 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.564081    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-52xr2"
Sep 09 13:26:30.565373 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.565357    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 09 13:26:30.566508 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.566493    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6kn8w"
Sep 09 13:26:30.568822 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.568807    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dq6cj"
Sep 09 13:26:30.570912 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.570883    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 09 13:26:30.571064 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.571045    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 09 13:26:30.571477 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.571459    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qf468"
Sep 09 13:26:30.572040 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.572018    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 09 13:26:30.572040 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.572033    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 09 13:26:30.572696 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.572680    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-x7bq4\""
Sep 09 13:26:30.573847 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.573829    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zqjnb"
Sep 09 13:26:30.573917 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:30.573890    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zqjnb" podUID="4f418699-7dc7-4c31-b9b1-e5612f362ce2"
Sep 09 13:26:30.576213 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.576197    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 09 13:26:30.576354 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.576334    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 09 13:26:30.576828 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.576812    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 09 13:26:30.576912 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.576861    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 09 13:26:30.577334 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.577318    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 09 13:26:30.578810 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.578792    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 09 13:26:30.597527 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.597509    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-gnd48\""
Sep 09 13:26:30.597780 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.597766    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 09 13:26:30.597837 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.597821    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-h4qgs\""
Sep 09 13:26:30.598042 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.598025    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 09 13:26:30.598119 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.598107    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 09 13:26:30.598684 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.598665    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 09 13:26:30.598775 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.598731    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 09 13:26:30.598828 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.598808    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-t4f89\""
Sep 09 13:26:30.599048 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.599030    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 09 13:26:30.599134 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.599035    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-4bbxn\""
Sep 09 13:26:30.599243 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.599225    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 09 13:26:30.599354 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.599239    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 09 13:26:30.599354 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.599309    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-fcclt\""
Sep 09 13:26:30.599436 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.599358    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 09 13:26:30.599718 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.599703    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 09 13:26:30.599798 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.599747    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2nspd\""
Sep 09 13:26:30.599798 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.599709    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 09 13:26:30.600399 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.600382    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 09 13:26:30.639886 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.639854    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 09 13:26:30.650966 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.650942    2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 09 13:26:30.658988 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.658945    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-192.ec2.internal" event={"ID":"ef1facbd3538f7ab78cc8a4e7adbe86c","Type":"ContainerStarted","Data":"3c490fe68cb2b2e182086effb86810ac3bf68ce803b859ec770d34c98037cb43"}
Sep 09 13:26:30.663171 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.663152    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szvvj\" (UniqueName: \"kubernetes.io/projected/82e246fd-3f6f-4482-8dca-098e1836b2e9-kube-api-access-szvvj\") pod \"tuned-nrp2k\" (UID: \"82e246fd-3f6f-4482-8dca-098e1836b2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-nrp2k"
Sep 09 13:26:30.663236 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.663179    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/47856a84-ddb7-437b-af1a-aa2e9f06bf23-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6kn8w\" (UID: \"47856a84-ddb7-437b-af1a-aa2e9f06bf23\") " pod="openshift-multus/multus-additional-cni-plugins-6kn8w"
Sep 09 13:26:30.663236 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.663214    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7832a0f6-3e3a-417d-96df-a284d6eb6429-system-cni-dir\") pod \"multus-52xr2\" (UID: \"7832a0f6-3e3a-417d-96df-a284d6eb6429\") " pod="openshift-multus/multus-52xr2"
Sep 09 13:26:30.663333 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.663251    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/59598bd9-9238-4f4e-a6cd-f7ca04a0b07d-run-openvswitch\") pod \"ovnkube-node-qf468\" (UID: \"59598bd9-9238-4f4e-a6cd-f7ca04a0b07d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf468"
Sep 09 13:26:30.663333 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.663276    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1a579537-6ec3-4ae0-8ed0-81e0843c0688-kubelet-dir\") pod \"aws-ebs-csi-driver-node-v9vnn\" (UID: \"1a579537-6ec3-4ae0-8ed0-81e0843c0688\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9vnn"
Sep 09 13:26:30.663333 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.663291    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1a579537-6ec3-4ae0-8ed0-81e0843c0688-device-dir\") pod \"aws-ebs-csi-driver-node-v9vnn\" (UID: \"1a579537-6ec3-4ae0-8ed0-81e0843c0688\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9vnn"
Sep 09 13:26:30.663333 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.663306    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1a579537-6ec3-4ae0-8ed0-81e0843c0688-etc-selinux\") pod \"aws-ebs-csi-driver-node-v9vnn\" (UID: \"1a579537-6ec3-4ae0-8ed0-81e0843c0688\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9vnn"
Sep 09 13:26:30.663333 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.663321    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/82e246fd-3f6f-4482-8dca-098e1836b2e9-etc-systemd\") pod \"tuned-nrp2k\" (UID: \"82e246fd-3f6f-4482-8dca-098e1836b2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-nrp2k"
Sep 09 13:26:30.663505 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.663340    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82e246fd-3f6f-4482-8dca-098e1836b2e9-tmp\") pod \"tuned-nrp2k\" (UID: \"82e246fd-3f6f-4482-8dca-098e1836b2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-nrp2k"
Sep 09 13:26:30.663505 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.663360    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7832a0f6-3e3a-417d-96df-a284d6eb6429-host-var-lib-cni-multus\") pod \"multus-52xr2\" (UID: \"7832a0f6-3e3a-417d-96df-a284d6eb6429\") " pod="openshift-multus/multus-52xr2"
Sep 09 13:26:30.663505 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.663374    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7832a0f6-3e3a-417d-96df-a284d6eb6429-host-var-lib-kubelet\") pod \"multus-52xr2\" (UID: \"7832a0f6-3e3a-417d-96df-a284d6eb6429\") " pod="openshift-multus/multus-52xr2"
Sep 09 13:26:30.663505 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.663388    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7832a0f6-3e3a-417d-96df-a284d6eb6429-hostroot\") pod \"multus-52xr2\" (UID: \"7832a0f6-3e3a-417d-96df-a284d6eb6429\") " pod="openshift-multus/multus-52xr2"
Sep 09 13:26:30.663505 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.663410    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/59598bd9-9238-4f4e-a6cd-f7ca04a0b07d-host-kubelet\") pod \"ovnkube-node-qf468\" (UID: \"59598bd9-9238-4f4e-a6cd-f7ca04a0b07d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf468"
Sep 09 13:26:30.663505 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.663464    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4f418699-7dc7-4c31-b9b1-e5612f362ce2-dbus\") pod \"global-pull-secret-syncer-zqjnb\" (UID: \"4f418699-7dc7-4c31-b9b1-e5612f362ce2\") " pod="kube-system/global-pull-secret-syncer-zqjnb"
Sep 09 13:26:30.663701 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.663518    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1aaceed8-333e-4fde-8412-843a7ea41bf2-serviceca\") pod \"node-ca-stlfb\" (UID: \"1aaceed8-333e-4fde-8412-843a7ea41bf2\") " pod="openshift-image-registry/node-ca-stlfb"
Sep 09 13:26:30.663701 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.663540    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzk2q\" (UniqueName: \"kubernetes.io/projected/1aaceed8-333e-4fde-8412-843a7ea41bf2-kube-api-access-tzk2q\") pod \"node-ca-stlfb\" (UID: \"1aaceed8-333e-4fde-8412-843a7ea41bf2\") " pod="openshift-image-registry/node-ca-stlfb"
Sep 09 13:26:30.663701 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.663557    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7832a0f6-3e3a-417d-96df-a284d6eb6429-multus-daemon-config\") pod \"multus-52xr2\" (UID: \"7832a0f6-3e3a-417d-96df-a284d6eb6429\") " pod="openshift-multus/multus-52xr2"
Sep 09 13:26:30.663701 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.663579    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7832a0f6-3e3a-417d-96df-a284d6eb6429-etc-kubernetes\") pod \"multus-52xr2\" (UID: \"7832a0f6-3e3a-417d-96df-a284d6eb6429\") " pod="openshift-multus/multus-52xr2"
Sep 09 13:26:30.663701 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.663603    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7dfc\" (UniqueName: \"kubernetes.io/projected/7832a0f6-3e3a-417d-96df-a284d6eb6429-kube-api-access-f7dfc\") pod \"multus-52xr2\" (UID: \"7832a0f6-3e3a-417d-96df-a284d6eb6429\") " pod="openshift-multus/multus-52xr2"
Sep 09 13:26:30.663701 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.663618    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/59598bd9-9238-4f4e-a6cd-f7ca04a0b07d-node-log\") pod \"ovnkube-node-qf468\" (UID: \"59598bd9-9238-4f4e-a6cd-f7ca04a0b07d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf468"
Sep 09 13:26:30.663701 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.663632    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/82e246fd-3f6f-4482-8dca-098e1836b2e9-lib-modules\") pod \"tuned-nrp2k\" (UID: \"82e246fd-3f6f-4482-8dca-098e1836b2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-nrp2k"
Sep 09 13:26:30.663701 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.663646    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/82e246fd-3f6f-4482-8dca-098e1836b2e9-var-lib-kubelet\") pod \"tuned-nrp2k\" (UID: \"82e246fd-3f6f-4482-8dca-098e1836b2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-nrp2k"
Sep 09 13:26:30.663701 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.663669    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7832a0f6-3e3a-417d-96df-a284d6eb6429-host-run-k8s-cni-cncf-io\") pod \"multus-52xr2\" (UID: \"7832a0f6-3e3a-417d-96df-a284d6eb6429\") " pod="openshift-multus/multus-52xr2"
Sep 09 13:26:30.663701 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.663692    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59598bd9-9238-4f4e-a6cd-f7ca04a0b07d-host-run-ovn-kubernetes\") pod \"ovnkube-node-qf468\" (UID: \"59598bd9-9238-4f4e-a6cd-f7ca04a0b07d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf468"
Sep 09 13:26:30.664038 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.663707    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/82e246fd-3f6f-4482-8dca-098e1836b2e9-sys\") pod \"tuned-nrp2k\" (UID: \"82e246fd-3f6f-4482-8dca-098e1836b2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-nrp2k"
Sep 09 13:26:30.664038 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.663721    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/82e246fd-3f6f-4482-8dca-098e1836b2e9-etc-tuned\") pod \"tuned-nrp2k\" (UID: \"82e246fd-3f6f-4482-8dca-098e1836b2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-nrp2k"
Sep 09 13:26:30.664038 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.663750    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/47856a84-ddb7-437b-af1a-aa2e9f06bf23-cnibin\") pod \"multus-additional-cni-plugins-6kn8w\" (UID: \"47856a84-ddb7-437b-af1a-aa2e9f06bf23\") " pod="openshift-multus/multus-additional-cni-plugins-6kn8w"
Sep 09 13:26:30.664038 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.663778    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94d06480-f6e0-4f65-9567-c9b9760aeb8a-metrics-certs\") pod \"network-metrics-daemon-l8p6d\" (UID: \"94d06480-f6e0-4f65-9567-c9b9760aeb8a\") " pod="openshift-multus/network-metrics-daemon-l8p6d"
Sep 09 13:26:30.664038 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.663860    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7832a0f6-3e3a-417d-96df-a284d6eb6429-cnibin\") pod \"multus-52xr2\" (UID: \"7832a0f6-3e3a-417d-96df-a284d6eb6429\") " pod="openshift-multus/multus-52xr2"
Sep 09 13:26:30.664038 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:30.663877    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 13:26:30.664038 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.663898    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7832a0f6-3e3a-417d-96df-a284d6eb6429-host-run-netns\") pod \"multus-52xr2\" (UID: \"7832a0f6-3e3a-417d-96df-a284d6eb6429\") " pod="openshift-multus/multus-52xr2"
Sep 09 13:26:30.664038 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:30.663948    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94d06480-f6e0-4f65-9567-c9b9760aeb8a-metrics-certs podName:94d06480-f6e0-4f65-9567-c9b9760aeb8a nodeName:}" failed. No retries permitted until 2026-09-09 13:26:31.163930289 +0000 UTC m=+2.979454462 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/94d06480-f6e0-4f65-9567-c9b9760aeb8a-metrics-certs") pod "network-metrics-daemon-l8p6d" (UID: "94d06480-f6e0-4f65-9567-c9b9760aeb8a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 13:26:30.664038 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.664000    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8gsj\" (UniqueName: \"kubernetes.io/projected/39b1a91d-b820-424a-891f-bc2cb7c20896-kube-api-access-z8gsj\") pod \"iptables-alerter-dq6cj\" (UID: \"39b1a91d-b820-424a-891f-bc2cb7c20896\") " pod="openshift-network-operator/iptables-alerter-dq6cj"
Sep 09 13:26:30.664038 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.664023    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/59598bd9-9238-4f4e-a6cd-f7ca04a0b07d-env-overrides\") pod \"ovnkube-node-qf468\" (UID: \"59598bd9-9238-4f4e-a6cd-f7ca04a0b07d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf468"
Sep 09 13:26:30.664038 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.664039    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd89162d-80ad-4a5d-9753-a376a17fa59c-tmp-dir\") pod \"node-resolver-pg486\" (UID: \"dd89162d-80ad-4a5d-9753-a376a17fa59c\") " pod="openshift-dns/node-resolver-pg486"
Sep 09 13:26:30.664440 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.664061    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7832a0f6-3e3a-417d-96df-a284d6eb6429-multus-socket-dir-parent\") pod \"multus-52xr2\" (UID: \"7832a0f6-3e3a-417d-96df-a284d6eb6429\") " pod="openshift-multus/multus-52xr2"
Sep 09 13:26:30.664440 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.664093    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/82e246fd-3f6f-4482-8dca-098e1836b2e9-etc-sysconfig\") pod \"tuned-nrp2k\" (UID: \"82e246fd-3f6f-4482-8dca-098e1836b2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-nrp2k"
Sep 09 13:26:30.664440 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.664117    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/82e246fd-3f6f-4482-8dca-098e1836b2e9-host\") pod \"tuned-nrp2k\" (UID: \"82e246fd-3f6f-4482-8dca-098e1836b2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-nrp2k"
Sep 09 13:26:30.664440 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.664137    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/47856a84-ddb7-437b-af1a-aa2e9f06bf23-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6kn8w\" (UID: \"47856a84-ddb7-437b-af1a-aa2e9f06bf23\") " pod="openshift-multus/multus-additional-cni-plugins-6kn8w"
Sep 09 13:26:30.664440 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.664172    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4f418699-7dc7-4c31-b9b1-e5612f362ce2-kubelet-config\") pod \"global-pull-secret-syncer-zqjnb\" (UID: \"4f418699-7dc7-4c31-b9b1-e5612f362ce2\") " pod="kube-system/global-pull-secret-syncer-zqjnb"
Sep 09 13:26:30.664440 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.664213    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7832a0f6-3e3a-417d-96df-a284d6eb6429-multus-cni-dir\") pod \"multus-52xr2\" (UID: \"7832a0f6-3e3a-417d-96df-a284d6eb6429\") " pod="openshift-multus/multus-52xr2"
Sep 09 13:26:30.664440 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.664250    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/59598bd9-9238-4f4e-a6cd-f7ca04a0b07d-host-run-netns\") pod \"ovnkube-node-qf468\" (UID: \"59598bd9-9238-4f4e-a6cd-f7ca04a0b07d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf468"
Sep 09 13:26:30.664440 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.664289    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/47856a84-ddb7-437b-af1a-aa2e9f06bf23-cni-binary-copy\") pod \"multus-additional-cni-plugins-6kn8w\" (UID: \"47856a84-ddb7-437b-af1a-aa2e9f06bf23\") " pod="openshift-multus/multus-additional-cni-plugins-6kn8w"
Sep 09 13:26:30.664440 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.664311    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4d6ead4a-74e5-40e3-a070-c1a9f49c78c8-agent-certs\") pod \"konnectivity-agent-lqpm7\" (UID: \"4d6ead4a-74e5-40e3-a070-c1a9f49c78c8\") " pod="kube-system/konnectivity-agent-lqpm7"
Sep 09 13:26:30.664440 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.664327    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/59598bd9-9238-4f4e-a6cd-f7ca04a0b07d-systemd-units\") pod \"ovnkube-node-qf468\" (UID: \"59598bd9-9238-4f4e-a6cd-f7ca04a0b07d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf468"
Sep 09 13:26:30.664440 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.664340    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/59598bd9-9238-4f4e-a6cd-f7ca04a0b07d-host-cni-bin\") pod \"ovnkube-node-qf468\" (UID: \"59598bd9-9238-4f4e-a6cd-f7ca04a0b07d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf468"
Sep 09 13:26:30.664440 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.664356    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1a579537-6ec3-4ae0-8ed0-81e0843c0688-registration-dir\") pod \"aws-ebs-csi-driver-node-v9vnn\" (UID: \"1a579537-6ec3-4ae0-8ed0-81e0843c0688\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9vnn"
Sep 09 13:26:30.664440 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.664370    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1a579537-6ec3-4ae0-8ed0-81e0843c0688-sys-fs\") pod \"aws-ebs-csi-driver-node-v9vnn\" (UID: \"1a579537-6ec3-4ae0-8ed0-81e0843c0688\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9vnn"
Sep 09 13:26:30.664440 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.664388    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/47856a84-ddb7-437b-af1a-aa2e9f06bf23-system-cni-dir\") pod \"multus-additional-cni-plugins-6kn8w\" (UID: \"47856a84-ddb7-437b-af1a-aa2e9f06bf23\") " pod="openshift-multus/multus-additional-cni-plugins-6kn8w"
Sep 09 13:26:30.664440 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.664407    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4d6ead4a-74e5-40e3-a070-c1a9f49c78c8-konnectivity-ca\") pod \"konnectivity-agent-lqpm7\" (UID: \"4d6ead4a-74e5-40e3-a070-c1a9f49c78c8\") " pod="kube-system/konnectivity-agent-lqpm7"
Sep 09 13:26:30.664440 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.664427    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7832a0f6-3e3a-417d-96df-a284d6eb6429-host-var-lib-cni-bin\") pod \"multus-52xr2\" (UID: \"7832a0f6-3e3a-417d-96df-a284d6eb6429\") " pod="openshift-multus/multus-52xr2"
Sep 09 13:26:30.664983 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.664442    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/59598bd9-9238-4f4e-a6cd-f7ca04a0b07d-ovnkube-config\") pod \"ovnkube-node-qf468\" (UID: \"59598bd9-9238-4f4e-a6cd-f7ca04a0b07d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf468"
Sep 09 13:26:30.664983 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.664462    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/82e246fd-3f6f-4482-8dca-098e1836b2e9-etc-sysctl-conf\") pod \"tuned-nrp2k\" (UID: \"82e246fd-3f6f-4482-8dca-098e1836b2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-nrp2k"
Sep 09 13:26:30.664983 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.664499    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpszh\" (UniqueName: \"kubernetes.io/projected/47856a84-ddb7-437b-af1a-aa2e9f06bf23-kube-api-access-tpszh\") pod \"multus-additional-cni-plugins-6kn8w\" (UID: \"47856a84-ddb7-437b-af1a-aa2e9f06bf23\") " pod="openshift-multus/multus-additional-cni-plugins-6kn8w"
Sep 09 13:26:30.664983 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.664520    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bh8vh\" (UniqueName: \"kubernetes.io/projected/dd89162d-80ad-4a5d-9753-a376a17fa59c-kube-api-access-bh8vh\") pod \"node-resolver-pg486\" (UID: \"dd89162d-80ad-4a5d-9753-a376a17fa59c\") " pod="openshift-dns/node-resolver-pg486"
Sep 09 13:26:30.664983 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.664537    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7832a0f6-3e3a-417d-96df-a284d6eb6429-cni-binary-copy\") pod \"multus-52xr2\" (UID: \"7832a0f6-3e3a-417d-96df-a284d6eb6429\") " pod="openshift-multus/multus-52xr2"
Sep 09 13:26:30.664983 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.664556    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/59598bd9-9238-4f4e-a6cd-f7ca04a0b07d-etc-openvswitch\") pod \"ovnkube-node-qf468\" (UID: \"59598bd9-9238-4f4e-a6cd-f7ca04a0b07d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf468"
Sep 09 13:26:30.664983 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.664607    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/59598bd9-9238-4f4e-a6cd-f7ca04a0b07d-ovnkube-script-lib\") pod \"ovnkube-node-qf468\" (UID: \"59598bd9-9238-4f4e-a6cd-f7ca04a0b07d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf468"
Sep 09 13:26:30.664983 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.664673    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/47856a84-ddb7-437b-af1a-aa2e9f06bf23-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6kn8w\" (UID: \"47856a84-ddb7-437b-af1a-aa2e9f06bf23\") " pod="openshift-multus/multus-additional-cni-plugins-6kn8w"
Sep 09 13:26:30.664983 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.664719    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4f418699-7dc7-4c31-b9b1-e5612f362ce2-original-pull-secret\") pod \"global-pull-secret-syncer-zqjnb\" (UID: \"4f418699-7dc7-4c31-b9b1-e5612f362ce2\") " pod="kube-system/global-pull-secret-syncer-zqjnb"
Sep 09 13:26:30.664983 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.664744    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1aaceed8-333e-4fde-8412-843a7ea41bf2-host\") pod \"node-ca-stlfb\" (UID: \"1aaceed8-333e-4fde-8412-843a7ea41bf2\") " pod="openshift-image-registry/node-ca-stlfb"
Sep 09 13:26:30.664983 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.664769    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gql4\" (UniqueName: \"kubernetes.io/projected/298d53a7-1f9e-450d-afef-b9d28c24ccb6-kube-api-access-8gql4\") pod \"network-check-target-7sgj5\" (UID: \"298d53a7-1f9e-450d-afef-b9d28c24ccb6\") " pod="openshift-network-diagnostics/network-check-target-7sgj5"
Sep 09 13:26:30.664983 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.664794    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7832a0f6-3e3a-417d-96df-a284d6eb6429-multus-conf-dir\") pod \"multus-52xr2\" (UID: \"7832a0f6-3e3a-417d-96df-a284d6eb6429\") " pod="openshift-multus/multus-52xr2"
Sep 09 13:26:30.664983 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.664839    2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 09 13:26:30.664983 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.664858    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/59598bd9-9238-4f4e-a6cd-f7ca04a0b07d-host-cni-netd\") pod \"ovnkube-node-qf468\" (UID: \"59598bd9-9238-4f4e-a6cd-f7ca04a0b07d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf468"
Sep 09 13:26:30.664983 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.664883    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/82e246fd-3f6f-4482-8dca-098e1836b2e9-run\") pod \"tuned-nrp2k\" (UID: \"82e246fd-3f6f-4482-8dca-098e1836b2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-nrp2k"
Sep 09 13:26:30.664983 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.664922    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7832a0f6-3e3a-417d-96df-a284d6eb6429-host-run-multus-certs\") pod \"multus-52xr2\" (UID: \"7832a0f6-3e3a-417d-96df-a284d6eb6429\") " pod="openshift-multus/multus-52xr2"
Sep 09 13:26:30.664983 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.664956    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/39b1a91d-b820-424a-891f-bc2cb7c20896-host-slash\") pod \"iptables-alerter-dq6cj\" (UID: \"39b1a91d-b820-424a-891f-bc2cb7c20896\") " pod="openshift-network-operator/iptables-alerter-dq6cj"
Sep 09 13:26:30.665637 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.664986    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/59598bd9-9238-4f4e-a6cd-f7ca04a0b07d-host-slash\") pod \"ovnkube-node-qf468\" (UID: \"59598bd9-9238-4f4e-a6cd-f7ca04a0b07d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf468"
Sep 09 13:26:30.665637 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.665002    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4d6ead4a-74e5-40e3-a070-c1a9f49c78c8-konnectivity-ca\") pod \"konnectivity-agent-lqpm7\" (UID: \"4d6ead4a-74e5-40e3-a070-c1a9f49c78c8\") " pod="kube-system/konnectivity-agent-lqpm7"
Sep 09 13:26:30.665637 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.665012    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59598bd9-9238-4f4e-a6cd-f7ca04a0b07d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qf468\" (UID: \"59598bd9-9238-4f4e-a6cd-f7ca04a0b07d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf468"
Sep 09 13:26:30.665637 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.665046    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8mcz\" (UniqueName: \"kubernetes.io/projected/59598bd9-9238-4f4e-a6cd-f7ca04a0b07d-kube-api-access-z8mcz\") pod \"ovnkube-node-qf468\" (UID: \"59598bd9-9238-4f4e-a6cd-f7ca04a0b07d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf468"
Sep 09 13:26:30.665637 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.665067    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1a579537-6ec3-4ae0-8ed0-81e0843c0688-socket-dir\") pod \"aws-ebs-csi-driver-node-v9vnn\" (UID: \"1a579537-6ec3-4ae0-8ed0-81e0843c0688\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9vnn"
Sep 09 13:26:30.665637 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.665095    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvzsq\" (UniqueName: \"kubernetes.io/projected/1a579537-6ec3-4ae0-8ed0-81e0843c0688-kube-api-access-hvzsq\") pod \"aws-ebs-csi-driver-node-v9vnn\" (UID: \"1a579537-6ec3-4ae0-8ed0-81e0843c0688\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9vnn"
Sep 09 13:26:30.665637 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.665113    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/59598bd9-9238-4f4e-a6cd-f7ca04a0b07d-run-ovn\") pod \"ovnkube-node-qf468\" (UID: \"59598bd9-9238-4f4e-a6cd-f7ca04a0b07d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf468"
Sep 09 13:26:30.665637 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.665149    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/59598bd9-9238-4f4e-a6cd-f7ca04a0b07d-ovn-node-metrics-cert\") pod \"ovnkube-node-qf468\" (UID: \"59598bd9-9238-4f4e-a6cd-f7ca04a0b07d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf468"
Sep 09 13:26:30.665637 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.665188    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/82e246fd-3f6f-4482-8dca-098e1836b2e9-etc-kubernetes\") pod \"tuned-nrp2k\" (UID: \"82e246fd-3f6f-4482-8dca-098e1836b2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-nrp2k"
Sep 09 13:26:30.665637 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.665210    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dd89162d-80ad-4a5d-9753-a376a17fa59c-hosts-file\") pod \"node-resolver-pg486\" (UID: \"dd89162d-80ad-4a5d-9753-a376a17fa59c\") " pod="openshift-dns/node-resolver-pg486"
Sep 09 13:26:30.665637 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.665237    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/39b1a91d-b820-424a-891f-bc2cb7c20896-iptables-alerter-script\") pod \"iptables-alerter-dq6cj\" (UID: \"39b1a91d-b820-424a-891f-bc2cb7c20896\") " pod="openshift-network-operator/iptables-alerter-dq6cj"
Sep 09 13:26:30.665637 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.665265    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/59598bd9-9238-4f4e-a6cd-f7ca04a0b07d-var-lib-openvswitch\") pod \"ovnkube-node-qf468\" (UID: \"59598bd9-9238-4f4e-a6cd-f7ca04a0b07d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf468"
Sep 09 13:26:30.665637 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.665284    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/59598bd9-9238-4f4e-a6cd-f7ca04a0b07d-log-socket\") pod \"ovnkube-node-qf468\" (UID: \"59598bd9-9238-4f4e-a6cd-f7ca04a0b07d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf468"
Sep 09 13:26:30.665637 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.665310    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/82e246fd-3f6f-4482-8dca-098e1836b2e9-etc-sysctl-d\") pod \"tuned-nrp2k\" (UID: \"82e246fd-3f6f-4482-8dca-098e1836b2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-nrp2k"
Sep 09 13:26:30.665637 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.665333    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzznn\" (UniqueName: \"kubernetes.io/projected/94d06480-f6e0-4f65-9567-c9b9760aeb8a-kube-api-access-dzznn\") pod \"network-metrics-daemon-l8p6d\" (UID: \"94d06480-f6e0-4f65-9567-c9b9760aeb8a\") " pod="openshift-multus/network-metrics-daemon-l8p6d"
Sep 09 13:26:30.665637 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.665357    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/59598bd9-9238-4f4e-a6cd-f7ca04a0b07d-run-systemd\") pod \"ovnkube-node-qf468\" (UID: \"59598bd9-9238-4f4e-a6cd-f7ca04a0b07d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf468"
Sep 09 13:26:30.666193 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.665397    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/82e246fd-3f6f-4482-8dca-098e1836b2e9-etc-modprobe-d\") pod \"tuned-nrp2k\" (UID: \"82e246fd-3f6f-4482-8dca-098e1836b2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-nrp2k"
Sep 09 13:26:30.666193 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.665946    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-b88p5"
Sep 09 13:26:30.668441 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.668422    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4d6ead4a-74e5-40e3-a070-c1a9f49c78c8-agent-certs\") pod \"konnectivity-agent-lqpm7\" (UID: \"4d6ead4a-74e5-40e3-a070-c1a9f49c78c8\") " pod="kube-system/konnectivity-agent-lqpm7"
Sep 09 13:26:30.691287 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.691250    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-b88p5"
Sep 09 13:26:30.691535 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.691516    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzznn\" (UniqueName: \"kubernetes.io/projected/94d06480-f6e0-4f65-9567-c9b9760aeb8a-kube-api-access-dzznn\") pod \"network-metrics-daemon-l8p6d\" (UID: \"94d06480-f6e0-4f65-9567-c9b9760aeb8a\") " pod="openshift-multus/network-metrics-daemon-l8p6d"
Sep 09 13:26:30.766830 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.766792    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/59598bd9-9238-4f4e-a6cd-f7ca04a0b07d-systemd-units\") pod \"ovnkube-node-qf468\" (UID: \"59598bd9-9238-4f4e-a6cd-f7ca04a0b07d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf468"
Sep 09 13:26:30.766830 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.766829    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/59598bd9-9238-4f4e-a6cd-f7ca04a0b07d-host-cni-bin\") pod \"ovnkube-node-qf468\" (UID: \"59598bd9-9238-4f4e-a6cd-f7ca04a0b07d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf468"
Sep 09 13:26:30.767059 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.766854    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1a579537-6ec3-4ae0-8ed0-81e0843c0688-registration-dir\") pod \"aws-ebs-csi-driver-node-v9vnn\" (UID: \"1a579537-6ec3-4ae0-8ed0-81e0843c0688\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9vnn"
Sep 09 13:26:30.767059 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.766881    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1a579537-6ec3-4ae0-8ed0-81e0843c0688-sys-fs\") pod \"aws-ebs-csi-driver-node-v9vnn\" (UID: \"1a579537-6ec3-4ae0-8ed0-81e0843c0688\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9vnn"
Sep 09 13:26:30.767059 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.766909    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/59598bd9-9238-4f4e-a6cd-f7ca04a0b07d-systemd-units\") pod \"ovnkube-node-qf468\" (UID: \"59598bd9-9238-4f4e-a6cd-f7ca04a0b07d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf468"
Sep 09 13:26:30.767059 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.766928    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/47856a84-ddb7-437b-af1a-aa2e9f06bf23-system-cni-dir\") pod \"multus-additional-cni-plugins-6kn8w\" (UID: \"47856a84-ddb7-437b-af1a-aa2e9f06bf23\") " pod="openshift-multus/multus-additional-cni-plugins-6kn8w"
Sep 09 13:26:30.767059 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.766946    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1a579537-6ec3-4ae0-8ed0-81e0843c0688-sys-fs\") pod \"aws-ebs-csi-driver-node-v9vnn\" (UID: \"1a579537-6ec3-4ae0-8ed0-81e0843c0688\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9vnn"
Sep 09 13:26:30.767059 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.766969    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/47856a84-ddb7-437b-af1a-aa2e9f06bf23-system-cni-dir\") pod \"multus-additional-cni-plugins-6kn8w\" (UID: \"47856a84-ddb7-437b-af1a-aa2e9f06bf23\") " pod="openshift-multus/multus-additional-cni-plugins-6kn8w"
Sep 09 13:26:30.767059 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.766997    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1a579537-6ec3-4ae0-8ed0-81e0843c0688-registration-dir\") pod \"aws-ebs-csi-driver-node-v9vnn\" (UID: \"1a579537-6ec3-4ae0-8ed0-81e0843c0688\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9vnn"
Sep 09 13:26:30.767059 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.766974    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7832a0f6-3e3a-417d-96df-a284d6eb6429-host-var-lib-cni-bin\") pod \"multus-52xr2\" (UID: \"7832a0f6-3e3a-417d-96df-a284d6eb6429\") " pod="openshift-multus/multus-52xr2"
Sep 09 13:26:30.767059 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.766931    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/59598bd9-9238-4f4e-a6cd-f7ca04a0b07d-host-cni-bin\") pod \"ovnkube-node-qf468\" (UID: \"59598bd9-9238-4f4e-a6cd-f7ca04a0b07d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf468"
Sep 09 13:26:30.767059 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.767017    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7832a0f6-3e3a-417d-96df-a284d6eb6429-host-var-lib-cni-bin\") pod \"multus-52xr2\" (UID: \"7832a0f6-3e3a-417d-96df-a284d6eb6429\") " pod="openshift-multus/multus-52xr2"
Sep 09 13:26:30.767059 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.767032    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/59598bd9-9238-4f4e-a6cd-f7ca04a0b07d-ovnkube-config\") pod \"ovnkube-node-qf468\" (UID: \"59598bd9-9238-4f4e-a6cd-f7ca04a0b07d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf468"
Sep 09 13:26:30.767059 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.767057    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/82e246fd-3f6f-4482-8dca-098e1836b2e9-etc-sysctl-conf\") pod \"tuned-nrp2k\" (UID: \"82e246fd-3f6f-4482-8dca-098e1836b2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-nrp2k"
Sep 09 13:26:30.767769 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.767075    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpszh\" (UniqueName: \"kubernetes.io/projected/47856a84-ddb7-437b-af1a-aa2e9f06bf23-kube-api-access-tpszh\") pod \"multus-additional-cni-plugins-6kn8w\" (UID: \"47856a84-ddb7-437b-af1a-aa2e9f06bf23\") " pod="openshift-multus/multus-additional-cni-plugins-6kn8w"
Sep 09 13:26:30.767769 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.767103    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bh8vh\" (UniqueName: \"kubernetes.io/projected/dd89162d-80ad-4a5d-9753-a376a17fa59c-kube-api-access-bh8vh\") pod \"node-resolver-pg486\" (UID: \"dd89162d-80ad-4a5d-9753-a376a17fa59c\") " pod="openshift-dns/node-resolver-pg486"
Sep 09 13:26:30.767769 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.767125    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7832a0f6-3e3a-417d-96df-a284d6eb6429-cni-binary-copy\") pod \"multus-52xr2\" (UID: \"7832a0f6-3e3a-417d-96df-a284d6eb6429\") " pod="openshift-multus/multus-52xr2"
Sep 09 13:26:30.767769 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.767152    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/59598bd9-9238-4f4e-a6cd-f7ca04a0b07d-etc-openvswitch\") pod \"ovnkube-node-qf468\" (UID: \"59598bd9-9238-4f4e-a6cd-f7ca04a0b07d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf468"
Sep 09 13:26:30.767769 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.767177    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/59598bd9-9238-4f4e-a6cd-f7ca04a0b07d-ovnkube-script-lib\") pod \"ovnkube-node-qf468\" (UID: \"59598bd9-9238-4f4e-a6cd-f7ca04a0b07d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf468"
Sep 09 13:26:30.767769 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.767216    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/47856a84-ddb7-437b-af1a-aa2e9f06bf23-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6kn8w\" (UID: \"47856a84-ddb7-437b-af1a-aa2e9f06bf23\") " pod="openshift-multus/multus-additional-cni-plugins-6kn8w"
Sep 09 13:26:30.767769 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.767224    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/82e246fd-3f6f-4482-8dca-098e1836b2e9-etc-sysctl-conf\") pod \"tuned-nrp2k\" (UID: \"82e246fd-3f6f-4482-8dca-098e1836b2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-nrp2k"
Sep 09 13:26:30.767769 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.767242    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4f418699-7dc7-4c31-b9b1-e5612f362ce2-original-pull-secret\") pod \"global-pull-secret-syncer-zqjnb\" (UID: \"4f418699-7dc7-4c31-b9b1-e5612f362ce2\") " pod="kube-system/global-pull-secret-syncer-zqjnb"
Sep 09 13:26:30.767769 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.767266    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1aaceed8-333e-4fde-8412-843a7ea41bf2-host\") pod \"node-ca-stlfb\" (UID: \"1aaceed8-333e-4fde-8412-843a7ea41bf2\") " pod="openshift-image-registry/node-ca-stlfb"
Sep 09 13:26:30.767769 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.767290    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gql4\" (UniqueName: \"kubernetes.io/projected/298d53a7-1f9e-450d-afef-b9d28c24ccb6-kube-api-access-8gql4\") pod \"network-check-target-7sgj5\" (UID: \"298d53a7-1f9e-450d-afef-b9d28c24ccb6\") " pod="openshift-network-diagnostics/network-check-target-7sgj5"
Sep 09 13:26:30.767769 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.767313    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7832a0f6-3e3a-417d-96df-a284d6eb6429-multus-conf-dir\") pod \"multus-52xr2\" (UID: \"7832a0f6-3e3a-417d-96df-a284d6eb6429\") " pod="openshift-multus/multus-52xr2"
Sep 09 13:26:30.767769 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.767336    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/59598bd9-9238-4f4e-a6cd-f7ca04a0b07d-host-cni-netd\") pod \"ovnkube-node-qf468\" (UID: \"59598bd9-9238-4f4e-a6cd-f7ca04a0b07d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf468"
Sep 09 13:26:30.767769 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.767362    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/82e246fd-3f6f-4482-8dca-098e1836b2e9-run\") pod \"tuned-nrp2k\" (UID: \"82e246fd-3f6f-4482-8dca-098e1836b2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-nrp2k"
Sep 09 13:26:30.767769 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.767373    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/59598bd9-9238-4f4e-a6cd-f7ca04a0b07d-etc-openvswitch\") pod \"ovnkube-node-qf468\" (UID: \"59598bd9-9238-4f4e-a6cd-f7ca04a0b07d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf468"
Sep 09 13:26:30.767769 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.767415    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7832a0f6-3e3a-417d-96df-a284d6eb6429-host-run-multus-certs\") pod \"multus-52xr2\" (UID: \"7832a0f6-3e3a-417d-96df-a284d6eb6429\") " pod="openshift-multus/multus-52xr2"
Sep 09 13:26:30.767769 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.767441    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/39b1a91d-b820-424a-891f-bc2cb7c20896-host-slash\") pod \"iptables-alerter-dq6cj\" (UID: \"39b1a91d-b820-424a-891f-bc2cb7c20896\") " pod="openshift-network-operator/iptables-alerter-dq6cj"
Sep 09 13:26:30.767769 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.767477    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/59598bd9-9238-4f4e-a6cd-f7ca04a0b07d-host-cni-netd\") pod \"ovnkube-node-qf468\" (UID: \"59598bd9-9238-4f4e-a6cd-f7ca04a0b07d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf468"
Sep 09 13:26:30.768626 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.767495    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/39b1a91d-b820-424a-891f-bc2cb7c20896-host-slash\") pod \"iptables-alerter-dq6cj\" (UID: \"39b1a91d-b820-424a-891f-bc2cb7c20896\") " pod="openshift-network-operator/iptables-alerter-dq6cj"
Sep 09 13:26:30.768626 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.767517    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7832a0f6-3e3a-417d-96df-a284d6eb6429-multus-conf-dir\") pod \"multus-52xr2\" (UID: \"7832a0f6-3e3a-417d-96df-a284d6eb6429\") " pod="openshift-multus/multus-52xr2"
Sep 09 13:26:30.768626 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.767530    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1aaceed8-333e-4fde-8412-843a7ea41bf2-host\") pod \"node-ca-stlfb\" (UID: \"1aaceed8-333e-4fde-8412-843a7ea41bf2\") " pod="openshift-image-registry/node-ca-stlfb"
Sep 09 13:26:30.768626 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.767543    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7832a0f6-3e3a-417d-96df-a284d6eb6429-host-run-multus-certs\") pod \"multus-52xr2\" (UID: \"7832a0f6-3e3a-417d-96df-a284d6eb6429\") " pod="openshift-multus/multus-52xr2"
Sep 09 13:26:30.768626 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.767567    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/59598bd9-9238-4f4e-a6cd-f7ca04a0b07d-host-slash\") pod \"ovnkube-node-qf468\" (UID: \"59598bd9-9238-4f4e-a6cd-f7ca04a0b07d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf468"
Sep 09 13:26:30.768626 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.767605    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/82e246fd-3f6f-4482-8dca-098e1836b2e9-run\") pod \"tuned-nrp2k\" (UID: \"82e246fd-3f6f-4482-8dca-098e1836b2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-nrp2k"
Sep 09 13:26:30.768626 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.767605    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59598bd9-9238-4f4e-a6cd-f7ca04a0b07d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qf468\" (UID: \"59598bd9-9238-4f4e-a6cd-f7ca04a0b07d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf468"
Sep 09 13:26:30.768626 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.767663    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/59598bd9-9238-4f4e-a6cd-f7ca04a0b07d-host-slash\") pod \"ovnkube-node-qf468\" (UID: \"59598bd9-9238-4f4e-a6cd-f7ca04a0b07d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf468"
Sep 09 13:26:30.768626 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.767673    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59598bd9-9238-4f4e-a6cd-f7ca04a0b07d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qf468\" (UID: \"59598bd9-9238-4f4e-a6cd-f7ca04a0b07d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf468"
Sep 09 13:26:30.768626 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:30.767691    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 13:26:30.768626 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.767663    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8mcz\" (UniqueName: \"kubernetes.io/projected/59598bd9-9238-4f4e-a6cd-f7ca04a0b07d-kube-api-access-z8mcz\") pod \"ovnkube-node-qf468\" (UID: \"59598bd9-9238-4f4e-a6cd-f7ca04a0b07d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf468"
Sep 09 13:26:30.768626 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.767736    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1a579537-6ec3-4ae0-8ed0-81e0843c0688-socket-dir\") pod \"aws-ebs-csi-driver-node-v9vnn\" (UID: \"1a579537-6ec3-4ae0-8ed0-81e0843c0688\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9vnn"
Sep 09 13:26:30.768626 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:30.767761    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f418699-7dc7-4c31-b9b1-e5612f362ce2-original-pull-secret podName:4f418699-7dc7-4c31-b9b1-e5612f362ce2 nodeName:}" failed. No retries permitted until 2026-09-09 13:26:31.267742691 +0000 UTC m=+3.083266884 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4f418699-7dc7-4c31-b9b1-e5612f362ce2-original-pull-secret") pod "global-pull-secret-syncer-zqjnb" (UID: "4f418699-7dc7-4c31-b9b1-e5612f362ce2") : object "kube-system"/"original-pull-secret" not registered
Sep 09 13:26:30.768626 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.767794    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvzsq\" (UniqueName: \"kubernetes.io/projected/1a579537-6ec3-4ae0-8ed0-81e0843c0688-kube-api-access-hvzsq\") pod \"aws-ebs-csi-driver-node-v9vnn\" (UID: \"1a579537-6ec3-4ae0-8ed0-81e0843c0688\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9vnn"
Sep 09 13:26:30.768626 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.767793    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7832a0f6-3e3a-417d-96df-a284d6eb6429-cni-binary-copy\") pod \"multus-52xr2\" (UID: \"7832a0f6-3e3a-417d-96df-a284d6eb6429\") " pod="openshift-multus/multus-52xr2"
Sep 09 13:26:30.768626 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.767829    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1a579537-6ec3-4ae0-8ed0-81e0843c0688-socket-dir\") pod \"aws-ebs-csi-driver-node-v9vnn\" (UID: \"1a579537-6ec3-4ae0-8ed0-81e0843c0688\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9vnn"
Sep 09 13:26:30.768626 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.767930    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/59598bd9-9238-4f4e-a6cd-f7ca04a0b07d-run-ovn\") pod \"ovnkube-node-qf468\" (UID: \"59598bd9-9238-4f4e-a6cd-f7ca04a0b07d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf468"
Sep 09 13:26:30.769508 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.767962    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/59598bd9-9238-4f4e-a6cd-f7ca04a0b07d-ovn-node-metrics-cert\") pod \"ovnkube-node-qf468\" (UID: \"59598bd9-9238-4f4e-a6cd-f7ca04a0b07d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf468"
Sep 09 13:26:30.769508 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.767989    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/82e246fd-3f6f-4482-8dca-098e1836b2e9-etc-kubernetes\") pod \"tuned-nrp2k\" (UID: \"82e246fd-3f6f-4482-8dca-098e1836b2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-nrp2k"
Sep 09 13:26:30.769508 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.767993    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/59598bd9-9238-4f4e-a6cd-f7ca04a0b07d-run-ovn\") pod \"ovnkube-node-qf468\" (UID: \"59598bd9-9238-4f4e-a6cd-f7ca04a0b07d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf468"
Sep 09 13:26:30.769508 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.768014    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dd89162d-80ad-4a5d-9753-a376a17fa59c-hosts-file\") pod \"node-resolver-pg486\" (UID: \"dd89162d-80ad-4a5d-9753-a376a17fa59c\") " pod="openshift-dns/node-resolver-pg486"
Sep 09 13:26:30.769508 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.768036    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/47856a84-ddb7-437b-af1a-aa2e9f06bf23-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6kn8w\" (UID: \"47856a84-ddb7-437b-af1a-aa2e9f06bf23\") " pod="openshift-multus/multus-additional-cni-plugins-6kn8w"
Sep 09 13:26:30.769508 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.768043    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/39b1a91d-b820-424a-891f-bc2cb7c20896-iptables-alerter-script\") pod \"iptables-alerter-dq6cj\" (UID: \"39b1a91d-b820-424a-891f-bc2cb7c20896\") " pod="openshift-network-operator/iptables-alerter-dq6cj"
Sep 09 13:26:30.769508 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.768074    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dd89162d-80ad-4a5d-9753-a376a17fa59c-hosts-file\") pod \"node-resolver-pg486\" (UID: \"dd89162d-80ad-4a5d-9753-a376a17fa59c\") " pod="openshift-dns/node-resolver-pg486"
Sep 09 13:26:30.769508 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.768081    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/59598bd9-9238-4f4e-a6cd-f7ca04a0b07d-var-lib-openvswitch\") pod \"ovnkube-node-qf468\" (UID: \"59598bd9-9238-4f4e-a6cd-f7ca04a0b07d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf468"
Sep 09 13:26:30.769508 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.768079    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/59598bd9-9238-4f4e-a6cd-f7ca04a0b07d-ovnkube-script-lib\") pod \"ovnkube-node-qf468\" (UID: \"59598bd9-9238-4f4e-a6cd-f7ca04a0b07d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf468"
Sep 09 13:26:30.769508 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.768110    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/59598bd9-9238-4f4e-a6cd-f7ca04a0b07d-log-socket\") pod \"ovnkube-node-qf468\" (UID: \"59598bd9-9238-4f4e-a6cd-f7ca04a0b07d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf468"
Sep 09 13:26:30.769508 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.768125    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/82e246fd-3f6f-4482-8dca-098e1836b2e9-etc-kubernetes\") pod \"tuned-nrp2k\" (UID: \"82e246fd-3f6f-4482-8dca-098e1836b2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-nrp2k"
Sep 09 13:26:30.769508 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.768132    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/59598bd9-9238-4f4e-a6cd-f7ca04a0b07d-var-lib-openvswitch\") pod \"ovnkube-node-qf468\" (UID: \"59598bd9-9238-4f4e-a6cd-f7ca04a0b07d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf468"
Sep 09 13:26:30.769508 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.768164    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/82e246fd-3f6f-4482-8dca-098e1836b2e9-etc-sysctl-d\") pod \"tuned-nrp2k\" (UID: \"82e246fd-3f6f-4482-8dca-098e1836b2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-nrp2k"
Sep 09 13:26:30.769508 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.768165    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/59598bd9-9238-4f4e-a6cd-f7ca04a0b07d-log-socket\") pod \"ovnkube-node-qf468\" (UID: \"59598bd9-9238-4f4e-a6cd-f7ca04a0b07d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf468"
Sep 09 13:26:30.769508 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.768221    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/59598bd9-9238-4f4e-a6cd-f7ca04a0b07d-run-systemd\") pod \"ovnkube-node-qf468\" (UID: \"59598bd9-9238-4f4e-a6cd-f7ca04a0b07d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf468"
Sep 09 13:26:30.769508 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.768285    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/82e246fd-3f6f-4482-8dca-098e1836b2e9-etc-modprobe-d\") pod \"tuned-nrp2k\" (UID: \"82e246fd-3f6f-4482-8dca-098e1836b2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-nrp2k"
Sep 09 13:26:30.769508 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.768288    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/82e246fd-3f6f-4482-8dca-098e1836b2e9-etc-sysctl-d\") pod \"tuned-nrp2k\" (UID: \"82e246fd-3f6f-4482-8dca-098e1836b2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-nrp2k"
Sep 09 13:26:30.770362 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.768321    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/59598bd9-9238-4f4e-a6cd-f7ca04a0b07d-run-systemd\") pod \"ovnkube-node-qf468\" (UID: \"59598bd9-9238-4f4e-a6cd-f7ca04a0b07d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf468"
Sep 09 13:26:30.770362 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.768381    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szvvj\" (UniqueName: \"kubernetes.io/projected/82e246fd-3f6f-4482-8dca-098e1836b2e9-kube-api-access-szvvj\") pod \"tuned-nrp2k\" (UID: \"82e246fd-3f6f-4482-8dca-098e1836b2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-nrp2k"
Sep 09 13:26:30.770362 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.768419    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/82e246fd-3f6f-4482-8dca-098e1836b2e9-etc-modprobe-d\") pod \"tuned-nrp2k\" (UID: \"82e246fd-3f6f-4482-8dca-098e1836b2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-nrp2k"
Sep 09 13:26:30.770362 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.768417    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/59598bd9-9238-4f4e-a6cd-f7ca04a0b07d-ovnkube-config\") pod \"ovnkube-node-qf468\" (UID: \"59598bd9-9238-4f4e-a6cd-f7ca04a0b07d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf468"
Sep 09 13:26:30.770362 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.768420    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/47856a84-ddb7-437b-af1a-aa2e9f06bf23-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6kn8w\" (UID: \"47856a84-ddb7-437b-af1a-aa2e9f06bf23\") " pod="openshift-multus/multus-additional-cni-plugins-6kn8w"
Sep 09 13:26:30.770362 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.768466    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7832a0f6-3e3a-417d-96df-a284d6eb6429-system-cni-dir\") pod \"multus-52xr2\" (UID: \"7832a0f6-3e3a-417d-96df-a284d6eb6429\") " pod="openshift-multus/multus-52xr2"
Sep 09 13:26:30.770362 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.768503    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/59598bd9-9238-4f4e-a6cd-f7ca04a0b07d-run-openvswitch\") pod \"ovnkube-node-qf468\" (UID: \"59598bd9-9238-4f4e-a6cd-f7ca04a0b07d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf468"
Sep 09 13:26:30.770362 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.768510    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7832a0f6-3e3a-417d-96df-a284d6eb6429-system-cni-dir\") pod \"multus-52xr2\" (UID: \"7832a0f6-3e3a-417d-96df-a284d6eb6429\") " pod="openshift-multus/multus-52xr2"
Sep 09 13:26:30.770362 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.768532    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1a579537-6ec3-4ae0-8ed0-81e0843c0688-kubelet-dir\") pod \"aws-ebs-csi-driver-node-v9vnn\" (UID: \"1a579537-6ec3-4ae0-8ed0-81e0843c0688\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9vnn"
Sep 09 13:26:30.770362 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.768551    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/59598bd9-9238-4f4e-a6cd-f7ca04a0b07d-run-openvswitch\") pod \"ovnkube-node-qf468\" (UID: \"59598bd9-9238-4f4e-a6cd-f7ca04a0b07d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf468"
Sep 09 13:26:30.770362 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.768561    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1a579537-6ec3-4ae0-8ed0-81e0843c0688-device-dir\") pod \"aws-ebs-csi-driver-node-v9vnn\" (UID: \"1a579537-6ec3-4ae0-8ed0-81e0843c0688\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9vnn"
Sep 09 13:26:30.770362 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.768573    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/39b1a91d-b820-424a-891f-bc2cb7c20896-iptables-alerter-script\") pod \"iptables-alerter-dq6cj\" (UID: \"39b1a91d-b820-424a-891f-bc2cb7c20896\") " pod="openshift-network-operator/iptables-alerter-dq6cj"
Sep 09 13:26:30.770362 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.768589    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1a579537-6ec3-4ae0-8ed0-81e0843c0688-etc-selinux\") pod \"aws-ebs-csi-driver-node-v9vnn\" (UID: \"1a579537-6ec3-4ae0-8ed0-81e0843c0688\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9vnn"
Sep 09 13:26:30.770362 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.768595    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/47856a84-ddb7-437b-af1a-aa2e9f06bf23-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6kn8w\" (UID: \"47856a84-ddb7-437b-af1a-aa2e9f06bf23\") " pod="openshift-multus/multus-additional-cni-plugins-6kn8w"
Sep 09 13:26:30.770362 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.768618    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/82e246fd-3f6f-4482-8dca-098e1836b2e9-etc-systemd\") pod \"tuned-nrp2k\" (UID: \"82e246fd-3f6f-4482-8dca-098e1836b2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-nrp2k"
Sep 09 13:26:30.770362 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.768634    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1a579537-6ec3-4ae0-8ed0-81e0843c0688-device-dir\") pod \"aws-ebs-csi-driver-node-v9vnn\" (UID: \"1a579537-6ec3-4ae0-8ed0-81e0843c0688\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9vnn"
Sep 09 13:26:30.770362 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.768595    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1a579537-6ec3-4ae0-8ed0-81e0843c0688-kubelet-dir\") pod \"aws-ebs-csi-driver-node-v9vnn\" (UID: \"1a579537-6ec3-4ae0-8ed0-81e0843c0688\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9vnn"
Sep 09 13:26:30.770912 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.768652    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82e246fd-3f6f-4482-8dca-098e1836b2e9-tmp\") pod \"tuned-nrp2k\" (UID: \"82e246fd-3f6f-4482-8dca-098e1836b2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-nrp2k"
Sep 09 13:26:30.770912 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.768662    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/82e246fd-3f6f-4482-8dca-098e1836b2e9-etc-systemd\") pod \"tuned-nrp2k\" (UID: \"82e246fd-3f6f-4482-8dca-098e1836b2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-nrp2k"
Sep 09 13:26:30.770912 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.768670    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1a579537-6ec3-4ae0-8ed0-81e0843c0688-etc-selinux\") pod \"aws-ebs-csi-driver-node-v9vnn\" (UID: \"1a579537-6ec3-4ae0-8ed0-81e0843c0688\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9vnn"
Sep 09 13:26:30.770912 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.768693    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7832a0f6-3e3a-417d-96df-a284d6eb6429-host-var-lib-cni-multus\") pod \"multus-52xr2\" (UID: \"7832a0f6-3e3a-417d-96df-a284d6eb6429\") " pod="openshift-multus/multus-52xr2"
Sep 09 13:26:30.770912 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.768723    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7832a0f6-3e3a-417d-96df-a284d6eb6429-host-var-lib-kubelet\") pod \"multus-52xr2\" (UID: \"7832a0f6-3e3a-417d-96df-a284d6eb6429\") " pod="openshift-multus/multus-52xr2"
Sep 09 13:26:30.770912 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.768750    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7832a0f6-3e3a-417d-96df-a284d6eb6429-hostroot\") pod \"multus-52xr2\" (UID: \"7832a0f6-3e3a-417d-96df-a284d6eb6429\") " pod="openshift-multus/multus-52xr2"
Sep 09 13:26:30.770912 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.768775    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/59598bd9-9238-4f4e-a6cd-f7ca04a0b07d-host-kubelet\") pod \"ovnkube-node-qf468\" (UID: \"59598bd9-9238-4f4e-a6cd-f7ca04a0b07d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf468"
Sep 09 13:26:30.770912 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.768798    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7832a0f6-3e3a-417d-96df-a284d6eb6429-hostroot\") pod \"multus-52xr2\" (UID: \"7832a0f6-3e3a-417d-96df-a284d6eb6429\") " pod="openshift-multus/multus-52xr2"
Sep 09 13:26:30.770912 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.768801    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4f418699-7dc7-4c31-b9b1-e5612f362ce2-dbus\") pod \"global-pull-secret-syncer-zqjnb\" (UID: \"4f418699-7dc7-4c31-b9b1-e5612f362ce2\") " pod="kube-system/global-pull-secret-syncer-zqjnb"
Sep 09 13:26:30.770912 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.768807    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7832a0f6-3e3a-417d-96df-a284d6eb6429-host-var-lib-kubelet\") pod \"multus-52xr2\" (UID: \"7832a0f6-3e3a-417d-96df-a284d6eb6429\") " pod="openshift-multus/multus-52xr2"
Sep 09 13:26:30.770912 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.768827    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/59598bd9-9238-4f4e-a6cd-f7ca04a0b07d-host-kubelet\") pod \"ovnkube-node-qf468\" (UID: \"59598bd9-9238-4f4e-a6cd-f7ca04a0b07d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf468"
Sep 09 13:26:30.770912 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.768777    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7832a0f6-3e3a-417d-96df-a284d6eb6429-host-var-lib-cni-multus\") pod \"multus-52xr2\" (UID: \"7832a0f6-3e3a-417d-96df-a284d6eb6429\") " pod="openshift-multus/multus-52xr2"
Sep 09 13:26:30.770912 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.768827    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1aaceed8-333e-4fde-8412-843a7ea41bf2-serviceca\") pod \"node-ca-stlfb\" (UID: \"1aaceed8-333e-4fde-8412-843a7ea41bf2\") " pod="openshift-image-registry/node-ca-stlfb"
Sep 09 13:26:30.770912 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.768878    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzk2q\" (UniqueName: \"kubernetes.io/projected/1aaceed8-333e-4fde-8412-843a7ea41bf2-kube-api-access-tzk2q\") pod \"node-ca-stlfb\" (UID: \"1aaceed8-333e-4fde-8412-843a7ea41bf2\") " pod="openshift-image-registry/node-ca-stlfb"
Sep 09 13:26:30.770912 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.768886    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4f418699-7dc7-4c31-b9b1-e5612f362ce2-dbus\") pod \"global-pull-secret-syncer-zqjnb\" (UID: \"4f418699-7dc7-4c31-b9b1-e5612f362ce2\") " pod="kube-system/global-pull-secret-syncer-zqjnb"
Sep 09 13:26:30.770912 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.768906    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7832a0f6-3e3a-417d-96df-a284d6eb6429-multus-daemon-config\") pod \"multus-52xr2\" (UID: \"7832a0f6-3e3a-417d-96df-a284d6eb6429\") " pod="openshift-multus/multus-52xr2"
Sep 09 13:26:30.770912 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.768927    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7832a0f6-3e3a-417d-96df-a284d6eb6429-etc-kubernetes\") pod \"multus-52xr2\" (UID: \"7832a0f6-3e3a-417d-96df-a284d6eb6429\") " pod="openshift-multus/multus-52xr2"
Sep 09 13:26:30.770912 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.768948    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7dfc\" (UniqueName: \"kubernetes.io/projected/7832a0f6-3e3a-417d-96df-a284d6eb6429-kube-api-access-f7dfc\") pod \"multus-52xr2\" (UID: \"7832a0f6-3e3a-417d-96df-a284d6eb6429\") " pod="openshift-multus/multus-52xr2"
Sep 09 13:26:30.771516 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.768967    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/59598bd9-9238-4f4e-a6cd-f7ca04a0b07d-node-log\") pod \"ovnkube-node-qf468\" (UID: \"59598bd9-9238-4f4e-a6cd-f7ca04a0b07d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf468"
Sep 09 13:26:30.771516 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.768984    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/82e246fd-3f6f-4482-8dca-098e1836b2e9-lib-modules\") pod \"tuned-nrp2k\" (UID: \"82e246fd-3f6f-4482-8dca-098e1836b2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-nrp2k"
Sep 09 13:26:30.771516 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.769009    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7832a0f6-3e3a-417d-96df-a284d6eb6429-etc-kubernetes\") pod \"multus-52xr2\" (UID: \"7832a0f6-3e3a-417d-96df-a284d6eb6429\") " pod="openshift-multus/multus-52xr2"
Sep 09 13:26:30.771516 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.769053    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/59598bd9-9238-4f4e-a6cd-f7ca04a0b07d-node-log\") pod \"ovnkube-node-qf468\" (UID: \"59598bd9-9238-4f4e-a6cd-f7ca04a0b07d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf468"
Sep 09 13:26:30.771516 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.769082    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/82e246fd-3f6f-4482-8dca-098e1836b2e9-lib-modules\") pod \"tuned-nrp2k\" (UID: \"82e246fd-3f6f-4482-8dca-098e1836b2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-nrp2k"
Sep 09 13:26:30.771516 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.769157    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/82e246fd-3f6f-4482-8dca-098e1836b2e9-var-lib-kubelet\") pod \"tuned-nrp2k\" (UID: \"82e246fd-3f6f-4482-8dca-098e1836b2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-nrp2k"
Sep 09 13:26:30.771516 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.769209    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7832a0f6-3e3a-417d-96df-a284d6eb6429-host-run-k8s-cni-cncf-io\") pod \"multus-52xr2\" (UID: \"7832a0f6-3e3a-417d-96df-a284d6eb6429\") " pod="openshift-multus/multus-52xr2"
Sep 09 13:26:30.771516 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.769237    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59598bd9-9238-4f4e-a6cd-f7ca04a0b07d-host-run-ovn-kubernetes\") pod \"ovnkube-node-qf468\" (UID: \"59598bd9-9238-4f4e-a6cd-f7ca04a0b07d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf468"
Sep 09 13:26:30.771516 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.769239    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/82e246fd-3f6f-4482-8dca-098e1836b2e9-var-lib-kubelet\") pod \"tuned-nrp2k\" (UID: \"82e246fd-3f6f-4482-8dca-098e1836b2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-nrp2k"
Sep 09 13:26:30.771516 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.769264    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/82e246fd-3f6f-4482-8dca-098e1836b2e9-sys\") pod \"tuned-nrp2k\" (UID: \"82e246fd-3f6f-4482-8dca-098e1836b2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-nrp2k"
Sep 09 13:26:30.771516 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.769288    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7832a0f6-3e3a-417d-96df-a284d6eb6429-host-run-k8s-cni-cncf-io\") pod \"multus-52xr2\" (UID: \"7832a0f6-3e3a-417d-96df-a284d6eb6429\") " pod="openshift-multus/multus-52xr2"
Sep 09 13:26:30.771516 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.769289    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/82e246fd-3f6f-4482-8dca-098e1836b2e9-etc-tuned\") pod \"tuned-nrp2k\" (UID: \"82e246fd-3f6f-4482-8dca-098e1836b2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-nrp2k"
Sep 09 13:26:30.771516 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.769328    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/47856a84-ddb7-437b-af1a-aa2e9f06bf23-cnibin\") pod \"multus-additional-cni-plugins-6kn8w\" (UID: \"47856a84-ddb7-437b-af1a-aa2e9f06bf23\") " pod="openshift-multus/multus-additional-cni-plugins-6kn8w"
Sep 09 13:26:30.771516 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.769353    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1aaceed8-333e-4fde-8412-843a7ea41bf2-serviceca\") pod \"node-ca-stlfb\" (UID: \"1aaceed8-333e-4fde-8412-843a7ea41bf2\") " pod="openshift-image-registry/node-ca-stlfb"
Sep 09 13:26:30.771516 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.769368    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7832a0f6-3e3a-417d-96df-a284d6eb6429-cnibin\") pod \"multus-52xr2\" (UID: \"7832a0f6-3e3a-417d-96df-a284d6eb6429\") " pod="openshift-multus/multus-52xr2"
Sep 09 13:26:30.771516 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.769386    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/82e246fd-3f6f-4482-8dca-098e1836b2e9-sys\") pod \"tuned-nrp2k\" (UID: \"82e246fd-3f6f-4482-8dca-098e1836b2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-nrp2k"
Sep 09 13:26:30.771516 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.769407    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7832a0f6-3e3a-417d-96df-a284d6eb6429-host-run-netns\") pod \"multus-52xr2\" (UID: \"7832a0f6-3e3a-417d-96df-a284d6eb6429\") " pod="openshift-multus/multus-52xr2"
Sep 09 13:26:30.771516 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.769429    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/47856a84-ddb7-437b-af1a-aa2e9f06bf23-cnibin\") pod \"multus-additional-cni-plugins-6kn8w\" (UID: \"47856a84-ddb7-437b-af1a-aa2e9f06bf23\") " pod="openshift-multus/multus-additional-cni-plugins-6kn8w"
Sep 09 13:26:30.772054 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.769328    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59598bd9-9238-4f4e-a6cd-f7ca04a0b07d-host-run-ovn-kubernetes\") pod \"ovnkube-node-qf468\" (UID: \"59598bd9-9238-4f4e-a6cd-f7ca04a0b07d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf468"
Sep 09 13:26:30.772054 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.769442    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8gsj\" (UniqueName: \"kubernetes.io/projected/39b1a91d-b820-424a-891f-bc2cb7c20896-kube-api-access-z8gsj\") pod \"iptables-alerter-dq6cj\" (UID: \"39b1a91d-b820-424a-891f-bc2cb7c20896\") " pod="openshift-network-operator/iptables-alerter-dq6cj"
Sep 09 13:26:30.772054 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.769444    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7832a0f6-3e3a-417d-96df-a284d6eb6429-host-run-netns\") pod \"multus-52xr2\" (UID: \"7832a0f6-3e3a-417d-96df-a284d6eb6429\") " pod="openshift-multus/multus-52xr2"
Sep 09 13:26:30.772054 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.769470    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/59598bd9-9238-4f4e-a6cd-f7ca04a0b07d-env-overrides\") pod \"ovnkube-node-qf468\" (UID: \"59598bd9-9238-4f4e-a6cd-f7ca04a0b07d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf468"
Sep 09 13:26:30.772054 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.769504    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd89162d-80ad-4a5d-9753-a376a17fa59c-tmp-dir\") pod \"node-resolver-pg486\" (UID: \"dd89162d-80ad-4a5d-9753-a376a17fa59c\") " pod="openshift-dns/node-resolver-pg486"
Sep 09 13:26:30.772054 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.769412    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7832a0f6-3e3a-417d-96df-a284d6eb6429-cnibin\") pod \"multus-52xr2\" (UID: \"7832a0f6-3e3a-417d-96df-a284d6eb6429\") " pod="openshift-multus/multus-52xr2"
Sep 09 13:26:30.772054 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.769541    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7832a0f6-3e3a-417d-96df-a284d6eb6429-multus-socket-dir-parent\") pod \"multus-52xr2\" (UID: \"7832a0f6-3e3a-417d-96df-a284d6eb6429\") " pod="openshift-multus/multus-52xr2"
Sep 09 13:26:30.772054 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.769567    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/82e246fd-3f6f-4482-8dca-098e1836b2e9-etc-sysconfig\") pod \"tuned-nrp2k\" (UID: \"82e246fd-3f6f-4482-8dca-098e1836b2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-nrp2k"
Sep 09 13:26:30.772054 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.769594    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/82e246fd-3f6f-4482-8dca-098e1836b2e9-host\") pod \"tuned-nrp2k\" (UID: \"82e246fd-3f6f-4482-8dca-098e1836b2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-nrp2k"
Sep 09 13:26:30.772054 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.769638    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/47856a84-ddb7-437b-af1a-aa2e9f06bf23-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6kn8w\" (UID: \"47856a84-ddb7-437b-af1a-aa2e9f06bf23\") " pod="openshift-multus/multus-additional-cni-plugins-6kn8w"
Sep 09 13:26:30.772054 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.769664    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4f418699-7dc7-4c31-b9b1-e5612f362ce2-kubelet-config\") pod \"global-pull-secret-syncer-zqjnb\" (UID: \"4f418699-7dc7-4c31-b9b1-e5612f362ce2\") " pod="kube-system/global-pull-secret-syncer-zqjnb"
Sep 09 13:26:30.772054 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.769682    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/82e246fd-3f6f-4482-8dca-098e1836b2e9-etc-sysconfig\") pod \"tuned-nrp2k\" (UID: \"82e246fd-3f6f-4482-8dca-098e1836b2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-nrp2k"
Sep 09 13:26:30.772054 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.769735    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/82e246fd-3f6f-4482-8dca-098e1836b2e9-host\") pod \"tuned-nrp2k\" (UID: \"82e246fd-3f6f-4482-8dca-098e1836b2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-nrp2k"
Sep 09 13:26:30.772054 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.769784    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7832a0f6-3e3a-417d-96df-a284d6eb6429-multus-socket-dir-parent\") pod \"multus-52xr2\" (UID: \"7832a0f6-3e3a-417d-96df-a284d6eb6429\") " pod="openshift-multus/multus-52xr2"
Sep 09 13:26:30.772054 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.769688    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7832a0f6-3e3a-417d-96df-a284d6eb6429-multus-cni-dir\") pod \"multus-52xr2\" (UID: \"7832a0f6-3e3a-417d-96df-a284d6eb6429\") " pod="openshift-multus/multus-52xr2"
Sep 09 13:26:30.772054 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.769824    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/59598bd9-9238-4f4e-a6cd-f7ca04a0b07d-host-run-netns\") pod \"ovnkube-node-qf468\" (UID: \"59598bd9-9238-4f4e-a6cd-f7ca04a0b07d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf468"
Sep 09 13:26:30.772054 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.769852    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/47856a84-ddb7-437b-af1a-aa2e9f06bf23-cni-binary-copy\") pod \"multus-additional-cni-plugins-6kn8w\" (UID: \"47856a84-ddb7-437b-af1a-aa2e9f06bf23\") " pod="openshift-multus/multus-additional-cni-plugins-6kn8w"
Sep 09 13:26:30.772054 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.769894    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/59598bd9-9238-4f4e-a6cd-f7ca04a0b07d-env-overrides\") pod \"ovnkube-node-qf468\" (UID: \"59598bd9-9238-4f4e-a6cd-f7ca04a0b07d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf468"
Sep 09 13:26:30.772597 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.769960    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7832a0f6-3e3a-417d-96df-a284d6eb6429-multus-cni-dir\") pod \"multus-52xr2\" (UID: \"7832a0f6-3e3a-417d-96df-a284d6eb6429\") " pod="openshift-multus/multus-52xr2"
Sep 09 13:26:30.772597 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.770004    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/59598bd9-9238-4f4e-a6cd-f7ca04a0b07d-host-run-netns\") pod \"ovnkube-node-qf468\" (UID: \"59598bd9-9238-4f4e-a6cd-f7ca04a0b07d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf468"
Sep 09 13:26:30.772597 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.770054    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4f418699-7dc7-4c31-b9b1-e5612f362ce2-kubelet-config\") pod \"global-pull-secret-syncer-zqjnb\" (UID: \"4f418699-7dc7-4c31-b9b1-e5612f362ce2\") " pod="kube-system/global-pull-secret-syncer-zqjnb"
Sep 09 13:26:30.772597 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.770142    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7832a0f6-3e3a-417d-96df-a284d6eb6429-multus-daemon-config\") pod \"multus-52xr2\" (UID: \"7832a0f6-3e3a-417d-96df-a284d6eb6429\") " pod="openshift-multus/multus-52xr2"
Sep 09 13:26:30.772597 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.770231    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd89162d-80ad-4a5d-9753-a376a17fa59c-tmp-dir\") pod \"node-resolver-pg486\" (UID: \"dd89162d-80ad-4a5d-9753-a376a17fa59c\") " pod="openshift-dns/node-resolver-pg486"
Sep 09 13:26:30.772597 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.770249    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/47856a84-ddb7-437b-af1a-aa2e9f06bf23-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6kn8w\" (UID: \"47856a84-ddb7-437b-af1a-aa2e9f06bf23\") " pod="openshift-multus/multus-additional-cni-plugins-6kn8w"
Sep 09 13:26:30.772597 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.770426    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/47856a84-ddb7-437b-af1a-aa2e9f06bf23-cni-binary-copy\") pod \"multus-additional-cni-plugins-6kn8w\" (UID: \"47856a84-ddb7-437b-af1a-aa2e9f06bf23\") " pod="openshift-multus/multus-additional-cni-plugins-6kn8w"
Sep 09 13:26:30.772597 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.770758    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/59598bd9-9238-4f4e-a6cd-f7ca04a0b07d-ovn-node-metrics-cert\") pod \"ovnkube-node-qf468\" (UID: \"59598bd9-9238-4f4e-a6cd-f7ca04a0b07d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf468"
Sep 09 13:26:30.772597 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.771202    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82e246fd-3f6f-4482-8dca-098e1836b2e9-tmp\") pod \"tuned-nrp2k\" (UID: \"82e246fd-3f6f-4482-8dca-098e1836b2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-nrp2k"
Sep 09 13:26:30.772597 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.771556    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/82e246fd-3f6f-4482-8dca-098e1836b2e9-etc-tuned\") pod \"tuned-nrp2k\" (UID: \"82e246fd-3f6f-4482-8dca-098e1836b2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-nrp2k"
Sep 09 13:26:30.799499 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:30.799200    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 13:26:30.799499 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:30.799224    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 13:26:30.799499 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:30.799237    2578 projected.go:196] Error preparing data for projected volume kube-api-access-8gql4 for pod openshift-network-diagnostics/network-check-target-7sgj5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 13:26:30.799499 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:30.799328    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/298d53a7-1f9e-450d-afef-b9d28c24ccb6-kube-api-access-8gql4 podName:298d53a7-1f9e-450d-afef-b9d28c24ccb6 nodeName:}" failed. No retries permitted until 2026-09-09 13:26:31.299306684 +0000 UTC m=+3.114830879 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-8gql4" (UniqueName: "kubernetes.io/projected/298d53a7-1f9e-450d-afef-b9d28c24ccb6-kube-api-access-8gql4") pod "network-check-target-7sgj5" (UID: "298d53a7-1f9e-450d-afef-b9d28c24ccb6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 13:26:30.801360 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.801331    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8gsj\" (UniqueName: \"kubernetes.io/projected/39b1a91d-b820-424a-891f-bc2cb7c20896-kube-api-access-z8gsj\") pod \"iptables-alerter-dq6cj\" (UID: \"39b1a91d-b820-424a-891f-bc2cb7c20896\") " pod="openshift-network-operator/iptables-alerter-dq6cj"
Sep 09 13:26:30.801582 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.801552    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7dfc\" (UniqueName: \"kubernetes.io/projected/7832a0f6-3e3a-417d-96df-a284d6eb6429-kube-api-access-f7dfc\") pod \"multus-52xr2\" (UID: \"7832a0f6-3e3a-417d-96df-a284d6eb6429\") " pod="openshift-multus/multus-52xr2"
Sep 09 13:26:30.801886 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.801864    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-szvvj\" (UniqueName: \"kubernetes.io/projected/82e246fd-3f6f-4482-8dca-098e1836b2e9-kube-api-access-szvvj\") pod \"tuned-nrp2k\" (UID: \"82e246fd-3f6f-4482-8dca-098e1836b2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-nrp2k"
Sep 09 13:26:30.801971 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.801883    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvzsq\" (UniqueName: \"kubernetes.io/projected/1a579537-6ec3-4ae0-8ed0-81e0843c0688-kube-api-access-hvzsq\") pod \"aws-ebs-csi-driver-node-v9vnn\" (UID: \"1a579537-6ec3-4ae0-8ed0-81e0843c0688\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9vnn"
Sep 09 13:26:30.802032 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.802011    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzk2q\" (UniqueName: \"kubernetes.io/projected/1aaceed8-333e-4fde-8412-843a7ea41bf2-kube-api-access-tzk2q\") pod \"node-ca-stlfb\" (UID: \"1aaceed8-333e-4fde-8412-843a7ea41bf2\") " pod="openshift-image-registry/node-ca-stlfb"
Sep 09 13:26:30.802155 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.802138    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpszh\" (UniqueName: \"kubernetes.io/projected/47856a84-ddb7-437b-af1a-aa2e9f06bf23-kube-api-access-tpszh\") pod \"multus-additional-cni-plugins-6kn8w\" (UID: \"47856a84-ddb7-437b-af1a-aa2e9f06bf23\") " pod="openshift-multus/multus-additional-cni-plugins-6kn8w"
Sep 09 13:26:30.805246 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.805229    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bh8vh\" (UniqueName: \"kubernetes.io/projected/dd89162d-80ad-4a5d-9753-a376a17fa59c-kube-api-access-bh8vh\") pod \"node-resolver-pg486\" (UID: \"dd89162d-80ad-4a5d-9753-a376a17fa59c\") " pod="openshift-dns/node-resolver-pg486"
Sep 09 13:26:30.807365 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.807345    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8mcz\" (UniqueName: \"kubernetes.io/projected/59598bd9-9238-4f4e-a6cd-f7ca04a0b07d-kube-api-access-z8mcz\") pod \"ovnkube-node-qf468\" (UID: \"59598bd9-9238-4f4e-a6cd-f7ca04a0b07d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf468"
Sep 09 13:26:30.856118 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.856089    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lqpm7"
Sep 09 13:26:30.865439 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.865416    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pg486"
Sep 09 13:26:30.867371 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:30.867338    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d6ead4a_74e5_40e3_a070_c1a9f49c78c8.slice/crio-3facd4de9bb801e4fb9d6b94a0027fc3b6f8a3509094ae3ecab204b7c9648c2b WatchSource:0}: Error finding container 3facd4de9bb801e4fb9d6b94a0027fc3b6f8a3509094ae3ecab204b7c9648c2b: Status 404 returned error can't find the container with id 3facd4de9bb801e4fb9d6b94a0027fc3b6f8a3509094ae3ecab204b7c9648c2b
Sep 09 13:26:30.871613 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.871590    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9vnn"
Sep 09 13:26:30.875496 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:30.874963    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd89162d_80ad_4a5d_9753_a376a17fa59c.slice/crio-0e595ae7ac1ed86192e14fe6514dd41a4469e5f0c3ad5d8b3aab338170cef395 WatchSource:0}: Error finding container 0e595ae7ac1ed86192e14fe6514dd41a4469e5f0c3ad5d8b3aab338170cef395: Status 404 returned error can't find the container with id 0e595ae7ac1ed86192e14fe6514dd41a4469e5f0c3ad5d8b3aab338170cef395
Sep 09 13:26:30.879314 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.879298    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-stlfb"
Sep 09 13:26:30.881491 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:30.881465    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a579537_6ec3_4ae0_8ed0_81e0843c0688.slice/crio-d3a75be0007465b500250fcfbb4692faffbcf3967a4765148120347f37a46648 WatchSource:0}: Error finding container d3a75be0007465b500250fcfbb4692faffbcf3967a4765148120347f37a46648: Status 404 returned error can't find the container with id d3a75be0007465b500250fcfbb4692faffbcf3967a4765148120347f37a46648
Sep 09 13:26:30.883080 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.883056    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nrp2k"
Sep 09 13:26:30.889966 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.889945    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-52xr2"
Sep 09 13:26:30.890734 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:30.890709    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1aaceed8_333e_4fde_8412_843a7ea41bf2.slice/crio-9c0317b862ff63d855e740dfde4203bbee93567f71602529967804099decdd12 WatchSource:0}: Error finding container 9c0317b862ff63d855e740dfde4203bbee93567f71602529967804099decdd12: Status 404 returned error can't find the container with id 9c0317b862ff63d855e740dfde4203bbee93567f71602529967804099decdd12
Sep 09 13:26:30.892662 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:30.892632    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82e246fd_3f6f_4482_8dca_098e1836b2e9.slice/crio-7330f8f14aa8229b17c299b4b98848bf0485e2f15275e1b13ca7157a786bda45 WatchSource:0}: Error finding container 7330f8f14aa8229b17c299b4b98848bf0485e2f15275e1b13ca7157a786bda45: Status 404 returned error can't find the container with id 7330f8f14aa8229b17c299b4b98848bf0485e2f15275e1b13ca7157a786bda45
Sep 09 13:26:30.894462 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.894445    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6kn8w"
Sep 09 13:26:30.900962 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:30.900940    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7832a0f6_3e3a_417d_96df_a284d6eb6429.slice/crio-606a271eeeb3150e2f512b7a6efb0818e095c5a51bbb889b40c69fef947a4399 WatchSource:0}: Error finding container 606a271eeeb3150e2f512b7a6efb0818e095c5a51bbb889b40c69fef947a4399: Status 404 returned error can't find the container with id 606a271eeeb3150e2f512b7a6efb0818e095c5a51bbb889b40c69fef947a4399
Sep 09 13:26:30.902135 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.902109    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dq6cj"
Sep 09 13:26:30.906242 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:30.906214    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47856a84_ddb7_437b_af1a_aa2e9f06bf23.slice/crio-c089af6868143d54502fb150d09156b7cc3869e2f4bc52ade965708176360207 WatchSource:0}: Error finding container c089af6868143d54502fb150d09156b7cc3869e2f4bc52ade965708176360207: Status 404 returned error can't find the container with id c089af6868143d54502fb150d09156b7cc3869e2f4bc52ade965708176360207
Sep 09 13:26:30.906357 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.906309    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qf468"
Sep 09 13:26:30.912522 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:30.912475    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39b1a91d_b820_424a_891f_bc2cb7c20896.slice/crio-7d5b8ac66ca50eaa459108f2573895bfa0808062979de9fb55ea501464dbd7fd WatchSource:0}: Error finding container 7d5b8ac66ca50eaa459108f2573895bfa0808062979de9fb55ea501464dbd7fd: Status 404 returned error can't find the container with id 7d5b8ac66ca50eaa459108f2573895bfa0808062979de9fb55ea501464dbd7fd
Sep 09 13:26:30.917160 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:30.917139    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59598bd9_9238_4f4e_a6cd_f7ca04a0b07d.slice/crio-08c9fc8bdf91a7d414045df2d6ec2e0fcf91f012ac674470a0eedd77bfc8b4f1 WatchSource:0}: Error finding container 08c9fc8bdf91a7d414045df2d6ec2e0fcf91f012ac674470a0eedd77bfc8b4f1: Status 404 returned error can't find the container with id 08c9fc8bdf91a7d414045df2d6ec2e0fcf91f012ac674470a0eedd77bfc8b4f1
Sep 09 13:26:30.994663 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:30.994627    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 13:26:31.172967 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:31.172862    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94d06480-f6e0-4f65-9567-c9b9760aeb8a-metrics-certs\") pod \"network-metrics-daemon-l8p6d\" (UID: \"94d06480-f6e0-4f65-9567-c9b9760aeb8a\") " pod="openshift-multus/network-metrics-daemon-l8p6d"
Sep 09 13:26:31.173145 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:31.173041    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 13:26:31.173145 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:31.173124    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94d06480-f6e0-4f65-9567-c9b9760aeb8a-metrics-certs podName:94d06480-f6e0-4f65-9567-c9b9760aeb8a nodeName:}" failed. No retries permitted until 2026-09-09 13:26:32.173101869 +0000 UTC m=+3.988626048 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/94d06480-f6e0-4f65-9567-c9b9760aeb8a-metrics-certs") pod "network-metrics-daemon-l8p6d" (UID: "94d06480-f6e0-4f65-9567-c9b9760aeb8a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 13:26:31.220629 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:31.220593    2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 13:26:31.273563 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:31.273527    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4f418699-7dc7-4c31-b9b1-e5612f362ce2-original-pull-secret\") pod \"global-pull-secret-syncer-zqjnb\" (UID: \"4f418699-7dc7-4c31-b9b1-e5612f362ce2\") " pod="kube-system/global-pull-secret-syncer-zqjnb"
Sep 09 13:26:31.273740 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:31.273687    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 13:26:31.273785 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:31.273756    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f418699-7dc7-4c31-b9b1-e5612f362ce2-original-pull-secret podName:4f418699-7dc7-4c31-b9b1-e5612f362ce2 nodeName:}" failed. No retries permitted until 2026-09-09 13:26:32.27373924 +0000 UTC m=+4.089263419 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4f418699-7dc7-4c31-b9b1-e5612f362ce2-original-pull-secret") pod "global-pull-secret-syncer-zqjnb" (UID: "4f418699-7dc7-4c31-b9b1-e5612f362ce2") : object "kube-system"/"original-pull-secret" not registered
Sep 09 13:26:31.374490 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:31.374180    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gql4\" (UniqueName: \"kubernetes.io/projected/298d53a7-1f9e-450d-afef-b9d28c24ccb6-kube-api-access-8gql4\") pod \"network-check-target-7sgj5\" (UID: \"298d53a7-1f9e-450d-afef-b9d28c24ccb6\") " pod="openshift-network-diagnostics/network-check-target-7sgj5"
Sep 09 13:26:31.374678 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:31.374454    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 13:26:31.374678 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:31.374587    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 13:26:31.374678 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:31.374607    2578 projected.go:196] Error preparing data for projected volume kube-api-access-8gql4 for pod openshift-network-diagnostics/network-check-target-7sgj5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 13:26:31.374678 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:31.374677    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/298d53a7-1f9e-450d-afef-b9d28c24ccb6-kube-api-access-8gql4 podName:298d53a7-1f9e-450d-afef-b9d28c24ccb6 nodeName:}" failed. No retries permitted until 2026-09-09 13:26:32.374654191 +0000 UTC m=+4.190178371 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-8gql4" (UniqueName: "kubernetes.io/projected/298d53a7-1f9e-450d-afef-b9d28c24ccb6-kube-api-access-8gql4") pod "network-check-target-7sgj5" (UID: "298d53a7-1f9e-450d-afef-b9d28c24ccb6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 13:26:31.655677 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:31.655582    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8p6d"
Sep 09 13:26:31.656158 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:31.655791    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8p6d" podUID="94d06480-f6e0-4f65-9567-c9b9760aeb8a"
Sep 09 13:26:31.680712 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:31.680670    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dq6cj" event={"ID":"39b1a91d-b820-424a-891f-bc2cb7c20896","Type":"ContainerStarted","Data":"7d5b8ac66ca50eaa459108f2573895bfa0808062979de9fb55ea501464dbd7fd"}
Sep 09 13:26:31.696176 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:31.696134    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 13:21:31 +0000 UTC" deadline="2028-06-01 13:30:08.615244546 +0000 UTC"
Sep 09 13:26:31.696367 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:31.696174    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15144h3m36.919075119s"
Sep 09 13:26:31.702149 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:31.702105    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nrp2k" event={"ID":"82e246fd-3f6f-4482-8dca-098e1836b2e9","Type":"ContainerStarted","Data":"7330f8f14aa8229b17c299b4b98848bf0485e2f15275e1b13ca7157a786bda45"}
Sep 09 13:26:31.710728 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:31.710690    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pg486" event={"ID":"dd89162d-80ad-4a5d-9753-a376a17fa59c","Type":"ContainerStarted","Data":"0e595ae7ac1ed86192e14fe6514dd41a4469e5f0c3ad5d8b3aab338170cef395"}
Sep 09 13:26:31.716142 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:31.716109    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qf468" event={"ID":"59598bd9-9238-4f4e-a6cd-f7ca04a0b07d","Type":"ContainerStarted","Data":"08c9fc8bdf91a7d414045df2d6ec2e0fcf91f012ac674470a0eedd77bfc8b4f1"}
Sep 09 13:26:31.723906 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:31.723871    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6kn8w" event={"ID":"47856a84-ddb7-437b-af1a-aa2e9f06bf23","Type":"ContainerStarted","Data":"c089af6868143d54502fb150d09156b7cc3869e2f4bc52ade965708176360207"}
Sep 09 13:26:31.726384 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:31.726353    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-52xr2" event={"ID":"7832a0f6-3e3a-417d-96df-a284d6eb6429","Type":"ContainerStarted","Data":"606a271eeeb3150e2f512b7a6efb0818e095c5a51bbb889b40c69fef947a4399"}
Sep 09 13:26:31.731866 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:31.731835    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-stlfb" event={"ID":"1aaceed8-333e-4fde-8412-843a7ea41bf2","Type":"ContainerStarted","Data":"9c0317b862ff63d855e740dfde4203bbee93567f71602529967804099decdd12"}
Sep 09 13:26:31.753173 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:31.750808    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9vnn" event={"ID":"1a579537-6ec3-4ae0-8ed0-81e0843c0688","Type":"ContainerStarted","Data":"d3a75be0007465b500250fcfbb4692faffbcf3967a4765148120347f37a46648"}
Sep 09 13:26:31.755669 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:31.755464    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lqpm7" event={"ID":"4d6ead4a-74e5-40e3-a070-c1a9f49c78c8","Type":"ContainerStarted","Data":"3facd4de9bb801e4fb9d6b94a0027fc3b6f8a3509094ae3ecab204b7c9648c2b"}
Sep 09 13:26:32.183368 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:32.183329    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94d06480-f6e0-4f65-9567-c9b9760aeb8a-metrics-certs\") pod \"network-metrics-daemon-l8p6d\" (UID: \"94d06480-f6e0-4f65-9567-c9b9760aeb8a\") " pod="openshift-multus/network-metrics-daemon-l8p6d"
Sep 09 13:26:32.183577 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:32.183530    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 13:26:32.183649 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:32.183608    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94d06480-f6e0-4f65-9567-c9b9760aeb8a-metrics-certs podName:94d06480-f6e0-4f65-9567-c9b9760aeb8a nodeName:}" failed. No retries permitted until 2026-09-09 13:26:34.183587645 +0000 UTC m=+5.999111825 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/94d06480-f6e0-4f65-9567-c9b9760aeb8a-metrics-certs") pod "network-metrics-daemon-l8p6d" (UID: "94d06480-f6e0-4f65-9567-c9b9760aeb8a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 13:26:32.284766 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:32.284725    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4f418699-7dc7-4c31-b9b1-e5612f362ce2-original-pull-secret\") pod \"global-pull-secret-syncer-zqjnb\" (UID: \"4f418699-7dc7-4c31-b9b1-e5612f362ce2\") " pod="kube-system/global-pull-secret-syncer-zqjnb"
Sep 09 13:26:32.284965 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:32.284942    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 13:26:32.285043 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:32.285010    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f418699-7dc7-4c31-b9b1-e5612f362ce2-original-pull-secret podName:4f418699-7dc7-4c31-b9b1-e5612f362ce2 nodeName:}" failed. No retries permitted until 2026-09-09 13:26:34.284991005 +0000 UTC m=+6.100515195 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4f418699-7dc7-4c31-b9b1-e5612f362ce2-original-pull-secret") pod "global-pull-secret-syncer-zqjnb" (UID: "4f418699-7dc7-4c31-b9b1-e5612f362ce2") : object "kube-system"/"original-pull-secret" not registered
Sep 09 13:26:32.385782 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:32.385728    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gql4\" (UniqueName: \"kubernetes.io/projected/298d53a7-1f9e-450d-afef-b9d28c24ccb6-kube-api-access-8gql4\") pod \"network-check-target-7sgj5\" (UID: \"298d53a7-1f9e-450d-afef-b9d28c24ccb6\") " pod="openshift-network-diagnostics/network-check-target-7sgj5"
Sep 09 13:26:32.385976 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:32.385907    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 13:26:32.385976 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:32.385959    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 13:26:32.385976 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:32.385974    2578 projected.go:196] Error preparing data for projected volume kube-api-access-8gql4 for pod openshift-network-diagnostics/network-check-target-7sgj5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 13:26:32.386151 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:32.386034    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/298d53a7-1f9e-450d-afef-b9d28c24ccb6-kube-api-access-8gql4 podName:298d53a7-1f9e-450d-afef-b9d28c24ccb6 nodeName:}" failed. No retries permitted until 2026-09-09 13:26:34.386015731 +0000 UTC m=+6.201539926 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-8gql4" (UniqueName: "kubernetes.io/projected/298d53a7-1f9e-450d-afef-b9d28c24ccb6-kube-api-access-8gql4") pod "network-check-target-7sgj5" (UID: "298d53a7-1f9e-450d-afef-b9d28c24ccb6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 13:26:32.656961 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:32.656925    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zqjnb"
Sep 09 13:26:32.657452 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:32.657067    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zqjnb" podUID="4f418699-7dc7-4c31-b9b1-e5612f362ce2"
Sep 09 13:26:32.657522 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:32.657503    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7sgj5"
Sep 09 13:26:32.657626 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:32.657603    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7sgj5" podUID="298d53a7-1f9e-450d-afef-b9d28c24ccb6"
Sep 09 13:26:32.695448 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:26:32.695414    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1c78154c3f34dfed8a9e280b4b66a37.slice/crio-b0fc8a3844cbdb433c236500840927c4c5e5ec5cbb31d97b8bec09d326334019 WatchSource:0}: Error finding container b0fc8a3844cbdb433c236500840927c4c5e5ec5cbb31d97b8bec09d326334019: Status 404 returned error can't find the container with id b0fc8a3844cbdb433c236500840927c4c5e5ec5cbb31d97b8bec09d326334019
Sep 09 13:26:32.696709 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:32.696673    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 13:21:31 +0000 UTC" deadline="2028-04-30 06:55:31.387185082 +0000 UTC"
Sep 09 13:26:32.696842 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:32.696710    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14369h28m58.690479352s"
Sep 09 13:26:32.763318 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:32.763275    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-192.ec2.internal" event={"ID":"d1c78154c3f34dfed8a9e280b4b66a37","Type":"ContainerStarted","Data":"b0fc8a3844cbdb433c236500840927c4c5e5ec5cbb31d97b8bec09d326334019"}
Sep 09 13:26:33.655051 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:33.654890    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8p6d"
Sep 09 13:26:33.655240 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:33.655085    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8p6d" podUID="94d06480-f6e0-4f65-9567-c9b9760aeb8a"
Sep 09 13:26:34.202151 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:34.201514    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94d06480-f6e0-4f65-9567-c9b9760aeb8a-metrics-certs\") pod \"network-metrics-daemon-l8p6d\" (UID: \"94d06480-f6e0-4f65-9567-c9b9760aeb8a\") " pod="openshift-multus/network-metrics-daemon-l8p6d"
Sep 09 13:26:34.202151 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:34.201670    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 13:26:34.202151 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:34.201743    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94d06480-f6e0-4f65-9567-c9b9760aeb8a-metrics-certs podName:94d06480-f6e0-4f65-9567-c9b9760aeb8a nodeName:}" failed. No retries permitted until 2026-09-09 13:26:38.201719475 +0000 UTC m=+10.017243674 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/94d06480-f6e0-4f65-9567-c9b9760aeb8a-metrics-certs") pod "network-metrics-daemon-l8p6d" (UID: "94d06480-f6e0-4f65-9567-c9b9760aeb8a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 13:26:34.303630 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:34.302914    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4f418699-7dc7-4c31-b9b1-e5612f362ce2-original-pull-secret\") pod \"global-pull-secret-syncer-zqjnb\" (UID: \"4f418699-7dc7-4c31-b9b1-e5612f362ce2\") " pod="kube-system/global-pull-secret-syncer-zqjnb"
Sep 09 13:26:34.303630 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:34.303171    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 13:26:34.303630 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:34.303257    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f418699-7dc7-4c31-b9b1-e5612f362ce2-original-pull-secret podName:4f418699-7dc7-4c31-b9b1-e5612f362ce2 nodeName:}" failed. No retries permitted until 2026-09-09 13:26:38.303221091 +0000 UTC m=+10.118745272 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4f418699-7dc7-4c31-b9b1-e5612f362ce2-original-pull-secret") pod "global-pull-secret-syncer-zqjnb" (UID: "4f418699-7dc7-4c31-b9b1-e5612f362ce2") : object "kube-system"/"original-pull-secret" not registered
Sep 09 13:26:34.404182 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:34.404065    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gql4\" (UniqueName: \"kubernetes.io/projected/298d53a7-1f9e-450d-afef-b9d28c24ccb6-kube-api-access-8gql4\") pod \"network-check-target-7sgj5\" (UID: \"298d53a7-1f9e-450d-afef-b9d28c24ccb6\") " pod="openshift-network-diagnostics/network-check-target-7sgj5"
Sep 09 13:26:34.404385 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:34.404310    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 13:26:34.404385 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:34.404339    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 13:26:34.404385 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:34.404356    2578 projected.go:196] Error preparing data for projected volume kube-api-access-8gql4 for pod openshift-network-diagnostics/network-check-target-7sgj5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 13:26:34.404559 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:34.404469    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/298d53a7-1f9e-450d-afef-b9d28c24ccb6-kube-api-access-8gql4 podName:298d53a7-1f9e-450d-afef-b9d28c24ccb6 nodeName:}" failed. No retries permitted until 2026-09-09 13:26:38.404447937 +0000 UTC m=+10.219972127 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-8gql4" (UniqueName: "kubernetes.io/projected/298d53a7-1f9e-450d-afef-b9d28c24ccb6-kube-api-access-8gql4") pod "network-check-target-7sgj5" (UID: "298d53a7-1f9e-450d-afef-b9d28c24ccb6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 13:26:34.655989 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:34.655444    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7sgj5"
Sep 09 13:26:34.655989 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:34.655586    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7sgj5" podUID="298d53a7-1f9e-450d-afef-b9d28c24ccb6"
Sep 09 13:26:34.655989 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:34.655814    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zqjnb"
Sep 09 13:26:34.656268 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:34.656010    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zqjnb" podUID="4f418699-7dc7-4c31-b9b1-e5612f362ce2"
Sep 09 13:26:35.654898 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:35.654863    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8p6d"
Sep 09 13:26:35.655394 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:35.655018    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8p6d" podUID="94d06480-f6e0-4f65-9567-c9b9760aeb8a"
Sep 09 13:26:36.655921 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:36.655297    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zqjnb"
Sep 09 13:26:36.655921 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:36.655317    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7sgj5"
Sep 09 13:26:36.655921 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:36.655442    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zqjnb" podUID="4f418699-7dc7-4c31-b9b1-e5612f362ce2"
Sep 09 13:26:36.655921 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:36.655872    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7sgj5" podUID="298d53a7-1f9e-450d-afef-b9d28c24ccb6"
Sep 09 13:26:37.654885 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:37.654778    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8p6d"
Sep 09 13:26:37.655080 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:37.654928    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8p6d" podUID="94d06480-f6e0-4f65-9567-c9b9760aeb8a"
Sep 09 13:26:38.239048 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:38.239008    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94d06480-f6e0-4f65-9567-c9b9760aeb8a-metrics-certs\") pod \"network-metrics-daemon-l8p6d\" (UID: \"94d06480-f6e0-4f65-9567-c9b9760aeb8a\") " pod="openshift-multus/network-metrics-daemon-l8p6d"
Sep 09 13:26:38.239556 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:38.239170    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 13:26:38.239556 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:38.239300    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94d06480-f6e0-4f65-9567-c9b9760aeb8a-metrics-certs podName:94d06480-f6e0-4f65-9567-c9b9760aeb8a nodeName:}" failed. No retries permitted until 2026-09-09 13:26:46.239233626 +0000 UTC m=+18.054757801 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/94d06480-f6e0-4f65-9567-c9b9760aeb8a-metrics-certs") pod "network-metrics-daemon-l8p6d" (UID: "94d06480-f6e0-4f65-9567-c9b9760aeb8a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 13:26:38.339382 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:38.339345    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4f418699-7dc7-4c31-b9b1-e5612f362ce2-original-pull-secret\") pod \"global-pull-secret-syncer-zqjnb\" (UID: \"4f418699-7dc7-4c31-b9b1-e5612f362ce2\") " pod="kube-system/global-pull-secret-syncer-zqjnb"
Sep 09 13:26:38.339583 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:38.339548    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 13:26:38.339649 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:38.339637    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f418699-7dc7-4c31-b9b1-e5612f362ce2-original-pull-secret podName:4f418699-7dc7-4c31-b9b1-e5612f362ce2 nodeName:}" failed. No retries permitted until 2026-09-09 13:26:46.339614596 +0000 UTC m=+18.155138793 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4f418699-7dc7-4c31-b9b1-e5612f362ce2-original-pull-secret") pod "global-pull-secret-syncer-zqjnb" (UID: "4f418699-7dc7-4c31-b9b1-e5612f362ce2") : object "kube-system"/"original-pull-secret" not registered
Sep 09 13:26:38.440081 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:38.440041    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gql4\" (UniqueName: \"kubernetes.io/projected/298d53a7-1f9e-450d-afef-b9d28c24ccb6-kube-api-access-8gql4\") pod \"network-check-target-7sgj5\" (UID: \"298d53a7-1f9e-450d-afef-b9d28c24ccb6\") " pod="openshift-network-diagnostics/network-check-target-7sgj5"
Sep 09 13:26:38.440311 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:38.440278    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 13:26:38.440311 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:38.440298    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 13:26:38.440311 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:38.440308    2578 projected.go:196] Error preparing data for projected volume kube-api-access-8gql4 for pod openshift-network-diagnostics/network-check-target-7sgj5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 13:26:38.440455 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:38.440369    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/298d53a7-1f9e-450d-afef-b9d28c24ccb6-kube-api-access-8gql4 podName:298d53a7-1f9e-450d-afef-b9d28c24ccb6 nodeName:}" failed. No retries permitted until 2026-09-09 13:26:46.440349689 +0000 UTC m=+18.255873887 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-8gql4" (UniqueName: "kubernetes.io/projected/298d53a7-1f9e-450d-afef-b9d28c24ccb6-kube-api-access-8gql4") pod "network-check-target-7sgj5" (UID: "298d53a7-1f9e-450d-afef-b9d28c24ccb6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 13:26:38.656119 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:38.655937    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7sgj5"
Sep 09 13:26:38.656119 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:38.656078    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7sgj5" podUID="298d53a7-1f9e-450d-afef-b9d28c24ccb6"
Sep 09 13:26:38.656531 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:38.656512    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zqjnb"
Sep 09 13:26:38.656655 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:38.656633    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zqjnb" podUID="4f418699-7dc7-4c31-b9b1-e5612f362ce2"
Sep 09 13:26:39.654764 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:39.654722    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8p6d"
Sep 09 13:26:39.655455 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:39.654883    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8p6d" podUID="94d06480-f6e0-4f65-9567-c9b9760aeb8a"
Sep 09 13:26:40.654902 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:40.654865    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zqjnb"
Sep 09 13:26:40.655411 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:40.655009    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zqjnb" podUID="4f418699-7dc7-4c31-b9b1-e5612f362ce2"
Sep 09 13:26:40.655411 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:40.655054    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7sgj5"
Sep 09 13:26:40.655411 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:40.655128    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7sgj5" podUID="298d53a7-1f9e-450d-afef-b9d28c24ccb6"
Sep 09 13:26:41.655025 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:41.654991    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8p6d"
Sep 09 13:26:41.655485 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:41.655113    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8p6d" podUID="94d06480-f6e0-4f65-9567-c9b9760aeb8a"
Sep 09 13:26:42.654740 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:42.654706    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zqjnb"
Sep 09 13:26:42.654926 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:42.654841    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zqjnb" podUID="4f418699-7dc7-4c31-b9b1-e5612f362ce2"
Sep 09 13:26:42.654926 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:42.654888    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7sgj5"
Sep 09 13:26:42.655047 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:42.654982    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7sgj5" podUID="298d53a7-1f9e-450d-afef-b9d28c24ccb6"
Sep 09 13:26:43.655361 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:43.655327    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8p6d"
Sep 09 13:26:43.655709 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:43.655439    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8p6d" podUID="94d06480-f6e0-4f65-9567-c9b9760aeb8a"
Sep 09 13:26:44.654958 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:44.654912    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7sgj5"
Sep 09 13:26:44.654958 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:44.654952    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zqjnb"
Sep 09 13:26:44.655158 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:44.655064    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7sgj5" podUID="298d53a7-1f9e-450d-afef-b9d28c24ccb6"
Sep 09 13:26:44.655299 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:44.655273    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zqjnb" podUID="4f418699-7dc7-4c31-b9b1-e5612f362ce2"
Sep 09 13:26:45.654944 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:45.654910    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8p6d"
Sep 09 13:26:45.655368 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:45.655042    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8p6d" podUID="94d06480-f6e0-4f65-9567-c9b9760aeb8a"
Sep 09 13:26:46.299561 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:46.299516    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94d06480-f6e0-4f65-9567-c9b9760aeb8a-metrics-certs\") pod \"network-metrics-daemon-l8p6d\" (UID: \"94d06480-f6e0-4f65-9567-c9b9760aeb8a\") " pod="openshift-multus/network-metrics-daemon-l8p6d"
Sep 09 13:26:46.299809 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:46.299691    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 13:26:46.299809 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:46.299756    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94d06480-f6e0-4f65-9567-c9b9760aeb8a-metrics-certs podName:94d06480-f6e0-4f65-9567-c9b9760aeb8a nodeName:}" failed. No retries permitted until 2026-09-09 13:27:02.299740071 +0000 UTC m=+34.115264242 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/94d06480-f6e0-4f65-9567-c9b9760aeb8a-metrics-certs") pod "network-metrics-daemon-l8p6d" (UID: "94d06480-f6e0-4f65-9567-c9b9760aeb8a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 13:26:46.400377 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:46.400332    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4f418699-7dc7-4c31-b9b1-e5612f362ce2-original-pull-secret\") pod \"global-pull-secret-syncer-zqjnb\" (UID: \"4f418699-7dc7-4c31-b9b1-e5612f362ce2\") " pod="kube-system/global-pull-secret-syncer-zqjnb"
Sep 09 13:26:46.400547 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:46.400502    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 13:26:46.400597 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:46.400578    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f418699-7dc7-4c31-b9b1-e5612f362ce2-original-pull-secret podName:4f418699-7dc7-4c31-b9b1-e5612f362ce2 nodeName:}" failed. No retries permitted until 2026-09-09 13:27:02.40056158 +0000 UTC m=+34.216085751 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4f418699-7dc7-4c31-b9b1-e5612f362ce2-original-pull-secret") pod "global-pull-secret-syncer-zqjnb" (UID: "4f418699-7dc7-4c31-b9b1-e5612f362ce2") : object "kube-system"/"original-pull-secret" not registered
Sep 09 13:26:46.501087 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:46.501044    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gql4\" (UniqueName: \"kubernetes.io/projected/298d53a7-1f9e-450d-afef-b9d28c24ccb6-kube-api-access-8gql4\") pod \"network-check-target-7sgj5\" (UID: \"298d53a7-1f9e-450d-afef-b9d28c24ccb6\") " pod="openshift-network-diagnostics/network-check-target-7sgj5"
Sep 09 13:26:46.501270 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:46.501231    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 13:26:46.501270 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:46.501254    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 13:26:46.501270 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:46.501264    2578 projected.go:196] Error preparing data for projected volume kube-api-access-8gql4 for pod openshift-network-diagnostics/network-check-target-7sgj5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 13:26:46.501395 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:46.501326    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/298d53a7-1f9e-450d-afef-b9d28c24ccb6-kube-api-access-8gql4 podName:298d53a7-1f9e-450d-afef-b9d28c24ccb6 nodeName:}" failed. No retries permitted until 2026-09-09 13:27:02.501305213 +0000 UTC m=+34.316829386 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-8gql4" (UniqueName: "kubernetes.io/projected/298d53a7-1f9e-450d-afef-b9d28c24ccb6-kube-api-access-8gql4") pod "network-check-target-7sgj5" (UID: "298d53a7-1f9e-450d-afef-b9d28c24ccb6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 13:26:46.654921 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:46.654891    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7sgj5"
Sep 09 13:26:46.654921 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:46.654928    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zqjnb"
Sep 09 13:26:46.655428 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:46.655018    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7sgj5" podUID="298d53a7-1f9e-450d-afef-b9d28c24ccb6"
Sep 09 13:26:46.655428 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:46.655167    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zqjnb" podUID="4f418699-7dc7-4c31-b9b1-e5612f362ce2"
Sep 09 13:26:47.654626 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:47.654597    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8p6d"
Sep 09 13:26:47.654789 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:47.654708    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8p6d" podUID="94d06480-f6e0-4f65-9567-c9b9760aeb8a"
Sep 09 13:26:48.658702 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:48.658668    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7sgj5"
Sep 09 13:26:48.659168 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:48.658683    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zqjnb"
Sep 09 13:26:48.659168 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:48.658784    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7sgj5" podUID="298d53a7-1f9e-450d-afef-b9d28c24ccb6"
Sep 09 13:26:48.659168 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:48.658851    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zqjnb" podUID="4f418699-7dc7-4c31-b9b1-e5612f362ce2"
Sep 09 13:26:49.655189 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:49.655154    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8p6d"
Sep 09 13:26:49.655391 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:49.655308    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8p6d" podUID="94d06480-f6e0-4f65-9567-c9b9760aeb8a"
Sep 09 13:26:50.655277 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:50.655229    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zqjnb"
Sep 09 13:26:50.655745 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:50.655353    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zqjnb" podUID="4f418699-7dc7-4c31-b9b1-e5612f362ce2"
Sep 09 13:26:50.655745 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:50.655229    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7sgj5"
Sep 09 13:26:50.655745 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:50.655678    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7sgj5" podUID="298d53a7-1f9e-450d-afef-b9d28c24ccb6"
Sep 09 13:26:51.655613 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:51.655305    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8p6d"
Sep 09 13:26:51.656253 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:51.655701    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8p6d" podUID="94d06480-f6e0-4f65-9567-c9b9760aeb8a"
Sep 09 13:26:51.811248 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:51.811208    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qf468" event={"ID":"59598bd9-9238-4f4e-a6cd-f7ca04a0b07d","Type":"ContainerStarted","Data":"f9e5363cafd6a0c0b0b8c8ff2a6de953af8dd34fa63e919a83f98c2911992234"}
Sep 09 13:26:51.811425 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:51.811290    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qf468" event={"ID":"59598bd9-9238-4f4e-a6cd-f7ca04a0b07d","Type":"ContainerStarted","Data":"9610ec56ece68966cc824cfdac537969bcd928591cf69df070d0ea21226a5b25"}
Sep 09 13:26:51.811425 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:51.811334    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qf468" event={"ID":"59598bd9-9238-4f4e-a6cd-f7ca04a0b07d","Type":"ContainerStarted","Data":"2b351474f356c6169458f77604aba66f5b258abed153a7d92aa6909126c891cd"}
Sep 09 13:26:51.811425 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:51.811376    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qf468" event={"ID":"59598bd9-9238-4f4e-a6cd-f7ca04a0b07d","Type":"ContainerStarted","Data":"0c36f4dbc2c12dd90be4d60ede59ecc2789a6f630fd17fb327b3a95fa9fef49c"}
Sep 09 13:26:51.811425 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:51.811412    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qf468" event={"ID":"59598bd9-9238-4f4e-a6cd-f7ca04a0b07d","Type":"ContainerStarted","Data":"95cc10551328b9dbf49cc5bafd92e61423fbb6fd9e8a9264d6f46aa44729c542"}
Sep 09 13:26:51.811657 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:51.811450    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qf468" event={"ID":"59598bd9-9238-4f4e-a6cd-f7ca04a0b07d","Type":"ContainerStarted","Data":"0a17918305f139f1133310f6f9053e201dab2f78d0cca2a92d00f6c8ae11f3ad"}
Sep 09 13:26:51.812702 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:51.812676    2578 generic.go:356] "Generic (PLEG): container finished" podID="47856a84-ddb7-437b-af1a-aa2e9f06bf23" containerID="1a56fdc6058f9314b867b30fdf540a6bd83bf7953372653960bed7bfe5be065c" exitCode=0
Sep 09 13:26:51.812831 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:51.812748    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6kn8w" event={"ID":"47856a84-ddb7-437b-af1a-aa2e9f06bf23","Type":"ContainerDied","Data":"1a56fdc6058f9314b867b30fdf540a6bd83bf7953372653960bed7bfe5be065c"}
Sep 09 13:26:51.814457 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:51.814418    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-52xr2" event={"ID":"7832a0f6-3e3a-417d-96df-a284d6eb6429","Type":"ContainerStarted","Data":"2a492dc9549abf46480e881473c1ba79caa429d7e016c5cb8ed339c09be6f661"}
Sep 09 13:26:51.815971 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:51.815944    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-stlfb" event={"ID":"1aaceed8-333e-4fde-8412-843a7ea41bf2","Type":"ContainerStarted","Data":"dbf9d1df7d1edfaf2dee7a80e017368d44fc9a91711c0fd3bfe5dd784f652793"}
Sep 09 13:26:51.817631 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:51.817599    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9vnn" event={"ID":"1a579537-6ec3-4ae0-8ed0-81e0843c0688","Type":"ContainerStarted","Data":"3eeda43e47ea762e1c674ee23ceeaf661f2b8f2782b90c55aea7cf6b9dec8933"}
Sep 09 13:26:51.819043 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:51.819016    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lqpm7" event={"ID":"4d6ead4a-74e5-40e3-a070-c1a9f49c78c8","Type":"ContainerStarted","Data":"7fdb5f81bc978da61e03e5deddfc7d93b5a9fc75d16b53a00a25ebde154b0c48"}
Sep 09 13:26:51.820520 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:51.820495    2578 generic.go:356] "Generic (PLEG): container finished" podID="ef1facbd3538f7ab78cc8a4e7adbe86c" containerID="f8709e1e326aa0898a0da0a6808f23ca0e2a5102a0adc9ac70246b7010600177" exitCode=0
Sep 09 13:26:51.820620 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:51.820568    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-192.ec2.internal" event={"ID":"ef1facbd3538f7ab78cc8a4e7adbe86c","Type":"ContainerDied","Data":"f8709e1e326aa0898a0da0a6808f23ca0e2a5102a0adc9ac70246b7010600177"}
Sep 09 13:26:51.821999 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:51.821979    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nrp2k" event={"ID":"82e246fd-3f6f-4482-8dca-098e1836b2e9","Type":"ContainerStarted","Data":"4f3a02cc04a53acd6dae0b11ee6e5bc7870b0101ddddb8effaa41e3897fd9e50"}
Sep 09 13:26:51.823432 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:51.823399    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pg486" event={"ID":"dd89162d-80ad-4a5d-9753-a376a17fa59c","Type":"ContainerStarted","Data":"a43632e7da8d4fbfe221f79944c235d57e15908779063e394ff90fd8dfe1f625"}
Sep 09 13:26:51.824855 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:51.824826    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-192.ec2.internal" event={"ID":"d1c78154c3f34dfed8a9e280b4b66a37","Type":"ContainerStarted","Data":"4ac84cfb5c602f97025275e41971c55fbd416b3466b0f1540f51f347dc0defa8"}
Sep 09 13:26:51.917702 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:51.917651    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-nrp2k" podStartSLOduration=2.91342533 podStartE2EDuration="22.917633313s" totalImagesPullingTime="20.004207983s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 13:26:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 13:26:51.888334769 +0000 UTC m=+23.703858962" watchObservedRunningTime="2026-09-09 13:26:51.917633313 +0000 UTC m=+23.733157508"
Sep 09 13:26:51.947625 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:51.947574    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-lqpm7" podStartSLOduration=2.9322942640000003 podStartE2EDuration="22.947559075s" totalImagesPullingTime="20.015264811s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 13:26:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 13:26:51.917773807 +0000 UTC m=+23.733297983" watchObservedRunningTime="2026-09-09 13:26:51.947559075 +0000 UTC m=+23.763083269"
Sep 09 13:26:51.949133 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:51.947988    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-pg486" podStartSLOduration=2.929871956 podStartE2EDuration="22.947975174s" totalImagesPullingTime="20.018103218s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 13:26:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 13:26:51.944567185 +0000 UTC m=+23.760091383" watchObservedRunningTime="2026-09-09 13:26:51.947975174 +0000 UTC m=+23.763499368"
Sep 09 13:26:51.977345 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:51.977301    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-stlfb" podStartSLOduration=2.9852624 podStartE2EDuration="22.977285529s" totalImagesPullingTime="19.992023129s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 13:26:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 13:26:51.976803558 +0000 UTC m=+23.792327752" watchObservedRunningTime="2026-09-09 13:26:51.977285529 +0000 UTC m=+23.792809721"
Sep 09 13:26:52.010810 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:52.010754    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-52xr2" podStartSLOduration=2.973094392 podStartE2EDuration="23.010740086s" totalImagesPullingTime="20.037645694s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 13:26:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 13:26:52.010519991 +0000 UTC m=+23.826044184" watchObservedRunningTime="2026-09-09 13:26:52.010740086 +0000 UTC m=+23.826264279"
Sep 09 13:26:52.093681 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:52.093632    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-192.ec2.internal" podStartSLOduration=22.093617524 podStartE2EDuration="22.093617524s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 13:26:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 13:26:52.092770856 +0000 UTC m=+23.908295051" watchObservedRunningTime="2026-09-09 13:26:52.093617524 +0000 UTC m=+23.909141718"
Sep 09 13:26:52.152494 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:52.152458    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:26:52.332393 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:52.332301    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:26:52.515702 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:52.515664    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:26:52.654477 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:52.654446    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7sgj5"
Sep 09 13:26:52.654702 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:52.654600    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7sgj5" podUID="298d53a7-1f9e-450d-afef-b9d28c24ccb6"
Sep 09 13:26:52.654702 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:52.654688    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zqjnb"
Sep 09 13:26:52.654817 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:52.654786    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zqjnb" podUID="4f418699-7dc7-4c31-b9b1-e5612f362ce2"
Sep 09 13:26:52.684007 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:52.683971    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:26:52.828805 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:52.828767    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-192.ec2.internal" event={"ID":"ef1facbd3538f7ab78cc8a4e7adbe86c","Type":"ContainerStarted","Data":"8c43b18bc2b21c14764d078b4b1274438778ed3c6e316011f8ea5e62524b9bac"}
Sep 09 13:26:52.830471 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:52.830421    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dq6cj" event={"ID":"39b1a91d-b820-424a-891f-bc2cb7c20896","Type":"ContainerStarted","Data":"8214955fbdbc30e7ad8076fcaad842e609847b9e636c12d717b925ebdd9dbaff"}
Sep 09 13:26:52.881573 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:52.881512    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-192.ec2.internal" podStartSLOduration=22.881490008 podStartE2EDuration="22.881490008s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 13:26:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 13:26:52.857135345 +0000 UTC m=+24.672659542" watchObservedRunningTime="2026-09-09 13:26:52.881490008 +0000 UTC m=+24.697014203"
Sep 09 13:26:53.087345 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:53.087270    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:26:53.257630 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:53.257593    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:26:53.654720 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:53.654685    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8p6d"
Sep 09 13:26:53.654890 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:53.654832    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8p6d" podUID="94d06480-f6e0-4f65-9567-c9b9760aeb8a"
Sep 09 13:26:53.871480 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:53.871405    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-lqpm7"
Sep 09 13:26:53.872277 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:53.872254    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-lqpm7"
Sep 09 13:26:53.905902 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:53.905821    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-dq6cj" podStartSLOduration=4.93519214 podStartE2EDuration="24.905802559s" totalImagesPullingTime="19.970610419s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 13:26:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 13:26:52.881959742 +0000 UTC m=+24.697483935" watchObservedRunningTime="2026-09-09 13:26:53.905802559 +0000 UTC m=+25.721326753"
Sep 09 13:26:53.941727 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:53.941510    2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 09 13:26:54.621510 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:54.621396    2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-09T13:26:53.941722634Z","UUID":"3321815e-999d-4281-bf51-cc2d3bb8b618","Handler":null,"Name":"","Endpoint":""}
Sep 09 13:26:54.623121 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:54.623095    2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 09 13:26:54.623277 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:54.623132    2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 09 13:26:54.654871 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:54.654840    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zqjnb"
Sep 09 13:26:54.655046 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:54.654840    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7sgj5"
Sep 09 13:26:54.655046 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:54.654982    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zqjnb" podUID="4f418699-7dc7-4c31-b9b1-e5612f362ce2"
Sep 09 13:26:54.655046 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:54.655038    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7sgj5" podUID="298d53a7-1f9e-450d-afef-b9d28c24ccb6"
Sep 09 13:26:54.840163 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:54.840120    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qf468" event={"ID":"59598bd9-9238-4f4e-a6cd-f7ca04a0b07d","Type":"ContainerStarted","Data":"b2368954fab1078f9bae3366a6f2ebc8d3d937fe34362b6db8fb333a1dd33cce"}
Sep 09 13:26:54.842241 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:54.842209    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9vnn" event={"ID":"1a579537-6ec3-4ae0-8ed0-81e0843c0688","Type":"ContainerStarted","Data":"d3c750399ee547aed85e486c4daa66cae5a6b19eef2ea999a9887e162b73e7f0"}
Sep 09 13:26:54.842576 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:54.842554    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-lqpm7"
Sep 09 13:26:54.843107 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:54.843089    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-lqpm7"
Sep 09 13:26:54.925115 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:54.925041    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:26:55.220895 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:55.220816    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:26:55.323584 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:55.323548    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:26:55.655109 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:55.655077    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8p6d"
Sep 09 13:26:55.655313 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:55.655221    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8p6d" podUID="94d06480-f6e0-4f65-9567-c9b9760aeb8a"
Sep 09 13:26:56.655410 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:56.655239    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7sgj5"
Sep 09 13:26:56.655826 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:56.655271    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zqjnb"
Sep 09 13:26:56.655826 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:56.655486    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7sgj5" podUID="298d53a7-1f9e-450d-afef-b9d28c24ccb6"
Sep 09 13:26:56.655826 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:56.655557    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zqjnb" podUID="4f418699-7dc7-4c31-b9b1-e5612f362ce2"
Sep 09 13:26:56.850023 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:56.849987    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qf468" event={"ID":"59598bd9-9238-4f4e-a6cd-f7ca04a0b07d","Type":"ContainerStarted","Data":"8920407b5ab852ae8e663713bc9edd20ffdeb65aaf6769d0aa701bdf5bf13c61"}
Sep 09 13:26:56.850201 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:56.850170    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qf468"
Sep 09 13:26:56.854916 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:56.854877    2578 generic.go:356] "Generic (PLEG): container finished" podID="47856a84-ddb7-437b-af1a-aa2e9f06bf23" containerID="304481f8052a04e82aa9a4324ea445abb14805fda0a05daf465af405249ab8e7" exitCode=0
Sep 09 13:26:56.855061 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:56.854956    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6kn8w" event={"ID":"47856a84-ddb7-437b-af1a-aa2e9f06bf23","Type":"ContainerDied","Data":"304481f8052a04e82aa9a4324ea445abb14805fda0a05daf465af405249ab8e7"}
Sep 09 13:26:56.868608 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:56.868575    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qf468"
Sep 09 13:26:56.891697 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:56.891647    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-qf468" podStartSLOduration=7.870202905 podStartE2EDuration="27.891632466s" totalImagesPullingTime="20.021429561s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 13:26:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 13:26:56.891168173 +0000 UTC m=+28.706692366" watchObservedRunningTime="2026-09-09 13:26:56.891632466 +0000 UTC m=+28.707156660"
Sep 09 13:26:57.654620 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:57.654590    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8p6d"
Sep 09 13:26:57.654758 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:57.654703    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8p6d" podUID="94d06480-f6e0-4f65-9567-c9b9760aeb8a"
Sep 09 13:26:57.745625 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:57.745594    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qf468"
Sep 09 13:26:57.862455 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:57.862421    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9vnn" event={"ID":"1a579537-6ec3-4ae0-8ed0-81e0843c0688","Type":"ContainerStarted","Data":"12f1b1d328d194f15e60c6da4824de499b54994ff78d9495260b3cd56c68b580"}
Sep 09 13:26:57.862752 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:57.862728    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qf468"
Sep 09 13:26:57.881456 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:57.881434    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qf468"
Sep 09 13:26:57.960204 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:57.960143    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9vnn" podStartSLOduration=3.621671551 podStartE2EDuration="28.96012537s" totalImagesPullingTime="25.338453819s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 13:26:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 13:26:57.896535393 +0000 UTC m=+29.712059588" watchObservedRunningTime="2026-09-09 13:26:57.96012537 +0000 UTC m=+29.775649563"
Sep 09 13:26:58.035796 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:58.035762    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:26:58.118226 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:58.118194    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-l8p6d"]
Sep 09 13:26:58.118386 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:58.118336    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8p6d"
Sep 09 13:26:58.118449 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:58.118429    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8p6d" podUID="94d06480-f6e0-4f65-9567-c9b9760aeb8a"
Sep 09 13:26:58.119680 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:58.119652    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7sgj5"]
Sep 09 13:26:58.119790 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:58.119764    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7sgj5"
Sep 09 13:26:58.119851 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:58.119834    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7sgj5" podUID="298d53a7-1f9e-450d-afef-b9d28c24ccb6"
Sep 09 13:26:58.128380 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:58.128350    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zqjnb"]
Sep 09 13:26:58.128476 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:58.128445    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zqjnb"
Sep 09 13:26:58.128527 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:58.128511    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zqjnb" podUID="4f418699-7dc7-4c31-b9b1-e5612f362ce2"
Sep 09 13:26:58.136398 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:58.136374    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:26:58.776753 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:58.776537    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:26:58.868739 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:58.868712    2578 generic.go:356] "Generic (PLEG): container finished" podID="47856a84-ddb7-437b-af1a-aa2e9f06bf23" containerID="f18b579117e37e7d28f3740112ca449e0212da9b6f3ea5f200709a47639e8687" exitCode=0
Sep 09 13:26:58.868908 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:58.868799    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6kn8w" event={"ID":"47856a84-ddb7-437b-af1a-aa2e9f06bf23","Type":"ContainerDied","Data":"f18b579117e37e7d28f3740112ca449e0212da9b6f3ea5f200709a47639e8687"}
Sep 09 13:26:58.990252 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:58.990224    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:26:59.302931 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:59.302884    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:26:59.655157 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:59.655118    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zqjnb"
Sep 09 13:26:59.655327 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:59.655234    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7sgj5"
Sep 09 13:26:59.655327 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:59.655241    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zqjnb" podUID="4f418699-7dc7-4c31-b9b1-e5612f362ce2"
Sep 09 13:26:59.655327 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:59.655259    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8p6d"
Sep 09 13:26:59.655327 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:59.655312    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7sgj5" podUID="298d53a7-1f9e-450d-afef-b9d28c24ccb6"
Sep 09 13:26:59.655478 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:26:59.655390    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8p6d" podUID="94d06480-f6e0-4f65-9567-c9b9760aeb8a"
Sep 09 13:26:59.673493 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:59.673468    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:26:59.814614 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:59.814582    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:26:59.947414 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:59.947347    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:26:59.978633 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:26:59.978608    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pg486_dd89162d-80ad-4a5d-9753-a376a17fa59c/dns-node-resolver/0.log"
Sep 09 13:27:00.047163 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:00.047133    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:00.147825 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:00.147789    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:00.453110 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:00.453084    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:00.668339 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:00.668306    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:01.386676 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:01.386651    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-stlfb_1aaceed8-333e-4fde-8412-843a7ea41bf2/node-ca/0.log"
Sep 09 13:27:01.655158 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:01.655120    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7sgj5"
Sep 09 13:27:01.655158 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:01.655142    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8p6d"
Sep 09 13:27:01.655387 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:01.655262    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zqjnb"
Sep 09 13:27:01.655387 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:27:01.655268    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8p6d" podUID="94d06480-f6e0-4f65-9567-c9b9760aeb8a"
Sep 09 13:27:01.655387 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:27:01.655316    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7sgj5" podUID="298d53a7-1f9e-450d-afef-b9d28c24ccb6"
Sep 09 13:27:01.655486 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:27:01.655389    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zqjnb" podUID="4f418699-7dc7-4c31-b9b1-e5612f362ce2"
Sep 09 13:27:01.878020 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:01.877990    2578 generic.go:356] "Generic (PLEG): container finished" podID="47856a84-ddb7-437b-af1a-aa2e9f06bf23" containerID="a2b2c48bea191be8c7d72bf9156771dfe68dd10e9530680dbda77b83095447a2" exitCode=0
Sep 09 13:27:01.878155 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:01.878037    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6kn8w" event={"ID":"47856a84-ddb7-437b-af1a-aa2e9f06bf23","Type":"ContainerDied","Data":"a2b2c48bea191be8c7d72bf9156771dfe68dd10e9530680dbda77b83095447a2"}
Sep 09 13:27:02.096934 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:02.096860    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:02.290059 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:02.290027    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:02.322142 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:02.322113    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94d06480-f6e0-4f65-9567-c9b9760aeb8a-metrics-certs\") pod \"network-metrics-daemon-l8p6d\" (UID: \"94d06480-f6e0-4f65-9567-c9b9760aeb8a\") " pod="openshift-multus/network-metrics-daemon-l8p6d"
Sep 09 13:27:02.322311 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:27:02.322264    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 13:27:02.322354 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:27:02.322327    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94d06480-f6e0-4f65-9567-c9b9760aeb8a-metrics-certs podName:94d06480-f6e0-4f65-9567-c9b9760aeb8a nodeName:}" failed. No retries permitted until 2026-09-09 13:27:34.322311389 +0000 UTC m=+66.137835577 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/94d06480-f6e0-4f65-9567-c9b9760aeb8a-metrics-certs") pod "network-metrics-daemon-l8p6d" (UID: "94d06480-f6e0-4f65-9567-c9b9760aeb8a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 13:27:02.423479 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:02.423444    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4f418699-7dc7-4c31-b9b1-e5612f362ce2-original-pull-secret\") pod \"global-pull-secret-syncer-zqjnb\" (UID: \"4f418699-7dc7-4c31-b9b1-e5612f362ce2\") " pod="kube-system/global-pull-secret-syncer-zqjnb"
Sep 09 13:27:02.423850 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:27:02.423588    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 13:27:02.423850 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:27:02.423660    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f418699-7dc7-4c31-b9b1-e5612f362ce2-original-pull-secret podName:4f418699-7dc7-4c31-b9b1-e5612f362ce2 nodeName:}" failed. No retries permitted until 2026-09-09 13:27:34.423643167 +0000 UTC m=+66.239167340 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4f418699-7dc7-4c31-b9b1-e5612f362ce2-original-pull-secret") pod "global-pull-secret-syncer-zqjnb" (UID: "4f418699-7dc7-4c31-b9b1-e5612f362ce2") : object "kube-system"/"original-pull-secret" not registered
Sep 09 13:27:02.523807 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:02.523775    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gql4\" (UniqueName: \"kubernetes.io/projected/298d53a7-1f9e-450d-afef-b9d28c24ccb6-kube-api-access-8gql4\") pod \"network-check-target-7sgj5\" (UID: \"298d53a7-1f9e-450d-afef-b9d28c24ccb6\") " pod="openshift-network-diagnostics/network-check-target-7sgj5"
Sep 09 13:27:02.523981 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:27:02.523963    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 13:27:02.524053 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:27:02.523986    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 13:27:02.524053 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:27:02.523996    2578 projected.go:196] Error preparing data for projected volume kube-api-access-8gql4 for pod openshift-network-diagnostics/network-check-target-7sgj5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 13:27:02.524053 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:27:02.524053    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/298d53a7-1f9e-450d-afef-b9d28c24ccb6-kube-api-access-8gql4 podName:298d53a7-1f9e-450d-afef-b9d28c24ccb6 nodeName:}" failed. No retries permitted until 2026-09-09 13:27:34.524038294 +0000 UTC m=+66.339562466 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-8gql4" (UniqueName: "kubernetes.io/projected/298d53a7-1f9e-450d-afef-b9d28c24ccb6-kube-api-access-8gql4") pod "network-check-target-7sgj5" (UID: "298d53a7-1f9e-450d-afef-b9d28c24ccb6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 13:27:03.655338 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:03.655306    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7sgj5"
Sep 09 13:27:03.655878 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:03.655435    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8p6d"
Sep 09 13:27:03.655878 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:27:03.655443    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7sgj5" podUID="298d53a7-1f9e-450d-afef-b9d28c24ccb6"
Sep 09 13:27:03.655878 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:03.655471    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zqjnb"
Sep 09 13:27:03.655878 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:27:03.655568    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l8p6d" podUID="94d06480-f6e0-4f65-9567-c9b9760aeb8a"
Sep 09 13:27:03.655878 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:27:03.655683    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zqjnb" podUID="4f418699-7dc7-4c31-b9b1-e5612f362ce2"
Sep 09 13:27:05.028023 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:05.027986    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-192.ec2.internal" event="NodeReady"
Sep 09 13:27:05.028432 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:05.028123    2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 09 13:27:05.547878 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:05.547844    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:05.654446 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:05.654413    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7sgj5"
Sep 09 13:27:05.654629 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:05.654413    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8p6d"
Sep 09 13:27:05.654733 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:05.654413    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zqjnb"
Sep 09 13:27:05.665326 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:05.665304    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 09 13:27:05.665439 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:05.665340    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 09 13:27:05.665439 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:05.665382    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 09 13:27:05.665439 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:05.665411    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zpj6j\""
Sep 09 13:27:05.665705 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:05.665621    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ps8jz\""
Sep 09 13:27:05.665705 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:05.665698    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 09 13:27:07.894923 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:07.894715    2578 generic.go:356] "Generic (PLEG): container finished" podID="47856a84-ddb7-437b-af1a-aa2e9f06bf23" containerID="8f4c159c097f2edd8736b848e4702cc98641cf2acdb76ed5452278fde535aed8" exitCode=0
Sep 09 13:27:07.894923 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:07.894786    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6kn8w" event={"ID":"47856a84-ddb7-437b-af1a-aa2e9f06bf23","Type":"ContainerDied","Data":"8f4c159c097f2edd8736b848e4702cc98641cf2acdb76ed5452278fde535aed8"}
Sep 09 13:27:08.811540 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:08.811504    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:08.900545 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:08.900510    2578 generic.go:356] "Generic (PLEG): container finished" podID="47856a84-ddb7-437b-af1a-aa2e9f06bf23" containerID="b671942eab114a988f159033d633634480fb32c9dd0e9169b4b0213ea776084d" exitCode=0
Sep 09 13:27:08.901110 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:08.900569    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6kn8w" event={"ID":"47856a84-ddb7-437b-af1a-aa2e9f06bf23","Type":"ContainerDied","Data":"b671942eab114a988f159033d633634480fb32c9dd0e9169b4b0213ea776084d"}
Sep 09 13:27:09.010618 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:09.010585    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:09.194487 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:09.194459    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:09.391893 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:09.391866    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:09.582306 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:09.582231    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:09.748379 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:09.748344    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:09.905889 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:09.905853    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6kn8w" event={"ID":"47856a84-ddb7-437b-af1a-aa2e9f06bf23","Type":"ContainerStarted","Data":"f461ce285386bb3030ff3f679a71ef3217c15310c8e5780b3bd8930f882e8dff"}
Sep 09 13:27:09.988331 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:09.988277    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-6kn8w" podStartSLOduration=8.619264624 podStartE2EDuration="40.988260754s" totalImagesPullingTime="32.36899613s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 13:26:29 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 13:27:09.987086531 +0000 UTC m=+41.802610725" watchObservedRunningTime="2026-09-09 13:27:09.988260754 +0000 UTC m=+41.803784975"
Sep 09 13:27:10.110273 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:10.110240    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:10.670130 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:10.670098    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:10.826889 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:10.826856    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:11.004040 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:11.003963    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:11.405487 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:11.405458    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:11.802391 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:11.802315    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:12.001332 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:12.001299    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:12.259042 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:12.259011    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:12.404989 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:12.404958    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:12.913565 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:12.913533    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:13.077360 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:13.077326    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:13.201315 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:13.201231    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:13.585360 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:13.585276    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:13.817942 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:13.817906    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:13.921123 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:13.921093    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:15.373033 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:15.373002    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:15.477352 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:15.477314    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:15.760023 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:15.759942    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:15.860937 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:15.860907    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:15.985374 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:15.985345    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:16.412248 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:16.412218    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:16.972510 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:16.972478    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:17.369934 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:17.369851    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:17.808149 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:17.808114    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:18.176695 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:18.176666    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:18.375022 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:18.374993    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:19.036222 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:19.036190    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:19.228439 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:19.228410    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:19.383231 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:19.383203    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:19.597676 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:19.597642    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:21.055917 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:21.055879    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:21.763376 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:21.763344    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:21.841403 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:21.841365    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:29.891840 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:29.891812    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qf468"
Sep 09 13:27:30.690992 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:30.690952    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-kflpw"]
Sep 09 13:27:30.693676 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:30.693653    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kflpw"
Sep 09 13:27:30.699852 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:30.699831    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 09 13:27:30.699976 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:30.699888    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 09 13:27:30.700122 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:30.700107    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ckz5q\""
Sep 09 13:27:30.712771 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:30.712751    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-gnb8t"]
Sep 09 13:27:30.714572 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:30.714554    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gnb8t"
Sep 09 13:27:30.724387 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:30.724367    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 09 13:27:30.724559 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:30.724540    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 09 13:27:30.724622 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:30.724582    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 09 13:27:30.724801 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:30.724784    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jg6wc\""
Sep 09 13:27:30.725369 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:30.725351    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 09 13:27:30.736917 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:30.736894    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kflpw"]
Sep 09 13:27:30.742286 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:30.742264    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gnb8t"]
Sep 09 13:27:30.805998 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:30.805970    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-mqjtn"]
Sep 09 13:27:30.807704 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:30.807688    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mqjtn"
Sep 09 13:27:30.812054 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:30.812032    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 09 13:27:30.812854 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:30.812836    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 09 13:27:30.812965 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:30.812947    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 09 13:27:30.813081 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:30.813065    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-kmkp6\""
Sep 09 13:27:30.815904 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:30.815884    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-749b4b959d-cnp69"]
Sep 09 13:27:30.817737 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:30.817702    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:30.817858 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:30.817752    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-749b4b959d-cnp69"
Sep 09 13:27:30.817922 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:30.817856    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/031e931e-9ee2-4cb0-8a7d-3dba0ce0c96b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gnb8t\" (UID: \"031e931e-9ee2-4cb0-8a7d-3dba0ce0c96b\") " pod="openshift-insights/insights-runtime-extractor-gnb8t"
Sep 09 13:27:30.817922 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:30.817901    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jflvt\" (UniqueName: \"kubernetes.io/projected/03af7327-8417-4d97-9c3c-cdf5be497be8-kube-api-access-jflvt\") pod \"dns-default-kflpw\" (UID: \"03af7327-8417-4d97-9c3c-cdf5be497be8\") " pod="openshift-dns/dns-default-kflpw"
Sep 09 13:27:30.818028 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:30.817933    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xx8vq\" (UniqueName: \"kubernetes.io/projected/031e931e-9ee2-4cb0-8a7d-3dba0ce0c96b-kube-api-access-xx8vq\") pod \"insights-runtime-extractor-gnb8t\" (UID: \"031e931e-9ee2-4cb0-8a7d-3dba0ce0c96b\") " pod="openshift-insights/insights-runtime-extractor-gnb8t"
Sep 09 13:27:30.818028 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:30.817964    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/031e931e-9ee2-4cb0-8a7d-3dba0ce0c96b-data-volume\") pod \"insights-runtime-extractor-gnb8t\" (UID: \"031e931e-9ee2-4cb0-8a7d-3dba0ce0c96b\") " pod="openshift-insights/insights-runtime-extractor-gnb8t"
Sep 09 13:27:30.818097 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:30.818073    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/031e931e-9ee2-4cb0-8a7d-3dba0ce0c96b-crio-socket\") pod \"insights-runtime-extractor-gnb8t\" (UID: \"031e931e-9ee2-4cb0-8a7d-3dba0ce0c96b\") " pod="openshift-insights/insights-runtime-extractor-gnb8t"
Sep 09 13:27:30.818148 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:30.818098    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/03af7327-8417-4d97-9c3c-cdf5be497be8-metrics-tls\") pod \"dns-default-kflpw\" (UID: \"03af7327-8417-4d97-9c3c-cdf5be497be8\") " pod="openshift-dns/dns-default-kflpw"
Sep 09 13:27:30.818148 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:30.818118    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/031e931e-9ee2-4cb0-8a7d-3dba0ce0c96b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gnb8t\" (UID: \"031e931e-9ee2-4cb0-8a7d-3dba0ce0c96b\") " pod="openshift-insights/insights-runtime-extractor-gnb8t"
Sep 09 13:27:30.818245 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:30.818190    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/03af7327-8417-4d97-9c3c-cdf5be497be8-config-volume\") pod \"dns-default-kflpw\" (UID: \"03af7327-8417-4d97-9c3c-cdf5be497be8\") " pod="openshift-dns/dns-default-kflpw"
Sep 09 13:27:30.818245 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:30.818224    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03af7327-8417-4d97-9c3c-cdf5be497be8-tmp-dir\") pod \"dns-default-kflpw\" (UID: \"03af7327-8417-4d97-9c3c-cdf5be497be8\") " pod="openshift-dns/dns-default-kflpw"
Sep 09 13:27:30.823520 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:30.823501    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 09 13:27:30.824440 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:27:30.824416    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"registry-dockercfg-4wzf7\" is forbidden: User \"system:node:ip-10-0-135-192.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-image-registry\": no relationship found between node 'ip-10-0-135-192.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4wzf7\"" type="*v1.Secret"
Sep 09 13:27:30.827362 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:27:30.827338    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"image-registry-private-configuration\" is forbidden: User \"system:node:ip-10-0-135-192.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-image-registry\": no relationship found between node 'ip-10-0-135-192.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" type="*v1.Secret"
Sep 09 13:27:30.827895 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:30.827876    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 09 13:27:30.830588 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:30.830559    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 09 13:27:30.832617 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:30.832596    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mqjtn"]
Sep 09 13:27:30.851218 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:30.851197    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-749b4b959d-cnp69"]
Sep 09 13:27:30.918832 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:30.918798    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d1143c2d-590c-4cfc-a2fa-1cf0094ea60a-ca-trust-extracted\") pod \"image-registry-749b4b959d-cnp69\" (UID: \"d1143c2d-590c-4cfc-a2fa-1cf0094ea60a\") " pod="openshift-image-registry/image-registry-749b4b959d-cnp69"
Sep 09 13:27:30.918832 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:30.918831    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d1143c2d-590c-4cfc-a2fa-1cf0094ea60a-bound-sa-token\") pod \"image-registry-749b4b959d-cnp69\" (UID: \"d1143c2d-590c-4cfc-a2fa-1cf0094ea60a\") " pod="openshift-image-registry/image-registry-749b4b959d-cnp69"
Sep 09 13:27:30.919323 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:30.918850    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2r7k\" (UniqueName: \"kubernetes.io/projected/d1143c2d-590c-4cfc-a2fa-1cf0094ea60a-kube-api-access-z2r7k\") pod \"image-registry-749b4b959d-cnp69\" (UID: \"d1143c2d-590c-4cfc-a2fa-1cf0094ea60a\") " pod="openshift-image-registry/image-registry-749b4b959d-cnp69"
Sep 09 13:27:30.919323 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:30.918889    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7b82458b-86a1-4247-9d77-58bad446ae15-cert\") pod \"ingress-canary-mqjtn\" (UID: \"7b82458b-86a1-4247-9d77-58bad446ae15\") " pod="openshift-ingress-canary/ingress-canary-mqjtn"
Sep 09 13:27:30.919323 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:30.918916    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d1143c2d-590c-4cfc-a2fa-1cf0094ea60a-trusted-ca\") pod \"image-registry-749b4b959d-cnp69\" (UID: \"d1143c2d-590c-4cfc-a2fa-1cf0094ea60a\") " pod="openshift-image-registry/image-registry-749b4b959d-cnp69"
Sep 09 13:27:30.919323 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:30.918943    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d1143c2d-590c-4cfc-a2fa-1cf0094ea60a-installation-pull-secrets\") pod \"image-registry-749b4b959d-cnp69\" (UID: \"d1143c2d-590c-4cfc-a2fa-1cf0094ea60a\") " pod="openshift-image-registry/image-registry-749b4b959d-cnp69"
Sep 09 13:27:30.919323 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:30.918999    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/031e931e-9ee2-4cb0-8a7d-3dba0ce0c96b-crio-socket\") pod \"insights-runtime-extractor-gnb8t\" (UID: \"031e931e-9ee2-4cb0-8a7d-3dba0ce0c96b\") " pod="openshift-insights/insights-runtime-extractor-gnb8t"
Sep 09 13:27:30.919323 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:30.919017    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d1143c2d-590c-4cfc-a2fa-1cf0094ea60a-image-registry-private-configuration\") pod \"image-registry-749b4b959d-cnp69\" (UID: \"d1143c2d-590c-4cfc-a2fa-1cf0094ea60a\") " pod="openshift-image-registry/image-registry-749b4b959d-cnp69"
Sep 09 13:27:30.919323 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:30.919035    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/03af7327-8417-4d97-9c3c-cdf5be497be8-metrics-tls\") pod \"dns-default-kflpw\" (UID: \"03af7327-8417-4d97-9c3c-cdf5be497be8\") " pod="openshift-dns/dns-default-kflpw"
Sep 09 13:27:30.919323 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:30.919053    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/031e931e-9ee2-4cb0-8a7d-3dba0ce0c96b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gnb8t\" (UID: \"031e931e-9ee2-4cb0-8a7d-3dba0ce0c96b\") " pod="openshift-insights/insights-runtime-extractor-gnb8t"
Sep 09 13:27:30.919323 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:30.919069    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/03af7327-8417-4d97-9c3c-cdf5be497be8-config-volume\") pod \"dns-default-kflpw\" (UID: \"03af7327-8417-4d97-9c3c-cdf5be497be8\") " pod="openshift-dns/dns-default-kflpw"
Sep 09 13:27:30.919323 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:30.919085    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03af7327-8417-4d97-9c3c-cdf5be497be8-tmp-dir\") pod \"dns-default-kflpw\" (UID: \"03af7327-8417-4d97-9c3c-cdf5be497be8\") " pod="openshift-dns/dns-default-kflpw"
Sep 09 13:27:30.919323 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:30.919123    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/031e931e-9ee2-4cb0-8a7d-3dba0ce0c96b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gnb8t\" (UID: \"031e931e-9ee2-4cb0-8a7d-3dba0ce0c96b\") " pod="openshift-insights/insights-runtime-extractor-gnb8t"
Sep 09 13:27:30.919323 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:30.919138    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/031e931e-9ee2-4cb0-8a7d-3dba0ce0c96b-crio-socket\") pod \"insights-runtime-extractor-gnb8t\" (UID: \"031e931e-9ee2-4cb0-8a7d-3dba0ce0c96b\") " pod="openshift-insights/insights-runtime-extractor-gnb8t"
Sep 09 13:27:30.919323 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:30.919208    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d1143c2d-590c-4cfc-a2fa-1cf0094ea60a-registry-tls\") pod \"image-registry-749b4b959d-cnp69\" (UID: \"d1143c2d-590c-4cfc-a2fa-1cf0094ea60a\") " pod="openshift-image-registry/image-registry-749b4b959d-cnp69"
Sep 09 13:27:30.919323 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:30.919254    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jflvt\" (UniqueName: \"kubernetes.io/projected/03af7327-8417-4d97-9c3c-cdf5be497be8-kube-api-access-jflvt\") pod \"dns-default-kflpw\" (UID: \"03af7327-8417-4d97-9c3c-cdf5be497be8\") " pod="openshift-dns/dns-default-kflpw"
Sep 09 13:27:30.919323 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:30.919286    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xx8vq\" (UniqueName: \"kubernetes.io/projected/031e931e-9ee2-4cb0-8a7d-3dba0ce0c96b-kube-api-access-xx8vq\") pod \"insights-runtime-extractor-gnb8t\" (UID: \"031e931e-9ee2-4cb0-8a7d-3dba0ce0c96b\") " pod="openshift-insights/insights-runtime-extractor-gnb8t"
Sep 09 13:27:30.919323 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:30.919317    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d1143c2d-590c-4cfc-a2fa-1cf0094ea60a-registry-certificates\") pod \"image-registry-749b4b959d-cnp69\" (UID: \"d1143c2d-590c-4cfc-a2fa-1cf0094ea60a\") " pod="openshift-image-registry/image-registry-749b4b959d-cnp69"
Sep 09 13:27:30.919974 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:30.919345    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/031e931e-9ee2-4cb0-8a7d-3dba0ce0c96b-data-volume\") pod \"insights-runtime-extractor-gnb8t\" (UID: \"031e931e-9ee2-4cb0-8a7d-3dba0ce0c96b\") " pod="openshift-insights/insights-runtime-extractor-gnb8t"
Sep 09 13:27:30.919974 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:30.919371    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7v6zd\" (UniqueName: \"kubernetes.io/projected/7b82458b-86a1-4247-9d77-58bad446ae15-kube-api-access-7v6zd\") pod \"ingress-canary-mqjtn\" (UID: \"7b82458b-86a1-4247-9d77-58bad446ae15\") " pod="openshift-ingress-canary/ingress-canary-mqjtn"
Sep 09 13:27:30.919974 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:30.919485    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03af7327-8417-4d97-9c3c-cdf5be497be8-tmp-dir\") pod \"dns-default-kflpw\" (UID: \"03af7327-8417-4d97-9c3c-cdf5be497be8\") " pod="openshift-dns/dns-default-kflpw"
Sep 09 13:27:30.919974 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:30.919747    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/031e931e-9ee2-4cb0-8a7d-3dba0ce0c96b-data-volume\") pod \"insights-runtime-extractor-gnb8t\" (UID: \"031e931e-9ee2-4cb0-8a7d-3dba0ce0c96b\") " pod="openshift-insights/insights-runtime-extractor-gnb8t"
Sep 09 13:27:30.919974 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:30.919752    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/03af7327-8417-4d97-9c3c-cdf5be497be8-config-volume\") pod \"dns-default-kflpw\" (UID: \"03af7327-8417-4d97-9c3c-cdf5be497be8\") " pod="openshift-dns/dns-default-kflpw"
Sep 09 13:27:30.919974 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:30.919755    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/031e931e-9ee2-4cb0-8a7d-3dba0ce0c96b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gnb8t\" (UID: \"031e931e-9ee2-4cb0-8a7d-3dba0ce0c96b\") " pod="openshift-insights/insights-runtime-extractor-gnb8t"
Sep 09 13:27:30.922875 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:30.922855    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/031e931e-9ee2-4cb0-8a7d-3dba0ce0c96b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gnb8t\" (UID: \"031e931e-9ee2-4cb0-8a7d-3dba0ce0c96b\") " pod="openshift-insights/insights-runtime-extractor-gnb8t"
Sep 09 13:27:30.922968 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:30.922921    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/03af7327-8417-4d97-9c3c-cdf5be497be8-metrics-tls\") pod \"dns-default-kflpw\" (UID: \"03af7327-8417-4d97-9c3c-cdf5be497be8\") " pod="openshift-dns/dns-default-kflpw"
Sep 09 13:27:30.931168 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:30.931143    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jflvt\" (UniqueName: \"kubernetes.io/projected/03af7327-8417-4d97-9c3c-cdf5be497be8-kube-api-access-jflvt\") pod \"dns-default-kflpw\" (UID: \"03af7327-8417-4d97-9c3c-cdf5be497be8\") " pod="openshift-dns/dns-default-kflpw"
Sep 09 13:27:30.931736 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:30.931708    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xx8vq\" (UniqueName: \"kubernetes.io/projected/031e931e-9ee2-4cb0-8a7d-3dba0ce0c96b-kube-api-access-xx8vq\") pod \"insights-runtime-extractor-gnb8t\" (UID: \"031e931e-9ee2-4cb0-8a7d-3dba0ce0c96b\") " pod="openshift-insights/insights-runtime-extractor-gnb8t"
Sep 09 13:27:30.955985 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:30.955927    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:31.002067 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:31.002029    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kflpw"
Sep 09 13:27:31.020367 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:31.020339    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7v6zd\" (UniqueName: \"kubernetes.io/projected/7b82458b-86a1-4247-9d77-58bad446ae15-kube-api-access-7v6zd\") pod \"ingress-canary-mqjtn\" (UID: \"7b82458b-86a1-4247-9d77-58bad446ae15\") " pod="openshift-ingress-canary/ingress-canary-mqjtn"
Sep 09 13:27:31.020456 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:31.020376    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d1143c2d-590c-4cfc-a2fa-1cf0094ea60a-ca-trust-extracted\") pod \"image-registry-749b4b959d-cnp69\" (UID: \"d1143c2d-590c-4cfc-a2fa-1cf0094ea60a\") " pod="openshift-image-registry/image-registry-749b4b959d-cnp69"
Sep 09 13:27:31.020456 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:31.020399    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d1143c2d-590c-4cfc-a2fa-1cf0094ea60a-bound-sa-token\") pod \"image-registry-749b4b959d-cnp69\" (UID: \"d1143c2d-590c-4cfc-a2fa-1cf0094ea60a\") " pod="openshift-image-registry/image-registry-749b4b959d-cnp69"
Sep 09 13:27:31.020456 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:31.020424    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2r7k\" (UniqueName: \"kubernetes.io/projected/d1143c2d-590c-4cfc-a2fa-1cf0094ea60a-kube-api-access-z2r7k\") pod \"image-registry-749b4b959d-cnp69\" (UID: \"d1143c2d-590c-4cfc-a2fa-1cf0094ea60a\") " pod="openshift-image-registry/image-registry-749b4b959d-cnp69"
Sep 09 13:27:31.020643 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:31.020609    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7b82458b-86a1-4247-9d77-58bad446ae15-cert\") pod \"ingress-canary-mqjtn\" (UID: \"7b82458b-86a1-4247-9d77-58bad446ae15\") " pod="openshift-ingress-canary/ingress-canary-mqjtn"
Sep 09 13:27:31.020770 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:31.020650    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d1143c2d-590c-4cfc-a2fa-1cf0094ea60a-trusted-ca\") pod \"image-registry-749b4b959d-cnp69\" (UID: \"d1143c2d-590c-4cfc-a2fa-1cf0094ea60a\") " pod="openshift-image-registry/image-registry-749b4b959d-cnp69"
Sep 09 13:27:31.020770 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:31.020676    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d1143c2d-590c-4cfc-a2fa-1cf0094ea60a-installation-pull-secrets\") pod \"image-registry-749b4b959d-cnp69\" (UID: \"d1143c2d-590c-4cfc-a2fa-1cf0094ea60a\") " pod="openshift-image-registry/image-registry-749b4b959d-cnp69"
Sep 09 13:27:31.020770 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:31.020747    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d1143c2d-590c-4cfc-a2fa-1cf0094ea60a-ca-trust-extracted\") pod \"image-registry-749b4b959d-cnp69\" (UID: \"d1143c2d-590c-4cfc-a2fa-1cf0094ea60a\") " pod="openshift-image-registry/image-registry-749b4b959d-cnp69"
Sep 09 13:27:31.020770 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:31.020760    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d1143c2d-590c-4cfc-a2fa-1cf0094ea60a-image-registry-private-configuration\") pod \"image-registry-749b4b959d-cnp69\" (UID: \"d1143c2d-590c-4cfc-a2fa-1cf0094ea60a\") " pod="openshift-image-registry/image-registry-749b4b959d-cnp69"
Sep 09 13:27:31.020953 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:31.020889    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d1143c2d-590c-4cfc-a2fa-1cf0094ea60a-registry-tls\") pod \"image-registry-749b4b959d-cnp69\" (UID: \"d1143c2d-590c-4cfc-a2fa-1cf0094ea60a\") " pod="openshift-image-registry/image-registry-749b4b959d-cnp69"
Sep 09 13:27:31.020953 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:31.020945    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d1143c2d-590c-4cfc-a2fa-1cf0094ea60a-registry-certificates\") pod \"image-registry-749b4b959d-cnp69\" (UID: \"d1143c2d-590c-4cfc-a2fa-1cf0094ea60a\") " pod="openshift-image-registry/image-registry-749b4b959d-cnp69"
Sep 09 13:27:31.021687 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:31.021659    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d1143c2d-590c-4cfc-a2fa-1cf0094ea60a-trusted-ca\") pod \"image-registry-749b4b959d-cnp69\" (UID: \"d1143c2d-590c-4cfc-a2fa-1cf0094ea60a\") " pod="openshift-image-registry/image-registry-749b4b959d-cnp69"
Sep 09 13:27:31.021792 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:31.021690    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d1143c2d-590c-4cfc-a2fa-1cf0094ea60a-registry-certificates\") pod \"image-registry-749b4b959d-cnp69\" (UID: \"d1143c2d-590c-4cfc-a2fa-1cf0094ea60a\") " pod="openshift-image-registry/image-registry-749b4b959d-cnp69"
Sep 09 13:27:31.021792 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:31.021765    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gnb8t"
Sep 09 13:27:31.023115 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:31.023094    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d1143c2d-590c-4cfc-a2fa-1cf0094ea60a-installation-pull-secrets\") pod \"image-registry-749b4b959d-cnp69\" (UID: \"d1143c2d-590c-4cfc-a2fa-1cf0094ea60a\") " pod="openshift-image-registry/image-registry-749b4b959d-cnp69"
Sep 09 13:27:31.023388 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:31.023370    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d1143c2d-590c-4cfc-a2fa-1cf0094ea60a-registry-tls\") pod \"image-registry-749b4b959d-cnp69\" (UID: \"d1143c2d-590c-4cfc-a2fa-1cf0094ea60a\") " pod="openshift-image-registry/image-registry-749b4b959d-cnp69"
Sep 09 13:27:31.023467 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:31.023369    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7b82458b-86a1-4247-9d77-58bad446ae15-cert\") pod \"ingress-canary-mqjtn\" (UID: \"7b82458b-86a1-4247-9d77-58bad446ae15\") " pod="openshift-ingress-canary/ingress-canary-mqjtn"
Sep 09 13:27:31.036261 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:31.036237    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7v6zd\" (UniqueName: \"kubernetes.io/projected/7b82458b-86a1-4247-9d77-58bad446ae15-kube-api-access-7v6zd\") pod \"ingress-canary-mqjtn\" (UID: \"7b82458b-86a1-4247-9d77-58bad446ae15\") " pod="openshift-ingress-canary/ingress-canary-mqjtn"
Sep 09 13:27:31.036545 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:31.036521    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d1143c2d-590c-4cfc-a2fa-1cf0094ea60a-bound-sa-token\") pod \"image-registry-749b4b959d-cnp69\" (UID: \"d1143c2d-590c-4cfc-a2fa-1cf0094ea60a\") " pod="openshift-image-registry/image-registry-749b4b959d-cnp69"
Sep 09 13:27:31.036595 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:31.036581    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2r7k\" (UniqueName: \"kubernetes.io/projected/d1143c2d-590c-4cfc-a2fa-1cf0094ea60a-kube-api-access-z2r7k\") pod \"image-registry-749b4b959d-cnp69\" (UID: \"d1143c2d-590c-4cfc-a2fa-1cf0094ea60a\") " pod="openshift-image-registry/image-registry-749b4b959d-cnp69"
Sep 09 13:27:31.076014 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:31.075978    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:31.116098 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:31.116068    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mqjtn"
Sep 09 13:27:31.192592 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:31.192560    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:31.299324 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:31.299243    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kflpw"]
Sep 09 13:27:31.305027 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:27:31.305000    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03af7327_8417_4d97_9c3c_cdf5be497be8.slice/crio-74bebf270d785e3dd2614c2e3238cd0d97b10a4ead2aac3fc6c0d67288f110af WatchSource:0}: Error finding container 74bebf270d785e3dd2614c2e3238cd0d97b10a4ead2aac3fc6c0d67288f110af: Status 404 returned error can't find the container with id 74bebf270d785e3dd2614c2e3238cd0d97b10a4ead2aac3fc6c0d67288f110af
Sep 09 13:27:31.328034 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:31.327999    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gnb8t"]
Sep 09 13:27:31.332806 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:27:31.332778    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod031e931e_9ee2_4cb0_8a7d_3dba0ce0c96b.slice/crio-ce0663b2f8a409ee44a14c3fa123050f8904672a576376e7394f15b33a877ac4 WatchSource:0}: Error finding container ce0663b2f8a409ee44a14c3fa123050f8904672a576376e7394f15b33a877ac4: Status 404 returned error can't find the container with id ce0663b2f8a409ee44a14c3fa123050f8904672a576376e7394f15b33a877ac4
Sep 09 13:27:31.388310 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:31.388284    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mqjtn"]
Sep 09 13:27:31.391388 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:27:31.391366    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b82458b_86a1_4247_9d77_58bad446ae15.slice/crio-04fdfc86d27efaf3a63771b8458a6fd47b16a788eced132899e20e64b67a6127 WatchSource:0}: Error finding container 04fdfc86d27efaf3a63771b8458a6fd47b16a788eced132899e20e64b67a6127: Status 404 returned error can't find the container with id 04fdfc86d27efaf3a63771b8458a6fd47b16a788eced132899e20e64b67a6127
Sep 09 13:27:31.631408 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:31.631383    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4wzf7\""
Sep 09 13:27:31.955149 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:31.955128    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 09 13:27:31.958426 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:31.958404    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kflpw" event={"ID":"03af7327-8417-4d97-9c3c-cdf5be497be8","Type":"ContainerStarted","Data":"74bebf270d785e3dd2614c2e3238cd0d97b10a4ead2aac3fc6c0d67288f110af"}
Sep 09 13:27:31.959493 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:31.959472    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mqjtn" event={"ID":"7b82458b-86a1-4247-9d77-58bad446ae15","Type":"ContainerStarted","Data":"04fdfc86d27efaf3a63771b8458a6fd47b16a788eced132899e20e64b67a6127"}
Sep 09 13:27:31.960955 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:31.960934    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gnb8t" event={"ID":"031e931e-9ee2-4cb0-8a7d-3dba0ce0c96b","Type":"ContainerStarted","Data":"e28605c71ff12a85f67a04376fa736e7552166a7841e9fe5e53de0a104552865"}
Sep 09 13:27:31.961068 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:31.960977    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gnb8t" event={"ID":"031e931e-9ee2-4cb0-8a7d-3dba0ce0c96b","Type":"ContainerStarted","Data":"ce0663b2f8a409ee44a14c3fa123050f8904672a576376e7394f15b33a877ac4"}
Sep 09 13:27:31.963156 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:31.963136    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d1143c2d-590c-4cfc-a2fa-1cf0094ea60a-image-registry-private-configuration\") pod \"image-registry-749b4b959d-cnp69\" (UID: \"d1143c2d-590c-4cfc-a2fa-1cf0094ea60a\") " pod="openshift-image-registry/image-registry-749b4b959d-cnp69"
Sep 09 13:27:32.025328 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:32.025301    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-749b4b959d-cnp69"
Sep 09 13:27:32.314099 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:32.314021    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-749b4b959d-cnp69"]
Sep 09 13:27:32.317499 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:27:32.317466    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1143c2d_590c_4cfc_a2fa_1cf0094ea60a.slice/crio-84047840d82dc00a5fd21f6dea7a689bafcc1c9028736d5806209058b05f4856 WatchSource:0}: Error finding container 84047840d82dc00a5fd21f6dea7a689bafcc1c9028736d5806209058b05f4856: Status 404 returned error can't find the container with id 84047840d82dc00a5fd21f6dea7a689bafcc1c9028736d5806209058b05f4856
Sep 09 13:27:32.965003 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:32.964966    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gnb8t" event={"ID":"031e931e-9ee2-4cb0-8a7d-3dba0ce0c96b","Type":"ContainerStarted","Data":"dc0593cdbabf0080dc637a279cd3a6ec084fcf2c78b6dd614537126bdea14f3d"}
Sep 09 13:27:32.966342 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:32.966320    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-749b4b959d-cnp69" event={"ID":"d1143c2d-590c-4cfc-a2fa-1cf0094ea60a","Type":"ContainerStarted","Data":"2b195047bfb4a0aae0e352cad2ea119e1fe178bbb401828fe8326fe54e0dac1b"}
Sep 09 13:27:32.966428 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:32.966362    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-749b4b959d-cnp69" event={"ID":"d1143c2d-590c-4cfc-a2fa-1cf0094ea60a","Type":"ContainerStarted","Data":"84047840d82dc00a5fd21f6dea7a689bafcc1c9028736d5806209058b05f4856"}
Sep 09 13:27:32.966475 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:32.966447    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-749b4b959d-cnp69"
Sep 09 13:27:32.989086 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:32.988993    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-749b4b959d-cnp69" podStartSLOduration=2.988974051 podStartE2EDuration="2.988974051s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 13:27:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 13:27:32.987715964 +0000 UTC m=+64.803240157" watchObservedRunningTime="2026-09-09 13:27:32.988974051 +0000 UTC m=+64.804498247"
Sep 09 13:27:34.350189 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:34.350148    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94d06480-f6e0-4f65-9567-c9b9760aeb8a-metrics-certs\") pod \"network-metrics-daemon-l8p6d\" (UID: \"94d06480-f6e0-4f65-9567-c9b9760aeb8a\") " pod="openshift-multus/network-metrics-daemon-l8p6d"
Sep 09 13:27:34.354207 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:34.354164    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 09 13:27:34.363487 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:34.363461    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94d06480-f6e0-4f65-9567-c9b9760aeb8a-metrics-certs\") pod \"network-metrics-daemon-l8p6d\" (UID: \"94d06480-f6e0-4f65-9567-c9b9760aeb8a\") " pod="openshift-multus/network-metrics-daemon-l8p6d"
Sep 09 13:27:34.450795 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:34.450632    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4f418699-7dc7-4c31-b9b1-e5612f362ce2-original-pull-secret\") pod \"global-pull-secret-syncer-zqjnb\" (UID: \"4f418699-7dc7-4c31-b9b1-e5612f362ce2\") " pod="kube-system/global-pull-secret-syncer-zqjnb"
Sep 09 13:27:34.453457 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:34.453433    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 09 13:27:34.464111 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:34.464087    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4f418699-7dc7-4c31-b9b1-e5612f362ce2-original-pull-secret\") pod \"global-pull-secret-syncer-zqjnb\" (UID: \"4f418699-7dc7-4c31-b9b1-e5612f362ce2\") " pod="kube-system/global-pull-secret-syncer-zqjnb"
Sep 09 13:27:34.474918 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:34.474892    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zpj6j\""
Sep 09 13:27:34.478009 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:34.477985    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zqjnb"
Sep 09 13:27:34.482917 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:34.482886    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l8p6d"
Sep 09 13:27:34.551674 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:34.551649    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gql4\" (UniqueName: \"kubernetes.io/projected/298d53a7-1f9e-450d-afef-b9d28c24ccb6-kube-api-access-8gql4\") pod \"network-check-target-7sgj5\" (UID: \"298d53a7-1f9e-450d-afef-b9d28c24ccb6\") " pod="openshift-network-diagnostics/network-check-target-7sgj5"
Sep 09 13:27:34.554587 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:34.554551    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 09 13:27:34.564988 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:34.564966    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 09 13:27:34.575726 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:34.575690    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gql4\" (UniqueName: \"kubernetes.io/projected/298d53a7-1f9e-450d-afef-b9d28c24ccb6-kube-api-access-8gql4\") pod \"network-check-target-7sgj5\" (UID: \"298d53a7-1f9e-450d-afef-b9d28c24ccb6\") " pod="openshift-network-diagnostics/network-check-target-7sgj5"
Sep 09 13:27:34.759335 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:34.759252    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zqjnb"]
Sep 09 13:27:34.762381 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:27:34.762354    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f418699_7dc7_4c31_b9b1_e5612f362ce2.slice/crio-5884e9a4ad5856342386c9a3c0ce9fa63853dd87b5ef57223386908885594822 WatchSource:0}: Error finding container 5884e9a4ad5856342386c9a3c0ce9fa63853dd87b5ef57223386908885594822: Status 404 returned error can't find the container with id 5884e9a4ad5856342386c9a3c0ce9fa63853dd87b5ef57223386908885594822
Sep 09 13:27:34.767305 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:34.767284    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ps8jz\""
Sep 09 13:27:34.768587 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:34.768547    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-l8p6d"]
Sep 09 13:27:34.771666 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:27:34.771644    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94d06480_f6e0_4f65_9567_c9b9760aeb8a.slice/crio-4e97163778c55cb744753257391d660ae3327b44c047f9c2bce9f257872510d2 WatchSource:0}: Error finding container 4e97163778c55cb744753257391d660ae3327b44c047f9c2bce9f257872510d2: Status 404 returned error can't find the container with id 4e97163778c55cb744753257391d660ae3327b44c047f9c2bce9f257872510d2
Sep 09 13:27:34.776027 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:34.776000    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7sgj5"
Sep 09 13:27:34.975011 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:34.974975    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gnb8t" event={"ID":"031e931e-9ee2-4cb0-8a7d-3dba0ce0c96b","Type":"ContainerStarted","Data":"68f1f2fac1f218b23dfbaefc553abb4008b326e97bd3eb00534c367d89eefc6e"}
Sep 09 13:27:34.976320 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:34.976291    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zqjnb" event={"ID":"4f418699-7dc7-4c31-b9b1-e5612f362ce2","Type":"ContainerStarted","Data":"5884e9a4ad5856342386c9a3c0ce9fa63853dd87b5ef57223386908885594822"}
Sep 09 13:27:34.977944 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:34.977926    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mqjtn" event={"ID":"7b82458b-86a1-4247-9d77-58bad446ae15","Type":"ContainerStarted","Data":"f1ea1ece2db180f5f52ef3b0039d8b72aae9b2e993d9e82a39395d4750f2fd54"}
Sep 09 13:27:34.979194 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:34.979155    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l8p6d" event={"ID":"94d06480-f6e0-4f65-9567-c9b9760aeb8a","Type":"ContainerStarted","Data":"4e97163778c55cb744753257391d660ae3327b44c047f9c2bce9f257872510d2"}
Sep 09 13:27:34.994601 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:34.994542    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-gnb8t" podStartSLOduration=2.311971995 podStartE2EDuration="4.994522026s" totalImagesPullingTime="2.682550031s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 13:27:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 13:27:34.993930665 +0000 UTC m=+66.809454858" watchObservedRunningTime="2026-09-09 13:27:34.994522026 +0000 UTC m=+66.810046215"
Sep 09 13:27:35.047268 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:35.047004    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-mqjtn" podStartSLOduration=2.2837204460000002 podStartE2EDuration="5.046986511s" totalImagesPullingTime="2.763266065s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 13:27:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 13:27:35.011091733 +0000 UTC m=+66.826615928" watchObservedRunningTime="2026-09-09 13:27:35.046986511 +0000 UTC m=+66.862510707"
Sep 09 13:27:35.048357 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:35.048326    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7sgj5"]
Sep 09 13:27:35.346362 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:27:35.346296    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod298d53a7_1f9e_450d_afef_b9d28c24ccb6.slice/crio-62633ad28654bc799a36979ed4f509d7c715394f136c80d23121b6f83bb69bbf WatchSource:0}: Error finding container 62633ad28654bc799a36979ed4f509d7c715394f136c80d23121b6f83bb69bbf: Status 404 returned error can't find the container with id 62633ad28654bc799a36979ed4f509d7c715394f136c80d23121b6f83bb69bbf
Sep 09 13:27:35.856247 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:35.856165    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:35.923726 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:35.923691    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:35.989569 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:35.989519    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kflpw" event={"ID":"03af7327-8417-4d97-9c3c-cdf5be497be8","Type":"ContainerStarted","Data":"bf9bba12270bae000ca8d594d85250e3a7b9d817250aaf0d486e16345fcbf00f"}
Sep 09 13:27:35.989750 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:35.989622    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kflpw" event={"ID":"03af7327-8417-4d97-9c3c-cdf5be497be8","Type":"ContainerStarted","Data":"ad0fae5e185815950d1f16dde2d9089e2b6de6927085f8f83d8e9c1977b4cfca"}
Sep 09 13:27:35.989808 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:35.989792    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-kflpw"
Sep 09 13:27:35.991386 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:35.991354    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7sgj5" event={"ID":"298d53a7-1f9e-450d-afef-b9d28c24ccb6","Type":"ContainerStarted","Data":"62633ad28654bc799a36979ed4f509d7c715394f136c80d23121b6f83bb69bbf"}
Sep 09 13:27:36.020308 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:36.020237    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-kflpw" podStartSLOduration=1.957437456 podStartE2EDuration="6.020217579s" totalImagesPullingTime="4.062780123s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 13:27:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 13:27:36.019805118 +0000 UTC m=+67.835329315" watchObservedRunningTime="2026-09-09 13:27:36.020217579 +0000 UTC m=+67.835741774"
Sep 09 13:27:38.298615 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:38.298581    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-85d98c998f-xt7qr"]
Sep 09 13:27:38.300836 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:38.300819    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-xt7qr"
Sep 09 13:27:38.306124 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:38.306098    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 09 13:27:38.306676 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:38.306656    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-hn4vn\""
Sep 09 13:27:38.307045 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:38.307023    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 09 13:27:38.316452 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:38.316425    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-xt7qr"]
Sep 09 13:27:38.340498 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:38.340452    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:38.377687 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:38.377651    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzc2f\" (UniqueName: \"kubernetes.io/projected/b5cd0b68-2d59-4f9c-bca9-521ab995c7cd-kube-api-access-rzc2f\") pod \"downloads-85d98c998f-xt7qr\" (UID: \"b5cd0b68-2d59-4f9c-bca9-521ab995c7cd\") " pod="openshift-console/downloads-85d98c998f-xt7qr"
Sep 09 13:27:38.432808 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:38.432770    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:38.478699 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:38.478668    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzc2f\" (UniqueName: \"kubernetes.io/projected/b5cd0b68-2d59-4f9c-bca9-521ab995c7cd-kube-api-access-rzc2f\") pod \"downloads-85d98c998f-xt7qr\" (UID: \"b5cd0b68-2d59-4f9c-bca9-521ab995c7cd\") " pod="openshift-console/downloads-85d98c998f-xt7qr"
Sep 09 13:27:38.490205 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:38.490153    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzc2f\" (UniqueName: \"kubernetes.io/projected/b5cd0b68-2d59-4f9c-bca9-521ab995c7cd-kube-api-access-rzc2f\") pod \"downloads-85d98c998f-xt7qr\" (UID: \"b5cd0b68-2d59-4f9c-bca9-521ab995c7cd\") " pod="openshift-console/downloads-85d98c998f-xt7qr"
Sep 09 13:27:38.582376 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:38.582268    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:38.610783 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:38.610735    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-xt7qr"
Sep 09 13:27:38.804747 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:38.804702    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:38.933001 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:38.932968    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:39.048189 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:39.048137    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:39.153445 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:39.153415    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:39.252520 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:39.252414    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:39.354076 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:39.354043    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:39.456631 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:39.456592    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:39.549388 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:39.549302    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:39.764969 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:39.764934    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:39.853783 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:39.853754    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:40.009868 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:40.009836    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l8p6d" event={"ID":"94d06480-f6e0-4f65-9567-c9b9760aeb8a","Type":"ContainerStarted","Data":"9a484650af288eebea664242d61318a7d44a3291eb8e47e32f9b686f77d6bbe7"}
Sep 09 13:27:40.011444 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:40.011363    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7sgj5" event={"ID":"298d53a7-1f9e-450d-afef-b9d28c24ccb6","Type":"ContainerStarted","Data":"1d4e44f3d32931c82e7140f037c511c418a87c9138a362ea8d9459d291b0bafa"}
Sep 09 13:27:40.011572 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:40.011453    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7sgj5"
Sep 09 13:27:40.013289 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:40.013265    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zqjnb" event={"ID":"4f418699-7dc7-4c31-b9b1-e5612f362ce2","Type":"ContainerStarted","Data":"8f63dfdd0bb5bf53e38ea883f0d3fe564bf58ab83266b9f0d45c2c8dc726de23"}
Sep 09 13:27:40.031881 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:40.031832    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7sgj5" podStartSLOduration=66.51939258 podStartE2EDuration="1m11.031811516s" totalImagesPullingTime="4.512418936s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 13:26:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 13:27:40.031100507 +0000 UTC m=+71.846624701" watchObservedRunningTime="2026-09-09 13:27:40.031811516 +0000 UTC m=+71.847335721"
Sep 09 13:27:40.051948 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:40.051896    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-zqjnb" podStartSLOduration=65.951093196 podStartE2EDuration="1m11.051877138s" totalImagesPullingTime="5.100783942s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 13:26:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 13:27:40.051426953 +0000 UTC m=+71.866951148" watchObservedRunningTime="2026-09-09 13:27:40.051877138 +0000 UTC m=+71.867401356"
Sep 09 13:27:40.138893 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:40.138844    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-xt7qr"]
Sep 09 13:27:40.143938 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:27:40.143913    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5cd0b68_2d59_4f9c_bca9_521ab995c7cd.slice/crio-11bb479147db1cd188d7a9d7c44781db630898d5ca80413236949cfddf094939 WatchSource:0}: Error finding container 11bb479147db1cd188d7a9d7c44781db630898d5ca80413236949cfddf094939: Status 404 returned error can't find the container with id 11bb479147db1cd188d7a9d7c44781db630898d5ca80413236949cfddf094939
Sep 09 13:27:40.179278 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:40.179253    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:40.373472 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:40.373434    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:40.483345 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:40.483269    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:41.019135 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:41.019098    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l8p6d" event={"ID":"94d06480-f6e0-4f65-9567-c9b9760aeb8a","Type":"ContainerStarted","Data":"c863ca94912616ea36b6d87251c8b1e0ceaf6e95ddb04be66501185d283c8561"}
Sep 09 13:27:41.020505 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:41.020473    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-xt7qr" event={"ID":"b5cd0b68-2d59-4f9c-bca9-521ab995c7cd","Type":"ContainerStarted","Data":"11bb479147db1cd188d7a9d7c44781db630898d5ca80413236949cfddf094939"}
Sep 09 13:27:41.231490 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:41.231435    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:41.320679 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:41.320604    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:45.999673 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:45.999631    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-kflpw"
Sep 09 13:27:46.020501 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:46.020386    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-l8p6d" podStartSLOduration=71.94151663 podStartE2EDuration="1m17.020364614s" totalImagesPullingTime="5.078847984s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 13:26:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 13:27:41.041754602 +0000 UTC m=+72.857278800" watchObservedRunningTime="2026-09-09 13:27:46.020364614 +0000 UTC m=+77.835888811"
Sep 09 13:27:47.836148 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:47.836110    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:47.921267 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:47.921223    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:48.457049 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:48.457017    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-xmf56"]
Sep 09 13:27:48.459389 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:48.459368    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-xmf56"
Sep 09 13:27:48.462757 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:48.462716    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-rrvtt\""
Sep 09 13:27:48.462967 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:48.462952    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 09 13:27:48.473263 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:48.473239    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-xmf56"]
Sep 09 13:27:48.547342 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:48.547307    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/00914ed8-781a-4ab4-b7d1-f354965e16ef-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-xmf56\" (UID: \"00914ed8-781a-4ab4-b7d1-f354965e16ef\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-xmf56"
Sep 09 13:27:48.648411 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:48.648369    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/00914ed8-781a-4ab4-b7d1-f354965e16ef-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-xmf56\" (UID: \"00914ed8-781a-4ab4-b7d1-f354965e16ef\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-xmf56"
Sep 09 13:27:48.648599 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:27:48.648505    2578 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Sep 09 13:27:48.648599 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:27:48.648579    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00914ed8-781a-4ab4-b7d1-f354965e16ef-tls-certificates podName:00914ed8-781a-4ab4-b7d1-f354965e16ef nodeName:}" failed. No retries permitted until 2026-09-09 13:27:49.148557525 +0000 UTC m=+80.964081701 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/00914ed8-781a-4ab4-b7d1-f354965e16ef-tls-certificates") pod "prometheus-operator-admission-webhook-78f599db79-xmf56" (UID: "00914ed8-781a-4ab4-b7d1-f354965e16ef") : secret "prometheus-operator-admission-webhook-tls" not found
Sep 09 13:27:49.138226 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:49.138187    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:49.152356 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:49.152320    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/00914ed8-781a-4ab4-b7d1-f354965e16ef-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-xmf56\" (UID: \"00914ed8-781a-4ab4-b7d1-f354965e16ef\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-xmf56"
Sep 09 13:27:49.152507 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:27:49.152476    2578 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Sep 09 13:27:49.152584 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:27:49.152549    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00914ed8-781a-4ab4-b7d1-f354965e16ef-tls-certificates podName:00914ed8-781a-4ab4-b7d1-f354965e16ef nodeName:}" failed. No retries permitted until 2026-09-09 13:27:50.152529229 +0000 UTC m=+81.968053422 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/00914ed8-781a-4ab4-b7d1-f354965e16ef-tls-certificates") pod "prometheus-operator-admission-webhook-78f599db79-xmf56" (UID: "00914ed8-781a-4ab4-b7d1-f354965e16ef") : secret "prometheus-operator-admission-webhook-tls" not found
Sep 09 13:27:49.254002 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:49.253950    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:49.339545 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:49.339510    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:49.572992 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:49.572862    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:49.673772 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:49.673734    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:50.159397 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:50.159358    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/00914ed8-781a-4ab4-b7d1-f354965e16ef-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-xmf56\" (UID: \"00914ed8-781a-4ab4-b7d1-f354965e16ef\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-xmf56"
Sep 09 13:27:50.162312 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:50.162277    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/00914ed8-781a-4ab4-b7d1-f354965e16ef-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-xmf56\" (UID: \"00914ed8-781a-4ab4-b7d1-f354965e16ef\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-xmf56"
Sep 09 13:27:50.184849 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:50.184821    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5fff9fbb7b-lhmrw"]
Sep 09 13:27:50.187449 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:50.187429    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fff9fbb7b-lhmrw"
Sep 09 13:27:50.191950 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:50.191931    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 09 13:27:50.192819 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:50.192697    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 09 13:27:50.192819 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:50.192701    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 09 13:27:50.192819 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:50.192728    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-277tr\""
Sep 09 13:27:50.193069 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:50.192701    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 09 13:27:50.193069 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:50.193053    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 09 13:27:50.197877 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:50.197853    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5fff9fbb7b-lhmrw"]
Sep 09 13:27:50.260279 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:50.260241    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e64a6d9b-fdad-40f4-baea-41eb123cdf37-console-oauth-config\") pod \"console-5fff9fbb7b-lhmrw\" (UID: \"e64a6d9b-fdad-40f4-baea-41eb123cdf37\") " pod="openshift-console/console-5fff9fbb7b-lhmrw"
Sep 09 13:27:50.260469 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:50.260290    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e64a6d9b-fdad-40f4-baea-41eb123cdf37-console-serving-cert\") pod \"console-5fff9fbb7b-lhmrw\" (UID: \"e64a6d9b-fdad-40f4-baea-41eb123cdf37\") " pod="openshift-console/console-5fff9fbb7b-lhmrw"
Sep 09 13:27:50.260469 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:50.260316    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e64a6d9b-fdad-40f4-baea-41eb123cdf37-console-config\") pod \"console-5fff9fbb7b-lhmrw\" (UID: \"e64a6d9b-fdad-40f4-baea-41eb123cdf37\") " pod="openshift-console/console-5fff9fbb7b-lhmrw"
Sep 09 13:27:50.260469 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:50.260377    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e64a6d9b-fdad-40f4-baea-41eb123cdf37-service-ca\") pod \"console-5fff9fbb7b-lhmrw\" (UID: \"e64a6d9b-fdad-40f4-baea-41eb123cdf37\") " pod="openshift-console/console-5fff9fbb7b-lhmrw"
Sep 09 13:27:50.260469 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:50.260401    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e64a6d9b-fdad-40f4-baea-41eb123cdf37-oauth-serving-cert\") pod \"console-5fff9fbb7b-lhmrw\" (UID: \"e64a6d9b-fdad-40f4-baea-41eb123cdf37\") " pod="openshift-console/console-5fff9fbb7b-lhmrw"
Sep 09 13:27:50.260638 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:50.260466    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkvx2\" (UniqueName: \"kubernetes.io/projected/e64a6d9b-fdad-40f4-baea-41eb123cdf37-kube-api-access-lkvx2\") pod \"console-5fff9fbb7b-lhmrw\" (UID: \"e64a6d9b-fdad-40f4-baea-41eb123cdf37\") " pod="openshift-console/console-5fff9fbb7b-lhmrw"
Sep 09 13:27:50.270253 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:50.270220    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-xmf56"
Sep 09 13:27:50.361467 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:50.361429    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e64a6d9b-fdad-40f4-baea-41eb123cdf37-service-ca\") pod \"console-5fff9fbb7b-lhmrw\" (UID: \"e64a6d9b-fdad-40f4-baea-41eb123cdf37\") " pod="openshift-console/console-5fff9fbb7b-lhmrw"
Sep 09 13:27:50.361663 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:50.361473    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e64a6d9b-fdad-40f4-baea-41eb123cdf37-oauth-serving-cert\") pod \"console-5fff9fbb7b-lhmrw\" (UID: \"e64a6d9b-fdad-40f4-baea-41eb123cdf37\") " pod="openshift-console/console-5fff9fbb7b-lhmrw"
Sep 09 13:27:50.361663 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:50.361513    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkvx2\" (UniqueName: \"kubernetes.io/projected/e64a6d9b-fdad-40f4-baea-41eb123cdf37-kube-api-access-lkvx2\") pod \"console-5fff9fbb7b-lhmrw\" (UID: \"e64a6d9b-fdad-40f4-baea-41eb123cdf37\") " pod="openshift-console/console-5fff9fbb7b-lhmrw"
Sep 09 13:27:50.361663 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:50.361547    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e64a6d9b-fdad-40f4-baea-41eb123cdf37-console-oauth-config\") pod \"console-5fff9fbb7b-lhmrw\" (UID: \"e64a6d9b-fdad-40f4-baea-41eb123cdf37\") " pod="openshift-console/console-5fff9fbb7b-lhmrw"
Sep 09 13:27:50.361663 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:50.361578    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e64a6d9b-fdad-40f4-baea-41eb123cdf37-console-serving-cert\") pod \"console-5fff9fbb7b-lhmrw\" (UID: \"e64a6d9b-fdad-40f4-baea-41eb123cdf37\") " pod="openshift-console/console-5fff9fbb7b-lhmrw"
Sep 09 13:27:50.361663 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:50.361651    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e64a6d9b-fdad-40f4-baea-41eb123cdf37-console-config\") pod \"console-5fff9fbb7b-lhmrw\" (UID: \"e64a6d9b-fdad-40f4-baea-41eb123cdf37\") " pod="openshift-console/console-5fff9fbb7b-lhmrw"
Sep 09 13:27:50.362288 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:50.362255    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e64a6d9b-fdad-40f4-baea-41eb123cdf37-oauth-serving-cert\") pod \"console-5fff9fbb7b-lhmrw\" (UID: \"e64a6d9b-fdad-40f4-baea-41eb123cdf37\") " pod="openshift-console/console-5fff9fbb7b-lhmrw"
Sep 09 13:27:50.362407 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:50.362255    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e64a6d9b-fdad-40f4-baea-41eb123cdf37-service-ca\") pod \"console-5fff9fbb7b-lhmrw\" (UID: \"e64a6d9b-fdad-40f4-baea-41eb123cdf37\") " pod="openshift-console/console-5fff9fbb7b-lhmrw"
Sep 09 13:27:50.362407 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:50.362307    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e64a6d9b-fdad-40f4-baea-41eb123cdf37-console-config\") pod \"console-5fff9fbb7b-lhmrw\" (UID: \"e64a6d9b-fdad-40f4-baea-41eb123cdf37\") " pod="openshift-console/console-5fff9fbb7b-lhmrw"
Sep 09 13:27:50.364385 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:50.364363    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e64a6d9b-fdad-40f4-baea-41eb123cdf37-console-oauth-config\") pod \"console-5fff9fbb7b-lhmrw\" (UID: \"e64a6d9b-fdad-40f4-baea-41eb123cdf37\") " pod="openshift-console/console-5fff9fbb7b-lhmrw"
Sep 09 13:27:50.364496 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:50.364435    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e64a6d9b-fdad-40f4-baea-41eb123cdf37-console-serving-cert\") pod \"console-5fff9fbb7b-lhmrw\" (UID: \"e64a6d9b-fdad-40f4-baea-41eb123cdf37\") " pod="openshift-console/console-5fff9fbb7b-lhmrw"
Sep 09 13:27:50.370562 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:50.370525    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkvx2\" (UniqueName: \"kubernetes.io/projected/e64a6d9b-fdad-40f4-baea-41eb123cdf37-kube-api-access-lkvx2\") pod \"console-5fff9fbb7b-lhmrw\" (UID: \"e64a6d9b-fdad-40f4-baea-41eb123cdf37\") " pod="openshift-console/console-5fff9fbb7b-lhmrw"
Sep 09 13:27:50.498267 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:50.498162    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fff9fbb7b-lhmrw"
Sep 09 13:27:51.760702 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:51.760661    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:51.861446 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:51.861410    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:53.966290 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:53.966253    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:53.975336 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:53.975310    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-749b4b959d-cnp69"
Sep 09 13:27:54.073143 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:54.073105    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:54.139217 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:54.139153    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:54.207440 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:54.207399    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:55.974831 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:55.974793    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c86bb7fd7-g7c9c"]
Sep 09 13:27:55.980553 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:55.980530    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c86bb7fd7-g7c9c"
Sep 09 13:27:55.992032 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:55.992007    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 09 13:27:55.994543 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:55.994516    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:56.001143 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:56.001111    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c86bb7fd7-g7c9c"]
Sep 09 13:27:56.004055 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:56.004029    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7446\" (UniqueName: \"kubernetes.io/projected/b3f61f10-185f-4683-be63-d08890b3cf60-kube-api-access-r7446\") pod \"console-5c86bb7fd7-g7c9c\" (UID: \"b3f61f10-185f-4683-be63-d08890b3cf60\") " pod="openshift-console/console-5c86bb7fd7-g7c9c"
Sep 09 13:27:56.004168 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:56.004069    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3f61f10-185f-4683-be63-d08890b3cf60-trusted-ca-bundle\") pod \"console-5c86bb7fd7-g7c9c\" (UID: \"b3f61f10-185f-4683-be63-d08890b3cf60\") " pod="openshift-console/console-5c86bb7fd7-g7c9c"
Sep 09 13:27:56.004168 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:56.004103    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b3f61f10-185f-4683-be63-d08890b3cf60-service-ca\") pod \"console-5c86bb7fd7-g7c9c\" (UID: \"b3f61f10-185f-4683-be63-d08890b3cf60\") " pod="openshift-console/console-5c86bb7fd7-g7c9c"
Sep 09 13:27:56.004168 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:56.004128    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b3f61f10-185f-4683-be63-d08890b3cf60-oauth-serving-cert\") pod \"console-5c86bb7fd7-g7c9c\" (UID: \"b3f61f10-185f-4683-be63-d08890b3cf60\") " pod="openshift-console/console-5c86bb7fd7-g7c9c"
Sep 09 13:27:56.004168 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:56.004160    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b3f61f10-185f-4683-be63-d08890b3cf60-console-serving-cert\") pod \"console-5c86bb7fd7-g7c9c\" (UID: \"b3f61f10-185f-4683-be63-d08890b3cf60\") " pod="openshift-console/console-5c86bb7fd7-g7c9c"
Sep 09 13:27:56.004410 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:56.004273    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b3f61f10-185f-4683-be63-d08890b3cf60-console-oauth-config\") pod \"console-5c86bb7fd7-g7c9c\" (UID: \"b3f61f10-185f-4683-be63-d08890b3cf60\") " pod="openshift-console/console-5c86bb7fd7-g7c9c"
Sep 09 13:27:56.004410 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:56.004339    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b3f61f10-185f-4683-be63-d08890b3cf60-console-config\") pod \"console-5c86bb7fd7-g7c9c\" (UID: \"b3f61f10-185f-4683-be63-d08890b3cf60\") " pod="openshift-console/console-5c86bb7fd7-g7c9c"
Sep 09 13:27:56.105577 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:56.105541    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7446\" (UniqueName: \"kubernetes.io/projected/b3f61f10-185f-4683-be63-d08890b3cf60-kube-api-access-r7446\") pod \"console-5c86bb7fd7-g7c9c\" (UID: \"b3f61f10-185f-4683-be63-d08890b3cf60\") " pod="openshift-console/console-5c86bb7fd7-g7c9c"
Sep 09 13:27:56.105759 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:56.105589    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3f61f10-185f-4683-be63-d08890b3cf60-trusted-ca-bundle\") pod \"console-5c86bb7fd7-g7c9c\" (UID: \"b3f61f10-185f-4683-be63-d08890b3cf60\") " pod="openshift-console/console-5c86bb7fd7-g7c9c"
Sep 09 13:27:56.105759 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:56.105620    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b3f61f10-185f-4683-be63-d08890b3cf60-service-ca\") pod \"console-5c86bb7fd7-g7c9c\" (UID: \"b3f61f10-185f-4683-be63-d08890b3cf60\") " pod="openshift-console/console-5c86bb7fd7-g7c9c"
Sep 09 13:27:56.105759 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:56.105646    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b3f61f10-185f-4683-be63-d08890b3cf60-oauth-serving-cert\") pod \"console-5c86bb7fd7-g7c9c\" (UID: \"b3f61f10-185f-4683-be63-d08890b3cf60\") " pod="openshift-console/console-5c86bb7fd7-g7c9c"
Sep 09 13:27:56.105759 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:56.105682    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b3f61f10-185f-4683-be63-d08890b3cf60-console-serving-cert\") pod \"console-5c86bb7fd7-g7c9c\" (UID: \"b3f61f10-185f-4683-be63-d08890b3cf60\") " pod="openshift-console/console-5c86bb7fd7-g7c9c"
Sep 09 13:27:56.105956 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:56.105823    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b3f61f10-185f-4683-be63-d08890b3cf60-console-oauth-config\") pod \"console-5c86bb7fd7-g7c9c\" (UID: \"b3f61f10-185f-4683-be63-d08890b3cf60\") " pod="openshift-console/console-5c86bb7fd7-g7c9c"
Sep 09 13:27:56.105956 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:56.105887    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b3f61f10-185f-4683-be63-d08890b3cf60-console-config\") pod \"console-5c86bb7fd7-g7c9c\" (UID: \"b3f61f10-185f-4683-be63-d08890b3cf60\") " pod="openshift-console/console-5c86bb7fd7-g7c9c"
Sep 09 13:27:56.106531 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:56.106467    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b3f61f10-185f-4683-be63-d08890b3cf60-oauth-serving-cert\") pod \"console-5c86bb7fd7-g7c9c\" (UID: \"b3f61f10-185f-4683-be63-d08890b3cf60\") " pod="openshift-console/console-5c86bb7fd7-g7c9c"
Sep 09 13:27:56.106665 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:56.106535    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b3f61f10-185f-4683-be63-d08890b3cf60-service-ca\") pod \"console-5c86bb7fd7-g7c9c\" (UID: \"b3f61f10-185f-4683-be63-d08890b3cf60\") " pod="openshift-console/console-5c86bb7fd7-g7c9c"
Sep 09 13:27:56.106904 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:56.106870    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b3f61f10-185f-4683-be63-d08890b3cf60-console-config\") pod \"console-5c86bb7fd7-g7c9c\" (UID: \"b3f61f10-185f-4683-be63-d08890b3cf60\") " pod="openshift-console/console-5c86bb7fd7-g7c9c"
Sep 09 13:27:56.107356 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:56.107312    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3f61f10-185f-4683-be63-d08890b3cf60-trusted-ca-bundle\") pod \"console-5c86bb7fd7-g7c9c\" (UID: \"b3f61f10-185f-4683-be63-d08890b3cf60\") " pod="openshift-console/console-5c86bb7fd7-g7c9c"
Sep 09 13:27:56.108822 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:56.108798    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b3f61f10-185f-4683-be63-d08890b3cf60-console-oauth-config\") pod \"console-5c86bb7fd7-g7c9c\" (UID: \"b3f61f10-185f-4683-be63-d08890b3cf60\") " pod="openshift-console/console-5c86bb7fd7-g7c9c"
Sep 09 13:27:56.108942 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:56.108833    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b3f61f10-185f-4683-be63-d08890b3cf60-console-serving-cert\") pod \"console-5c86bb7fd7-g7c9c\" (UID: \"b3f61f10-185f-4683-be63-d08890b3cf60\") " pod="openshift-console/console-5c86bb7fd7-g7c9c"
Sep 09 13:27:56.117318 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:56.117297    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7446\" (UniqueName: \"kubernetes.io/projected/b3f61f10-185f-4683-be63-d08890b3cf60-kube-api-access-r7446\") pod \"console-5c86bb7fd7-g7c9c\" (UID: \"b3f61f10-185f-4683-be63-d08890b3cf60\") " pod="openshift-console/console-5c86bb7fd7-g7c9c"
Sep 09 13:27:56.174205 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:56.174157    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:56.247067 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:56.246990    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:56.292028 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:56.291788    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c86bb7fd7-g7c9c"
Sep 09 13:27:56.568245 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:56.568138    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5fff9fbb7b-lhmrw"]
Sep 09 13:27:56.571266 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:27:56.571239    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode64a6d9b_fdad_40f4_baea_41eb123cdf37.slice/crio-15e763dd6481d9dd44d8f5de9bd82f8b8dcd4835cfb095886e048e137570abb2 WatchSource:0}: Error finding container 15e763dd6481d9dd44d8f5de9bd82f8b8dcd4835cfb095886e048e137570abb2: Status 404 returned error can't find the container with id 15e763dd6481d9dd44d8f5de9bd82f8b8dcd4835cfb095886e048e137570abb2
Sep 09 13:27:56.577758 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:56.577732    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c86bb7fd7-g7c9c"]
Sep 09 13:27:56.580669 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:56.580645    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-xmf56"]
Sep 09 13:27:56.581528 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:27:56.581459    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3f61f10_185f_4683_be63_d08890b3cf60.slice/crio-71698163c69cd7ef1722a8c35db0971266c7d779ecfdb6e625f72255f3259e88 WatchSource:0}: Error finding container 71698163c69cd7ef1722a8c35db0971266c7d779ecfdb6e625f72255f3259e88: Status 404 returned error can't find the container with id 71698163c69cd7ef1722a8c35db0971266c7d779ecfdb6e625f72255f3259e88
Sep 09 13:27:56.583722 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:27:56.583698    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00914ed8_781a_4ab4_b7d1_f354965e16ef.slice/crio-30c6a25af02ec21bd1f73ee99c9344d9a77b445eedf30795a902cb572cd0a1a4 WatchSource:0}: Error finding container 30c6a25af02ec21bd1f73ee99c9344d9a77b445eedf30795a902cb572cd0a1a4: Status 404 returned error can't find the container with id 30c6a25af02ec21bd1f73ee99c9344d9a77b445eedf30795a902cb572cd0a1a4
Sep 09 13:27:57.083626 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:57.083593    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-xmf56" event={"ID":"00914ed8-781a-4ab4-b7d1-f354965e16ef","Type":"ContainerStarted","Data":"30c6a25af02ec21bd1f73ee99c9344d9a77b445eedf30795a902cb572cd0a1a4"}
Sep 09 13:27:57.085520 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:57.085492    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-xt7qr" event={"ID":"b5cd0b68-2d59-4f9c-bca9-521ab995c7cd","Type":"ContainerStarted","Data":"3b274df57c933e65ea33eaaaf6a3b381ee9fe89da2cca797ff21ce05dd9c4872"}
Sep 09 13:27:57.085818 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:57.085766    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-85d98c998f-xt7qr"
Sep 09 13:27:57.087010 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:57.086955    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fff9fbb7b-lhmrw" event={"ID":"e64a6d9b-fdad-40f4-baea-41eb123cdf37","Type":"ContainerStarted","Data":"15e763dd6481d9dd44d8f5de9bd82f8b8dcd4835cfb095886e048e137570abb2"}
Sep 09 13:27:57.088268 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:57.088248    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c86bb7fd7-g7c9c" event={"ID":"b3f61f10-185f-4683-be63-d08890b3cf60","Type":"ContainerStarted","Data":"71698163c69cd7ef1722a8c35db0971266c7d779ecfdb6e625f72255f3259e88"}
Sep 09 13:27:57.100849 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:57.100829    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-85d98c998f-xt7qr"
Sep 09 13:27:57.105721 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:57.105680    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-85d98c998f-xt7qr" podStartSLOduration=2.84994788 podStartE2EDuration="19.105669094s" totalImagesPullingTime="16.255721214s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 13:27:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 13:27:57.10442614 +0000 UTC m=+88.919950338" watchObservedRunningTime="2026-09-09 13:27:57.105669094 +0000 UTC m=+88.921193287"
Sep 09 13:27:58.043509 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:58.043418    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:58.142585 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:58.142548    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:59.779508 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:59.779463    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:27:59.881038 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:27:59.880954    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:28:00.104131 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:00.104049    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-xmf56" event={"ID":"00914ed8-781a-4ab4-b7d1-f354965e16ef","Type":"ContainerStarted","Data":"99eb5244245a78eec9e881be93761a24ef1690a6367ea2d3c42107a1d5581929"}
Sep 09 13:28:00.104714 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:00.104660    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-xmf56"
Sep 09 13:28:00.110625 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:00.110595    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-xmf56"
Sep 09 13:28:00.121420 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:00.121364    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-xmf56" podStartSLOduration=9.723766144 podStartE2EDuration="12.121344835s" totalImagesPullingTime="2.397578691s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 13:27:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 13:28:00.120709662 +0000 UTC m=+91.936233869" watchObservedRunningTime="2026-09-09 13:28:00.121344835 +0000 UTC m=+91.936869030"
Sep 09 13:28:00.487420 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:00.487375    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:28:00.578010 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:00.577934    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:28:00.772592 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:00.772493    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:28:02.115277 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:02.115231    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fff9fbb7b-lhmrw" event={"ID":"e64a6d9b-fdad-40f4-baea-41eb123cdf37","Type":"ContainerStarted","Data":"1f893b1620c2162ef0ca59595f2e9debc524dfd1f14f634ff9e4e0e6c8929713"}
Sep 09 13:28:02.117202 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:02.117159    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c86bb7fd7-g7c9c" event={"ID":"b3f61f10-185f-4683-be63-d08890b3cf60","Type":"ContainerStarted","Data":"b39af412d39efc2f61444f201041ae2934b2c50655f4b8d954f7e8fcd25e0fcd"}
Sep 09 13:28:02.134523 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:02.134460    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5fff9fbb7b-lhmrw" podStartSLOduration=7.492981676 podStartE2EDuration="12.134421379s" totalImagesPullingTime="4.641439703s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 13:27:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 13:28:02.133885452 +0000 UTC m=+93.949409648" watchObservedRunningTime="2026-09-09 13:28:02.134421379 +0000 UTC m=+93.949945573"
Sep 09 13:28:02.152002 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:02.151953    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5c86bb7fd7-g7c9c" podStartSLOduration=2.528157408 podStartE2EDuration="7.15192953s" totalImagesPullingTime="4.623772122s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 13:27:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 13:28:02.150630764 +0000 UTC m=+93.966154959" watchObservedRunningTime="2026-09-09 13:28:02.15192953 +0000 UTC m=+93.967453744"
Sep 09 13:28:02.692090 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:02.692053    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:28:04.643606 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:04.643569    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:28:04.758410 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:04.758370    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:28:04.865296 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:04.865255    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:28:04.890741 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:04.890706    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-ds7jv"]
Sep 09 13:28:04.916842 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:04.916761    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ztdz2"]
Sep 09 13:28:04.916998 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:04.916890    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-ds7jv"
Sep 09 13:28:04.924193 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:04.921129    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 09 13:28:04.924193 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:04.921735    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 09 13:28:04.924193 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:04.922113    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 09 13:28:04.924193 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:04.922886    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 09 13:28:04.924193 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:04.923317    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 09 13:28:04.925839 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:04.925013    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-prtk8\""
Sep 09 13:28:04.943591 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:04.943567    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-ds7jv"]
Sep 09 13:28:04.943721 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:04.943707    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ztdz2"
Sep 09 13:28:04.945782 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:04.945760    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 09 13:28:04.946387 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:04.946360    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 09 13:28:04.946736 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:04.946700    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 09 13:28:04.946844 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:04.946765    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-lqv6c\""
Sep 09 13:28:04.974976 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:04.974943    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/451fab74-793e-41e2-8d31-c868d074948c-node-exporter-textfile\") pod \"node-exporter-ztdz2\" (UID: \"451fab74-793e-41e2-8d31-c868d074948c\") " pod="openshift-monitoring/node-exporter-ztdz2"
Sep 09 13:28:04.974976 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:04.974985    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkz9l\" (UniqueName: \"kubernetes.io/projected/451fab74-793e-41e2-8d31-c868d074948c-kube-api-access-vkz9l\") pod \"node-exporter-ztdz2\" (UID: \"451fab74-793e-41e2-8d31-c868d074948c\") " pod="openshift-monitoring/node-exporter-ztdz2"
Sep 09 13:28:04.975223 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:04.975010    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/451fab74-793e-41e2-8d31-c868d074948c-node-exporter-wtmp\") pod \"node-exporter-ztdz2\" (UID: \"451fab74-793e-41e2-8d31-c868d074948c\") " pod="openshift-monitoring/node-exporter-ztdz2"
Sep 09 13:28:04.975223 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:04.975095    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f6844652-d3a7-44f7-a095-45291f1ad4aa-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-ds7jv\" (UID: \"f6844652-d3a7-44f7-a095-45291f1ad4aa\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-ds7jv"
Sep 09 13:28:04.975223 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:04.975132    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/451fab74-793e-41e2-8d31-c868d074948c-metrics-client-ca\") pod \"node-exporter-ztdz2\" (UID: \"451fab74-793e-41e2-8d31-c868d074948c\") " pod="openshift-monitoring/node-exporter-ztdz2"
Sep 09 13:28:04.975223 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:04.975166    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f6844652-d3a7-44f7-a095-45291f1ad4aa-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-ds7jv\" (UID: \"f6844652-d3a7-44f7-a095-45291f1ad4aa\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-ds7jv"
Sep 09 13:28:04.975223 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:04.975212    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/451fab74-793e-41e2-8d31-c868d074948c-node-exporter-accelerators-collector-config\") pod \"node-exporter-ztdz2\" (UID: \"451fab74-793e-41e2-8d31-c868d074948c\") " pod="openshift-monitoring/node-exporter-ztdz2"
Sep 09 13:28:04.975472 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:04.975233    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2968f\" (UniqueName: \"kubernetes.io/projected/f6844652-d3a7-44f7-a095-45291f1ad4aa-kube-api-access-2968f\") pod \"openshift-state-metrics-657fd6c54-ds7jv\" (UID: \"f6844652-d3a7-44f7-a095-45291f1ad4aa\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-ds7jv"
Sep 09 13:28:04.975472 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:04.975287    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f6844652-d3a7-44f7-a095-45291f1ad4aa-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-ds7jv\" (UID: \"f6844652-d3a7-44f7-a095-45291f1ad4aa\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-ds7jv"
Sep 09 13:28:04.975472 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:04.975356    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/451fab74-793e-41e2-8d31-c868d074948c-node-exporter-tls\") pod \"node-exporter-ztdz2\" (UID: \"451fab74-793e-41e2-8d31-c868d074948c\") " pod="openshift-monitoring/node-exporter-ztdz2"
Sep 09 13:28:04.975472 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:04.975385    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/451fab74-793e-41e2-8d31-c868d074948c-sys\") pod \"node-exporter-ztdz2\" (UID: \"451fab74-793e-41e2-8d31-c868d074948c\") " pod="openshift-monitoring/node-exporter-ztdz2"
Sep 09 13:28:04.975472 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:04.975446    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/451fab74-793e-41e2-8d31-c868d074948c-root\") pod \"node-exporter-ztdz2\" (UID: \"451fab74-793e-41e2-8d31-c868d074948c\") " pod="openshift-monitoring/node-exporter-ztdz2"
Sep 09 13:28:04.975661 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:04.975480    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/451fab74-793e-41e2-8d31-c868d074948c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ztdz2\" (UID: \"451fab74-793e-41e2-8d31-c868d074948c\") " pod="openshift-monitoring/node-exporter-ztdz2"
Sep 09 13:28:04.977901 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:04.977871    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:28:05.073569 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:05.073536    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:28:05.076834 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:05.076803    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/451fab74-793e-41e2-8d31-c868d074948c-node-exporter-textfile\") pod \"node-exporter-ztdz2\" (UID: \"451fab74-793e-41e2-8d31-c868d074948c\") " pod="openshift-monitoring/node-exporter-ztdz2"
Sep 09 13:28:05.076978 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:05.076849    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkz9l\" (UniqueName: \"kubernetes.io/projected/451fab74-793e-41e2-8d31-c868d074948c-kube-api-access-vkz9l\") pod \"node-exporter-ztdz2\" (UID: \"451fab74-793e-41e2-8d31-c868d074948c\") " pod="openshift-monitoring/node-exporter-ztdz2"
Sep 09 13:28:05.076978 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:05.076897    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/451fab74-793e-41e2-8d31-c868d074948c-node-exporter-wtmp\") pod \"node-exporter-ztdz2\" (UID: \"451fab74-793e-41e2-8d31-c868d074948c\") " pod="openshift-monitoring/node-exporter-ztdz2"
Sep 09 13:28:05.076978 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:05.076935    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f6844652-d3a7-44f7-a095-45291f1ad4aa-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-ds7jv\" (UID: \"f6844652-d3a7-44f7-a095-45291f1ad4aa\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-ds7jv"
Sep 09 13:28:05.077133 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:05.077060    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/451fab74-793e-41e2-8d31-c868d074948c-metrics-client-ca\") pod \"node-exporter-ztdz2\" (UID: \"451fab74-793e-41e2-8d31-c868d074948c\") " pod="openshift-monitoring/node-exporter-ztdz2"
Sep 09 13:28:05.077133 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:05.077068    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/451fab74-793e-41e2-8d31-c868d074948c-node-exporter-wtmp\") pod \"node-exporter-ztdz2\" (UID: \"451fab74-793e-41e2-8d31-c868d074948c\") " pod="openshift-monitoring/node-exporter-ztdz2"
Sep 09 13:28:05.077255 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:05.077114    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f6844652-d3a7-44f7-a095-45291f1ad4aa-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-ds7jv\" (UID: \"f6844652-d3a7-44f7-a095-45291f1ad4aa\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-ds7jv"
Sep 09 13:28:05.077255 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:05.077199    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/451fab74-793e-41e2-8d31-c868d074948c-node-exporter-accelerators-collector-config\") pod \"node-exporter-ztdz2\" (UID: \"451fab74-793e-41e2-8d31-c868d074948c\") " pod="openshift-monitoring/node-exporter-ztdz2"
Sep 09 13:28:05.077255 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:05.077237    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2968f\" (UniqueName: \"kubernetes.io/projected/f6844652-d3a7-44f7-a095-45291f1ad4aa-kube-api-access-2968f\") pod \"openshift-state-metrics-657fd6c54-ds7jv\" (UID: \"f6844652-d3a7-44f7-a095-45291f1ad4aa\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-ds7jv"
Sep 09 13:28:05.077395 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:05.077287    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f6844652-d3a7-44f7-a095-45291f1ad4aa-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-ds7jv\" (UID: \"f6844652-d3a7-44f7-a095-45291f1ad4aa\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-ds7jv"
Sep 09 13:28:05.077395 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:05.077305    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/451fab74-793e-41e2-8d31-c868d074948c-node-exporter-textfile\") pod \"node-exporter-ztdz2\" (UID: \"451fab74-793e-41e2-8d31-c868d074948c\") " pod="openshift-monitoring/node-exporter-ztdz2"
Sep 09 13:28:05.077395 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:05.077317    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/451fab74-793e-41e2-8d31-c868d074948c-node-exporter-tls\") pod \"node-exporter-ztdz2\" (UID: \"451fab74-793e-41e2-8d31-c868d074948c\") " pod="openshift-monitoring/node-exporter-ztdz2"
Sep 09 13:28:05.077395 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:05.077345    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/451fab74-793e-41e2-8d31-c868d074948c-sys\") pod \"node-exporter-ztdz2\" (UID: \"451fab74-793e-41e2-8d31-c868d074948c\") " pod="openshift-monitoring/node-exporter-ztdz2"
Sep 09 13:28:05.077594 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:28:05.077402    2578 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Sep 09 13:28:05.077594 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:05.077411    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/451fab74-793e-41e2-8d31-c868d074948c-root\") pod \"node-exporter-ztdz2\" (UID: \"451fab74-793e-41e2-8d31-c868d074948c\") " pod="openshift-monitoring/node-exporter-ztdz2"
Sep 09 13:28:05.077594 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:28:05.077454    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6844652-d3a7-44f7-a095-45291f1ad4aa-openshift-state-metrics-tls podName:f6844652-d3a7-44f7-a095-45291f1ad4aa nodeName:}" failed. No retries permitted until 2026-09-09 13:28:05.57743577 +0000 UTC m=+97.392959960 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/f6844652-d3a7-44f7-a095-45291f1ad4aa-openshift-state-metrics-tls") pod "openshift-state-metrics-657fd6c54-ds7jv" (UID: "f6844652-d3a7-44f7-a095-45291f1ad4aa") : secret "openshift-state-metrics-tls" not found
Sep 09 13:28:05.077594 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:05.077475    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/451fab74-793e-41e2-8d31-c868d074948c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ztdz2\" (UID: \"451fab74-793e-41e2-8d31-c868d074948c\") " pod="openshift-monitoring/node-exporter-ztdz2"
Sep 09 13:28:05.077594 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:05.077491    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/451fab74-793e-41e2-8d31-c868d074948c-root\") pod \"node-exporter-ztdz2\" (UID: \"451fab74-793e-41e2-8d31-c868d074948c\") " pod="openshift-monitoring/node-exporter-ztdz2"
Sep 09 13:28:05.077851 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:05.077634    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/451fab74-793e-41e2-8d31-c868d074948c-metrics-client-ca\") pod \"node-exporter-ztdz2\" (UID: \"451fab74-793e-41e2-8d31-c868d074948c\") " pod="openshift-monitoring/node-exporter-ztdz2"
Sep 09 13:28:05.077851 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:05.077681    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/451fab74-793e-41e2-8d31-c868d074948c-sys\") pod \"node-exporter-ztdz2\" (UID: \"451fab74-793e-41e2-8d31-c868d074948c\") " pod="openshift-monitoring/node-exporter-ztdz2"
Sep 09 13:28:05.077851 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:05.077751    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/451fab74-793e-41e2-8d31-c868d074948c-node-exporter-accelerators-collector-config\") pod \"node-exporter-ztdz2\" (UID: \"451fab74-793e-41e2-8d31-c868d074948c\") " pod="openshift-monitoring/node-exporter-ztdz2"
Sep 09 13:28:05.078105 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:05.078081    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f6844652-d3a7-44f7-a095-45291f1ad4aa-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-ds7jv\" (UID: \"f6844652-d3a7-44f7-a095-45291f1ad4aa\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-ds7jv"
Sep 09 13:28:05.080034 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:05.080004    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/451fab74-793e-41e2-8d31-c868d074948c-node-exporter-tls\") pod \"node-exporter-ztdz2\" (UID: \"451fab74-793e-41e2-8d31-c868d074948c\") " pod="openshift-monitoring/node-exporter-ztdz2"
Sep 09 13:28:05.080242 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:05.080226    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/451fab74-793e-41e2-8d31-c868d074948c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ztdz2\" (UID: \"451fab74-793e-41e2-8d31-c868d074948c\") " pod="openshift-monitoring/node-exporter-ztdz2"
Sep 09 13:28:05.080392 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:05.080372    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f6844652-d3a7-44f7-a095-45291f1ad4aa-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-ds7jv\" (UID: \"f6844652-d3a7-44f7-a095-45291f1ad4aa\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-ds7jv"
Sep 09 13:28:05.088885 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:05.088765    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkz9l\" (UniqueName: \"kubernetes.io/projected/451fab74-793e-41e2-8d31-c868d074948c-kube-api-access-vkz9l\") pod \"node-exporter-ztdz2\" (UID: \"451fab74-793e-41e2-8d31-c868d074948c\") " pod="openshift-monitoring/node-exporter-ztdz2"
Sep 09 13:28:05.090531 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:05.090509    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2968f\" (UniqueName: \"kubernetes.io/projected/f6844652-d3a7-44f7-a095-45291f1ad4aa-kube-api-access-2968f\") pod \"openshift-state-metrics-657fd6c54-ds7jv\" (UID: \"f6844652-d3a7-44f7-a095-45291f1ad4aa\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-ds7jv"
Sep 09 13:28:05.174136 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:05.174047    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:28:05.253536 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:05.253497    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ztdz2"
Sep 09 13:28:05.274986 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:05.274950    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:28:05.294799 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:28:05.294768    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod451fab74_793e_41e2_8d31_c868d074948c.slice/crio-fafe7de41d9c360a2e2b5e50694ecafcda93fe0d1c0426d95a2ec3a0408a7efa WatchSource:0}: Error finding container fafe7de41d9c360a2e2b5e50694ecafcda93fe0d1c0426d95a2ec3a0408a7efa: Status 404 returned error can't find the container with id fafe7de41d9c360a2e2b5e50694ecafcda93fe0d1c0426d95a2ec3a0408a7efa
Sep 09 13:28:05.375366 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:05.375330    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:28:05.476485 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:05.476392    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:28:05.576646 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:05.576616    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:28:05.580745 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:05.580724    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f6844652-d3a7-44f7-a095-45291f1ad4aa-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-ds7jv\" (UID: \"f6844652-d3a7-44f7-a095-45291f1ad4aa\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-ds7jv"
Sep 09 13:28:05.582997 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:05.582979    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f6844652-d3a7-44f7-a095-45291f1ad4aa-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-ds7jv\" (UID: \"f6844652-d3a7-44f7-a095-45291f1ad4aa\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-ds7jv"
Sep 09 13:28:05.760859 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:05.760774    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:28:05.835586 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:05.835552    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-ds7jv"
Sep 09 13:28:05.865145 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:05.865111    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:28:05.963576 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:05.963549    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:28:06.132663 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:06.132634    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ztdz2" event={"ID":"451fab74-793e-41e2-8d31-c868d074948c","Type":"ContainerStarted","Data":"fafe7de41d9c360a2e2b5e50694ecafcda93fe0d1c0426d95a2ec3a0408a7efa"}
Sep 09 13:28:06.135870 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:06.135846    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-ds7jv"]
Sep 09 13:28:06.138528 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:28:06.138505    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6844652_d3a7_44f7_a095_45291f1ad4aa.slice/crio-bb0136edf089075269564f96a9a54a23b13923d5385b3d29977002996296bda3 WatchSource:0}: Error finding container bb0136edf089075269564f96a9a54a23b13923d5385b3d29977002996296bda3: Status 404 returned error can't find the container with id bb0136edf089075269564f96a9a54a23b13923d5385b3d29977002996296bda3
Sep 09 13:28:06.186352 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:06.186321    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:28:06.292631 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:06.292602    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c86bb7fd7-g7c9c"
Sep 09 13:28:06.292739 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:06.292649    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c86bb7fd7-g7c9c"
Sep 09 13:28:06.298735 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:06.298717    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5c86bb7fd7-g7c9c"
Sep 09 13:28:06.787607 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:06.787574    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:28:06.846665 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:06.846630    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:28:06.980412 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:06.980380    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5dd99cbf48-hhw7x"]
Sep 09 13:28:06.985444 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:06.985419    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:28:06.999373 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:06.999346    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5dd99cbf48-hhw7x"
Sep 09 13:28:06.999650 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:06.999625    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5dd99cbf48-hhw7x"]
Sep 09 13:28:07.002059 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:07.002036    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 09 13:28:07.002163 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:07.002084    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 09 13:28:07.002163 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:07.002041    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 09 13:28:07.002312 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:07.002164    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-4arenj0b77d0s\""
Sep 09 13:28:07.002312 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:07.002041    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 09 13:28:07.002312 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:07.002092    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-vm6qb\""
Sep 09 13:28:07.002468 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:07.002401    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 09 13:28:07.066934 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:07.066856    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:28:07.092556 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:07.092520    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/928b5550-3225-43a5-8833-acd6039a524a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5dd99cbf48-hhw7x\" (UID: \"928b5550-3225-43a5-8833-acd6039a524a\") " pod="openshift-monitoring/thanos-querier-5dd99cbf48-hhw7x"
Sep 09 13:28:07.092697 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:07.092579    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/928b5550-3225-43a5-8833-acd6039a524a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5dd99cbf48-hhw7x\" (UID: \"928b5550-3225-43a5-8833-acd6039a524a\") " pod="openshift-monitoring/thanos-querier-5dd99cbf48-hhw7x"
Sep 09 13:28:07.092697 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:07.092632    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thdqs\" (UniqueName: \"kubernetes.io/projected/928b5550-3225-43a5-8833-acd6039a524a-kube-api-access-thdqs\") pod \"thanos-querier-5dd99cbf48-hhw7x\" (UID: \"928b5550-3225-43a5-8833-acd6039a524a\") " pod="openshift-monitoring/thanos-querier-5dd99cbf48-hhw7x"
Sep 09 13:28:07.092697 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:07.092673    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/928b5550-3225-43a5-8833-acd6039a524a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5dd99cbf48-hhw7x\" (UID: \"928b5550-3225-43a5-8833-acd6039a524a\") " pod="openshift-monitoring/thanos-querier-5dd99cbf48-hhw7x"
Sep 09 13:28:07.092831 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:07.092712    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/928b5550-3225-43a5-8833-acd6039a524a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5dd99cbf48-hhw7x\" (UID: \"928b5550-3225-43a5-8833-acd6039a524a\") " pod="openshift-monitoring/thanos-querier-5dd99cbf48-hhw7x"
Sep 09 13:28:07.092831 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:07.092751    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/928b5550-3225-43a5-8833-acd6039a524a-secret-thanos-querier-tls\") pod \"thanos-querier-5dd99cbf48-hhw7x\" (UID: \"928b5550-3225-43a5-8833-acd6039a524a\") " pod="openshift-monitoring/thanos-querier-5dd99cbf48-hhw7x"
Sep 09 13:28:07.092831 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:07.092776    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/928b5550-3225-43a5-8833-acd6039a524a-metrics-client-ca\") pod \"thanos-querier-5dd99cbf48-hhw7x\" (UID: \"928b5550-3225-43a5-8833-acd6039a524a\") " pod="openshift-monitoring/thanos-querier-5dd99cbf48-hhw7x"
Sep 09 13:28:07.092831 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:07.092813    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/928b5550-3225-43a5-8833-acd6039a524a-secret-grpc-tls\") pod \"thanos-querier-5dd99cbf48-hhw7x\" (UID: \"928b5550-3225-43a5-8833-acd6039a524a\") " pod="openshift-monitoring/thanos-querier-5dd99cbf48-hhw7x"
Sep 09 13:28:07.138674 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:07.138642    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-ds7jv" event={"ID":"f6844652-d3a7-44f7-a095-45291f1ad4aa","Type":"ContainerStarted","Data":"8438266e5634494c727f8c014feb2194e8dbfcb7f195869e6ba7cad5fee67d9c"}
Sep 09 13:28:07.138852 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:07.138699    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-ds7jv" event={"ID":"f6844652-d3a7-44f7-a095-45291f1ad4aa","Type":"ContainerStarted","Data":"990938b48f34d3ab928764cb391657a01e9078d5b6ce27c54dcc9ec0db898b76"}
Sep 09 13:28:07.138852 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:07.138718    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-ds7jv" event={"ID":"f6844652-d3a7-44f7-a095-45291f1ad4aa","Type":"ContainerStarted","Data":"bb0136edf089075269564f96a9a54a23b13923d5385b3d29977002996296bda3"}
Sep 09 13:28:07.142452 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:07.142430    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5c86bb7fd7-g7c9c"
Sep 09 13:28:07.185784 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:07.185739    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5fff9fbb7b-lhmrw"]
Sep 09 13:28:07.193623 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:07.193597    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/928b5550-3225-43a5-8833-acd6039a524a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5dd99cbf48-hhw7x\" (UID: \"928b5550-3225-43a5-8833-acd6039a524a\") " pod="openshift-monitoring/thanos-querier-5dd99cbf48-hhw7x"
Sep 09 13:28:07.193784 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:07.193639    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thdqs\" (UniqueName: \"kubernetes.io/projected/928b5550-3225-43a5-8833-acd6039a524a-kube-api-access-thdqs\") pod \"thanos-querier-5dd99cbf48-hhw7x\" (UID: \"928b5550-3225-43a5-8833-acd6039a524a\") " pod="openshift-monitoring/thanos-querier-5dd99cbf48-hhw7x"
Sep 09 13:28:07.193784 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:07.193684    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/928b5550-3225-43a5-8833-acd6039a524a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5dd99cbf48-hhw7x\" (UID: \"928b5550-3225-43a5-8833-acd6039a524a\") " pod="openshift-monitoring/thanos-querier-5dd99cbf48-hhw7x"
Sep 09 13:28:07.193784 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:07.193703    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/928b5550-3225-43a5-8833-acd6039a524a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5dd99cbf48-hhw7x\" (UID: \"928b5550-3225-43a5-8833-acd6039a524a\") " pod="openshift-monitoring/thanos-querier-5dd99cbf48-hhw7x"
Sep 09 13:28:07.193784 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:07.193759    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/928b5550-3225-43a5-8833-acd6039a524a-secret-thanos-querier-tls\") pod \"thanos-querier-5dd99cbf48-hhw7x\" (UID: \"928b5550-3225-43a5-8833-acd6039a524a\") " pod="openshift-monitoring/thanos-querier-5dd99cbf48-hhw7x"
Sep 09 13:28:07.194056 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:07.193786    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/928b5550-3225-43a5-8833-acd6039a524a-metrics-client-ca\") pod \"thanos-querier-5dd99cbf48-hhw7x\" (UID: \"928b5550-3225-43a5-8833-acd6039a524a\") " pod="openshift-monitoring/thanos-querier-5dd99cbf48-hhw7x"
Sep 09 13:28:07.194056 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:07.193848    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/928b5550-3225-43a5-8833-acd6039a524a-secret-grpc-tls\") pod \"thanos-querier-5dd99cbf48-hhw7x\" (UID: \"928b5550-3225-43a5-8833-acd6039a524a\") " pod="openshift-monitoring/thanos-querier-5dd99cbf48-hhw7x"
Sep 09 13:28:07.194056 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:07.193926    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/928b5550-3225-43a5-8833-acd6039a524a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5dd99cbf48-hhw7x\" (UID: \"928b5550-3225-43a5-8833-acd6039a524a\") " pod="openshift-monitoring/thanos-querier-5dd99cbf48-hhw7x"
Sep 09 13:28:07.195755 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:07.195314    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/928b5550-3225-43a5-8833-acd6039a524a-metrics-client-ca\") pod \"thanos-querier-5dd99cbf48-hhw7x\" (UID: \"928b5550-3225-43a5-8833-acd6039a524a\") " pod="openshift-monitoring/thanos-querier-5dd99cbf48-hhw7x"
Sep 09 13:28:07.196765 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:07.196738    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/928b5550-3225-43a5-8833-acd6039a524a-secret-thanos-querier-tls\") pod \"thanos-querier-5dd99cbf48-hhw7x\" (UID: \"928b5550-3225-43a5-8833-acd6039a524a\") " pod="openshift-monitoring/thanos-querier-5dd99cbf48-hhw7x"
Sep 09 13:28:07.196868 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:07.196760    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/928b5550-3225-43a5-8833-acd6039a524a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5dd99cbf48-hhw7x\" (UID: \"928b5550-3225-43a5-8833-acd6039a524a\") " pod="openshift-monitoring/thanos-querier-5dd99cbf48-hhw7x"
Sep 09 13:28:07.197847 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:07.197825    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/928b5550-3225-43a5-8833-acd6039a524a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5dd99cbf48-hhw7x\" (UID: \"928b5550-3225-43a5-8833-acd6039a524a\") " pod="openshift-monitoring/thanos-querier-5dd99cbf48-hhw7x"
Sep 09 13:28:07.197945 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:07.197898    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/928b5550-3225-43a5-8833-acd6039a524a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5dd99cbf48-hhw7x\" (UID: \"928b5550-3225-43a5-8833-acd6039a524a\") " pod="openshift-monitoring/thanos-querier-5dd99cbf48-hhw7x"
Sep 09 13:28:07.200115 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:07.198833    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/928b5550-3225-43a5-8833-acd6039a524a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5dd99cbf48-hhw7x\" (UID: \"928b5550-3225-43a5-8833-acd6039a524a\") " pod="openshift-monitoring/thanos-querier-5dd99cbf48-hhw7x"
Sep 09 13:28:07.200115 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:07.199004    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/928b5550-3225-43a5-8833-acd6039a524a-secret-grpc-tls\") pod \"thanos-querier-5dd99cbf48-hhw7x\" (UID: \"928b5550-3225-43a5-8833-acd6039a524a\") " pod="openshift-monitoring/thanos-querier-5dd99cbf48-hhw7x"
Sep 09 13:28:07.206754 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:07.206723    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thdqs\" (UniqueName: \"kubernetes.io/projected/928b5550-3225-43a5-8833-acd6039a524a-kube-api-access-thdqs\") pod \"thanos-querier-5dd99cbf48-hhw7x\" (UID: \"928b5550-3225-43a5-8833-acd6039a524a\") " pod="openshift-monitoring/thanos-querier-5dd99cbf48-hhw7x"
Sep 09 13:28:07.311569 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:07.311532    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5dd99cbf48-hhw7x"
Sep 09 13:28:07.853801 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:07.853770    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5dd99cbf48-hhw7x"]
Sep 09 13:28:07.856305 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:28:07.856276    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod928b5550_3225_43a5_8833_acd6039a524a.slice/crio-b2dd9288a69dddd2e7f3009ac16bee2d46663a2cf7fd6bad422cba161f01c985 WatchSource:0}: Error finding container b2dd9288a69dddd2e7f3009ac16bee2d46663a2cf7fd6bad422cba161f01c985: Status 404 returned error can't find the container with id b2dd9288a69dddd2e7f3009ac16bee2d46663a2cf7fd6bad422cba161f01c985
Sep 09 13:28:07.856780 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:07.856740    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:28:07.956751 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:07.956716    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:28:08.055831 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:08.055796    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:28:08.128332 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:08.128296    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:28:08.143732 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:08.143693    2578 generic.go:356] "Generic (PLEG): container finished" podID="451fab74-793e-41e2-8d31-c868d074948c" containerID="166c94abd6cfc7e7d6dd4a0196cdad5fb7673fe1a85bacf6305b3986bd36ca52" exitCode=0
Sep 09 13:28:08.143894 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:08.143760    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ztdz2" event={"ID":"451fab74-793e-41e2-8d31-c868d074948c","Type":"ContainerDied","Data":"166c94abd6cfc7e7d6dd4a0196cdad5fb7673fe1a85bacf6305b3986bd36ca52"}
Sep 09 13:28:08.146088 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:08.146056    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-ds7jv" event={"ID":"f6844652-d3a7-44f7-a095-45291f1ad4aa","Type":"ContainerStarted","Data":"b677b764202e8e003e8ccd9fa439b5256520b0650114605bcd63606778043298"}
Sep 09 13:28:08.147304 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:08.147284    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5dd99cbf48-hhw7x" event={"ID":"928b5550-3225-43a5-8833-acd6039a524a","Type":"ContainerStarted","Data":"b2dd9288a69dddd2e7f3009ac16bee2d46663a2cf7fd6bad422cba161f01c985"}
Sep 09 13:28:08.181796 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:08.181754    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-ds7jv" podStartSLOduration=2.763785922 podStartE2EDuration="4.18173354s" totalImagesPullingTime="1.417947618s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 13:28:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 13:28:08.181366923 +0000 UTC m=+99.996891120" watchObservedRunningTime="2026-09-09 13:28:08.18173354 +0000 UTC m=+99.997257739"
Sep 09 13:28:08.377870 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:08.377845    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:28:09.088940 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:09.088905    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:28:09.157010 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:09.156970    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ztdz2" event={"ID":"451fab74-793e-41e2-8d31-c868d074948c","Type":"ContainerStarted","Data":"c6ef162fadf9ced7b834949e2c2515be402ff501c87470bb3c87439809e36553"}
Sep 09 13:28:09.157170 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:09.157070    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ztdz2" event={"ID":"451fab74-793e-41e2-8d31-c868d074948c","Type":"ContainerStarted","Data":"454421d33246a44eb7e07db2ff5b1b8f03499db35f81ae6cb1c1ba93c996403a"}
Sep 09 13:28:09.178586 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:09.178536    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ztdz2" podStartSLOduration=2.832395907 podStartE2EDuration="5.178520277s" totalImagesPullingTime="2.285917755s" totalInitContainerRuntime="60.206615ms" isStatefulPod=true podCreationTimestamp="2026-09-09 13:28:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 13:28:09.177078142 +0000 UTC m=+100.992602336" watchObservedRunningTime="2026-09-09 13:28:09.178520277 +0000 UTC m=+100.994044471"
Sep 09 13:28:09.672889 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:09.672855    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:28:09.677460 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:09.677430    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6fffffc674-9fd8w"]
Sep 09 13:28:09.695111 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:09.695055    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fffffc674-9fd8w"]
Sep 09 13:28:09.695291 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:09.695201    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fffffc674-9fd8w"
Sep 09 13:28:09.769298 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:09.769242    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:28:09.814137 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:09.814097    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a3e5347b-c510-488b-9c63-ffd395958d43-console-config\") pod \"console-6fffffc674-9fd8w\" (UID: \"a3e5347b-c510-488b-9c63-ffd395958d43\") " pod="openshift-console/console-6fffffc674-9fd8w"
Sep 09 13:28:09.814340 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:09.814151    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3e5347b-c510-488b-9c63-ffd395958d43-trusted-ca-bundle\") pod \"console-6fffffc674-9fd8w\" (UID: \"a3e5347b-c510-488b-9c63-ffd395958d43\") " pod="openshift-console/console-6fffffc674-9fd8w"
Sep 09 13:28:09.814340 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:09.814234    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a3e5347b-c510-488b-9c63-ffd395958d43-service-ca\") pod \"console-6fffffc674-9fd8w\" (UID: \"a3e5347b-c510-488b-9c63-ffd395958d43\") " pod="openshift-console/console-6fffffc674-9fd8w"
Sep 09 13:28:09.814340 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:09.814314    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a3e5347b-c510-488b-9c63-ffd395958d43-console-oauth-config\") pod \"console-6fffffc674-9fd8w\" (UID: \"a3e5347b-c510-488b-9c63-ffd395958d43\") " pod="openshift-console/console-6fffffc674-9fd8w"
Sep 09 13:28:09.814489 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:09.814351    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a3e5347b-c510-488b-9c63-ffd395958d43-console-serving-cert\") pod \"console-6fffffc674-9fd8w\" (UID: \"a3e5347b-c510-488b-9c63-ffd395958d43\") " pod="openshift-console/console-6fffffc674-9fd8w"
Sep 09 13:28:09.814489 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:09.814391    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a3e5347b-c510-488b-9c63-ffd395958d43-oauth-serving-cert\") pod \"console-6fffffc674-9fd8w\" (UID: \"a3e5347b-c510-488b-9c63-ffd395958d43\") " pod="openshift-console/console-6fffffc674-9fd8w"
Sep 09 13:28:09.814489 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:09.814423    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stv9b\" (UniqueName: \"kubernetes.io/projected/a3e5347b-c510-488b-9c63-ffd395958d43-kube-api-access-stv9b\") pod \"console-6fffffc674-9fd8w\" (UID: \"a3e5347b-c510-488b-9c63-ffd395958d43\") " pod="openshift-console/console-6fffffc674-9fd8w"
Sep 09 13:28:09.915020 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:09.914990    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a3e5347b-c510-488b-9c63-ffd395958d43-console-oauth-config\") pod \"console-6fffffc674-9fd8w\" (UID: \"a3e5347b-c510-488b-9c63-ffd395958d43\") " pod="openshift-console/console-6fffffc674-9fd8w"
Sep 09 13:28:09.915020 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:09.915022    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a3e5347b-c510-488b-9c63-ffd395958d43-console-serving-cert\") pod \"console-6fffffc674-9fd8w\" (UID: \"a3e5347b-c510-488b-9c63-ffd395958d43\") " pod="openshift-console/console-6fffffc674-9fd8w"
Sep 09 13:28:09.915273 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:09.915039    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a3e5347b-c510-488b-9c63-ffd395958d43-oauth-serving-cert\") pod \"console-6fffffc674-9fd8w\" (UID: \"a3e5347b-c510-488b-9c63-ffd395958d43\") " pod="openshift-console/console-6fffffc674-9fd8w"
Sep 09 13:28:09.915273 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:09.915065    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stv9b\" (UniqueName: \"kubernetes.io/projected/a3e5347b-c510-488b-9c63-ffd395958d43-kube-api-access-stv9b\") pod \"console-6fffffc674-9fd8w\" (UID: \"a3e5347b-c510-488b-9c63-ffd395958d43\") " pod="openshift-console/console-6fffffc674-9fd8w"
Sep 09 13:28:09.915273 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:09.915089    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a3e5347b-c510-488b-9c63-ffd395958d43-console-config\") pod \"console-6fffffc674-9fd8w\" (UID: \"a3e5347b-c510-488b-9c63-ffd395958d43\") " pod="openshift-console/console-6fffffc674-9fd8w"
Sep 09 13:28:09.915273 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:09.915130    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3e5347b-c510-488b-9c63-ffd395958d43-trusted-ca-bundle\") pod \"console-6fffffc674-9fd8w\" (UID: \"a3e5347b-c510-488b-9c63-ffd395958d43\") " pod="openshift-console/console-6fffffc674-9fd8w"
Sep 09 13:28:09.915273 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:09.915156    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a3e5347b-c510-488b-9c63-ffd395958d43-service-ca\") pod \"console-6fffffc674-9fd8w\" (UID: \"a3e5347b-c510-488b-9c63-ffd395958d43\") " pod="openshift-console/console-6fffffc674-9fd8w"
Sep 09 13:28:09.915867 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:09.915839    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a3e5347b-c510-488b-9c63-ffd395958d43-oauth-serving-cert\") pod \"console-6fffffc674-9fd8w\" (UID: \"a3e5347b-c510-488b-9c63-ffd395958d43\") " pod="openshift-console/console-6fffffc674-9fd8w"
Sep 09 13:28:09.915867 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:09.915859    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a3e5347b-c510-488b-9c63-ffd395958d43-console-config\") pod \"console-6fffffc674-9fd8w\" (UID: \"a3e5347b-c510-488b-9c63-ffd395958d43\") " pod="openshift-console/console-6fffffc674-9fd8w"
Sep 09 13:28:09.916043 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:09.915845    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a3e5347b-c510-488b-9c63-ffd395958d43-service-ca\") pod \"console-6fffffc674-9fd8w\" (UID: \"a3e5347b-c510-488b-9c63-ffd395958d43\") " pod="openshift-console/console-6fffffc674-9fd8w"
Sep 09 13:28:09.916043 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:09.915950    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3e5347b-c510-488b-9c63-ffd395958d43-trusted-ca-bundle\") pod \"console-6fffffc674-9fd8w\" (UID: \"a3e5347b-c510-488b-9c63-ffd395958d43\") " pod="openshift-console/console-6fffffc674-9fd8w"
Sep 09 13:28:09.917543 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:09.917513    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a3e5347b-c510-488b-9c63-ffd395958d43-console-serving-cert\") pod \"console-6fffffc674-9fd8w\" (UID: \"a3e5347b-c510-488b-9c63-ffd395958d43\") " pod="openshift-console/console-6fffffc674-9fd8w"
Sep 09 13:28:09.917657 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:09.917604    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a3e5347b-c510-488b-9c63-ffd395958d43-console-oauth-config\") pod \"console-6fffffc674-9fd8w\" (UID: \"a3e5347b-c510-488b-9c63-ffd395958d43\") " pod="openshift-console/console-6fffffc674-9fd8w"
Sep 09 13:28:09.922498 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:09.922473    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-stv9b\" (UniqueName: \"kubernetes.io/projected/a3e5347b-c510-488b-9c63-ffd395958d43-kube-api-access-stv9b\") pod \"console-6fffffc674-9fd8w\" (UID: \"a3e5347b-c510-488b-9c63-ffd395958d43\") " pod="openshift-console/console-6fffffc674-9fd8w"
Sep 09 13:28:10.006278 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:10.006202    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fffffc674-9fd8w"
Sep 09 13:28:10.046721 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:10.046690    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:28:10.288557 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:10.288531    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fffffc674-9fd8w"]
Sep 09 13:28:10.295193 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:28:10.295152    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3e5347b_c510_488b_9c63_ffd395958d43.slice/crio-6bd543fef60884deb2270e9d497ce5b3c4c0f8c240c59afe796181eac1438e45 WatchSource:0}: Error finding container 6bd543fef60884deb2270e9d497ce5b3c4c0f8c240c59afe796181eac1438e45: Status 404 returned error can't find the container with id 6bd543fef60884deb2270e9d497ce5b3c4c0f8c240c59afe796181eac1438e45
Sep 09 13:28:10.380199 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:10.380108    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:28:10.480576 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:10.480551    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:28:10.498874 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:10.498849    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5fff9fbb7b-lhmrw"
Sep 09 13:28:11.023137 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.023110    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7sgj5"
Sep 09 13:28:11.167234 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.167205    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5dd99cbf48-hhw7x" event={"ID":"928b5550-3225-43a5-8833-acd6039a524a","Type":"ContainerStarted","Data":"65009649c6ff70b8e306c6ff22aa51d777b08d65af9ee0a04eb404b055b83076"}
Sep 09 13:28:11.167427 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.167294    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5dd99cbf48-hhw7x" event={"ID":"928b5550-3225-43a5-8833-acd6039a524a","Type":"ContainerStarted","Data":"68d26e30839fab311f9e1e5cf36793b1dc09687bb10ce85a42afd0ef08b20b29"}
Sep 09 13:28:11.167427 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.167339    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5dd99cbf48-hhw7x" event={"ID":"928b5550-3225-43a5-8833-acd6039a524a","Type":"ContainerStarted","Data":"95b8442c60607c9a3861c7b8cfee7d574fd89b425f0ebf2e69d5c88b3e47ff6f"}
Sep 09 13:28:11.168676 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.168648    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fffffc674-9fd8w" event={"ID":"a3e5347b-c510-488b-9c63-ffd395958d43","Type":"ContainerStarted","Data":"2b643bb20b3dd3841d339c5ed29220796d0ad96522e8b7a54e560ec59bd22d31"}
Sep 09 13:28:11.168804 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.168694    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fffffc674-9fd8w" event={"ID":"a3e5347b-c510-488b-9c63-ffd395958d43","Type":"ContainerStarted","Data":"6bd543fef60884deb2270e9d497ce5b3c4c0f8c240c59afe796181eac1438e45"}
Sep 09 13:28:11.187754 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.187725    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 09 13:28:11.194039 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.192815    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6fffffc674-9fd8w" podStartSLOduration=2.192794734 podStartE2EDuration="2.192794734s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 13:28:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 13:28:11.191300261 +0000 UTC m=+103.006824459" watchObservedRunningTime="2026-09-09 13:28:11.192794734 +0000 UTC m=+103.008318930"
Sep 09 13:28:11.196168 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.196097    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:28:11.201505 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.201483    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:28:11.204422 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.204401    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 09 13:28:11.204540 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.204432    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 09 13:28:11.205641 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.205617    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 09 13:28:11.205728 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.205661    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 09 13:28:11.205728 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.205663    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 09 13:28:11.206763 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.206745    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 09 13:28:11.206763 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.206758    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 09 13:28:11.206894 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.206780    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 09 13:28:11.206978 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.206962    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 09 13:28:11.207170 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.207152    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-bxv7m\""
Sep 09 13:28:11.207270 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.207162    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 09 13:28:11.207270 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.207189    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 09 13:28:11.207270 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.207203    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 09 13:28:11.207270 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.207169    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 09 13:28:11.207584 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.207570    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-enkglot24blnv\""
Sep 09 13:28:11.211673 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.211650    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 09 13:28:11.213097 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.213078    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 09 13:28:11.213906 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.213890    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 09 13:28:11.326127 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.326051    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bd184531-b42a-4c01-a978-11c99b00d637-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:28:11.326127 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.326087    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bd184531-b42a-4c01-a978-11c99b00d637-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:28:11.326127 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.326109    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd184531-b42a-4c01-a978-11c99b00d637-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:28:11.326596 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.326161    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd184531-b42a-4c01-a978-11c99b00d637-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:28:11.326596 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.326217    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd184531-b42a-4c01-a978-11c99b00d637-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:28:11.326596 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.326235    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bd184531-b42a-4c01-a978-11c99b00d637-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:28:11.326596 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.326259    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bd184531-b42a-4c01-a978-11c99b00d637-config\") pod \"prometheus-k8s-0\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:28:11.326596 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.326316    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bd184531-b42a-4c01-a978-11c99b00d637-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:28:11.326596 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.326345    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd184531-b42a-4c01-a978-11c99b00d637-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:28:11.326596 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.326386    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bd184531-b42a-4c01-a978-11c99b00d637-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:28:11.326596 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.326409    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bd184531-b42a-4c01-a978-11c99b00d637-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:28:11.326596 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.326427    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bd184531-b42a-4c01-a978-11c99b00d637-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:28:11.326596 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.326453    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bd184531-b42a-4c01-a978-11c99b00d637-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:28:11.326596 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.326478    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmsws\" (UniqueName: \"kubernetes.io/projected/bd184531-b42a-4c01-a978-11c99b00d637-kube-api-access-qmsws\") pod \"prometheus-k8s-0\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:28:11.326596 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.326504    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bd184531-b42a-4c01-a978-11c99b00d637-config-out\") pod \"prometheus-k8s-0\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:28:11.326596 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.326536    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bd184531-b42a-4c01-a978-11c99b00d637-web-config\") pod \"prometheus-k8s-0\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:28:11.326596 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.326560    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bd184531-b42a-4c01-a978-11c99b00d637-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:28:11.326596 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.326577    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bd184531-b42a-4c01-a978-11c99b00d637-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:28:11.326596 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.326595    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bd184531-b42a-4c01-a978-11c99b00d637-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:28:11.327108 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.326614    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bd184531-b42a-4c01-a978-11c99b00d637-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:28:11.427528 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.427489    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bd184531-b42a-4c01-a978-11c99b00d637-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:28:11.427528 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.427530    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bd184531-b42a-4c01-a978-11c99b00d637-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:28:11.427781 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.427551    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bd184531-b42a-4c01-a978-11c99b00d637-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:28:11.427781 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.427570    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bd184531-b42a-4c01-a978-11c99b00d637-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:28:11.427781 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.427589    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bd184531-b42a-4c01-a978-11c99b00d637-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:28:11.427781 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.427635    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd184531-b42a-4c01-a978-11c99b00d637-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:28:11.427781 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.427668    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd184531-b42a-4c01-a978-11c99b00d637-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:28:11.428009 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.427820    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd184531-b42a-4c01-a978-11c99b00d637-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:28:11.428009 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.427861    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bd184531-b42a-4c01-a978-11c99b00d637-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:28:11.428009 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.427899    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bd184531-b42a-4c01-a978-11c99b00d637-config\") pod \"prometheus-k8s-0\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:28:11.428009 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.427929    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bd184531-b42a-4c01-a978-11c99b00d637-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:28:11.428009 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.427974    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd184531-b42a-4c01-a978-11c99b00d637-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:28:11.428009 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.428007    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bd184531-b42a-4c01-a978-11c99b00d637-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:28:11.428334 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.428037    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bd184531-b42a-4c01-a978-11c99b00d637-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:28:11.428334 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.428062    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bd184531-b42a-4c01-a978-11c99b00d637-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:28:11.428334 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.428104    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bd184531-b42a-4c01-a978-11c99b00d637-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:28:11.428334 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.428144    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmsws\" (UniqueName: \"kubernetes.io/projected/bd184531-b42a-4c01-a978-11c99b00d637-kube-api-access-qmsws\") pod \"prometheus-k8s-0\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:28:11.428334 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.428161    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bd184531-b42a-4c01-a978-11c99b00d637-config-out\") pod \"prometheus-k8s-0\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:28:11.428334 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.428210    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bd184531-b42a-4c01-a978-11c99b00d637-web-config\") pod \"prometheus-k8s-0\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:28:11.428334 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.428233    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bd184531-b42a-4c01-a978-11c99b00d637-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:28:11.428334 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.428273    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bd184531-b42a-4c01-a978-11c99b00d637-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:28:11.428717 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.428590    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd184531-b42a-4c01-a978-11c99b00d637-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:28:11.428951 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.428923    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd184531-b42a-4c01-a978-11c99b00d637-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:28:11.429213 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.429191    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bd184531-b42a-4c01-a978-11c99b00d637-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:28:11.429283 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.429207    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd184531-b42a-4c01-a978-11c99b00d637-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:28:11.429526 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.429503    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bd184531-b42a-4c01-a978-11c99b00d637-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:28:11.430535 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.430507    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bd184531-b42a-4c01-a978-11c99b00d637-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:28:11.431000 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.430847    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bd184531-b42a-4c01-a978-11c99b00d637-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:28:11.431361 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.431112    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bd184531-b42a-4c01-a978-11c99b00d637-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:28:11.431361 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.431252    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bd184531-b42a-4c01-a978-11c99b00d637-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:28:11.431483 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.431375    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd184531-b42a-4c01-a978-11c99b00d637-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:28:11.432070 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.431935    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bd184531-b42a-4c01-a978-11c99b00d637-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:28:11.432070 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.432032    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bd184531-b42a-4c01-a978-11c99b00d637-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:28:11.432660 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.432637    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bd184531-b42a-4c01-a978-11c99b00d637-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:28:11.433336 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.433316    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bd184531-b42a-4c01-a978-11c99b00d637-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:28:11.433425 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.433319    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bd184531-b42a-4c01-a978-11c99b00d637-config-out\") pod \"prometheus-k8s-0\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:28:11.433425 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.433418    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bd184531-b42a-4c01-a978-11c99b00d637-web-config\") pod \"prometheus-k8s-0\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:28:11.433670 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.433652    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/bd184531-b42a-4c01-a978-11c99b00d637-config\") pod \"prometheus-k8s-0\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:28:11.438363 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.438343    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bd184531-b42a-4c01-a978-11c99b00d637-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:28:11.440719 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.440698    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmsws\" (UniqueName: \"kubernetes.io/projected/bd184531-b42a-4c01-a978-11c99b00d637-kube-api-access-qmsws\") pod \"prometheus-k8s-0\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:28:11.512962 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.512926    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:28:11.818827 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:11.818568    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 09 13:28:11.821553 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:28:11.821520    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd184531_b42a_4c01_a978_11c99b00d637.slice/crio-dc331c609e364fcc093700d805970b37e24f61ed51b4e1489f5dd47f6906a23c WatchSource:0}: Error finding container dc331c609e364fcc093700d805970b37e24f61ed51b4e1489f5dd47f6906a23c: Status 404 returned error can't find the container with id dc331c609e364fcc093700d805970b37e24f61ed51b4e1489f5dd47f6906a23c
Sep 09 13:28:12.173832 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:12.173799    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bd184531-b42a-4c01-a978-11c99b00d637","Type":"ContainerStarted","Data":"dc331c609e364fcc093700d805970b37e24f61ed51b4e1489f5dd47f6906a23c"}
Sep 09 13:28:13.181106 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:13.181069    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5dd99cbf48-hhw7x" event={"ID":"928b5550-3225-43a5-8833-acd6039a524a","Type":"ContainerStarted","Data":"b80fe2e6b49134892e4ac3b20682be5aed27d5eeaa753641de9a25c82389802b"}
Sep 09 13:28:13.181592 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:13.181163    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5dd99cbf48-hhw7x" event={"ID":"928b5550-3225-43a5-8833-acd6039a524a","Type":"ContainerStarted","Data":"b4e5009c1aa525d16a3212b91e26ce9984f7f7cd58beeca209918d1d97fa0826"}
Sep 09 13:28:13.181592 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:13.181208    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5dd99cbf48-hhw7x" event={"ID":"928b5550-3225-43a5-8833-acd6039a524a","Type":"ContainerStarted","Data":"8bb287e2a3da3f76d41ba640a207e1ba8a5db35ee4d4d806ed08446157260c6d"}
Sep 09 13:28:13.181592 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:13.181243    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5dd99cbf48-hhw7x"
Sep 09 13:28:13.210601 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:13.210530    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5dd99cbf48-hhw7x" podStartSLOduration=3.016508465 podStartE2EDuration="7.210508689s" totalImagesPullingTime="4.194000224s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 13:28:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 13:28:13.209162133 +0000 UTC m=+105.024686364" watchObservedRunningTime="2026-09-09 13:28:13.210508689 +0000 UTC m=+105.026032906"
Sep 09 13:28:13.779516 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:13.779485    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:28:13.879290 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:13.879260    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:28:14.186135 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:14.186100    2578 generic.go:356] "Generic (PLEG): container finished" podID="bd184531-b42a-4c01-a978-11c99b00d637" containerID="3a3c0d9306f45259b709f67a015ebfc654809dab41be2584855d99c50ffd5acd" exitCode=0
Sep 09 13:28:14.186546 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:14.186195    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bd184531-b42a-4c01-a978-11c99b00d637","Type":"ContainerDied","Data":"3a3c0d9306f45259b709f67a015ebfc654809dab41be2584855d99c50ffd5acd"}
Sep 09 13:28:15.584950 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:15.584913    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6fffffc674-9fd8w"]
Sep 09 13:28:17.129869 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:17.129832    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:28:17.241707 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:17.241674    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:28:18.206802 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:18.206777    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bd184531-b42a-4c01-a978-11c99b00d637","Type":"ContainerStarted","Data":"53fe36f869d02f0e03bad898dafcb34e1ade9acd98790d84fc37bb469f7a1750"}
Sep 09 13:28:18.207148 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:18.206852    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bd184531-b42a-4c01-a978-11c99b00d637","Type":"ContainerStarted","Data":"6d05a261eb91800071f80e265344ae8dc5a934cfdad017c308c58bf8d2f83905"}
Sep 09 13:28:18.207148 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:18.206900    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bd184531-b42a-4c01-a978-11c99b00d637","Type":"ContainerStarted","Data":"b3a232704d2ce90f67f941ab00fe9e59fec35ff40b9ce92d2a671618cda584df"}
Sep 09 13:28:18.207148 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:18.206942    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bd184531-b42a-4c01-a978-11c99b00d637","Type":"ContainerStarted","Data":"3da3c8cc00f898b476bd816ee37b3a3ec403cd6bff295022d81eeca6972acdf8"}
Sep 09 13:28:19.192683 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:19.192655    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5dd99cbf48-hhw7x"
Sep 09 13:28:19.214499 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:19.214465    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bd184531-b42a-4c01-a978-11c99b00d637","Type":"ContainerStarted","Data":"86045e0265ce2ffa4f66e57a08c69a5dd0431537ce160ba10bf11396ca1919d6"}
Sep 09 13:28:19.215065 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:19.214543    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bd184531-b42a-4c01-a978-11c99b00d637","Type":"ContainerStarted","Data":"5df1ee7b8bb0b69e8a228c1a53f4b3e9e78c2f85f947f5f7876465720a8820bd"}
Sep 09 13:28:19.247573 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:19.247522    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.867440695 podStartE2EDuration="8.247503804s" totalImagesPullingTime="5.359300213s" totalInitContainerRuntime="20.762896ms" isStatefulPod=false podCreationTimestamp="2026-09-09 13:28:11 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 13:28:19.245856345 +0000 UTC m=+111.061380541" watchObservedRunningTime="2026-09-09 13:28:19.247503804 +0000 UTC m=+111.063027998"
Sep 09 13:28:19.937010 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:19.936981    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:28:20.007293 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:20.007249    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6fffffc674-9fd8w"
Sep 09 13:28:20.037637 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:20.037607    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:28:21.513810 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:21.513764    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:28:21.780904 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:21.780828    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:28:21.845119 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:21.845086    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:28:26.193812 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:26.193777    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c86bb7fd7-g7c9c"]
Sep 09 13:28:26.308892 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:26.308863    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:28:26.418054 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:26.418026    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:28:26.480400 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:26.480325    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:28:29.145264 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:29.145234    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:28:29.245501 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:29.245470    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:28:29.346576 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:29.346547    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:28:32.209849 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:32.209788    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5fff9fbb7b-lhmrw" podUID="e64a6d9b-fdad-40f4-baea-41eb123cdf37" containerName="console" containerID="cri-o://1f893b1620c2162ef0ca59595f2e9debc524dfd1f14f634ff9e4e0e6c8929713" gracePeriod=15
Sep 09 13:28:32.486597 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:32.486530    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fff9fbb7b-lhmrw"
Sep 09 13:28:32.609530 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:32.609497    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e64a6d9b-fdad-40f4-baea-41eb123cdf37-oauth-serving-cert\") pod \"e64a6d9b-fdad-40f4-baea-41eb123cdf37\" (UID: \"e64a6d9b-fdad-40f4-baea-41eb123cdf37\") "
Sep 09 13:28:32.609530 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:32.609539    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e64a6d9b-fdad-40f4-baea-41eb123cdf37-console-serving-cert\") pod \"e64a6d9b-fdad-40f4-baea-41eb123cdf37\" (UID: \"e64a6d9b-fdad-40f4-baea-41eb123cdf37\") "
Sep 09 13:28:32.609734 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:32.609558    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e64a6d9b-fdad-40f4-baea-41eb123cdf37-service-ca\") pod \"e64a6d9b-fdad-40f4-baea-41eb123cdf37\" (UID: \"e64a6d9b-fdad-40f4-baea-41eb123cdf37\") "
Sep 09 13:28:32.609734 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:32.609605    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e64a6d9b-fdad-40f4-baea-41eb123cdf37-console-config\") pod \"e64a6d9b-fdad-40f4-baea-41eb123cdf37\" (UID: \"e64a6d9b-fdad-40f4-baea-41eb123cdf37\") "
Sep 09 13:28:32.609734 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:32.609657    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e64a6d9b-fdad-40f4-baea-41eb123cdf37-console-oauth-config\") pod \"e64a6d9b-fdad-40f4-baea-41eb123cdf37\" (UID: \"e64a6d9b-fdad-40f4-baea-41eb123cdf37\") "
Sep 09 13:28:32.609734 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:32.609687    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lkvx2\" (UniqueName: \"kubernetes.io/projected/e64a6d9b-fdad-40f4-baea-41eb123cdf37-kube-api-access-lkvx2\") pod \"e64a6d9b-fdad-40f4-baea-41eb123cdf37\" (UID: \"e64a6d9b-fdad-40f4-baea-41eb123cdf37\") "
Sep 09 13:28:32.610020 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:32.609991    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e64a6d9b-fdad-40f4-baea-41eb123cdf37-service-ca" (OuterVolumeSpecName: "service-ca") pod "e64a6d9b-fdad-40f4-baea-41eb123cdf37" (UID: "e64a6d9b-fdad-40f4-baea-41eb123cdf37"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 13:28:32.610120 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:32.610017    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e64a6d9b-fdad-40f4-baea-41eb123cdf37-console-config" (OuterVolumeSpecName: "console-config") pod "e64a6d9b-fdad-40f4-baea-41eb123cdf37" (UID: "e64a6d9b-fdad-40f4-baea-41eb123cdf37"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 13:28:32.610120 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:32.610036    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e64a6d9b-fdad-40f4-baea-41eb123cdf37-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e64a6d9b-fdad-40f4-baea-41eb123cdf37" (UID: "e64a6d9b-fdad-40f4-baea-41eb123cdf37"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 13:28:32.611916 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:32.611885    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e64a6d9b-fdad-40f4-baea-41eb123cdf37-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e64a6d9b-fdad-40f4-baea-41eb123cdf37" (UID: "e64a6d9b-fdad-40f4-baea-41eb123cdf37"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 13:28:32.611916 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:32.611892    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e64a6d9b-fdad-40f4-baea-41eb123cdf37-kube-api-access-lkvx2" (OuterVolumeSpecName: "kube-api-access-lkvx2") pod "e64a6d9b-fdad-40f4-baea-41eb123cdf37" (UID: "e64a6d9b-fdad-40f4-baea-41eb123cdf37"). InnerVolumeSpecName "kube-api-access-lkvx2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 13:28:32.612045 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:32.611924    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e64a6d9b-fdad-40f4-baea-41eb123cdf37-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e64a6d9b-fdad-40f4-baea-41eb123cdf37" (UID: "e64a6d9b-fdad-40f4-baea-41eb123cdf37"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 13:28:32.710681 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:32.710624    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e64a6d9b-fdad-40f4-baea-41eb123cdf37-console-config\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:28:32.710681 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:32.710671    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e64a6d9b-fdad-40f4-baea-41eb123cdf37-console-oauth-config\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:28:32.710681 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:32.710682    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lkvx2\" (UniqueName: \"kubernetes.io/projected/e64a6d9b-fdad-40f4-baea-41eb123cdf37-kube-api-access-lkvx2\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:28:32.710681 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:32.710692    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e64a6d9b-fdad-40f4-baea-41eb123cdf37-oauth-serving-cert\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:28:32.710929 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:32.710701    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e64a6d9b-fdad-40f4-baea-41eb123cdf37-console-serving-cert\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:28:32.710929 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:32.710709    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e64a6d9b-fdad-40f4-baea-41eb123cdf37-service-ca\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:28:33.267146 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:33.267111    2578 generic.go:356] "Generic (PLEG): container finished" podID="e64a6d9b-fdad-40f4-baea-41eb123cdf37" containerID="1f893b1620c2162ef0ca59595f2e9debc524dfd1f14f634ff9e4e0e6c8929713" exitCode=0
Sep 09 13:28:33.267146 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:33.267150    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fff9fbb7b-lhmrw" event={"ID":"e64a6d9b-fdad-40f4-baea-41eb123cdf37","Type":"ContainerDied","Data":"1f893b1620c2162ef0ca59595f2e9debc524dfd1f14f634ff9e4e0e6c8929713"}
Sep 09 13:28:33.267617 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:33.267157    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fff9fbb7b-lhmrw"
Sep 09 13:28:33.267617 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:33.267206    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fff9fbb7b-lhmrw" event={"ID":"e64a6d9b-fdad-40f4-baea-41eb123cdf37","Type":"ContainerDied","Data":"15e763dd6481d9dd44d8f5de9bd82f8b8dcd4835cfb095886e048e137570abb2"}
Sep 09 13:28:33.267617 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:33.267226    2578 scope.go:117] "RemoveContainer" containerID="1f893b1620c2162ef0ca59595f2e9debc524dfd1f14f634ff9e4e0e6c8929713"
Sep 09 13:28:33.275333 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:33.275315    2578 scope.go:117] "RemoveContainer" containerID="1f893b1620c2162ef0ca59595f2e9debc524dfd1f14f634ff9e4e0e6c8929713"
Sep 09 13:28:33.275629 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:28:33.275608    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f893b1620c2162ef0ca59595f2e9debc524dfd1f14f634ff9e4e0e6c8929713\": container with ID starting with 1f893b1620c2162ef0ca59595f2e9debc524dfd1f14f634ff9e4e0e6c8929713 not found: ID does not exist" containerID="1f893b1620c2162ef0ca59595f2e9debc524dfd1f14f634ff9e4e0e6c8929713"
Sep 09 13:28:33.275699 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:33.275643    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f893b1620c2162ef0ca59595f2e9debc524dfd1f14f634ff9e4e0e6c8929713"} err="failed to get container status \"1f893b1620c2162ef0ca59595f2e9debc524dfd1f14f634ff9e4e0e6c8929713\": rpc error: code = NotFound desc = could not find container \"1f893b1620c2162ef0ca59595f2e9debc524dfd1f14f634ff9e4e0e6c8929713\": container with ID starting with 1f893b1620c2162ef0ca59595f2e9debc524dfd1f14f634ff9e4e0e6c8929713 not found: ID does not exist"
Sep 09 13:28:33.284549 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:33.284511    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5fff9fbb7b-lhmrw"]
Sep 09 13:28:33.288558 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:33.288538    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5fff9fbb7b-lhmrw"]
Sep 09 13:28:34.659519 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:34.659485    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e64a6d9b-fdad-40f4-baea-41eb123cdf37" path="/var/lib/kubelet/pods/e64a6d9b-fdad-40f4-baea-41eb123cdf37/volumes"
Sep 09 13:28:36.759223 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:36.759188    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:28:36.860400 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:36.860368    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:28:40.607642 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:40.607600    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6fffffc674-9fd8w" podUID="a3e5347b-c510-488b-9c63-ffd395958d43" containerName="console" containerID="cri-o://2b643bb20b3dd3841d339c5ed29220796d0ad96522e8b7a54e560ec59bd22d31" gracePeriod=15
Sep 09 13:28:40.893187 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:40.893149    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fffffc674-9fd8w"
Sep 09 13:28:40.978324 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:40.978282    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a3e5347b-c510-488b-9c63-ffd395958d43-console-oauth-config\") pod \"a3e5347b-c510-488b-9c63-ffd395958d43\" (UID: \"a3e5347b-c510-488b-9c63-ffd395958d43\") "
Sep 09 13:28:40.978324 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:40.978324    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3e5347b-c510-488b-9c63-ffd395958d43-trusted-ca-bundle\") pod \"a3e5347b-c510-488b-9c63-ffd395958d43\" (UID: \"a3e5347b-c510-488b-9c63-ffd395958d43\") "
Sep 09 13:28:40.978580 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:40.978370    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a3e5347b-c510-488b-9c63-ffd395958d43-console-config\") pod \"a3e5347b-c510-488b-9c63-ffd395958d43\" (UID: \"a3e5347b-c510-488b-9c63-ffd395958d43\") "
Sep 09 13:28:40.978580 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:40.978397    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a3e5347b-c510-488b-9c63-ffd395958d43-service-ca\") pod \"a3e5347b-c510-488b-9c63-ffd395958d43\" (UID: \"a3e5347b-c510-488b-9c63-ffd395958d43\") "
Sep 09 13:28:40.978580 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:40.978426    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a3e5347b-c510-488b-9c63-ffd395958d43-console-serving-cert\") pod \"a3e5347b-c510-488b-9c63-ffd395958d43\" (UID: \"a3e5347b-c510-488b-9c63-ffd395958d43\") "
Sep 09 13:28:40.978580 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:40.978467    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-stv9b\" (UniqueName: \"kubernetes.io/projected/a3e5347b-c510-488b-9c63-ffd395958d43-kube-api-access-stv9b\") pod \"a3e5347b-c510-488b-9c63-ffd395958d43\" (UID: \"a3e5347b-c510-488b-9c63-ffd395958d43\") "
Sep 09 13:28:40.978580 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:40.978489    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a3e5347b-c510-488b-9c63-ffd395958d43-oauth-serving-cert\") pod \"a3e5347b-c510-488b-9c63-ffd395958d43\" (UID: \"a3e5347b-c510-488b-9c63-ffd395958d43\") "
Sep 09 13:28:40.978944 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:40.978900    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3e5347b-c510-488b-9c63-ffd395958d43-console-config" (OuterVolumeSpecName: "console-config") pod "a3e5347b-c510-488b-9c63-ffd395958d43" (UID: "a3e5347b-c510-488b-9c63-ffd395958d43"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 13:28:40.978944 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:40.978910    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3e5347b-c510-488b-9c63-ffd395958d43-service-ca" (OuterVolumeSpecName: "service-ca") pod "a3e5347b-c510-488b-9c63-ffd395958d43" (UID: "a3e5347b-c510-488b-9c63-ffd395958d43"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 13:28:40.978944 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:40.978934    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3e5347b-c510-488b-9c63-ffd395958d43-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a3e5347b-c510-488b-9c63-ffd395958d43" (UID: "a3e5347b-c510-488b-9c63-ffd395958d43"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 13:28:40.979123 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:40.978975    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3e5347b-c510-488b-9c63-ffd395958d43-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a3e5347b-c510-488b-9c63-ffd395958d43" (UID: "a3e5347b-c510-488b-9c63-ffd395958d43"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 13:28:40.980667 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:40.980639    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3e5347b-c510-488b-9c63-ffd395958d43-kube-api-access-stv9b" (OuterVolumeSpecName: "kube-api-access-stv9b") pod "a3e5347b-c510-488b-9c63-ffd395958d43" (UID: "a3e5347b-c510-488b-9c63-ffd395958d43"). InnerVolumeSpecName "kube-api-access-stv9b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 13:28:40.980964 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:40.980940    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3e5347b-c510-488b-9c63-ffd395958d43-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a3e5347b-c510-488b-9c63-ffd395958d43" (UID: "a3e5347b-c510-488b-9c63-ffd395958d43"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 13:28:40.981044 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:40.980966    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3e5347b-c510-488b-9c63-ffd395958d43-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a3e5347b-c510-488b-9c63-ffd395958d43" (UID: "a3e5347b-c510-488b-9c63-ffd395958d43"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 13:28:41.079538 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:41.079497    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a3e5347b-c510-488b-9c63-ffd395958d43-console-config\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:28:41.079538 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:41.079531    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a3e5347b-c510-488b-9c63-ffd395958d43-service-ca\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:28:41.079538 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:41.079540    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a3e5347b-c510-488b-9c63-ffd395958d43-console-serving-cert\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:28:41.079538 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:41.079549    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-stv9b\" (UniqueName: \"kubernetes.io/projected/a3e5347b-c510-488b-9c63-ffd395958d43-kube-api-access-stv9b\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:28:41.079843 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:41.079558    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a3e5347b-c510-488b-9c63-ffd395958d43-oauth-serving-cert\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:28:41.079843 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:41.079566    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a3e5347b-c510-488b-9c63-ffd395958d43-console-oauth-config\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:28:41.079843 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:41.079574    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3e5347b-c510-488b-9c63-ffd395958d43-trusted-ca-bundle\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:28:41.297462 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:41.297382    2578 generic.go:356] "Generic (PLEG): container finished" podID="a3e5347b-c510-488b-9c63-ffd395958d43" containerID="2b643bb20b3dd3841d339c5ed29220796d0ad96522e8b7a54e560ec59bd22d31" exitCode=0
Sep 09 13:28:41.297462 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:41.297425    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fffffc674-9fd8w"
Sep 09 13:28:41.297462 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:41.297440    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fffffc674-9fd8w" event={"ID":"a3e5347b-c510-488b-9c63-ffd395958d43","Type":"ContainerDied","Data":"2b643bb20b3dd3841d339c5ed29220796d0ad96522e8b7a54e560ec59bd22d31"}
Sep 09 13:28:41.297662 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:41.297487    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fffffc674-9fd8w" event={"ID":"a3e5347b-c510-488b-9c63-ffd395958d43","Type":"ContainerDied","Data":"6bd543fef60884deb2270e9d497ce5b3c4c0f8c240c59afe796181eac1438e45"}
Sep 09 13:28:41.297662 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:41.297510    2578 scope.go:117] "RemoveContainer" containerID="2b643bb20b3dd3841d339c5ed29220796d0ad96522e8b7a54e560ec59bd22d31"
Sep 09 13:28:41.305662 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:41.305645    2578 scope.go:117] "RemoveContainer" containerID="2b643bb20b3dd3841d339c5ed29220796d0ad96522e8b7a54e560ec59bd22d31"
Sep 09 13:28:41.305939 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:28:41.305920    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b643bb20b3dd3841d339c5ed29220796d0ad96522e8b7a54e560ec59bd22d31\": container with ID starting with 2b643bb20b3dd3841d339c5ed29220796d0ad96522e8b7a54e560ec59bd22d31 not found: ID does not exist" containerID="2b643bb20b3dd3841d339c5ed29220796d0ad96522e8b7a54e560ec59bd22d31"
Sep 09 13:28:41.305989 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:41.305949    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b643bb20b3dd3841d339c5ed29220796d0ad96522e8b7a54e560ec59bd22d31"} err="failed to get container status \"2b643bb20b3dd3841d339c5ed29220796d0ad96522e8b7a54e560ec59bd22d31\": rpc error: code = NotFound desc = could not find container \"2b643bb20b3dd3841d339c5ed29220796d0ad96522e8b7a54e560ec59bd22d31\": container with ID starting with 2b643bb20b3dd3841d339c5ed29220796d0ad96522e8b7a54e560ec59bd22d31 not found: ID does not exist"
Sep 09 13:28:41.319807 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:41.319787    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6fffffc674-9fd8w"]
Sep 09 13:28:41.323497 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:41.323477    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6fffffc674-9fd8w"]
Sep 09 13:28:42.659411 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:42.659382    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3e5347b-c510-488b-9c63-ffd395958d43" path="/var/lib/kubelet/pods/a3e5347b-c510-488b-9c63-ffd395958d43/volumes"
Sep 09 13:28:51.213066 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:51.213017    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5c86bb7fd7-g7c9c" podUID="b3f61f10-185f-4683-be63-d08890b3cf60" containerName="console" containerID="cri-o://b39af412d39efc2f61444f201041ae2934b2c50655f4b8d954f7e8fcd25e0fcd" gracePeriod=15
Sep 09 13:28:51.338399 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:51.338369    2578 generic.go:356] "Generic (PLEG): container finished" podID="b3f61f10-185f-4683-be63-d08890b3cf60" containerID="b39af412d39efc2f61444f201041ae2934b2c50655f4b8d954f7e8fcd25e0fcd" exitCode=0
Sep 09 13:28:51.338553 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:51.338427    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c86bb7fd7-g7c9c" event={"ID":"b3f61f10-185f-4683-be63-d08890b3cf60","Type":"ContainerDied","Data":"b39af412d39efc2f61444f201041ae2934b2c50655f4b8d954f7e8fcd25e0fcd"}
Sep 09 13:28:51.477197 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:51.477113    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c86bb7fd7-g7c9c"
Sep 09 13:28:51.560640 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:51.560599    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b3f61f10-185f-4683-be63-d08890b3cf60-oauth-serving-cert\") pod \"b3f61f10-185f-4683-be63-d08890b3cf60\" (UID: \"b3f61f10-185f-4683-be63-d08890b3cf60\") "
Sep 09 13:28:51.560640 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:51.560643    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b3f61f10-185f-4683-be63-d08890b3cf60-service-ca\") pod \"b3f61f10-185f-4683-be63-d08890b3cf60\" (UID: \"b3f61f10-185f-4683-be63-d08890b3cf60\") "
Sep 09 13:28:51.560872 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:51.560679    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b3f61f10-185f-4683-be63-d08890b3cf60-console-serving-cert\") pod \"b3f61f10-185f-4683-be63-d08890b3cf60\" (UID: \"b3f61f10-185f-4683-be63-d08890b3cf60\") "
Sep 09 13:28:51.560872 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:51.560721    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b3f61f10-185f-4683-be63-d08890b3cf60-console-config\") pod \"b3f61f10-185f-4683-be63-d08890b3cf60\" (UID: \"b3f61f10-185f-4683-be63-d08890b3cf60\") "
Sep 09 13:28:51.560872 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:51.560771    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r7446\" (UniqueName: \"kubernetes.io/projected/b3f61f10-185f-4683-be63-d08890b3cf60-kube-api-access-r7446\") pod \"b3f61f10-185f-4683-be63-d08890b3cf60\" (UID: \"b3f61f10-185f-4683-be63-d08890b3cf60\") "
Sep 09 13:28:51.560872 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:51.560809    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3f61f10-185f-4683-be63-d08890b3cf60-trusted-ca-bundle\") pod \"b3f61f10-185f-4683-be63-d08890b3cf60\" (UID: \"b3f61f10-185f-4683-be63-d08890b3cf60\") "
Sep 09 13:28:51.560872 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:51.560838    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b3f61f10-185f-4683-be63-d08890b3cf60-console-oauth-config\") pod \"b3f61f10-185f-4683-be63-d08890b3cf60\" (UID: \"b3f61f10-185f-4683-be63-d08890b3cf60\") "
Sep 09 13:28:51.561147 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:51.561118    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3f61f10-185f-4683-be63-d08890b3cf60-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b3f61f10-185f-4683-be63-d08890b3cf60" (UID: "b3f61f10-185f-4683-be63-d08890b3cf60"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 13:28:51.561350 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:51.561320    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3f61f10-185f-4683-be63-d08890b3cf60-service-ca" (OuterVolumeSpecName: "service-ca") pod "b3f61f10-185f-4683-be63-d08890b3cf60" (UID: "b3f61f10-185f-4683-be63-d08890b3cf60"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 13:28:51.561437 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:51.561340    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3f61f10-185f-4683-be63-d08890b3cf60-console-config" (OuterVolumeSpecName: "console-config") pod "b3f61f10-185f-4683-be63-d08890b3cf60" (UID: "b3f61f10-185f-4683-be63-d08890b3cf60"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 13:28:51.561437 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:51.561408    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3f61f10-185f-4683-be63-d08890b3cf60-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b3f61f10-185f-4683-be63-d08890b3cf60" (UID: "b3f61f10-185f-4683-be63-d08890b3cf60"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 13:28:51.562894 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:51.562868    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3f61f10-185f-4683-be63-d08890b3cf60-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b3f61f10-185f-4683-be63-d08890b3cf60" (UID: "b3f61f10-185f-4683-be63-d08890b3cf60"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 13:28:51.562991 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:51.562971    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3f61f10-185f-4683-be63-d08890b3cf60-kube-api-access-r7446" (OuterVolumeSpecName: "kube-api-access-r7446") pod "b3f61f10-185f-4683-be63-d08890b3cf60" (UID: "b3f61f10-185f-4683-be63-d08890b3cf60"). InnerVolumeSpecName "kube-api-access-r7446". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 13:28:51.563048 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:51.563013    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3f61f10-185f-4683-be63-d08890b3cf60-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b3f61f10-185f-4683-be63-d08890b3cf60" (UID: "b3f61f10-185f-4683-be63-d08890b3cf60"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 13:28:51.661592 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:51.661552    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b3f61f10-185f-4683-be63-d08890b3cf60-oauth-serving-cert\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:28:51.661592 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:51.661586    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b3f61f10-185f-4683-be63-d08890b3cf60-service-ca\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:28:51.661592 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:51.661595    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b3f61f10-185f-4683-be63-d08890b3cf60-console-serving-cert\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:28:51.661592 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:51.661604    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b3f61f10-185f-4683-be63-d08890b3cf60-console-config\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:28:51.661851 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:51.661613    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r7446\" (UniqueName: \"kubernetes.io/projected/b3f61f10-185f-4683-be63-d08890b3cf60-kube-api-access-r7446\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:28:51.661851 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:51.661622    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3f61f10-185f-4683-be63-d08890b3cf60-trusted-ca-bundle\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:28:51.661851 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:51.661631    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b3f61f10-185f-4683-be63-d08890b3cf60-console-oauth-config\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:28:52.343277 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:52.343240    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c86bb7fd7-g7c9c" event={"ID":"b3f61f10-185f-4683-be63-d08890b3cf60","Type":"ContainerDied","Data":"71698163c69cd7ef1722a8c35db0971266c7d779ecfdb6e625f72255f3259e88"}
Sep 09 13:28:52.343277 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:52.343268    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c86bb7fd7-g7c9c"
Sep 09 13:28:52.343798 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:52.343327    2578 scope.go:117] "RemoveContainer" containerID="b39af412d39efc2f61444f201041ae2934b2c50655f4b8d954f7e8fcd25e0fcd"
Sep 09 13:28:52.363849 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:52.363818    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c86bb7fd7-g7c9c"]
Sep 09 13:28:52.367742 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:52.367713    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5c86bb7fd7-g7c9c"]
Sep 09 13:28:52.659455 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:28:52.659426    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3f61f10-185f-4683-be63-d08890b3cf60" path="/var/lib/kubelet/pods/b3f61f10-185f-4683-be63-d08890b3cf60/volumes"
Sep 09 13:29:11.513663 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:11.513606    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:29:11.532454 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:11.532427    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:29:12.432320 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:12.432292    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:29:21.022763 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:21.022678    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:29:21.088276 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:21.088243    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:29:29.515128 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:29.515092    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 09 13:29:29.515585 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:29.515397    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="bd184531-b42a-4c01-a978-11c99b00d637" containerName="prometheus" containerID="cri-o://3da3c8cc00f898b476bd816ee37b3a3ec403cd6bff295022d81eeca6972acdf8" gracePeriod=600
Sep 09 13:29:29.515585 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:29.515410    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="bd184531-b42a-4c01-a978-11c99b00d637" containerName="kube-rbac-proxy" containerID="cri-o://5df1ee7b8bb0b69e8a228c1a53f4b3e9e78c2f85f947f5f7876465720a8820bd" gracePeriod=600
Sep 09 13:29:29.515585 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:29.515460    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="bd184531-b42a-4c01-a978-11c99b00d637" containerName="config-reloader" containerID="cri-o://b3a232704d2ce90f67f941ab00fe9e59fec35ff40b9ce92d2a671618cda584df" gracePeriod=600
Sep 09 13:29:29.515585 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:29.515490    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="bd184531-b42a-4c01-a978-11c99b00d637" containerName="kube-rbac-proxy-web" containerID="cri-o://53fe36f869d02f0e03bad898dafcb34e1ade9acd98790d84fc37bb469f7a1750" gracePeriod=600
Sep 09 13:29:29.515585 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:29.515432    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="bd184531-b42a-4c01-a978-11c99b00d637" containerName="kube-rbac-proxy-thanos" containerID="cri-o://86045e0265ce2ffa4f66e57a08c69a5dd0431537ce160ba10bf11396ca1919d6" gracePeriod=600
Sep 09 13:29:29.515585 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:29.515460    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="bd184531-b42a-4c01-a978-11c99b00d637" containerName="thanos-sidecar" containerID="cri-o://6d05a261eb91800071f80e265344ae8dc5a934cfdad017c308c58bf8d2f83905" gracePeriod=600
Sep 09 13:29:29.755904 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:29.755879    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:29:29.845302 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:29.845225    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd184531-b42a-4c01-a978-11c99b00d637-configmap-kubelet-serving-ca-bundle\") pod \"bd184531-b42a-4c01-a978-11c99b00d637\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") "
Sep 09 13:29:29.845302 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:29.845262    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bd184531-b42a-4c01-a978-11c99b00d637-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"bd184531-b42a-4c01-a978-11c99b00d637\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") "
Sep 09 13:29:29.845302 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:29.845287    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bd184531-b42a-4c01-a978-11c99b00d637-config\") pod \"bd184531-b42a-4c01-a978-11c99b00d637\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") "
Sep 09 13:29:29.845566 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:29.845313    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bd184531-b42a-4c01-a978-11c99b00d637-secret-prometheus-k8s-tls\") pod \"bd184531-b42a-4c01-a978-11c99b00d637\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") "
Sep 09 13:29:29.845566 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:29.845395    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bd184531-b42a-4c01-a978-11c99b00d637-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"bd184531-b42a-4c01-a978-11c99b00d637\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") "
Sep 09 13:29:29.845566 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:29.845425    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bd184531-b42a-4c01-a978-11c99b00d637-config-out\") pod \"bd184531-b42a-4c01-a978-11c99b00d637\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") "
Sep 09 13:29:29.845566 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:29.845452    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bd184531-b42a-4c01-a978-11c99b00d637-secret-grpc-tls\") pod \"bd184531-b42a-4c01-a978-11c99b00d637\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") "
Sep 09 13:29:29.845566 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:29.845477    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bd184531-b42a-4c01-a978-11c99b00d637-prometheus-k8s-rulefiles-1\") pod \"bd184531-b42a-4c01-a978-11c99b00d637\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") "
Sep 09 13:29:29.845566 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:29.845517    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd184531-b42a-4c01-a978-11c99b00d637-prometheus-trusted-ca-bundle\") pod \"bd184531-b42a-4c01-a978-11c99b00d637\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") "
Sep 09 13:29:29.845566 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:29.845539    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bd184531-b42a-4c01-a978-11c99b00d637-prometheus-k8s-db\") pod \"bd184531-b42a-4c01-a978-11c99b00d637\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") "
Sep 09 13:29:29.845566 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:29.845566    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bd184531-b42a-4c01-a978-11c99b00d637-prometheus-k8s-rulefiles-2\") pod \"bd184531-b42a-4c01-a978-11c99b00d637\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") "
Sep 09 13:29:29.845953 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:29.845596    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd184531-b42a-4c01-a978-11c99b00d637-configmap-serving-certs-ca-bundle\") pod \"bd184531-b42a-4c01-a978-11c99b00d637\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") "
Sep 09 13:29:29.845953 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:29.845630    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bd184531-b42a-4c01-a978-11c99b00d637-web-config\") pod \"bd184531-b42a-4c01-a978-11c99b00d637\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") "
Sep 09 13:29:29.845953 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:29.845654    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bd184531-b42a-4c01-a978-11c99b00d637-secret-metrics-client-certs\") pod \"bd184531-b42a-4c01-a978-11c99b00d637\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") "
Sep 09 13:29:29.845953 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:29.845674    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd184531-b42a-4c01-a978-11c99b00d637-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "bd184531-b42a-4c01-a978-11c99b00d637" (UID: "bd184531-b42a-4c01-a978-11c99b00d637"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 13:29:29.845953 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:29.845688    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd184531-b42a-4c01-a978-11c99b00d637-configmap-metrics-client-ca\") pod \"bd184531-b42a-4c01-a978-11c99b00d637\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") "
Sep 09 13:29:29.845953 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:29.845747    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bd184531-b42a-4c01-a978-11c99b00d637-prometheus-k8s-rulefiles-0\") pod \"bd184531-b42a-4c01-a978-11c99b00d637\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") "
Sep 09 13:29:29.845953 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:29.845784    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qmsws\" (UniqueName: \"kubernetes.io/projected/bd184531-b42a-4c01-a978-11c99b00d637-kube-api-access-qmsws\") pod \"bd184531-b42a-4c01-a978-11c99b00d637\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") "
Sep 09 13:29:29.845953 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:29.845811    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bd184531-b42a-4c01-a978-11c99b00d637-thanos-prometheus-http-client-file\") pod \"bd184531-b42a-4c01-a978-11c99b00d637\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") "
Sep 09 13:29:29.846351 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:29.845998    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bd184531-b42a-4c01-a978-11c99b00d637-secret-kube-rbac-proxy\") pod \"bd184531-b42a-4c01-a978-11c99b00d637\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") "
Sep 09 13:29:29.846351 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:29.846029    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bd184531-b42a-4c01-a978-11c99b00d637-tls-assets\") pod \"bd184531-b42a-4c01-a978-11c99b00d637\" (UID: \"bd184531-b42a-4c01-a978-11c99b00d637\") "
Sep 09 13:29:29.846351 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:29.846303    2578 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd184531-b42a-4c01-a978-11c99b00d637-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:29:29.846484 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:29.846431    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd184531-b42a-4c01-a978-11c99b00d637-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "bd184531-b42a-4c01-a978-11c99b00d637" (UID: "bd184531-b42a-4c01-a978-11c99b00d637"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 13:29:29.846605 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:29.846578    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd184531-b42a-4c01-a978-11c99b00d637-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "bd184531-b42a-4c01-a978-11c99b00d637" (UID: "bd184531-b42a-4c01-a978-11c99b00d637"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 13:29:29.847166 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:29.846974    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd184531-b42a-4c01-a978-11c99b00d637-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "bd184531-b42a-4c01-a978-11c99b00d637" (UID: "bd184531-b42a-4c01-a978-11c99b00d637"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 13:29:29.847820 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:29.847498    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd184531-b42a-4c01-a978-11c99b00d637-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "bd184531-b42a-4c01-a978-11c99b00d637" (UID: "bd184531-b42a-4c01-a978-11c99b00d637"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 13:29:29.847820 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:29.847762    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd184531-b42a-4c01-a978-11c99b00d637-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "bd184531-b42a-4c01-a978-11c99b00d637" (UID: "bd184531-b42a-4c01-a978-11c99b00d637"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 13:29:29.848203 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:29.848140    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd184531-b42a-4c01-a978-11c99b00d637-config" (OuterVolumeSpecName: "config") pod "bd184531-b42a-4c01-a978-11c99b00d637" (UID: "bd184531-b42a-4c01-a978-11c99b00d637"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 13:29:29.848646 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:29.848623    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd184531-b42a-4c01-a978-11c99b00d637-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "bd184531-b42a-4c01-a978-11c99b00d637" (UID: "bd184531-b42a-4c01-a978-11c99b00d637"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 13:29:29.849288 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:29.849260    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd184531-b42a-4c01-a978-11c99b00d637-config-out" (OuterVolumeSpecName: "config-out") pod "bd184531-b42a-4c01-a978-11c99b00d637" (UID: "bd184531-b42a-4c01-a978-11c99b00d637"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 13:29:29.849625 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:29.849605    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd184531-b42a-4c01-a978-11c99b00d637-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "bd184531-b42a-4c01-a978-11c99b00d637" (UID: "bd184531-b42a-4c01-a978-11c99b00d637"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 13:29:29.849743 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:29.849711    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd184531-b42a-4c01-a978-11c99b00d637-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "bd184531-b42a-4c01-a978-11c99b00d637" (UID: "bd184531-b42a-4c01-a978-11c99b00d637"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 13:29:29.849743 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:29.849724    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd184531-b42a-4c01-a978-11c99b00d637-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "bd184531-b42a-4c01-a978-11c99b00d637" (UID: "bd184531-b42a-4c01-a978-11c99b00d637"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 13:29:29.849845 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:29.849692    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd184531-b42a-4c01-a978-11c99b00d637-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "bd184531-b42a-4c01-a978-11c99b00d637" (UID: "bd184531-b42a-4c01-a978-11c99b00d637"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 13:29:29.849845 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:29.849658    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd184531-b42a-4c01-a978-11c99b00d637-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "bd184531-b42a-4c01-a978-11c99b00d637" (UID: "bd184531-b42a-4c01-a978-11c99b00d637"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 13:29:29.849991 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:29.849970    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd184531-b42a-4c01-a978-11c99b00d637-kube-api-access-qmsws" (OuterVolumeSpecName: "kube-api-access-qmsws") pod "bd184531-b42a-4c01-a978-11c99b00d637" (UID: "bd184531-b42a-4c01-a978-11c99b00d637"). InnerVolumeSpecName "kube-api-access-qmsws". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 13:29:29.850152 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:29.850134    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd184531-b42a-4c01-a978-11c99b00d637-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "bd184531-b42a-4c01-a978-11c99b00d637" (UID: "bd184531-b42a-4c01-a978-11c99b00d637"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 13:29:29.850346 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:29.850326    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd184531-b42a-4c01-a978-11c99b00d637-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "bd184531-b42a-4c01-a978-11c99b00d637" (UID: "bd184531-b42a-4c01-a978-11c99b00d637"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 13:29:29.850810 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:29.850790    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd184531-b42a-4c01-a978-11c99b00d637-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "bd184531-b42a-4c01-a978-11c99b00d637" (UID: "bd184531-b42a-4c01-a978-11c99b00d637"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 13:29:29.851042 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:29.851028    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd184531-b42a-4c01-a978-11c99b00d637-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "bd184531-b42a-4c01-a978-11c99b00d637" (UID: "bd184531-b42a-4c01-a978-11c99b00d637"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 13:29:29.859758 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:29.859735    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd184531-b42a-4c01-a978-11c99b00d637-web-config" (OuterVolumeSpecName: "web-config") pod "bd184531-b42a-4c01-a978-11c99b00d637" (UID: "bd184531-b42a-4c01-a978-11c99b00d637"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 13:29:29.947315 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:29.947277    2578 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bd184531-b42a-4c01-a978-11c99b00d637-secret-kube-rbac-proxy\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:29:29.947315 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:29.947309    2578 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bd184531-b42a-4c01-a978-11c99b00d637-tls-assets\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:29:29.947507 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:29.947323    2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bd184531-b42a-4c01-a978-11c99b00d637-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:29:29.947507 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:29.947337    2578 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/bd184531-b42a-4c01-a978-11c99b00d637-config\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:29:29.947507 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:29.947347    2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bd184531-b42a-4c01-a978-11c99b00d637-secret-prometheus-k8s-tls\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:29:29.947507 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:29.947355    2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bd184531-b42a-4c01-a978-11c99b00d637-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:29:29.947507 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:29.947365    2578 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bd184531-b42a-4c01-a978-11c99b00d637-config-out\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:29:29.947507 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:29.947375    2578 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bd184531-b42a-4c01-a978-11c99b00d637-secret-grpc-tls\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:29:29.947507 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:29.947383    2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bd184531-b42a-4c01-a978-11c99b00d637-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:29:29.947507 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:29.947391    2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd184531-b42a-4c01-a978-11c99b00d637-prometheus-trusted-ca-bundle\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:29:29.947507 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:29.947402    2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bd184531-b42a-4c01-a978-11c99b00d637-prometheus-k8s-db\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:29:29.947507 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:29.947415    2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bd184531-b42a-4c01-a978-11c99b00d637-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:29:29.947507 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:29.947424    2578 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd184531-b42a-4c01-a978-11c99b00d637-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:29:29.947507 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:29.947432    2578 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bd184531-b42a-4c01-a978-11c99b00d637-web-config\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:29:29.947507 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:29.947440    2578 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bd184531-b42a-4c01-a978-11c99b00d637-secret-metrics-client-certs\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:29:29.947507 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:29.947449    2578 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd184531-b42a-4c01-a978-11c99b00d637-configmap-metrics-client-ca\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:29:29.947507 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:29.947458    2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bd184531-b42a-4c01-a978-11c99b00d637-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:29:29.947507 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:29.947465    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qmsws\" (UniqueName: \"kubernetes.io/projected/bd184531-b42a-4c01-a978-11c99b00d637-kube-api-access-qmsws\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:29:29.947507 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:29.947473    2578 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bd184531-b42a-4c01-a978-11c99b00d637-thanos-prometheus-http-client-file\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:29:30.483705 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.483677    2578 generic.go:356] "Generic (PLEG): container finished" podID="bd184531-b42a-4c01-a978-11c99b00d637" containerID="86045e0265ce2ffa4f66e57a08c69a5dd0431537ce160ba10bf11396ca1919d6" exitCode=0
Sep 09 13:29:30.483705 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.483698    2578 generic.go:356] "Generic (PLEG): container finished" podID="bd184531-b42a-4c01-a978-11c99b00d637" containerID="5df1ee7b8bb0b69e8a228c1a53f4b3e9e78c2f85f947f5f7876465720a8820bd" exitCode=0
Sep 09 13:29:30.483705 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.483705    2578 generic.go:356] "Generic (PLEG): container finished" podID="bd184531-b42a-4c01-a978-11c99b00d637" containerID="53fe36f869d02f0e03bad898dafcb34e1ade9acd98790d84fc37bb469f7a1750" exitCode=0
Sep 09 13:29:30.483705 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.483711    2578 generic.go:356] "Generic (PLEG): container finished" podID="bd184531-b42a-4c01-a978-11c99b00d637" containerID="6d05a261eb91800071f80e265344ae8dc5a934cfdad017c308c58bf8d2f83905" exitCode=0
Sep 09 13:29:30.483705 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.483716    2578 generic.go:356] "Generic (PLEG): container finished" podID="bd184531-b42a-4c01-a978-11c99b00d637" containerID="b3a232704d2ce90f67f941ab00fe9e59fec35ff40b9ce92d2a671618cda584df" exitCode=0
Sep 09 13:29:30.484000 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.483722    2578 generic.go:356] "Generic (PLEG): container finished" podID="bd184531-b42a-4c01-a978-11c99b00d637" containerID="3da3c8cc00f898b476bd816ee37b3a3ec403cd6bff295022d81eeca6972acdf8" exitCode=0
Sep 09 13:29:30.484000 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.483750    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:29:30.484000 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.483765    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bd184531-b42a-4c01-a978-11c99b00d637","Type":"ContainerDied","Data":"86045e0265ce2ffa4f66e57a08c69a5dd0431537ce160ba10bf11396ca1919d6"}
Sep 09 13:29:30.484000 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.483846    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bd184531-b42a-4c01-a978-11c99b00d637","Type":"ContainerDied","Data":"5df1ee7b8bb0b69e8a228c1a53f4b3e9e78c2f85f947f5f7876465720a8820bd"}
Sep 09 13:29:30.484000 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.483875    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bd184531-b42a-4c01-a978-11c99b00d637","Type":"ContainerDied","Data":"53fe36f869d02f0e03bad898dafcb34e1ade9acd98790d84fc37bb469f7a1750"}
Sep 09 13:29:30.484000 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.483905    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bd184531-b42a-4c01-a978-11c99b00d637","Type":"ContainerDied","Data":"6d05a261eb91800071f80e265344ae8dc5a934cfdad017c308c58bf8d2f83905"}
Sep 09 13:29:30.484000 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.483921    2578 scope.go:117] "RemoveContainer" containerID="86045e0265ce2ffa4f66e57a08c69a5dd0431537ce160ba10bf11396ca1919d6"
Sep 09 13:29:30.484000 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.483944    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bd184531-b42a-4c01-a978-11c99b00d637","Type":"ContainerDied","Data":"b3a232704d2ce90f67f941ab00fe9e59fec35ff40b9ce92d2a671618cda584df"}
Sep 09 13:29:30.484000 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.483980    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bd184531-b42a-4c01-a978-11c99b00d637","Type":"ContainerDied","Data":"3da3c8cc00f898b476bd816ee37b3a3ec403cd6bff295022d81eeca6972acdf8"}
Sep 09 13:29:30.484350 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.484020    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bd184531-b42a-4c01-a978-11c99b00d637","Type":"ContainerDied","Data":"dc331c609e364fcc093700d805970b37e24f61ed51b4e1489f5dd47f6906a23c"}
Sep 09 13:29:30.491694 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.491678    2578 scope.go:117] "RemoveContainer" containerID="5df1ee7b8bb0b69e8a228c1a53f4b3e9e78c2f85f947f5f7876465720a8820bd"
Sep 09 13:29:30.498746 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.498729    2578 scope.go:117] "RemoveContainer" containerID="53fe36f869d02f0e03bad898dafcb34e1ade9acd98790d84fc37bb469f7a1750"
Sep 09 13:29:30.505632 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.505614    2578 scope.go:117] "RemoveContainer" containerID="6d05a261eb91800071f80e265344ae8dc5a934cfdad017c308c58bf8d2f83905"
Sep 09 13:29:30.508793 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.508767    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 09 13:29:30.512948 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.512926    2578 scope.go:117] "RemoveContainer" containerID="b3a232704d2ce90f67f941ab00fe9e59fec35ff40b9ce92d2a671618cda584df"
Sep 09 13:29:30.513216 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.513198    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 09 13:29:30.519854 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.519838    2578 scope.go:117] "RemoveContainer" containerID="3da3c8cc00f898b476bd816ee37b3a3ec403cd6bff295022d81eeca6972acdf8"
Sep 09 13:29:30.526549 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.526533    2578 scope.go:117] "RemoveContainer" containerID="3a3c0d9306f45259b709f67a015ebfc654809dab41be2584855d99c50ffd5acd"
Sep 09 13:29:30.539247 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.539224    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 09 13:29:30.539474 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.539462    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd184531-b42a-4c01-a978-11c99b00d637" containerName="prometheus"
Sep 09 13:29:30.539517 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.539475    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd184531-b42a-4c01-a978-11c99b00d637" containerName="prometheus"
Sep 09 13:29:30.539517 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.539485    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3e5347b-c510-488b-9c63-ffd395958d43" containerName="console"
Sep 09 13:29:30.539517 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.539491    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3e5347b-c510-488b-9c63-ffd395958d43" containerName="console"
Sep 09 13:29:30.539517 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.539499    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd184531-b42a-4c01-a978-11c99b00d637" containerName="config-reloader"
Sep 09 13:29:30.539517 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.539504    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd184531-b42a-4c01-a978-11c99b00d637" containerName="config-reloader"
Sep 09 13:29:30.539517 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.539512    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3f61f10-185f-4683-be63-d08890b3cf60" containerName="console"
Sep 09 13:29:30.539517 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.539517    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3f61f10-185f-4683-be63-d08890b3cf60" containerName="console"
Sep 09 13:29:30.539742 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.539526    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd184531-b42a-4c01-a978-11c99b00d637" containerName="init-config-reloader"
Sep 09 13:29:30.539742 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.539532    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd184531-b42a-4c01-a978-11c99b00d637" containerName="init-config-reloader"
Sep 09 13:29:30.539742 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.539537    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd184531-b42a-4c01-a978-11c99b00d637" containerName="kube-rbac-proxy-thanos"
Sep 09 13:29:30.539742 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.539542    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd184531-b42a-4c01-a978-11c99b00d637" containerName="kube-rbac-proxy-thanos"
Sep 09 13:29:30.539742 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.539549    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd184531-b42a-4c01-a978-11c99b00d637" containerName="thanos-sidecar"
Sep 09 13:29:30.539742 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.539554    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd184531-b42a-4c01-a978-11c99b00d637" containerName="thanos-sidecar"
Sep 09 13:29:30.539742 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.539560    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e64a6d9b-fdad-40f4-baea-41eb123cdf37" containerName="console"
Sep 09 13:29:30.539742 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.539565    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e64a6d9b-fdad-40f4-baea-41eb123cdf37" containerName="console"
Sep 09 13:29:30.539742 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.539571    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd184531-b42a-4c01-a978-11c99b00d637" containerName="kube-rbac-proxy-web"
Sep 09 13:29:30.539742 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.539576    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd184531-b42a-4c01-a978-11c99b00d637" containerName="kube-rbac-proxy-web"
Sep 09 13:29:30.539742 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.539582    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd184531-b42a-4c01-a978-11c99b00d637" containerName="kube-rbac-proxy"
Sep 09 13:29:30.539742 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.539587    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd184531-b42a-4c01-a978-11c99b00d637" containerName="kube-rbac-proxy"
Sep 09 13:29:30.539742 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.539622    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd184531-b42a-4c01-a978-11c99b00d637" containerName="kube-rbac-proxy-web"
Sep 09 13:29:30.539742 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.539629    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd184531-b42a-4c01-a978-11c99b00d637" containerName="kube-rbac-proxy-thanos"
Sep 09 13:29:30.539742 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.539635    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd184531-b42a-4c01-a978-11c99b00d637" containerName="thanos-sidecar"
Sep 09 13:29:30.539742 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.539640    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd184531-b42a-4c01-a978-11c99b00d637" containerName="kube-rbac-proxy"
Sep 09 13:29:30.539742 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.539645    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd184531-b42a-4c01-a978-11c99b00d637" containerName="prometheus"
Sep 09 13:29:30.539742 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.539650    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3e5347b-c510-488b-9c63-ffd395958d43" containerName="console"
Sep 09 13:29:30.539742 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.539655    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e64a6d9b-fdad-40f4-baea-41eb123cdf37" containerName="console"
Sep 09 13:29:30.539742 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.539661    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd184531-b42a-4c01-a978-11c99b00d637" containerName="config-reloader"
Sep 09 13:29:30.539742 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.539665    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3f61f10-185f-4683-be63-d08890b3cf60" containerName="console"
Sep 09 13:29:30.542005 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.541987    2578 scope.go:117] "RemoveContainer" containerID="86045e0265ce2ffa4f66e57a08c69a5dd0431537ce160ba10bf11396ca1919d6"
Sep 09 13:29:30.542329 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:29:30.542309    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86045e0265ce2ffa4f66e57a08c69a5dd0431537ce160ba10bf11396ca1919d6\": container with ID starting with 86045e0265ce2ffa4f66e57a08c69a5dd0431537ce160ba10bf11396ca1919d6 not found: ID does not exist" containerID="86045e0265ce2ffa4f66e57a08c69a5dd0431537ce160ba10bf11396ca1919d6"
Sep 09 13:29:30.542394 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.542337    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86045e0265ce2ffa4f66e57a08c69a5dd0431537ce160ba10bf11396ca1919d6"} err="failed to get container status \"86045e0265ce2ffa4f66e57a08c69a5dd0431537ce160ba10bf11396ca1919d6\": rpc error: code = NotFound desc = could not find container \"86045e0265ce2ffa4f66e57a08c69a5dd0431537ce160ba10bf11396ca1919d6\": container with ID starting with 86045e0265ce2ffa4f66e57a08c69a5dd0431537ce160ba10bf11396ca1919d6 not found: ID does not exist"
Sep 09 13:29:30.542394 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.542360    2578 scope.go:117] "RemoveContainer" containerID="5df1ee7b8bb0b69e8a228c1a53f4b3e9e78c2f85f947f5f7876465720a8820bd"
Sep 09 13:29:30.542641 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:29:30.542625    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5df1ee7b8bb0b69e8a228c1a53f4b3e9e78c2f85f947f5f7876465720a8820bd\": container with ID starting with 5df1ee7b8bb0b69e8a228c1a53f4b3e9e78c2f85f947f5f7876465720a8820bd not found: ID does not exist" containerID="5df1ee7b8bb0b69e8a228c1a53f4b3e9e78c2f85f947f5f7876465720a8820bd"
Sep 09 13:29:30.542690 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.542647    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5df1ee7b8bb0b69e8a228c1a53f4b3e9e78c2f85f947f5f7876465720a8820bd"} err="failed to get container status \"5df1ee7b8bb0b69e8a228c1a53f4b3e9e78c2f85f947f5f7876465720a8820bd\": rpc error: code = NotFound desc = could not find container \"5df1ee7b8bb0b69e8a228c1a53f4b3e9e78c2f85f947f5f7876465720a8820bd\": container with ID starting with 5df1ee7b8bb0b69e8a228c1a53f4b3e9e78c2f85f947f5f7876465720a8820bd not found: ID does not exist"
Sep 09 13:29:30.542690 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.542661    2578 scope.go:117] "RemoveContainer" containerID="53fe36f869d02f0e03bad898dafcb34e1ade9acd98790d84fc37bb469f7a1750"
Sep 09 13:29:30.542911 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:29:30.542889    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53fe36f869d02f0e03bad898dafcb34e1ade9acd98790d84fc37bb469f7a1750\": container with ID starting with 53fe36f869d02f0e03bad898dafcb34e1ade9acd98790d84fc37bb469f7a1750 not found: ID does not exist" containerID="53fe36f869d02f0e03bad898dafcb34e1ade9acd98790d84fc37bb469f7a1750"
Sep 09 13:29:30.542955 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.542920    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53fe36f869d02f0e03bad898dafcb34e1ade9acd98790d84fc37bb469f7a1750"} err="failed to get container status \"53fe36f869d02f0e03bad898dafcb34e1ade9acd98790d84fc37bb469f7a1750\": rpc error: code = NotFound desc = could not find container \"53fe36f869d02f0e03bad898dafcb34e1ade9acd98790d84fc37bb469f7a1750\": container with ID starting with 53fe36f869d02f0e03bad898dafcb34e1ade9acd98790d84fc37bb469f7a1750 not found: ID does not exist"
Sep 09 13:29:30.542955 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.542939    2578 scope.go:117] "RemoveContainer" containerID="6d05a261eb91800071f80e265344ae8dc5a934cfdad017c308c58bf8d2f83905"
Sep 09 13:29:30.543015 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.542962    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:29:30.543630 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:29:30.543598    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d05a261eb91800071f80e265344ae8dc5a934cfdad017c308c58bf8d2f83905\": container with ID starting with 6d05a261eb91800071f80e265344ae8dc5a934cfdad017c308c58bf8d2f83905 not found: ID does not exist" containerID="6d05a261eb91800071f80e265344ae8dc5a934cfdad017c308c58bf8d2f83905"
Sep 09 13:29:30.543719 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.543637    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d05a261eb91800071f80e265344ae8dc5a934cfdad017c308c58bf8d2f83905"} err="failed to get container status \"6d05a261eb91800071f80e265344ae8dc5a934cfdad017c308c58bf8d2f83905\": rpc error: code = NotFound desc = could not find container \"6d05a261eb91800071f80e265344ae8dc5a934cfdad017c308c58bf8d2f83905\": container with ID starting with 6d05a261eb91800071f80e265344ae8dc5a934cfdad017c308c58bf8d2f83905 not found: ID does not exist"
Sep 09 13:29:30.543719 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.543668    2578 scope.go:117] "RemoveContainer" containerID="b3a232704d2ce90f67f941ab00fe9e59fec35ff40b9ce92d2a671618cda584df"
Sep 09 13:29:30.544681 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:29:30.544518    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3a232704d2ce90f67f941ab00fe9e59fec35ff40b9ce92d2a671618cda584df\": container with ID starting with b3a232704d2ce90f67f941ab00fe9e59fec35ff40b9ce92d2a671618cda584df not found: ID does not exist" containerID="b3a232704d2ce90f67f941ab00fe9e59fec35ff40b9ce92d2a671618cda584df"
Sep 09 13:29:30.544681 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.544556    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3a232704d2ce90f67f941ab00fe9e59fec35ff40b9ce92d2a671618cda584df"} err="failed to get container status \"b3a232704d2ce90f67f941ab00fe9e59fec35ff40b9ce92d2a671618cda584df\": rpc error: code = NotFound desc = could not find container \"b3a232704d2ce90f67f941ab00fe9e59fec35ff40b9ce92d2a671618cda584df\": container with ID starting with b3a232704d2ce90f67f941ab00fe9e59fec35ff40b9ce92d2a671618cda584df not found: ID does not exist"
Sep 09 13:29:30.544681 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.544584    2578 scope.go:117] "RemoveContainer" containerID="3da3c8cc00f898b476bd816ee37b3a3ec403cd6bff295022d81eeca6972acdf8"
Sep 09 13:29:30.548033 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:29:30.544995    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3da3c8cc00f898b476bd816ee37b3a3ec403cd6bff295022d81eeca6972acdf8\": container with ID starting with 3da3c8cc00f898b476bd816ee37b3a3ec403cd6bff295022d81eeca6972acdf8 not found: ID does not exist" containerID="3da3c8cc00f898b476bd816ee37b3a3ec403cd6bff295022d81eeca6972acdf8"
Sep 09 13:29:30.548033 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.545027    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3da3c8cc00f898b476bd816ee37b3a3ec403cd6bff295022d81eeca6972acdf8"} err="failed to get container status \"3da3c8cc00f898b476bd816ee37b3a3ec403cd6bff295022d81eeca6972acdf8\": rpc error: code = NotFound desc = could not find container \"3da3c8cc00f898b476bd816ee37b3a3ec403cd6bff295022d81eeca6972acdf8\": container with ID starting with 3da3c8cc00f898b476bd816ee37b3a3ec403cd6bff295022d81eeca6972acdf8 not found: ID does not exist"
Sep 09 13:29:30.548033 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.545070    2578 scope.go:117] "RemoveContainer" containerID="3a3c0d9306f45259b709f67a015ebfc654809dab41be2584855d99c50ffd5acd"
Sep 09 13:29:30.548033 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.547069    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 09 13:29:30.548033 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.547328    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 09 13:29:30.548033 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.547378    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 09 13:29:30.548033 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:29:30.547516    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a3c0d9306f45259b709f67a015ebfc654809dab41be2584855d99c50ffd5acd\": container with ID starting with 3a3c0d9306f45259b709f67a015ebfc654809dab41be2584855d99c50ffd5acd not found: ID does not exist" containerID="3a3c0d9306f45259b709f67a015ebfc654809dab41be2584855d99c50ffd5acd"
Sep 09 13:29:30.548033 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.547575    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 09 13:29:30.548033 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.547620    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a3c0d9306f45259b709f67a015ebfc654809dab41be2584855d99c50ffd5acd"} err="failed to get container status \"3a3c0d9306f45259b709f67a015ebfc654809dab41be2584855d99c50ffd5acd\": rpc error: code = NotFound desc = could not find container \"3a3c0d9306f45259b709f67a015ebfc654809dab41be2584855d99c50ffd5acd\": container with ID starting with 3a3c0d9306f45259b709f67a015ebfc654809dab41be2584855d99c50ffd5acd not found: ID does not exist"
Sep 09 13:29:30.548033 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.547642    2578 scope.go:117] "RemoveContainer" containerID="86045e0265ce2ffa4f66e57a08c69a5dd0431537ce160ba10bf11396ca1919d6"
Sep 09 13:29:30.548033 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.547841    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 09 13:29:30.548033 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.547896    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 09 13:29:30.548728 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.548058    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86045e0265ce2ffa4f66e57a08c69a5dd0431537ce160ba10bf11396ca1919d6"} err="failed to get container status \"86045e0265ce2ffa4f66e57a08c69a5dd0431537ce160ba10bf11396ca1919d6\": rpc error: code = NotFound desc = could not find container \"86045e0265ce2ffa4f66e57a08c69a5dd0431537ce160ba10bf11396ca1919d6\": container with ID starting with 86045e0265ce2ffa4f66e57a08c69a5dd0431537ce160ba10bf11396ca1919d6 not found: ID does not exist"
Sep 09 13:29:30.548728 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.548080    2578 scope.go:117] "RemoveContainer" containerID="5df1ee7b8bb0b69e8a228c1a53f4b3e9e78c2f85f947f5f7876465720a8820bd"
Sep 09 13:29:30.548728 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.548388    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-enkglot24blnv\""
Sep 09 13:29:30.548728 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.548454    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 09 13:29:30.548728 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.548631    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 09 13:29:30.548975 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.548723    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5df1ee7b8bb0b69e8a228c1a53f4b3e9e78c2f85f947f5f7876465720a8820bd"} err="failed to get container status \"5df1ee7b8bb0b69e8a228c1a53f4b3e9e78c2f85f947f5f7876465720a8820bd\": rpc error: code = NotFound desc = could not find container \"5df1ee7b8bb0b69e8a228c1a53f4b3e9e78c2f85f947f5f7876465720a8820bd\": container with ID starting with 5df1ee7b8bb0b69e8a228c1a53f4b3e9e78c2f85f947f5f7876465720a8820bd not found: ID does not exist"
Sep 09 13:29:30.548975 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.548776    2578 scope.go:117] "RemoveContainer" containerID="53fe36f869d02f0e03bad898dafcb34e1ade9acd98790d84fc37bb469f7a1750"
Sep 09 13:29:30.548975 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.548799    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 09 13:29:30.548975 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.548921    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 09 13:29:30.549193 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.549041    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-bxv7m\""
Sep 09 13:29:30.549193 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.549078    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53fe36f869d02f0e03bad898dafcb34e1ade9acd98790d84fc37bb469f7a1750"} err="failed to get container status \"53fe36f869d02f0e03bad898dafcb34e1ade9acd98790d84fc37bb469f7a1750\": rpc error: code = NotFound desc = could not find container \"53fe36f869d02f0e03bad898dafcb34e1ade9acd98790d84fc37bb469f7a1750\": container with ID starting with 53fe36f869d02f0e03bad898dafcb34e1ade9acd98790d84fc37bb469f7a1750 not found: ID does not exist"
Sep 09 13:29:30.549193 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.549100    2578 scope.go:117] "RemoveContainer" containerID="6d05a261eb91800071f80e265344ae8dc5a934cfdad017c308c58bf8d2f83905"
Sep 09 13:29:30.549410 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.549394    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 09 13:29:30.549519 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.549428    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 09 13:29:30.549519 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.549422    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d05a261eb91800071f80e265344ae8dc5a934cfdad017c308c58bf8d2f83905"} err="failed to get container status \"6d05a261eb91800071f80e265344ae8dc5a934cfdad017c308c58bf8d2f83905\": rpc error: code = NotFound desc = could not find container \"6d05a261eb91800071f80e265344ae8dc5a934cfdad017c308c58bf8d2f83905\": container with ID starting with 6d05a261eb91800071f80e265344ae8dc5a934cfdad017c308c58bf8d2f83905 not found: ID does not exist"
Sep 09 13:29:30.549519 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.549502    2578 scope.go:117] "RemoveContainer" containerID="b3a232704d2ce90f67f941ab00fe9e59fec35ff40b9ce92d2a671618cda584df"
Sep 09 13:29:30.549987 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.549857    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3a232704d2ce90f67f941ab00fe9e59fec35ff40b9ce92d2a671618cda584df"} err="failed to get container status \"b3a232704d2ce90f67f941ab00fe9e59fec35ff40b9ce92d2a671618cda584df\": rpc error: code = NotFound desc = could not find container \"b3a232704d2ce90f67f941ab00fe9e59fec35ff40b9ce92d2a671618cda584df\": container with ID starting with b3a232704d2ce90f67f941ab00fe9e59fec35ff40b9ce92d2a671618cda584df not found: ID does not exist"
Sep 09 13:29:30.549987 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.549901    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 09 13:29:30.549987 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.549901    2578 scope.go:117] "RemoveContainer" containerID="3da3c8cc00f898b476bd816ee37b3a3ec403cd6bff295022d81eeca6972acdf8"
Sep 09 13:29:30.550341 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.550228    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3da3c8cc00f898b476bd816ee37b3a3ec403cd6bff295022d81eeca6972acdf8"} err="failed to get container status \"3da3c8cc00f898b476bd816ee37b3a3ec403cd6bff295022d81eeca6972acdf8\": rpc error: code = NotFound desc = could not find container \"3da3c8cc00f898b476bd816ee37b3a3ec403cd6bff295022d81eeca6972acdf8\": container with ID starting with 3da3c8cc00f898b476bd816ee37b3a3ec403cd6bff295022d81eeca6972acdf8 not found: ID does not exist"
Sep 09 13:29:30.550341 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.550255    2578 scope.go:117] "RemoveContainer" containerID="3a3c0d9306f45259b709f67a015ebfc654809dab41be2584855d99c50ffd5acd"
Sep 09 13:29:30.550705 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.550597    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a3c0d9306f45259b709f67a015ebfc654809dab41be2584855d99c50ffd5acd"} err="failed to get container status \"3a3c0d9306f45259b709f67a015ebfc654809dab41be2584855d99c50ffd5acd\": rpc error: code = NotFound desc = could not find container \"3a3c0d9306f45259b709f67a015ebfc654809dab41be2584855d99c50ffd5acd\": container with ID starting with 3a3c0d9306f45259b709f67a015ebfc654809dab41be2584855d99c50ffd5acd not found: ID does not exist"
Sep 09 13:29:30.550705 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.550632    2578 scope.go:117] "RemoveContainer" containerID="86045e0265ce2ffa4f66e57a08c69a5dd0431537ce160ba10bf11396ca1919d6"
Sep 09 13:29:30.550951 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.550922    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86045e0265ce2ffa4f66e57a08c69a5dd0431537ce160ba10bf11396ca1919d6"} err="failed to get container status \"86045e0265ce2ffa4f66e57a08c69a5dd0431537ce160ba10bf11396ca1919d6\": rpc error: code = NotFound desc = could not find container \"86045e0265ce2ffa4f66e57a08c69a5dd0431537ce160ba10bf11396ca1919d6\": container with ID starting with 86045e0265ce2ffa4f66e57a08c69a5dd0431537ce160ba10bf11396ca1919d6 not found: ID does not exist"
Sep 09 13:29:30.551030 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.550954    2578 scope.go:117] "RemoveContainer" containerID="5df1ee7b8bb0b69e8a228c1a53f4b3e9e78c2f85f947f5f7876465720a8820bd"
Sep 09 13:29:30.551346 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.551321    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5df1ee7b8bb0b69e8a228c1a53f4b3e9e78c2f85f947f5f7876465720a8820bd"} err="failed to get container status \"5df1ee7b8bb0b69e8a228c1a53f4b3e9e78c2f85f947f5f7876465720a8820bd\": rpc error: code = NotFound desc = could not find container \"5df1ee7b8bb0b69e8a228c1a53f4b3e9e78c2f85f947f5f7876465720a8820bd\": container with ID starting with 5df1ee7b8bb0b69e8a228c1a53f4b3e9e78c2f85f947f5f7876465720a8820bd not found: ID does not exist"
Sep 09 13:29:30.551443 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.551354    2578 scope.go:117] "RemoveContainer" containerID="53fe36f869d02f0e03bad898dafcb34e1ade9acd98790d84fc37bb469f7a1750"
Sep 09 13:29:30.552281 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.552089    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53fe36f869d02f0e03bad898dafcb34e1ade9acd98790d84fc37bb469f7a1750"} err="failed to get container status \"53fe36f869d02f0e03bad898dafcb34e1ade9acd98790d84fc37bb469f7a1750\": rpc error: code = NotFound desc = could not find container \"53fe36f869d02f0e03bad898dafcb34e1ade9acd98790d84fc37bb469f7a1750\": container with ID starting with 53fe36f869d02f0e03bad898dafcb34e1ade9acd98790d84fc37bb469f7a1750 not found: ID does not exist"
Sep 09 13:29:30.552281 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.552114    2578 scope.go:117] "RemoveContainer" containerID="6d05a261eb91800071f80e265344ae8dc5a934cfdad017c308c58bf8d2f83905"
Sep 09 13:29:30.552604 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.552506    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d05a261eb91800071f80e265344ae8dc5a934cfdad017c308c58bf8d2f83905"} err="failed to get container status \"6d05a261eb91800071f80e265344ae8dc5a934cfdad017c308c58bf8d2f83905\": rpc error: code = NotFound desc = could not find container \"6d05a261eb91800071f80e265344ae8dc5a934cfdad017c308c58bf8d2f83905\": container with ID starting with 6d05a261eb91800071f80e265344ae8dc5a934cfdad017c308c58bf8d2f83905 not found: ID does not exist"
Sep 09 13:29:30.552604 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.552532    2578 scope.go:117] "RemoveContainer" containerID="b3a232704d2ce90f67f941ab00fe9e59fec35ff40b9ce92d2a671618cda584df"
Sep 09 13:29:30.552838 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.552810    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3a232704d2ce90f67f941ab00fe9e59fec35ff40b9ce92d2a671618cda584df"} err="failed to get container status \"b3a232704d2ce90f67f941ab00fe9e59fec35ff40b9ce92d2a671618cda584df\": rpc error: code = NotFound desc = could not find container \"b3a232704d2ce90f67f941ab00fe9e59fec35ff40b9ce92d2a671618cda584df\": container with ID starting with b3a232704d2ce90f67f941ab00fe9e59fec35ff40b9ce92d2a671618cda584df not found: ID does not exist"
Sep 09 13:29:30.552936 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.552837    2578 scope.go:117] "RemoveContainer" containerID="3da3c8cc00f898b476bd816ee37b3a3ec403cd6bff295022d81eeca6972acdf8"
Sep 09 13:29:30.553057 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.553041    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 09 13:29:30.553221 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.553167    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3da3c8cc00f898b476bd816ee37b3a3ec403cd6bff295022d81eeca6972acdf8"} err="failed to get container status \"3da3c8cc00f898b476bd816ee37b3a3ec403cd6bff295022d81eeca6972acdf8\": rpc error: code = NotFound desc = could not find container \"3da3c8cc00f898b476bd816ee37b3a3ec403cd6bff295022d81eeca6972acdf8\": container with ID starting with 3da3c8cc00f898b476bd816ee37b3a3ec403cd6bff295022d81eeca6972acdf8 not found: ID does not exist"
Sep 09 13:29:30.553221 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.553210    2578 scope.go:117] "RemoveContainer" containerID="3a3c0d9306f45259b709f67a015ebfc654809dab41be2584855d99c50ffd5acd"
Sep 09 13:29:30.553660 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.553640    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a3c0d9306f45259b709f67a015ebfc654809dab41be2584855d99c50ffd5acd"} err="failed to get container status \"3a3c0d9306f45259b709f67a015ebfc654809dab41be2584855d99c50ffd5acd\": rpc error: code = NotFound desc = could not find container \"3a3c0d9306f45259b709f67a015ebfc654809dab41be2584855d99c50ffd5acd\": container with ID starting with 3a3c0d9306f45259b709f67a015ebfc654809dab41be2584855d99c50ffd5acd not found: ID does not exist"
Sep 09 13:29:30.553722 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.553661    2578 scope.go:117] "RemoveContainer" containerID="86045e0265ce2ffa4f66e57a08c69a5dd0431537ce160ba10bf11396ca1919d6"
Sep 09 13:29:30.553928 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.553910    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86045e0265ce2ffa4f66e57a08c69a5dd0431537ce160ba10bf11396ca1919d6"} err="failed to get container status \"86045e0265ce2ffa4f66e57a08c69a5dd0431537ce160ba10bf11396ca1919d6\": rpc error: code = NotFound desc = could not find container \"86045e0265ce2ffa4f66e57a08c69a5dd0431537ce160ba10bf11396ca1919d6\": container with ID starting with 86045e0265ce2ffa4f66e57a08c69a5dd0431537ce160ba10bf11396ca1919d6 not found: ID does not exist"
Sep 09 13:29:30.554004 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.553929    2578 scope.go:117] "RemoveContainer" containerID="5df1ee7b8bb0b69e8a228c1a53f4b3e9e78c2f85f947f5f7876465720a8820bd"
Sep 09 13:29:30.554160 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.554133    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5df1ee7b8bb0b69e8a228c1a53f4b3e9e78c2f85f947f5f7876465720a8820bd"} err="failed to get container status \"5df1ee7b8bb0b69e8a228c1a53f4b3e9e78c2f85f947f5f7876465720a8820bd\": rpc error: code = NotFound desc = could not find container \"5df1ee7b8bb0b69e8a228c1a53f4b3e9e78c2f85f947f5f7876465720a8820bd\": container with ID starting with 5df1ee7b8bb0b69e8a228c1a53f4b3e9e78c2f85f947f5f7876465720a8820bd not found: ID does not exist"
Sep 09 13:29:30.554242 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.554160    2578 scope.go:117] "RemoveContainer" containerID="53fe36f869d02f0e03bad898dafcb34e1ade9acd98790d84fc37bb469f7a1750"
Sep 09 13:29:30.554459 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.554440    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53fe36f869d02f0e03bad898dafcb34e1ade9acd98790d84fc37bb469f7a1750"} err="failed to get container status \"53fe36f869d02f0e03bad898dafcb34e1ade9acd98790d84fc37bb469f7a1750\": rpc error: code = NotFound desc = could not find container \"53fe36f869d02f0e03bad898dafcb34e1ade9acd98790d84fc37bb469f7a1750\": container with ID starting with 53fe36f869d02f0e03bad898dafcb34e1ade9acd98790d84fc37bb469f7a1750 not found: ID does not exist"
Sep 09 13:29:30.554534 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.554461    2578 scope.go:117] "RemoveContainer" containerID="6d05a261eb91800071f80e265344ae8dc5a934cfdad017c308c58bf8d2f83905"
Sep 09 13:29:30.554769 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.554724    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d05a261eb91800071f80e265344ae8dc5a934cfdad017c308c58bf8d2f83905"} err="failed to get container status \"6d05a261eb91800071f80e265344ae8dc5a934cfdad017c308c58bf8d2f83905\": rpc error: code = NotFound desc = could not find container \"6d05a261eb91800071f80e265344ae8dc5a934cfdad017c308c58bf8d2f83905\": container with ID starting with 6d05a261eb91800071f80e265344ae8dc5a934cfdad017c308c58bf8d2f83905 not found: ID does not exist"
Sep 09 13:29:30.554810 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.554772    2578 scope.go:117] "RemoveContainer" containerID="b3a232704d2ce90f67f941ab00fe9e59fec35ff40b9ce92d2a671618cda584df"
Sep 09 13:29:30.554991 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.554975    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 09 13:29:30.555044 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.555029    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3a232704d2ce90f67f941ab00fe9e59fec35ff40b9ce92d2a671618cda584df"} err="failed to get container status \"b3a232704d2ce90f67f941ab00fe9e59fec35ff40b9ce92d2a671618cda584df\": rpc error: code = NotFound desc = could not find container \"b3a232704d2ce90f67f941ab00fe9e59fec35ff40b9ce92d2a671618cda584df\": container with ID starting with b3a232704d2ce90f67f941ab00fe9e59fec35ff40b9ce92d2a671618cda584df not found: ID does not exist"
Sep 09 13:29:30.555091 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.555045    2578 scope.go:117] "RemoveContainer" containerID="3da3c8cc00f898b476bd816ee37b3a3ec403cd6bff295022d81eeca6972acdf8"
Sep 09 13:29:30.555313 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.555298    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3da3c8cc00f898b476bd816ee37b3a3ec403cd6bff295022d81eeca6972acdf8"} err="failed to get container status \"3da3c8cc00f898b476bd816ee37b3a3ec403cd6bff295022d81eeca6972acdf8\": rpc error: code = NotFound desc = could not find container \"3da3c8cc00f898b476bd816ee37b3a3ec403cd6bff295022d81eeca6972acdf8\": container with ID starting with 3da3c8cc00f898b476bd816ee37b3a3ec403cd6bff295022d81eeca6972acdf8 not found: ID does not exist"
Sep 09 13:29:30.555358 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.555313    2578 scope.go:117] "RemoveContainer" containerID="3a3c0d9306f45259b709f67a015ebfc654809dab41be2584855d99c50ffd5acd"
Sep 09 13:29:30.555576 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.555536    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a3c0d9306f45259b709f67a015ebfc654809dab41be2584855d99c50ffd5acd"} err="failed to get container status \"3a3c0d9306f45259b709f67a015ebfc654809dab41be2584855d99c50ffd5acd\": rpc error: code = NotFound desc = could not find container \"3a3c0d9306f45259b709f67a015ebfc654809dab41be2584855d99c50ffd5acd\": container with ID starting with 3a3c0d9306f45259b709f67a015ebfc654809dab41be2584855d99c50ffd5acd not found: ID does not exist"
Sep 09 13:29:30.555645 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.555576    2578 scope.go:117] "RemoveContainer" containerID="86045e0265ce2ffa4f66e57a08c69a5dd0431537ce160ba10bf11396ca1919d6"
Sep 09 13:29:30.555847 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.555823    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86045e0265ce2ffa4f66e57a08c69a5dd0431537ce160ba10bf11396ca1919d6"} err="failed to get container status \"86045e0265ce2ffa4f66e57a08c69a5dd0431537ce160ba10bf11396ca1919d6\": rpc error: code = NotFound desc = could not find container \"86045e0265ce2ffa4f66e57a08c69a5dd0431537ce160ba10bf11396ca1919d6\": container with ID starting with 86045e0265ce2ffa4f66e57a08c69a5dd0431537ce160ba10bf11396ca1919d6 not found: ID does not exist"
Sep 09 13:29:30.555847 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.555846    2578 scope.go:117] "RemoveContainer" containerID="5df1ee7b8bb0b69e8a228c1a53f4b3e9e78c2f85f947f5f7876465720a8820bd"
Sep 09 13:29:30.556095 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.556076    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5df1ee7b8bb0b69e8a228c1a53f4b3e9e78c2f85f947f5f7876465720a8820bd"} err="failed to get container status \"5df1ee7b8bb0b69e8a228c1a53f4b3e9e78c2f85f947f5f7876465720a8820bd\": rpc error: code = NotFound desc = could not find container \"5df1ee7b8bb0b69e8a228c1a53f4b3e9e78c2f85f947f5f7876465720a8820bd\": container with ID starting with 5df1ee7b8bb0b69e8a228c1a53f4b3e9e78c2f85f947f5f7876465720a8820bd not found: ID does not exist"
Sep 09 13:29:30.556135 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.556096    2578 scope.go:117] "RemoveContainer" containerID="53fe36f869d02f0e03bad898dafcb34e1ade9acd98790d84fc37bb469f7a1750"
Sep 09 13:29:30.556331 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.556312    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53fe36f869d02f0e03bad898dafcb34e1ade9acd98790d84fc37bb469f7a1750"} err="failed to get container status \"53fe36f869d02f0e03bad898dafcb34e1ade9acd98790d84fc37bb469f7a1750\": rpc error: code = NotFound desc = could not find container \"53fe36f869d02f0e03bad898dafcb34e1ade9acd98790d84fc37bb469f7a1750\": container with ID starting with 53fe36f869d02f0e03bad898dafcb34e1ade9acd98790d84fc37bb469f7a1750 not found: ID does not exist"
Sep 09 13:29:30.556409 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.556332    2578 scope.go:117] "RemoveContainer" containerID="6d05a261eb91800071f80e265344ae8dc5a934cfdad017c308c58bf8d2f83905"
Sep 09 13:29:30.556557 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.556542    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d05a261eb91800071f80e265344ae8dc5a934cfdad017c308c58bf8d2f83905"} err="failed to get container status \"6d05a261eb91800071f80e265344ae8dc5a934cfdad017c308c58bf8d2f83905\": rpc error: code = NotFound desc = could not find container \"6d05a261eb91800071f80e265344ae8dc5a934cfdad017c308c58bf8d2f83905\": container with ID starting with 6d05a261eb91800071f80e265344ae8dc5a934cfdad017c308c58bf8d2f83905 not found: ID does not exist"
Sep 09 13:29:30.556598 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.556559    2578 scope.go:117] "RemoveContainer" containerID="b3a232704d2ce90f67f941ab00fe9e59fec35ff40b9ce92d2a671618cda584df"
Sep 09 13:29:30.556808 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.556790    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3a232704d2ce90f67f941ab00fe9e59fec35ff40b9ce92d2a671618cda584df"} err="failed to get container status \"b3a232704d2ce90f67f941ab00fe9e59fec35ff40b9ce92d2a671618cda584df\": rpc error: code = NotFound desc = could not find container \"b3a232704d2ce90f67f941ab00fe9e59fec35ff40b9ce92d2a671618cda584df\": container with ID starting with b3a232704d2ce90f67f941ab00fe9e59fec35ff40b9ce92d2a671618cda584df not found: ID does not exist"
Sep 09 13:29:30.556880 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.556810    2578 scope.go:117] "RemoveContainer" containerID="3da3c8cc00f898b476bd816ee37b3a3ec403cd6bff295022d81eeca6972acdf8"
Sep 09 13:29:30.557064 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.557040    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3da3c8cc00f898b476bd816ee37b3a3ec403cd6bff295022d81eeca6972acdf8"} err="failed to get container status \"3da3c8cc00f898b476bd816ee37b3a3ec403cd6bff295022d81eeca6972acdf8\": rpc error: code = NotFound desc = could not find container \"3da3c8cc00f898b476bd816ee37b3a3ec403cd6bff295022d81eeca6972acdf8\": container with ID starting with 3da3c8cc00f898b476bd816ee37b3a3ec403cd6bff295022d81eeca6972acdf8 not found: ID does not exist"
Sep 09 13:29:30.557112 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.557064    2578 scope.go:117] "RemoveContainer" containerID="3a3c0d9306f45259b709f67a015ebfc654809dab41be2584855d99c50ffd5acd"
Sep 09 13:29:30.557305 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.557279    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a3c0d9306f45259b709f67a015ebfc654809dab41be2584855d99c50ffd5acd"} err="failed to get container status \"3a3c0d9306f45259b709f67a015ebfc654809dab41be2584855d99c50ffd5acd\": rpc error: code = NotFound desc = could not find container \"3a3c0d9306f45259b709f67a015ebfc654809dab41be2584855d99c50ffd5acd\": container with ID starting with 3a3c0d9306f45259b709f67a015ebfc654809dab41be2584855d99c50ffd5acd not found: ID does not exist"
Sep 09 13:29:30.557378 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.557307    2578 scope.go:117] "RemoveContainer" containerID="86045e0265ce2ffa4f66e57a08c69a5dd0431537ce160ba10bf11396ca1919d6"
Sep 09 13:29:30.557526 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.557511    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86045e0265ce2ffa4f66e57a08c69a5dd0431537ce160ba10bf11396ca1919d6"} err="failed to get container status \"86045e0265ce2ffa4f66e57a08c69a5dd0431537ce160ba10bf11396ca1919d6\": rpc error: code = NotFound desc = could not find container \"86045e0265ce2ffa4f66e57a08c69a5dd0431537ce160ba10bf11396ca1919d6\": container with ID starting with 86045e0265ce2ffa4f66e57a08c69a5dd0431537ce160ba10bf11396ca1919d6 not found: ID does not exist"
Sep 09 13:29:30.557570 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.557527    2578 scope.go:117] "RemoveContainer" containerID="5df1ee7b8bb0b69e8a228c1a53f4b3e9e78c2f85f947f5f7876465720a8820bd"
Sep 09 13:29:30.557761 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.557744    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5df1ee7b8bb0b69e8a228c1a53f4b3e9e78c2f85f947f5f7876465720a8820bd"} err="failed to get container status \"5df1ee7b8bb0b69e8a228c1a53f4b3e9e78c2f85f947f5f7876465720a8820bd\": rpc error: code = NotFound desc = could not find container \"5df1ee7b8bb0b69e8a228c1a53f4b3e9e78c2f85f947f5f7876465720a8820bd\": container with ID starting with 5df1ee7b8bb0b69e8a228c1a53f4b3e9e78c2f85f947f5f7876465720a8820bd not found: ID does not exist"
Sep 09 13:29:30.557833 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.557763    2578 scope.go:117] "RemoveContainer" containerID="53fe36f869d02f0e03bad898dafcb34e1ade9acd98790d84fc37bb469f7a1750"
Sep 09 13:29:30.557988 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.557969    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53fe36f869d02f0e03bad898dafcb34e1ade9acd98790d84fc37bb469f7a1750"} err="failed to get container status \"53fe36f869d02f0e03bad898dafcb34e1ade9acd98790d84fc37bb469f7a1750\": rpc error: code = NotFound desc = could not find container \"53fe36f869d02f0e03bad898dafcb34e1ade9acd98790d84fc37bb469f7a1750\": container with ID starting with 53fe36f869d02f0e03bad898dafcb34e1ade9acd98790d84fc37bb469f7a1750 not found: ID does not exist"
Sep 09 13:29:30.558033 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.557990    2578 scope.go:117] "RemoveContainer" containerID="6d05a261eb91800071f80e265344ae8dc5a934cfdad017c308c58bf8d2f83905"
Sep 09 13:29:30.558224 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.558205    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d05a261eb91800071f80e265344ae8dc5a934cfdad017c308c58bf8d2f83905"} err="failed to get container status \"6d05a261eb91800071f80e265344ae8dc5a934cfdad017c308c58bf8d2f83905\": rpc error: code = NotFound desc = could not find container \"6d05a261eb91800071f80e265344ae8dc5a934cfdad017c308c58bf8d2f83905\": container with ID starting with 6d05a261eb91800071f80e265344ae8dc5a934cfdad017c308c58bf8d2f83905 not found: ID does not exist"
Sep 09 13:29:30.558299 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.558225    2578 scope.go:117] "RemoveContainer" containerID="b3a232704d2ce90f67f941ab00fe9e59fec35ff40b9ce92d2a671618cda584df"
Sep 09 13:29:30.558450 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.558435    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3a232704d2ce90f67f941ab00fe9e59fec35ff40b9ce92d2a671618cda584df"} err="failed to get container status \"b3a232704d2ce90f67f941ab00fe9e59fec35ff40b9ce92d2a671618cda584df\": rpc error: code = NotFound desc = could not find container \"b3a232704d2ce90f67f941ab00fe9e59fec35ff40b9ce92d2a671618cda584df\": container with ID starting with b3a232704d2ce90f67f941ab00fe9e59fec35ff40b9ce92d2a671618cda584df not found: ID does not exist"
Sep 09 13:29:30.558496 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.558451    2578 scope.go:117] "RemoveContainer" containerID="3da3c8cc00f898b476bd816ee37b3a3ec403cd6bff295022d81eeca6972acdf8"
Sep 09 13:29:30.558645 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.558627    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3da3c8cc00f898b476bd816ee37b3a3ec403cd6bff295022d81eeca6972acdf8"} err="failed to get container status \"3da3c8cc00f898b476bd816ee37b3a3ec403cd6bff295022d81eeca6972acdf8\": rpc error: code = NotFound desc = could not find container \"3da3c8cc00f898b476bd816ee37b3a3ec403cd6bff295022d81eeca6972acdf8\": container with ID starting with 3da3c8cc00f898b476bd816ee37b3a3ec403cd6bff295022d81eeca6972acdf8 not found: ID does not exist"
Sep 09 13:29:30.558710 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.558646    2578 scope.go:117] "RemoveContainer" containerID="3a3c0d9306f45259b709f67a015ebfc654809dab41be2584855d99c50ffd5acd"
Sep 09 13:29:30.558873 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.558856    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a3c0d9306f45259b709f67a015ebfc654809dab41be2584855d99c50ffd5acd"} err="failed to get container status \"3a3c0d9306f45259b709f67a015ebfc654809dab41be2584855d99c50ffd5acd\": rpc error: code = NotFound desc = could not find container \"3a3c0d9306f45259b709f67a015ebfc654809dab41be2584855d99c50ffd5acd\": container with ID starting with 3a3c0d9306f45259b709f67a015ebfc654809dab41be2584855d99c50ffd5acd not found: ID does not exist"
Sep 09 13:29:30.561738 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.561716    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 09 13:29:30.652164 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.652124    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8a5077e0-163a-4c9e-8d78-e7c0224c5965-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8a5077e0-163a-4c9e-8d78-e7c0224c5965\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:29:30.652164 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.652165    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a5077e0-163a-4c9e-8d78-e7c0224c5965-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8a5077e0-163a-4c9e-8d78-e7c0224c5965\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:29:30.652434 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.652214    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wmbm\" (UniqueName: \"kubernetes.io/projected/8a5077e0-163a-4c9e-8d78-e7c0224c5965-kube-api-access-8wmbm\") pod \"prometheus-k8s-0\" (UID: \"8a5077e0-163a-4c9e-8d78-e7c0224c5965\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:29:30.652434 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.652239    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8a5077e0-163a-4c9e-8d78-e7c0224c5965-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8a5077e0-163a-4c9e-8d78-e7c0224c5965\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:29:30.652434 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.652260    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8a5077e0-163a-4c9e-8d78-e7c0224c5965-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8a5077e0-163a-4c9e-8d78-e7c0224c5965\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:29:30.652434 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.652304    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8a5077e0-163a-4c9e-8d78-e7c0224c5965-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8a5077e0-163a-4c9e-8d78-e7c0224c5965\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:29:30.652434 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.652325    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8a5077e0-163a-4c9e-8d78-e7c0224c5965-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8a5077e0-163a-4c9e-8d78-e7c0224c5965\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:29:30.652434 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.652369    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8a5077e0-163a-4c9e-8d78-e7c0224c5965-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8a5077e0-163a-4c9e-8d78-e7c0224c5965\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:29:30.652434 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.652399    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8a5077e0-163a-4c9e-8d78-e7c0224c5965-web-config\") pod \"prometheus-k8s-0\" (UID: \"8a5077e0-163a-4c9e-8d78-e7c0224c5965\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:29:30.652434 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.652425    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8a5077e0-163a-4c9e-8d78-e7c0224c5965-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8a5077e0-163a-4c9e-8d78-e7c0224c5965\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:29:30.652786 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.652453    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8a5077e0-163a-4c9e-8d78-e7c0224c5965-config-out\") pod \"prometheus-k8s-0\" (UID: \"8a5077e0-163a-4c9e-8d78-e7c0224c5965\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:29:30.652786 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.652487    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8a5077e0-163a-4c9e-8d78-e7c0224c5965-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8a5077e0-163a-4c9e-8d78-e7c0224c5965\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:29:30.652786 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.652514    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8a5077e0-163a-4c9e-8d78-e7c0224c5965-config\") pod \"prometheus-k8s-0\" (UID: \"8a5077e0-163a-4c9e-8d78-e7c0224c5965\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:29:30.652786 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.652543    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8a5077e0-163a-4c9e-8d78-e7c0224c5965-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8a5077e0-163a-4c9e-8d78-e7c0224c5965\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:29:30.652786 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.652566    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8a5077e0-163a-4c9e-8d78-e7c0224c5965-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8a5077e0-163a-4c9e-8d78-e7c0224c5965\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:29:30.652786 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.652610    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8a5077e0-163a-4c9e-8d78-e7c0224c5965-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8a5077e0-163a-4c9e-8d78-e7c0224c5965\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:29:30.652786 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.652637    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8a5077e0-163a-4c9e-8d78-e7c0224c5965-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8a5077e0-163a-4c9e-8d78-e7c0224c5965\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:29:30.652786 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.652659    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8a5077e0-163a-4c9e-8d78-e7c0224c5965-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8a5077e0-163a-4c9e-8d78-e7c0224c5965\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:29:30.652786 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.652696    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a5077e0-163a-4c9e-8d78-e7c0224c5965-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8a5077e0-163a-4c9e-8d78-e7c0224c5965\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:29:30.652786 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.652745    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a5077e0-163a-4c9e-8d78-e7c0224c5965-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8a5077e0-163a-4c9e-8d78-e7c0224c5965\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:29:30.659419 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.659398    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd184531-b42a-4c01-a978-11c99b00d637" path="/var/lib/kubelet/pods/bd184531-b42a-4c01-a978-11c99b00d637/volumes"
Sep 09 13:29:30.753166 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.753087    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8a5077e0-163a-4c9e-8d78-e7c0224c5965-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8a5077e0-163a-4c9e-8d78-e7c0224c5965\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:29:30.753166 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.753130    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8a5077e0-163a-4c9e-8d78-e7c0224c5965-web-config\") pod \"prometheus-k8s-0\" (UID: \"8a5077e0-163a-4c9e-8d78-e7c0224c5965\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:29:30.753166 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.753157    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8a5077e0-163a-4c9e-8d78-e7c0224c5965-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8a5077e0-163a-4c9e-8d78-e7c0224c5965\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:29:30.753420 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.753297    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8a5077e0-163a-4c9e-8d78-e7c0224c5965-config-out\") pod \"prometheus-k8s-0\" (UID: \"8a5077e0-163a-4c9e-8d78-e7c0224c5965\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:29:30.753420 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.753353    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8a5077e0-163a-4c9e-8d78-e7c0224c5965-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8a5077e0-163a-4c9e-8d78-e7c0224c5965\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:29:30.753420 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.753394    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8a5077e0-163a-4c9e-8d78-e7c0224c5965-config\") pod \"prometheus-k8s-0\" (UID: \"8a5077e0-163a-4c9e-8d78-e7c0224c5965\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:29:30.753566 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.753456    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8a5077e0-163a-4c9e-8d78-e7c0224c5965-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8a5077e0-163a-4c9e-8d78-e7c0224c5965\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:29:30.753566 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.753484    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8a5077e0-163a-4c9e-8d78-e7c0224c5965-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8a5077e0-163a-4c9e-8d78-e7c0224c5965\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:29:30.756018 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.753738    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8a5077e0-163a-4c9e-8d78-e7c0224c5965-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8a5077e0-163a-4c9e-8d78-e7c0224c5965\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:29:30.756018 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.753776    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8a5077e0-163a-4c9e-8d78-e7c0224c5965-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8a5077e0-163a-4c9e-8d78-e7c0224c5965\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:29:30.756018 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.753802    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8a5077e0-163a-4c9e-8d78-e7c0224c5965-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8a5077e0-163a-4c9e-8d78-e7c0224c5965\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:29:30.756018 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.753835    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8a5077e0-163a-4c9e-8d78-e7c0224c5965-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8a5077e0-163a-4c9e-8d78-e7c0224c5965\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:29:30.756018 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.753846    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a5077e0-163a-4c9e-8d78-e7c0224c5965-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8a5077e0-163a-4c9e-8d78-e7c0224c5965\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:29:30.756018 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.753872    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8a5077e0-163a-4c9e-8d78-e7c0224c5965-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8a5077e0-163a-4c9e-8d78-e7c0224c5965\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:29:30.756018 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.753562    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8a5077e0-163a-4c9e-8d78-e7c0224c5965-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8a5077e0-163a-4c9e-8d78-e7c0224c5965\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:29:30.756018 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.753906    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a5077e0-163a-4c9e-8d78-e7c0224c5965-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8a5077e0-163a-4c9e-8d78-e7c0224c5965\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:29:30.756018 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.753940    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8a5077e0-163a-4c9e-8d78-e7c0224c5965-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8a5077e0-163a-4c9e-8d78-e7c0224c5965\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:29:30.756018 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.753969    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a5077e0-163a-4c9e-8d78-e7c0224c5965-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8a5077e0-163a-4c9e-8d78-e7c0224c5965\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:29:30.756018 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.753997    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wmbm\" (UniqueName: \"kubernetes.io/projected/8a5077e0-163a-4c9e-8d78-e7c0224c5965-kube-api-access-8wmbm\") pod \"prometheus-k8s-0\" (UID: \"8a5077e0-163a-4c9e-8d78-e7c0224c5965\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:29:30.756018 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.754023    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8a5077e0-163a-4c9e-8d78-e7c0224c5965-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8a5077e0-163a-4c9e-8d78-e7c0224c5965\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:29:30.756018 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.754046    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8a5077e0-163a-4c9e-8d78-e7c0224c5965-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8a5077e0-163a-4c9e-8d78-e7c0224c5965\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:29:30.756018 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.754078    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8a5077e0-163a-4c9e-8d78-e7c0224c5965-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8a5077e0-163a-4c9e-8d78-e7c0224c5965\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:29:30.756018 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.754102    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8a5077e0-163a-4c9e-8d78-e7c0224c5965-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8a5077e0-163a-4c9e-8d78-e7c0224c5965\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:29:30.756018 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.754126    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8a5077e0-163a-4c9e-8d78-e7c0224c5965-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8a5077e0-163a-4c9e-8d78-e7c0224c5965\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:29:30.756018 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.754681    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a5077e0-163a-4c9e-8d78-e7c0224c5965-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8a5077e0-163a-4c9e-8d78-e7c0224c5965\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:29:30.756966 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.755835    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a5077e0-163a-4c9e-8d78-e7c0224c5965-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8a5077e0-163a-4c9e-8d78-e7c0224c5965\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:29:30.756966 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.756220    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8a5077e0-163a-4c9e-8d78-e7c0224c5965-config-out\") pod \"prometheus-k8s-0\" (UID: \"8a5077e0-163a-4c9e-8d78-e7c0224c5965\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:29:30.756966 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.756222    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8a5077e0-163a-4c9e-8d78-e7c0224c5965-web-config\") pod \"prometheus-k8s-0\" (UID: \"8a5077e0-163a-4c9e-8d78-e7c0224c5965\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:29:30.756966 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.756923    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a5077e0-163a-4c9e-8d78-e7c0224c5965-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8a5077e0-163a-4c9e-8d78-e7c0224c5965\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:29:30.758073 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.757665    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8a5077e0-163a-4c9e-8d78-e7c0224c5965-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8a5077e0-163a-4c9e-8d78-e7c0224c5965\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:29:30.758073 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.758015    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8a5077e0-163a-4c9e-8d78-e7c0224c5965-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8a5077e0-163a-4c9e-8d78-e7c0224c5965\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:29:30.758273 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.758073    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8a5077e0-163a-4c9e-8d78-e7c0224c5965-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8a5077e0-163a-4c9e-8d78-e7c0224c5965\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:29:30.758418 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.758392    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/8a5077e0-163a-4c9e-8d78-e7c0224c5965-config\") pod \"prometheus-k8s-0\" (UID: \"8a5077e0-163a-4c9e-8d78-e7c0224c5965\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:29:30.758726 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.758697    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8a5077e0-163a-4c9e-8d78-e7c0224c5965-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8a5077e0-163a-4c9e-8d78-e7c0224c5965\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:29:30.758838 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.758817    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8a5077e0-163a-4c9e-8d78-e7c0224c5965-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8a5077e0-163a-4c9e-8d78-e7c0224c5965\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:29:30.758887 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.758831    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8a5077e0-163a-4c9e-8d78-e7c0224c5965-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8a5077e0-163a-4c9e-8d78-e7c0224c5965\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:29:30.759390 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.759374    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8a5077e0-163a-4c9e-8d78-e7c0224c5965-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8a5077e0-163a-4c9e-8d78-e7c0224c5965\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:29:30.759513 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.759497    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8a5077e0-163a-4c9e-8d78-e7c0224c5965-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8a5077e0-163a-4c9e-8d78-e7c0224c5965\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:29:30.760115 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.760090    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8a5077e0-163a-4c9e-8d78-e7c0224c5965-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8a5077e0-163a-4c9e-8d78-e7c0224c5965\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:29:30.763635 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.763618    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wmbm\" (UniqueName: \"kubernetes.io/projected/8a5077e0-163a-4c9e-8d78-e7c0224c5965-kube-api-access-8wmbm\") pod \"prometheus-k8s-0\" (UID: \"8a5077e0-163a-4c9e-8d78-e7c0224c5965\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:29:30.856927 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:30.856891    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:29:31.168473 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:31.168346    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 09 13:29:31.170476 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:29:31.170452    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a5077e0_163a_4c9e_8d78_e7c0224c5965.slice/crio-80fe133152a7566096de8bff426fce0c74f53cdf33fefef943b21886db124421 WatchSource:0}: Error finding container 80fe133152a7566096de8bff426fce0c74f53cdf33fefef943b21886db124421: Status 404 returned error can't find the container with id 80fe133152a7566096de8bff426fce0c74f53cdf33fefef943b21886db124421
Sep 09 13:29:31.490069 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:31.489987    2578 generic.go:356] "Generic (PLEG): container finished" podID="8a5077e0-163a-4c9e-8d78-e7c0224c5965" containerID="6a536c9d75e14189b3cc2195cfb581e3fa8ccc65b127d34782fcc968fd05b419" exitCode=0
Sep 09 13:29:31.490069 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:31.490059    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8a5077e0-163a-4c9e-8d78-e7c0224c5965","Type":"ContainerDied","Data":"6a536c9d75e14189b3cc2195cfb581e3fa8ccc65b127d34782fcc968fd05b419"}
Sep 09 13:29:31.490258 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:31.490113    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8a5077e0-163a-4c9e-8d78-e7c0224c5965","Type":"ContainerStarted","Data":"80fe133152a7566096de8bff426fce0c74f53cdf33fefef943b21886db124421"}
Sep 09 13:29:32.498118 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:32.498079    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8a5077e0-163a-4c9e-8d78-e7c0224c5965","Type":"ContainerStarted","Data":"86b61cc2fc54e62069b53aefb1ab0f196836e0caa6c34e964b5b82b85e401b96"}
Sep 09 13:29:32.498564 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:32.498167    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8a5077e0-163a-4c9e-8d78-e7c0224c5965","Type":"ContainerStarted","Data":"775d54f05831c18077dae828ba7abd8825fad1ef49ce3d4f17da3705cad42d68"}
Sep 09 13:29:32.498564 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:32.498212    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8a5077e0-163a-4c9e-8d78-e7c0224c5965","Type":"ContainerStarted","Data":"829438d23851f25c58ca4166b23e2ab4ea056d61c0b5f2f52896d66f032d5444"}
Sep 09 13:29:32.498564 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:32.498236    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8a5077e0-163a-4c9e-8d78-e7c0224c5965","Type":"ContainerStarted","Data":"365c898ac21bb71972e6448ecb68737d6de4011146eaa14744f9ff85a7f978db"}
Sep 09 13:29:32.498564 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:32.498259    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8a5077e0-163a-4c9e-8d78-e7c0224c5965","Type":"ContainerStarted","Data":"645356eebb92bf402e257aa3b107d861ad8a5c99b13c04a1c53ed88abc7f8655"}
Sep 09 13:29:32.498564 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:32.498285    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8a5077e0-163a-4c9e-8d78-e7c0224c5965","Type":"ContainerStarted","Data":"aab7bee510a9d69a22852a4d3b197846416e140b9c7ea401dc76e0e280cabe9c"}
Sep 09 13:29:32.535691 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:32.535555    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.517104444 podStartE2EDuration="2.535533557s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.429113ms" isStatefulPod=false podCreationTimestamp="2026-09-09 13:29:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 13:29:32.533220736 +0000 UTC m=+184.348744931" watchObservedRunningTime="2026-09-09 13:29:32.535533557 +0000 UTC m=+184.351057753"
Sep 09 13:29:33.002815 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:33.002782    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:29:33.071478 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:33.071429    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:29:35.858043 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:35.858000    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:29:36.094887 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:36.094848    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:29:36.161639 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:36.161609    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:29:36.761225 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:36.761170    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:29:36.861896 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:36.861866    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:29:46.626806 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:46.626773    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:29:46.728118 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:46.728084    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:29:46.788266 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:29:46.788236    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:30:07.421518 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:30:07.421485    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:30:07.477321 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:30:07.477292    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:30:30.857509 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:30:30.857471    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:30:30.872415 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:30:30.872387    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:30:31.719200 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:30:31.719153    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 13:30:47.334069 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:30:47.334030    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:30:47.452940 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:30:47.452905    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:31:09.182258 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:09.182221    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:31:10.493552 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:10.493521    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:31:13.042788 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:13.042749    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:31:13.138759 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:13.138727    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:31:14.309113 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:14.309075    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:31:14.875445 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:14.875415    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:31:15.230029 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:15.229944    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:31:15.351568 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:15.351538    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:31:17.433858 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:17.433819    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:31:17.612802 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:17.612769    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:31:19.776776 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:19.776748    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:31:19.841744 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:19.841712    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:31:24.657021 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:24.656982    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:31:24.759887 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:24.759846    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:31:25.630643 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:25.630598    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:31:26.128123 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:26.128086    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-b24jm"]
Sep 09 13:31:26.130060 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:26.130044    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-b24jm"
Sep 09 13:31:26.132445 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:26.132421    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-249mk\""
Sep 09 13:31:26.132445 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:26.132440    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 09 13:31:26.133295 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:26.133273    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 09 13:31:26.141606 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:26.141587    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-b24jm"]
Sep 09 13:31:26.251851 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:26.251812    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7n4xf\" (UniqueName: \"kubernetes.io/projected/d0db7a42-556f-4001-b6b9-20237dd4628c-kube-api-access-7n4xf\") pod \"cert-manager-55b4d954d5-b24jm\" (UID: \"d0db7a42-556f-4001-b6b9-20237dd4628c\") " pod="cert-manager/cert-manager-55b4d954d5-b24jm"
Sep 09 13:31:26.252031 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:26.251857    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d0db7a42-556f-4001-b6b9-20237dd4628c-bound-sa-token\") pod \"cert-manager-55b4d954d5-b24jm\" (UID: \"d0db7a42-556f-4001-b6b9-20237dd4628c\") " pod="cert-manager/cert-manager-55b4d954d5-b24jm"
Sep 09 13:31:26.352585 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:26.352550    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7n4xf\" (UniqueName: \"kubernetes.io/projected/d0db7a42-556f-4001-b6b9-20237dd4628c-kube-api-access-7n4xf\") pod \"cert-manager-55b4d954d5-b24jm\" (UID: \"d0db7a42-556f-4001-b6b9-20237dd4628c\") " pod="cert-manager/cert-manager-55b4d954d5-b24jm"
Sep 09 13:31:26.352708 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:26.352598    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d0db7a42-556f-4001-b6b9-20237dd4628c-bound-sa-token\") pod \"cert-manager-55b4d954d5-b24jm\" (UID: \"d0db7a42-556f-4001-b6b9-20237dd4628c\") " pod="cert-manager/cert-manager-55b4d954d5-b24jm"
Sep 09 13:31:26.360873 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:26.360839    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d0db7a42-556f-4001-b6b9-20237dd4628c-bound-sa-token\") pod \"cert-manager-55b4d954d5-b24jm\" (UID: \"d0db7a42-556f-4001-b6b9-20237dd4628c\") " pod="cert-manager/cert-manager-55b4d954d5-b24jm"
Sep 09 13:31:26.360873 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:26.360842    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7n4xf\" (UniqueName: \"kubernetes.io/projected/d0db7a42-556f-4001-b6b9-20237dd4628c-kube-api-access-7n4xf\") pod \"cert-manager-55b4d954d5-b24jm\" (UID: \"d0db7a42-556f-4001-b6b9-20237dd4628c\") " pod="cert-manager/cert-manager-55b4d954d5-b24jm"
Sep 09 13:31:26.453625 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:26.453543    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-b24jm"
Sep 09 13:31:26.722086 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:26.722012    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-b24jm"]
Sep 09 13:31:26.725303 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:31:26.725271    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd0db7a42_556f_4001_b6b9_20237dd4628c.slice/crio-580c38c9fcee7b47582728c0f7d326de82dbdcc698f5ce06763d60c7d6124137 WatchSource:0}: Error finding container 580c38c9fcee7b47582728c0f7d326de82dbdcc698f5ce06763d60c7d6124137: Status 404 returned error can't find the container with id 580c38c9fcee7b47582728c0f7d326de82dbdcc698f5ce06763d60c7d6124137
Sep 09 13:31:26.894049 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:26.894011    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-b24jm" event={"ID":"d0db7a42-556f-4001-b6b9-20237dd4628c","Type":"ContainerStarted","Data":"580c38c9fcee7b47582728c0f7d326de82dbdcc698f5ce06763d60c7d6124137"}
Sep 09 13:31:29.190081 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:29.190043    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:31:29.292273 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:29.292234    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:31:29.869602 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:29.869576    2578 kubelet.go:1648] "Image garbage collection succeeded"
Sep 09 13:31:30.866312 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:30.866281    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cxq54"]
Sep 09 13:31:30.869357 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:30.869342    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cxq54"
Sep 09 13:31:30.871878 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:30.871834    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-cvxj2\""
Sep 09 13:31:30.872004 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:30.871965    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 09 13:31:30.872937 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:30.872919    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 09 13:31:30.880796 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:30.880774    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cxq54"]
Sep 09 13:31:30.910943 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:30.910916    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-b24jm" event={"ID":"d0db7a42-556f-4001-b6b9-20237dd4628c","Type":"ContainerStarted","Data":"dd31f34bde7ba19ffcba0d9cc3f239821c8964daaaa4c49367a18b0476d70df4"}
Sep 09 13:31:30.938479 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:30.938428    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-b24jm" podStartSLOduration=1.756187513 podStartE2EDuration="4.93841058s" totalImagesPullingTime="3.182223067s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 13:31:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 13:31:30.937294152 +0000 UTC m=+302.752818347" watchObservedRunningTime="2026-09-09 13:31:30.93841058 +0000 UTC m=+302.753934773"
Sep 09 13:31:30.992052 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:30.992019    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rq4jp\" (UniqueName: \"kubernetes.io/projected/0b4383ae-e35d-448b-9596-0c563d7f5c9e-kube-api-access-rq4jp\") pod \"openshift-lws-operator-fd8ccff4c-cxq54\" (UID: \"0b4383ae-e35d-448b-9596-0c563d7f5c9e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cxq54"
Sep 09 13:31:30.992207 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:30.992091    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b4383ae-e35d-448b-9596-0c563d7f5c9e-tmp\") pod \"openshift-lws-operator-fd8ccff4c-cxq54\" (UID: \"0b4383ae-e35d-448b-9596-0c563d7f5c9e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cxq54"
Sep 09 13:31:31.093444 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:31.093388    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rq4jp\" (UniqueName: \"kubernetes.io/projected/0b4383ae-e35d-448b-9596-0c563d7f5c9e-kube-api-access-rq4jp\") pod \"openshift-lws-operator-fd8ccff4c-cxq54\" (UID: \"0b4383ae-e35d-448b-9596-0c563d7f5c9e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cxq54"
Sep 09 13:31:31.093630 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:31.093516    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b4383ae-e35d-448b-9596-0c563d7f5c9e-tmp\") pod \"openshift-lws-operator-fd8ccff4c-cxq54\" (UID: \"0b4383ae-e35d-448b-9596-0c563d7f5c9e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cxq54"
Sep 09 13:31:31.093933 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:31.093913    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b4383ae-e35d-448b-9596-0c563d7f5c9e-tmp\") pod \"openshift-lws-operator-fd8ccff4c-cxq54\" (UID: \"0b4383ae-e35d-448b-9596-0c563d7f5c9e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cxq54"
Sep 09 13:31:31.102305 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:31.102285    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rq4jp\" (UniqueName: \"kubernetes.io/projected/0b4383ae-e35d-448b-9596-0c563d7f5c9e-kube-api-access-rq4jp\") pod \"openshift-lws-operator-fd8ccff4c-cxq54\" (UID: \"0b4383ae-e35d-448b-9596-0c563d7f5c9e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cxq54"
Sep 09 13:31:31.178807 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:31.178776    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cxq54"
Sep 09 13:31:31.453852 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:31.453781    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cxq54"]
Sep 09 13:31:31.457509 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:31:31.457470    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0b4383ae_e35d_448b_9596_0c563d7f5c9e.slice/crio-b76843b3a76c2fc6467e5e0473f7ba773d4b9f766ae3b652926de71035c307bd WatchSource:0}: Error finding container b76843b3a76c2fc6467e5e0473f7ba773d4b9f766ae3b652926de71035c307bd: Status 404 returned error can't find the container with id b76843b3a76c2fc6467e5e0473f7ba773d4b9f766ae3b652926de71035c307bd
Sep 09 13:31:31.458990 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:31.458971    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 13:31:31.916170 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:31.916126    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cxq54" event={"ID":"0b4383ae-e35d-448b-9596-0c563d7f5c9e","Type":"ContainerStarted","Data":"b76843b3a76c2fc6467e5e0473f7ba773d4b9f766ae3b652926de71035c307bd"}
Sep 09 13:31:32.808322 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:32.808290    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:31:34.929039 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:34.929001    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cxq54" event={"ID":"0b4383ae-e35d-448b-9596-0c563d7f5c9e","Type":"ContainerStarted","Data":"60a08ed49a1d2d6d2ea6971674f7465ee913088ae174113b0a1e93455dcf9041"}
Sep 09 13:31:34.950847 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:34.950794    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cxq54" podStartSLOduration=2.455288234 podStartE2EDuration="4.950775435s" totalImagesPullingTime="2.495487201s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 13:31:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 13:31:34.945556684 +0000 UTC m=+306.761080878" watchObservedRunningTime="2026-09-09 13:31:34.950775435 +0000 UTC m=+306.766299631"
Sep 09 13:31:35.697527 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:35.697496    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:31:35.798710 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:35.798672    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:31:37.533166 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:37.533137    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:31:49.347779 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:49.347737    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:31:49.457790 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:49.457759    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:31:49.943826 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:49.943787    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:31:50.237357 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:50.237275    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:31:50.353590 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:50.353558    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:31:50.404379 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:50.404339    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8469c9486d-6j8ld"]
Sep 09 13:31:50.407731 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:50.407714    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8469c9486d-6j8ld"
Sep 09 13:31:50.411938 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:50.411915    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 09 13:31:50.412059 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:50.411917    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-bk6bx\""
Sep 09 13:31:50.412252 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:50.412238    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 09 13:31:50.412548 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:50.412534    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 09 13:31:50.412626 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:50.412611    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 09 13:31:50.429632 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:50.429608    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8469c9486d-6j8ld"]
Sep 09 13:31:50.431743 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:50.431717    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9cf8ff24-1a89-4f63-a188-ddccaf2f8720-manifests\") pod \"opendatahub-operator-controller-manager-8469c9486d-6j8ld\" (UID: \"9cf8ff24-1a89-4f63-a188-ddccaf2f8720\") " pod="opendatahub/opendatahub-operator-controller-manager-8469c9486d-6j8ld"
Sep 09 13:31:50.431852 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:50.431763    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9cf8ff24-1a89-4f63-a188-ddccaf2f8720-tmp\") pod \"opendatahub-operator-controller-manager-8469c9486d-6j8ld\" (UID: \"9cf8ff24-1a89-4f63-a188-ddccaf2f8720\") " pod="opendatahub/opendatahub-operator-controller-manager-8469c9486d-6j8ld"
Sep 09 13:31:50.431898 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:50.431873    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbdzs\" (UniqueName: \"kubernetes.io/projected/9cf8ff24-1a89-4f63-a188-ddccaf2f8720-kube-api-access-jbdzs\") pod \"opendatahub-operator-controller-manager-8469c9486d-6j8ld\" (UID: \"9cf8ff24-1a89-4f63-a188-ddccaf2f8720\") " pod="opendatahub/opendatahub-operator-controller-manager-8469c9486d-6j8ld"
Sep 09 13:31:50.431943 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:50.431903    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9cf8ff24-1a89-4f63-a188-ddccaf2f8720-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8469c9486d-6j8ld\" (UID: \"9cf8ff24-1a89-4f63-a188-ddccaf2f8720\") " pod="opendatahub/opendatahub-operator-controller-manager-8469c9486d-6j8ld"
Sep 09 13:31:50.431943 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:50.431936    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9cf8ff24-1a89-4f63-a188-ddccaf2f8720-webhook-cert\") pod \"opendatahub-operator-controller-manager-8469c9486d-6j8ld\" (UID: \"9cf8ff24-1a89-4f63-a188-ddccaf2f8720\") " pod="opendatahub/opendatahub-operator-controller-manager-8469c9486d-6j8ld"
Sep 09 13:31:50.532471 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:50.532390    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9cf8ff24-1a89-4f63-a188-ddccaf2f8720-webhook-cert\") pod \"opendatahub-operator-controller-manager-8469c9486d-6j8ld\" (UID: \"9cf8ff24-1a89-4f63-a188-ddccaf2f8720\") " pod="opendatahub/opendatahub-operator-controller-manager-8469c9486d-6j8ld"
Sep 09 13:31:50.532471 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:50.532437    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9cf8ff24-1a89-4f63-a188-ddccaf2f8720-manifests\") pod \"opendatahub-operator-controller-manager-8469c9486d-6j8ld\" (UID: \"9cf8ff24-1a89-4f63-a188-ddccaf2f8720\") " pod="opendatahub/opendatahub-operator-controller-manager-8469c9486d-6j8ld"
Sep 09 13:31:50.532471 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:50.532455    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9cf8ff24-1a89-4f63-a188-ddccaf2f8720-tmp\") pod \"opendatahub-operator-controller-manager-8469c9486d-6j8ld\" (UID: \"9cf8ff24-1a89-4f63-a188-ddccaf2f8720\") " pod="opendatahub/opendatahub-operator-controller-manager-8469c9486d-6j8ld"
Sep 09 13:31:50.532690 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:50.532511    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbdzs\" (UniqueName: \"kubernetes.io/projected/9cf8ff24-1a89-4f63-a188-ddccaf2f8720-kube-api-access-jbdzs\") pod \"opendatahub-operator-controller-manager-8469c9486d-6j8ld\" (UID: \"9cf8ff24-1a89-4f63-a188-ddccaf2f8720\") " pod="opendatahub/opendatahub-operator-controller-manager-8469c9486d-6j8ld"
Sep 09 13:31:50.532690 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:50.532530    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9cf8ff24-1a89-4f63-a188-ddccaf2f8720-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8469c9486d-6j8ld\" (UID: \"9cf8ff24-1a89-4f63-a188-ddccaf2f8720\") " pod="opendatahub/opendatahub-operator-controller-manager-8469c9486d-6j8ld"
Sep 09 13:31:50.532921 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:50.532891    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9cf8ff24-1a89-4f63-a188-ddccaf2f8720-manifests\") pod \"opendatahub-operator-controller-manager-8469c9486d-6j8ld\" (UID: \"9cf8ff24-1a89-4f63-a188-ddccaf2f8720\") " pod="opendatahub/opendatahub-operator-controller-manager-8469c9486d-6j8ld"
Sep 09 13:31:50.534716 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:50.534691    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9cf8ff24-1a89-4f63-a188-ddccaf2f8720-tmp\") pod \"opendatahub-operator-controller-manager-8469c9486d-6j8ld\" (UID: \"9cf8ff24-1a89-4f63-a188-ddccaf2f8720\") " pod="opendatahub/opendatahub-operator-controller-manager-8469c9486d-6j8ld"
Sep 09 13:31:50.534978 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:50.534962    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9cf8ff24-1a89-4f63-a188-ddccaf2f8720-webhook-cert\") pod \"opendatahub-operator-controller-manager-8469c9486d-6j8ld\" (UID: \"9cf8ff24-1a89-4f63-a188-ddccaf2f8720\") " pod="opendatahub/opendatahub-operator-controller-manager-8469c9486d-6j8ld"
Sep 09 13:31:50.535044 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:50.535025    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9cf8ff24-1a89-4f63-a188-ddccaf2f8720-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8469c9486d-6j8ld\" (UID: \"9cf8ff24-1a89-4f63-a188-ddccaf2f8720\") " pod="opendatahub/opendatahub-operator-controller-manager-8469c9486d-6j8ld"
Sep 09 13:31:50.544144 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:50.544123    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbdzs\" (UniqueName: \"kubernetes.io/projected/9cf8ff24-1a89-4f63-a188-ddccaf2f8720-kube-api-access-jbdzs\") pod \"opendatahub-operator-controller-manager-8469c9486d-6j8ld\" (UID: \"9cf8ff24-1a89-4f63-a188-ddccaf2f8720\") " pod="opendatahub/opendatahub-operator-controller-manager-8469c9486d-6j8ld"
Sep 09 13:31:50.546816 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:50.546793    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:31:50.647329 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:50.647296    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:31:50.717391 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:50.717358    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8469c9486d-6j8ld"
Sep 09 13:31:50.748789 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:50.748752    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:31:50.854881 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:50.854802    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:31:50.978546 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:50.978512    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:31:51.004856 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:51.004835    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8469c9486d-6j8ld"]
Sep 09 13:31:51.006504 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:31:51.006477    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cf8ff24_1a89_4f63_a188_ddccaf2f8720.slice/crio-640201779bea52dda2816da8a6708ea0091434973cb41283778299be0e1b9e9d WatchSource:0}: Error finding container 640201779bea52dda2816da8a6708ea0091434973cb41283778299be0e1b9e9d: Status 404 returned error can't find the container with id 640201779bea52dda2816da8a6708ea0091434973cb41283778299be0e1b9e9d
Sep 09 13:31:51.143513 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:51.143483    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:31:51.992259 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:51.992217    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8469c9486d-6j8ld" event={"ID":"9cf8ff24-1a89-4f63-a188-ddccaf2f8720","Type":"ContainerStarted","Data":"640201779bea52dda2816da8a6708ea0091434973cb41283778299be0e1b9e9d"}
Sep 09 13:31:54.404266 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:54.404233    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:31:55.005405 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:55.005366    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8469c9486d-6j8ld" event={"ID":"9cf8ff24-1a89-4f63-a188-ddccaf2f8720","Type":"ContainerStarted","Data":"3935d03984540083946e3cd1f0e1392c96f2db11dd7718ea3f90da96ed031fbe"}
Sep 09 13:31:56.010751 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:56.010718    2578 generic.go:356] "Generic (PLEG): container finished" podID="9cf8ff24-1a89-4f63-a188-ddccaf2f8720" containerID="3935d03984540083946e3cd1f0e1392c96f2db11dd7718ea3f90da96ed031fbe" exitCode=0
Sep 09 13:31:56.011120 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:56.010810    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8469c9486d-6j8ld" event={"ID":"9cf8ff24-1a89-4f63-a188-ddccaf2f8720","Type":"ContainerDied","Data":"3935d03984540083946e3cd1f0e1392c96f2db11dd7718ea3f90da96ed031fbe"}
Sep 09 13:31:57.016848 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:57.016814    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8469c9486d-6j8ld" event={"ID":"9cf8ff24-1a89-4f63-a188-ddccaf2f8720","Type":"ContainerStarted","Data":"d2e4a655d4825f72b9509e1fc37422aed8b779d1f90457087d6f107fb0bee1ce"}
Sep 09 13:31:57.017297 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:57.016917    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-8469c9486d-6j8ld"
Sep 09 13:31:57.044441 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:31:57.044388    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-8469c9486d-6j8ld" podStartSLOduration=2.696791116 podStartE2EDuration="7.044371217s" totalImagesPullingTime="3.268707543s" totalInitContainerRuntime="1.078872558s" isStatefulPod=false podCreationTimestamp="2026-09-09 13:31:50 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 13:31:57.043223405 +0000 UTC m=+328.858747600" watchObservedRunningTime="2026-09-09 13:31:57.044371217 +0000 UTC m=+328.859895410"
Sep 09 13:32:05.312783 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:05.312748    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:32:05.415910 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:05.415880    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:32:08.025215 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:08.025099    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-8469c9486d-6j8ld"
Sep 09 13:32:09.609165 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:09.609133    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:32:09.734781 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:09.734745    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:32:10.219344 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:10.219310    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:32:17.255621 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:17.255588    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:32:17.610894 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:17.610813    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:32:19.004914 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:19.004875    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:32:19.079598 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:19.079563    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:32:20.368525 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:20.368498    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:32:20.480650 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:20.480620    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:32:20.938874 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:20.938794    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:32:21.025982 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:21.025949    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:32:21.094388 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:21.094362    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:32:21.267527 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:21.267444    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:32:21.788923 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:21.788893    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:32:22.005369 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:22.005340    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:32:22.103361 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:22.103283    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:32:22.493428 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:22.493398    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:32:23.114814 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:23.114784    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:32:28.251945 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:28.251907    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-nd4b5"]
Sep 09 13:32:28.259735 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:28.259715    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nd4b5"
Sep 09 13:32:28.263425 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:28.263396    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 09 13:32:28.263425 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:28.263404    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 09 13:32:28.263662 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:28.263651    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 09 13:32:28.263732 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:28.263670    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 09 13:32:28.264132 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:28.264115    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 09 13:32:28.264132 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:28.264126    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 09 13:32:28.264317 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:28.264138    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-qkfck\""
Sep 09 13:32:28.275070 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:28.275050    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-nd4b5"]
Sep 09 13:32:28.339869 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:28.339825    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj285\" (UniqueName: \"kubernetes.io/projected/919b3366-f8a5-48e6-a58e-51a3f5622f79-kube-api-access-gj285\") pod \"istiod-openshift-gateway-5677ccb49b-nd4b5\" (UID: \"919b3366-f8a5-48e6-a58e-51a3f5622f79\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nd4b5"
Sep 09 13:32:28.340062 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:28.339881    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/919b3366-f8a5-48e6-a58e-51a3f5622f79-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-nd4b5\" (UID: \"919b3366-f8a5-48e6-a58e-51a3f5622f79\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nd4b5"
Sep 09 13:32:28.340062 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:28.339924    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/919b3366-f8a5-48e6-a58e-51a3f5622f79-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-nd4b5\" (UID: \"919b3366-f8a5-48e6-a58e-51a3f5622f79\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nd4b5"
Sep 09 13:32:28.340062 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:28.339945    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/919b3366-f8a5-48e6-a58e-51a3f5622f79-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-nd4b5\" (UID: \"919b3366-f8a5-48e6-a58e-51a3f5622f79\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nd4b5"
Sep 09 13:32:28.340062 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:28.339964    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/919b3366-f8a5-48e6-a58e-51a3f5622f79-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-nd4b5\" (UID: \"919b3366-f8a5-48e6-a58e-51a3f5622f79\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nd4b5"
Sep 09 13:32:28.340062 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:28.339990    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/919b3366-f8a5-48e6-a58e-51a3f5622f79-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-nd4b5\" (UID: \"919b3366-f8a5-48e6-a58e-51a3f5622f79\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nd4b5"
Sep 09 13:32:28.340062 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:28.340045    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/919b3366-f8a5-48e6-a58e-51a3f5622f79-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-nd4b5\" (UID: \"919b3366-f8a5-48e6-a58e-51a3f5622f79\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nd4b5"
Sep 09 13:32:28.344990 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:28.344964    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:32:28.441256 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:28.441218    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/919b3366-f8a5-48e6-a58e-51a3f5622f79-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-nd4b5\" (UID: \"919b3366-f8a5-48e6-a58e-51a3f5622f79\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nd4b5"
Sep 09 13:32:28.441435 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:28.441266    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/919b3366-f8a5-48e6-a58e-51a3f5622f79-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-nd4b5\" (UID: \"919b3366-f8a5-48e6-a58e-51a3f5622f79\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nd4b5"
Sep 09 13:32:28.441435 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:28.441285    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/919b3366-f8a5-48e6-a58e-51a3f5622f79-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-nd4b5\" (UID: \"919b3366-f8a5-48e6-a58e-51a3f5622f79\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nd4b5"
Sep 09 13:32:28.441435 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:28.441305    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/919b3366-f8a5-48e6-a58e-51a3f5622f79-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-nd4b5\" (UID: \"919b3366-f8a5-48e6-a58e-51a3f5622f79\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nd4b5"
Sep 09 13:32:28.441613 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:28.441438    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/919b3366-f8a5-48e6-a58e-51a3f5622f79-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-nd4b5\" (UID: \"919b3366-f8a5-48e6-a58e-51a3f5622f79\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nd4b5"
Sep 09 13:32:28.441613 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:28.441504    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/919b3366-f8a5-48e6-a58e-51a3f5622f79-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-nd4b5\" (UID: \"919b3366-f8a5-48e6-a58e-51a3f5622f79\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nd4b5"
Sep 09 13:32:28.441613 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:28.441568    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gj285\" (UniqueName: \"kubernetes.io/projected/919b3366-f8a5-48e6-a58e-51a3f5622f79-kube-api-access-gj285\") pod \"istiod-openshift-gateway-5677ccb49b-nd4b5\" (UID: \"919b3366-f8a5-48e6-a58e-51a3f5622f79\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nd4b5"
Sep 09 13:32:28.442085 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:28.442057    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/919b3366-f8a5-48e6-a58e-51a3f5622f79-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-nd4b5\" (UID: \"919b3366-f8a5-48e6-a58e-51a3f5622f79\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nd4b5"
Sep 09 13:32:28.443662 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:28.443634    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/919b3366-f8a5-48e6-a58e-51a3f5622f79-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-nd4b5\" (UID: \"919b3366-f8a5-48e6-a58e-51a3f5622f79\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nd4b5"
Sep 09 13:32:28.443841 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:28.443818    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/919b3366-f8a5-48e6-a58e-51a3f5622f79-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-nd4b5\" (UID: \"919b3366-f8a5-48e6-a58e-51a3f5622f79\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nd4b5"
Sep 09 13:32:28.443991 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:28.443973    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/919b3366-f8a5-48e6-a58e-51a3f5622f79-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-nd4b5\" (UID: \"919b3366-f8a5-48e6-a58e-51a3f5622f79\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nd4b5"
Sep 09 13:32:28.444053 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:28.444012    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/919b3366-f8a5-48e6-a58e-51a3f5622f79-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-nd4b5\" (UID: \"919b3366-f8a5-48e6-a58e-51a3f5622f79\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nd4b5"
Sep 09 13:32:28.453996 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:28.453974    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj285\" (UniqueName: \"kubernetes.io/projected/919b3366-f8a5-48e6-a58e-51a3f5622f79-kube-api-access-gj285\") pod \"istiod-openshift-gateway-5677ccb49b-nd4b5\" (UID: \"919b3366-f8a5-48e6-a58e-51a3f5622f79\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nd4b5"
Sep 09 13:32:28.460470 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:28.460452    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/919b3366-f8a5-48e6-a58e-51a3f5622f79-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-nd4b5\" (UID: \"919b3366-f8a5-48e6-a58e-51a3f5622f79\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nd4b5"
Sep 09 13:32:28.473168 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:28.473150    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:32:28.573063 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:28.572998    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-qkfck\""
Sep 09 13:32:28.580574 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:28.580552    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nd4b5"
Sep 09 13:32:28.870595 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:28.870511    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-nd4b5"]
Sep 09 13:32:28.874875 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:32:28.874851    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod919b3366_f8a5_48e6_a58e_51a3f5622f79.slice/crio-9d9ad02e6244b07bc049c4b7bd551be9f2adf1d5b5269741c5e206c50d5ed3d2 WatchSource:0}: Error finding container 9d9ad02e6244b07bc049c4b7bd551be9f2adf1d5b5269741c5e206c50d5ed3d2: Status 404 returned error can't find the container with id 9d9ad02e6244b07bc049c4b7bd551be9f2adf1d5b5269741c5e206c50d5ed3d2
Sep 09 13:32:29.145091 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:29.145007    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nd4b5" event={"ID":"919b3366-f8a5-48e6-a58e-51a3f5622f79","Type":"ContainerStarted","Data":"9d9ad02e6244b07bc049c4b7bd551be9f2adf1d5b5269741c5e206c50d5ed3d2"}
Sep 09 13:32:29.332765 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:29.332730    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:32:29.549575 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:29.549486    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-68df89f6f5-7v6hd"]
Sep 09 13:32:29.552271 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:29.552241    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-68df89f6f5-7v6hd"
Sep 09 13:32:29.556511 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:29.556403    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-6jc27\""
Sep 09 13:32:29.557220 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:29.557196    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 09 13:32:29.557220 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:29.557199    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 09 13:32:29.557386 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:29.557232    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 09 13:32:29.568542 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:29.568513    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:32:29.569396 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:29.569370    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-68df89f6f5-7v6hd"]
Sep 09 13:32:29.652627 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:29.652586    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d85178e3-afa8-48db-bb3c-b424bebb3995-cert\") pod \"lws-controller-manager-68df89f6f5-7v6hd\" (UID: \"d85178e3-afa8-48db-bb3c-b424bebb3995\") " pod="openshift-lws-operator/lws-controller-manager-68df89f6f5-7v6hd"
Sep 09 13:32:29.652790 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:29.652651    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d85178e3-afa8-48db-bb3c-b424bebb3995-manager-config\") pod \"lws-controller-manager-68df89f6f5-7v6hd\" (UID: \"d85178e3-afa8-48db-bb3c-b424bebb3995\") " pod="openshift-lws-operator/lws-controller-manager-68df89f6f5-7v6hd"
Sep 09 13:32:29.652790 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:29.652717    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dm4b\" (UniqueName: \"kubernetes.io/projected/d85178e3-afa8-48db-bb3c-b424bebb3995-kube-api-access-8dm4b\") pod \"lws-controller-manager-68df89f6f5-7v6hd\" (UID: \"d85178e3-afa8-48db-bb3c-b424bebb3995\") " pod="openshift-lws-operator/lws-controller-manager-68df89f6f5-7v6hd"
Sep 09 13:32:29.652913 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:29.652812    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d85178e3-afa8-48db-bb3c-b424bebb3995-metrics-cert\") pod \"lws-controller-manager-68df89f6f5-7v6hd\" (UID: \"d85178e3-afa8-48db-bb3c-b424bebb3995\") " pod="openshift-lws-operator/lws-controller-manager-68df89f6f5-7v6hd"
Sep 09 13:32:29.680480 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:29.680438    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:32:29.753770 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:29.753733    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d85178e3-afa8-48db-bb3c-b424bebb3995-metrics-cert\") pod \"lws-controller-manager-68df89f6f5-7v6hd\" (UID: \"d85178e3-afa8-48db-bb3c-b424bebb3995\") " pod="openshift-lws-operator/lws-controller-manager-68df89f6f5-7v6hd"
Sep 09 13:32:29.753935 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:29.753846    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d85178e3-afa8-48db-bb3c-b424bebb3995-cert\") pod \"lws-controller-manager-68df89f6f5-7v6hd\" (UID: \"d85178e3-afa8-48db-bb3c-b424bebb3995\") " pod="openshift-lws-operator/lws-controller-manager-68df89f6f5-7v6hd"
Sep 09 13:32:29.753935 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:29.753895    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d85178e3-afa8-48db-bb3c-b424bebb3995-manager-config\") pod \"lws-controller-manager-68df89f6f5-7v6hd\" (UID: \"d85178e3-afa8-48db-bb3c-b424bebb3995\") " pod="openshift-lws-operator/lws-controller-manager-68df89f6f5-7v6hd"
Sep 09 13:32:29.754017 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:29.753953    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dm4b\" (UniqueName: \"kubernetes.io/projected/d85178e3-afa8-48db-bb3c-b424bebb3995-kube-api-access-8dm4b\") pod \"lws-controller-manager-68df89f6f5-7v6hd\" (UID: \"d85178e3-afa8-48db-bb3c-b424bebb3995\") " pod="openshift-lws-operator/lws-controller-manager-68df89f6f5-7v6hd"
Sep 09 13:32:29.754798 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:29.754768    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d85178e3-afa8-48db-bb3c-b424bebb3995-manager-config\") pod \"lws-controller-manager-68df89f6f5-7v6hd\" (UID: \"d85178e3-afa8-48db-bb3c-b424bebb3995\") " pod="openshift-lws-operator/lws-controller-manager-68df89f6f5-7v6hd"
Sep 09 13:32:29.757369 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:29.757232    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d85178e3-afa8-48db-bb3c-b424bebb3995-metrics-cert\") pod \"lws-controller-manager-68df89f6f5-7v6hd\" (UID: \"d85178e3-afa8-48db-bb3c-b424bebb3995\") " pod="openshift-lws-operator/lws-controller-manager-68df89f6f5-7v6hd"
Sep 09 13:32:29.757369 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:29.757274    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d85178e3-afa8-48db-bb3c-b424bebb3995-cert\") pod \"lws-controller-manager-68df89f6f5-7v6hd\" (UID: \"d85178e3-afa8-48db-bb3c-b424bebb3995\") " pod="openshift-lws-operator/lws-controller-manager-68df89f6f5-7v6hd"
Sep 09 13:32:29.777066 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:29.777011    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dm4b\" (UniqueName: \"kubernetes.io/projected/d85178e3-afa8-48db-bb3c-b424bebb3995-kube-api-access-8dm4b\") pod \"lws-controller-manager-68df89f6f5-7v6hd\" (UID: \"d85178e3-afa8-48db-bb3c-b424bebb3995\") " pod="openshift-lws-operator/lws-controller-manager-68df89f6f5-7v6hd"
Sep 09 13:32:29.865865 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:29.865785    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-68df89f6f5-7v6hd"
Sep 09 13:32:30.148774 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:30.148637    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-68df89f6f5-7v6hd"]
Sep 09 13:32:30.151773 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:32:30.151741    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd85178e3_afa8_48db_bb3c_b424bebb3995.slice/crio-781698558ac7cfef3737f54bbf5f2ee87a58afcd8a204c664e7236bf6885fc1c WatchSource:0}: Error finding container 781698558ac7cfef3737f54bbf5f2ee87a58afcd8a204c664e7236bf6885fc1c: Status 404 returned error can't find the container with id 781698558ac7cfef3737f54bbf5f2ee87a58afcd8a204c664e7236bf6885fc1c
Sep 09 13:32:31.156617 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:31.156581    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-68df89f6f5-7v6hd" event={"ID":"d85178e3-afa8-48db-bb3c-b424bebb3995","Type":"ContainerStarted","Data":"781698558ac7cfef3737f54bbf5f2ee87a58afcd8a204c664e7236bf6885fc1c"}
Sep 09 13:32:31.181573 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:31.181537    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 13:32:31.181686 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:31.181605    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 13:32:31.766636 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:31.765987    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:32:31.869346 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:31.869252    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:32:31.952825 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:31.952792    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:32:32.163847 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:32.163814    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nd4b5" event={"ID":"919b3366-f8a5-48e6-a58e-51a3f5622f79","Type":"ContainerStarted","Data":"90a8f451ae3e46cff0b633e4e4fcd567130215b8af17e0a99a540b227cd8637d"}
Sep 09 13:32:32.164347 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:32.164035    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nd4b5"
Sep 09 13:32:32.166138 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:32.166110    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nd4b5"
Sep 09 13:32:32.220840 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:32.220784    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nd4b5" podStartSLOduration=1.916499567 podStartE2EDuration="4.220767421s" totalImagesPullingTime="2.304267854s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 13:32:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 13:32:32.21859296 +0000 UTC m=+364.034117156" watchObservedRunningTime="2026-09-09 13:32:32.220767421 +0000 UTC m=+364.036291614"
Sep 09 13:32:32.714912 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:32.714879    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:32:33.089465 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:33.089434    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:32:33.170121 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:33.170086    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-68df89f6f5-7v6hd" event={"ID":"d85178e3-afa8-48db-bb3c-b424bebb3995","Type":"ContainerStarted","Data":"d7a8e86c7f5359f8c1d735e094312e8b0ba37527a5d52c4c5b4d97aa4048825b"}
Sep 09 13:32:33.218281 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:33.218250    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:32:33.259349 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:33.259281    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-68df89f6f5-7v6hd" podStartSLOduration=1.909745659 podStartE2EDuration="4.259259825s" totalImagesPullingTime="2.349514166s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 13:32:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 13:32:33.258602221 +0000 UTC m=+365.074126406" watchObservedRunningTime="2026-09-09 13:32:33.259259825 +0000 UTC m=+365.074784035"
Sep 09 13:32:33.411481 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:33.411442    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:32:34.175138 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:34.175098    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-68df89f6f5-7v6hd"
Sep 09 13:32:45.181483 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:45.181451    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-68df89f6f5-7v6hd"
Sep 09 13:32:55.598659 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:55.598602    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:32:55.698647 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:55.698611    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:32:55.763239 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:55.763212    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:32:56.331908 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:32:56.331873    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:33:06.601605 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:33:06.601570    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:33:06.702758 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:33:06.702725    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:33:06.800586 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:33:06.800552    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:33:21.982516 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:33:21.982473    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:33:22.079350 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:33:22.079320    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:33:40.485989 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:33:40.485953    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:33:41.496139 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:33:41.496103    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:33:46.085562 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:33:46.085525    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:33:48.767926 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:33:48.767891    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:33:49.382885 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:33:49.382854    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:33:49.732841 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:33:49.732762    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:33:49.875606 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:33:49.875577    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:33:54.891455 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:33:54.891362    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:33:57.754035 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:33:57.754003    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:33:57.883237 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:33:57.883207    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:33:58.888829 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:33:58.888771    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:33:58.989075 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:33:58.989030    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:33:59.129061 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:33:59.129023    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:33:59.289790 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:33:59.289687    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:33:59.391257 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:33:59.391211    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:34:00.321505 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:34:00.321466    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:34:01.388447 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:34:01.388408    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:34:01.723191 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:34:01.723092    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:34:01.822508 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:34:01.822479    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:34:02.486482 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:34:02.486451    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:34:02.592375 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:34:02.592333    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:34:06.888442 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:34:06.888405    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:34:07.024706 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:34:07.024676    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:34:07.157466 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:34:07.157376    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:34:07.255315 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:34:07.255285    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:34:13.834728 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:34:13.834683    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:34:14.017388 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:34:14.017358    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:34:18.954626 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:34:18.954593    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:34:19.056109 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:34:19.056078    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:34:19.156547 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:34:19.156512    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:34:19.252840 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:34:19.252765    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:34:21.171598 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:34:21.171564    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:34:21.265367 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:34:21.265339    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:34:26.008832 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:34:26.008795    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:34:26.109706 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:34:26.109675    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:34:26.208675 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:34:26.208639    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:34:32.479681 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:34:32.479638    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:34:32.581025 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:34:32.580991    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:34:38.022021 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:34:38.021987    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:34:38.077948 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:34:38.077914    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:34:38.254951 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:34:38.254920    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:34:38.320370 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:34:38.320275    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:34:38.633728 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:34:38.633693    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:34:38.732883 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:34:38.732849    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:34:41.056646 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:34:41.056588    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:34:41.154595 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:34:41.154547    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:34:44.396230 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:34:44.396166    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:34:44.469631 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:34:44.469594    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:34:46.237807 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:34:46.237772    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:34:46.301521 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:34:46.301484    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:34:46.424490 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:34:46.424459    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:34:46.487292 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:34:46.487236    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:34:46.633532 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:34:46.633499    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:34:46.733436 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:34:46.733406    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:34:50.114588 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:34:50.114551    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:34:50.214732 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:34:50.214680    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:34:50.278009 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:34:50.277976    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:34:50.422528 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:34:50.422496    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:34:50.424740 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:34:50.424720    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"
Sep 09 13:34:50.427398 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:34:50.427375    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-5fch6\""
Sep 09 13:34:50.427500 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:34:50.427400    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 09 13:34:50.427563 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:34:50.427497    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 09 13:34:50.428202 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:34:50.428186    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 09 13:34:50.437461 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:34:50.437441    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:34:50.470188 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:34:50.470156    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:34:50.509408 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:34:50.509381    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/db09cae3-6550-4ea9-ac30-f10ebf24a23b-config-file\") pod \"limitador-limitador-84994f7ffc-xw4kv\" (UID: \"db09cae3-6550-4ea9-ac30-f10ebf24a23b\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"
Sep 09 13:34:50.509511 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:34:50.509456    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5k74v\" (UniqueName: \"kubernetes.io/projected/db09cae3-6550-4ea9-ac30-f10ebf24a23b-kube-api-access-5k74v\") pod \"limitador-limitador-84994f7ffc-xw4kv\" (UID: \"db09cae3-6550-4ea9-ac30-f10ebf24a23b\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"
Sep 09 13:34:50.610642 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:34:50.610610    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5k74v\" (UniqueName: \"kubernetes.io/projected/db09cae3-6550-4ea9-ac30-f10ebf24a23b-kube-api-access-5k74v\") pod \"limitador-limitador-84994f7ffc-xw4kv\" (UID: \"db09cae3-6550-4ea9-ac30-f10ebf24a23b\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"
Sep 09 13:34:50.610756 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:34:50.610670    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/db09cae3-6550-4ea9-ac30-f10ebf24a23b-config-file\") pod \"limitador-limitador-84994f7ffc-xw4kv\" (UID: \"db09cae3-6550-4ea9-ac30-f10ebf24a23b\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"
Sep 09 13:34:50.611271 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:34:50.611253    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/db09cae3-6550-4ea9-ac30-f10ebf24a23b-config-file\") pod \"limitador-limitador-84994f7ffc-xw4kv\" (UID: \"db09cae3-6550-4ea9-ac30-f10ebf24a23b\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"
Sep 09 13:34:50.621006 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:34:50.620986    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5k74v\" (UniqueName: \"kubernetes.io/projected/db09cae3-6550-4ea9-ac30-f10ebf24a23b-kube-api-access-5k74v\") pod \"limitador-limitador-84994f7ffc-xw4kv\" (UID: \"db09cae3-6550-4ea9-ac30-f10ebf24a23b\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"
Sep 09 13:34:50.735080 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:34:50.734997    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"
Sep 09 13:34:50.936669 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:34:50.936632    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:34:51.006640 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:34:51.006614    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:34:51.013514 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:34:51.013492    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:34:51.735740 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:34:51.735706    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-xw4kv" event={"ID":"db09cae3-6550-4ea9-ac30-f10ebf24a23b","Type":"ContainerStarted","Data":"39f329ecc88651f0ba3c201c993654619bbedae761feb283c6e9f8934ba1644e"}
Sep 09 13:34:52.274500 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:34:52.274462    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:34:52.376475 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:34:52.376439    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:34:54.543910 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:34:54.543871    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:34:54.659781 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:34:54.659736    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:34:54.760820 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:34:54.760780    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:35:00.779454 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:35:00.779415    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-xw4kv" event={"ID":"db09cae3-6550-4ea9-ac30-f10ebf24a23b","Type":"ContainerStarted","Data":"a23c532ceb4933e7aff901c31f84d2dd79a74f0946b47c2e546842cb9047d883"}
Sep 09 13:35:00.779855 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:35:00.779499    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"
Sep 09 13:35:00.798337 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:35:00.798285    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-xw4kv" podStartSLOduration=1.523213994 podStartE2EDuration="10.798269885s" totalImagesPullingTime="9.275055891s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 13:34:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 13:35:00.797146568 +0000 UTC m=+512.612670762" watchObservedRunningTime="2026-09-09 13:35:00.798269885 +0000 UTC m=+512.613794081"
Sep 09 13:35:11.784201 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:35:11.784142    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"
Sep 09 13:35:16.531161 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:35:16.531128    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:35:16.625079 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:35:16.625043    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:35:17.089546 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:35:17.089517    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:35:28.651965 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:35:28.651898    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:35:28.954711 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:35:28.954632    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:35:38.396127 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:35:38.396092    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:35:38.492439 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:35:38.492399    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:35:38.596383 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:35:38.596347    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:35:38.671383 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:35:38.671297    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:35:41.910729 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:35:41.910688    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:35:42.006824 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:35:42.006780    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:36:07.663630 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:36:07.663597    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:36:14.842571 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:36:14.842532    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:36:15.208594 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:36:15.208561    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:36:16.046369 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:36:16.046331    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:36:26.741377 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:36:26.741342    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:36:26.838511 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:36:26.838457    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:36:28.171623 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:36:28.171592    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:36:28.241875 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:36:28.241842    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:36:41.961951 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:36:41.961918    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jprjq"]
Sep 09 13:36:41.963830 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:36:41.963814    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jprjq"
Sep 09 13:36:41.966597 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:36:41.966573    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 09 13:36:41.966725 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:36:41.966665    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-ztzlx\""
Sep 09 13:36:41.967640 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:36:41.967621    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 09 13:36:41.968124 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:36:41.968109    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 09 13:36:42.005511 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:36:42.005482    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jprjq"]
Sep 09 13:36:42.034912 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:36:42.034882    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:36:42.123305 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:36:42.123253    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8814be59-4761-45d8-9c50-955f0a3c8256-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jprjq\" (UID: \"8814be59-4761-45d8-9c50-955f0a3c8256\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jprjq"
Sep 09 13:36:42.123305 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:36:42.123308    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84rk4\" (UniqueName: \"kubernetes.io/projected/8814be59-4761-45d8-9c50-955f0a3c8256-kube-api-access-84rk4\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jprjq\" (UID: \"8814be59-4761-45d8-9c50-955f0a3c8256\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jprjq"
Sep 09 13:36:42.123549 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:36:42.123351    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8814be59-4761-45d8-9c50-955f0a3c8256-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jprjq\" (UID: \"8814be59-4761-45d8-9c50-955f0a3c8256\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jprjq"
Sep 09 13:36:42.123549 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:36:42.123399    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8814be59-4761-45d8-9c50-955f0a3c8256-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jprjq\" (UID: \"8814be59-4761-45d8-9c50-955f0a3c8256\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jprjq"
Sep 09 13:36:42.123549 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:36:42.123491    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8814be59-4761-45d8-9c50-955f0a3c8256-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jprjq\" (UID: \"8814be59-4761-45d8-9c50-955f0a3c8256\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jprjq"
Sep 09 13:36:42.123549 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:36:42.123545    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8814be59-4761-45d8-9c50-955f0a3c8256-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jprjq\" (UID: \"8814be59-4761-45d8-9c50-955f0a3c8256\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jprjq"
Sep 09 13:36:42.224525 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:36:42.224429    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8814be59-4761-45d8-9c50-955f0a3c8256-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jprjq\" (UID: \"8814be59-4761-45d8-9c50-955f0a3c8256\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jprjq"
Sep 09 13:36:42.224525 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:36:42.224472    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84rk4\" (UniqueName: \"kubernetes.io/projected/8814be59-4761-45d8-9c50-955f0a3c8256-kube-api-access-84rk4\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jprjq\" (UID: \"8814be59-4761-45d8-9c50-955f0a3c8256\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jprjq"
Sep 09 13:36:42.224525 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:36:42.224499    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8814be59-4761-45d8-9c50-955f0a3c8256-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jprjq\" (UID: \"8814be59-4761-45d8-9c50-955f0a3c8256\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jprjq"
Sep 09 13:36:42.224525 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:36:42.224522    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8814be59-4761-45d8-9c50-955f0a3c8256-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jprjq\" (UID: \"8814be59-4761-45d8-9c50-955f0a3c8256\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jprjq"
Sep 09 13:36:42.224830 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:36:42.224588    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8814be59-4761-45d8-9c50-955f0a3c8256-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jprjq\" (UID: \"8814be59-4761-45d8-9c50-955f0a3c8256\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jprjq"
Sep 09 13:36:42.224830 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:36:42.224622    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8814be59-4761-45d8-9c50-955f0a3c8256-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jprjq\" (UID: \"8814be59-4761-45d8-9c50-955f0a3c8256\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jprjq"
Sep 09 13:36:42.224938 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:36:42.224879    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8814be59-4761-45d8-9c50-955f0a3c8256-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jprjq\" (UID: \"8814be59-4761-45d8-9c50-955f0a3c8256\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jprjq"
Sep 09 13:36:42.224938 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:36:42.224927    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8814be59-4761-45d8-9c50-955f0a3c8256-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jprjq\" (UID: \"8814be59-4761-45d8-9c50-955f0a3c8256\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jprjq"
Sep 09 13:36:42.225040 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:36:42.224974    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8814be59-4761-45d8-9c50-955f0a3c8256-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jprjq\" (UID: \"8814be59-4761-45d8-9c50-955f0a3c8256\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jprjq"
Sep 09 13:36:42.227250 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:36:42.227227    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8814be59-4761-45d8-9c50-955f0a3c8256-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jprjq\" (UID: \"8814be59-4761-45d8-9c50-955f0a3c8256\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jprjq"
Sep 09 13:36:42.227449 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:36:42.227432    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8814be59-4761-45d8-9c50-955f0a3c8256-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jprjq\" (UID: \"8814be59-4761-45d8-9c50-955f0a3c8256\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jprjq"
Sep 09 13:36:42.233381 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:36:42.233355    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84rk4\" (UniqueName: \"kubernetes.io/projected/8814be59-4761-45d8-9c50-955f0a3c8256-kube-api-access-84rk4\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jprjq\" (UID: \"8814be59-4761-45d8-9c50-955f0a3c8256\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jprjq"
Sep 09 13:36:42.274055 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:36:42.274020    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jprjq"
Sep 09 13:36:42.544018 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:36:42.543993    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jprjq"]
Sep 09 13:36:42.546715 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:36:42.546678    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8814be59_4761_45d8_9c50_955f0a3c8256.slice/crio-df66e2a9f567b27c71ca8b37e60b4f35a925a4e8d88738face4bc87d47547404 WatchSource:0}: Error finding container df66e2a9f567b27c71ca8b37e60b4f35a925a4e8d88738face4bc87d47547404: Status 404 returned error can't find the container with id df66e2a9f567b27c71ca8b37e60b4f35a925a4e8d88738face4bc87d47547404
Sep 09 13:36:42.548001 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:36:42.547978    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 13:36:42.606085 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:36:42.606053    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:36:43.214747 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:36:43.214715    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jprjq" event={"ID":"8814be59-4761-45d8-9c50-955f0a3c8256","Type":"ContainerStarted","Data":"df66e2a9f567b27c71ca8b37e60b4f35a925a4e8d88738face4bc87d47547404"}
Sep 09 13:36:44.220207 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:36:44.220155    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jprjq" event={"ID":"8814be59-4761-45d8-9c50-955f0a3c8256","Type":"ContainerStarted","Data":"398da194c838f8e2abdea3e1a94194e3c90367e0791275a6fe41092f06d41841"}
Sep 09 13:36:44.241182 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:36:44.241131    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jprjq" podStartSLOduration=2.107129788 podStartE2EDuration="3.241115714s" totalImagesPullingTime="1.133985926s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 13:36:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 13:36:44.239397936 +0000 UTC m=+616.054922130" watchObservedRunningTime="2026-09-09 13:36:44.241115714 +0000 UTC m=+616.056639901"
Sep 09 13:36:51.256476 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:36:51.256388    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:36:51.965468 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:36:51.965437    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:36:52.274912 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:36:52.274829    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jprjq"
Sep 09 13:36:52.275296 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:36:52.274928    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jprjq"
Sep 09 13:36:52.287485 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:36:52.287457    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jprjq"
Sep 09 13:36:53.270653 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:36:53.270626    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jprjq"
Sep 09 13:36:54.607266 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:36:54.607221    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:36:55.665411 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:36:55.665373    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:37:04.394745 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:37:04.394692    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:37:05.366939 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:37:05.366902    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:37:10.662075 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:37:10.662042    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftq2bj"]
Sep 09 13:37:10.665342 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:37:10.665321    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftq2bj"
Sep 09 13:37:10.667679 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:37:10.667653    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 09 13:37:10.672188 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:37:10.672149    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftq2bj"]
Sep 09 13:37:10.693100 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:37:10.693068    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:37:10.765285 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:37:10.765243    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb96ae20-f118-47ca-9435-94704ad28a2e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftq2bj\" (UID: \"eb96ae20-f118-47ca-9435-94704ad28a2e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftq2bj"
Sep 09 13:37:10.765487 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:37:10.765308    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb96ae20-f118-47ca-9435-94704ad28a2e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftq2bj\" (UID: \"eb96ae20-f118-47ca-9435-94704ad28a2e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftq2bj"
Sep 09 13:37:10.765487 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:37:10.765350    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb96ae20-f118-47ca-9435-94704ad28a2e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftq2bj\" (UID: \"eb96ae20-f118-47ca-9435-94704ad28a2e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftq2bj"
Sep 09 13:37:10.765487 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:37:10.765373    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb96ae20-f118-47ca-9435-94704ad28a2e-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftq2bj\" (UID: \"eb96ae20-f118-47ca-9435-94704ad28a2e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftq2bj"
Sep 09 13:37:10.765487 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:37:10.765415    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb96ae20-f118-47ca-9435-94704ad28a2e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftq2bj\" (UID: \"eb96ae20-f118-47ca-9435-94704ad28a2e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftq2bj"
Sep 09 13:37:10.765487 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:37:10.765448    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbw46\" (UniqueName: \"kubernetes.io/projected/eb96ae20-f118-47ca-9435-94704ad28a2e-kube-api-access-sbw46\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftq2bj\" (UID: \"eb96ae20-f118-47ca-9435-94704ad28a2e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftq2bj"
Sep 09 13:37:10.866759 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:37:10.866721    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbw46\" (UniqueName: \"kubernetes.io/projected/eb96ae20-f118-47ca-9435-94704ad28a2e-kube-api-access-sbw46\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftq2bj\" (UID: \"eb96ae20-f118-47ca-9435-94704ad28a2e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftq2bj"
Sep 09 13:37:10.866931 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:37:10.866817    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb96ae20-f118-47ca-9435-94704ad28a2e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftq2bj\" (UID: \"eb96ae20-f118-47ca-9435-94704ad28a2e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftq2bj"
Sep 09 13:37:10.866931 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:37:10.866875    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb96ae20-f118-47ca-9435-94704ad28a2e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftq2bj\" (UID: \"eb96ae20-f118-47ca-9435-94704ad28a2e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftq2bj"
Sep 09 13:37:10.866931 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:37:10.866903    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb96ae20-f118-47ca-9435-94704ad28a2e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftq2bj\" (UID: \"eb96ae20-f118-47ca-9435-94704ad28a2e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftq2bj"
Sep 09 13:37:10.866931 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:37:10.866924    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb96ae20-f118-47ca-9435-94704ad28a2e-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftq2bj\" (UID: \"eb96ae20-f118-47ca-9435-94704ad28a2e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftq2bj"
Sep 09 13:37:10.867134 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:37:10.866950    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb96ae20-f118-47ca-9435-94704ad28a2e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftq2bj\" (UID: \"eb96ae20-f118-47ca-9435-94704ad28a2e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftq2bj"
Sep 09 13:37:10.867370 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:37:10.867347    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb96ae20-f118-47ca-9435-94704ad28a2e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftq2bj\" (UID: \"eb96ae20-f118-47ca-9435-94704ad28a2e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftq2bj"
Sep 09 13:37:10.867438 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:37:10.867374    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb96ae20-f118-47ca-9435-94704ad28a2e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftq2bj\" (UID: \"eb96ae20-f118-47ca-9435-94704ad28a2e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftq2bj"
Sep 09 13:37:10.867438 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:37:10.867417    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb96ae20-f118-47ca-9435-94704ad28a2e-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftq2bj\" (UID: \"eb96ae20-f118-47ca-9435-94704ad28a2e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftq2bj"
Sep 09 13:37:10.869499 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:37:10.869477    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb96ae20-f118-47ca-9435-94704ad28a2e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftq2bj\" (UID: \"eb96ae20-f118-47ca-9435-94704ad28a2e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftq2bj"
Sep 09 13:37:10.869577 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:37:10.869506    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb96ae20-f118-47ca-9435-94704ad28a2e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftq2bj\" (UID: \"eb96ae20-f118-47ca-9435-94704ad28a2e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftq2bj"
Sep 09 13:37:10.876584 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:37:10.876559    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbw46\" (UniqueName: \"kubernetes.io/projected/eb96ae20-f118-47ca-9435-94704ad28a2e-kube-api-access-sbw46\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftq2bj\" (UID: \"eb96ae20-f118-47ca-9435-94704ad28a2e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftq2bj"
Sep 09 13:37:10.977833 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:37:10.977741    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftq2bj"
Sep 09 13:37:11.249885 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:37:11.249859    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftq2bj"]
Sep 09 13:37:11.252461 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:37:11.252427    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb96ae20_f118_47ca_9435_94704ad28a2e.slice/crio-7566b420f6b38b2701c2edda87870647f319bf087f4553acebf676a0f26f66a6 WatchSource:0}: Error finding container 7566b420f6b38b2701c2edda87870647f319bf087f4553acebf676a0f26f66a6: Status 404 returned error can't find the container with id 7566b420f6b38b2701c2edda87870647f319bf087f4553acebf676a0f26f66a6
Sep 09 13:37:11.338710 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:37:11.338673    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftq2bj" event={"ID":"eb96ae20-f118-47ca-9435-94704ad28a2e","Type":"ContainerStarted","Data":"7566b420f6b38b2701c2edda87870647f319bf087f4553acebf676a0f26f66a6"}
Sep 09 13:37:12.163002 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:37:12.162962    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:37:12.344558 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:37:12.344517    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftq2bj" event={"ID":"eb96ae20-f118-47ca-9435-94704ad28a2e","Type":"ContainerStarted","Data":"1aa3502bcbf5379dc2cc1dba474d9674e52650526fac51c906b60f1afb3f50a1"}
Sep 09 13:37:12.364845 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:37:12.364794    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftq2bj" podStartSLOduration=2.132361023 podStartE2EDuration="2.364776755s" totalImagesPullingTime="232.415732ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 13:37:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 13:37:12.364573203 +0000 UTC m=+644.180097397" watchObservedRunningTime="2026-09-09 13:37:12.364776755 +0000 UTC m=+644.180300948"
Sep 09 13:37:17.665193 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:37:17.665139    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-hh9ps"]
Sep 09 13:37:17.668682 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:37:17.668665    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hh9ps"
Sep 09 13:37:17.671544 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:37:17.671521    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 09 13:37:17.680382 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:37:17.680356    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-hh9ps"]
Sep 09 13:37:17.694703 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:37:17.694675    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:37:17.828829 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:37:17.828788    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3587eab6-1c91-4a54-b13c-6c9e8785b847-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hh9ps\" (UID: \"3587eab6-1c91-4a54-b13c-6c9e8785b847\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hh9ps"
Sep 09 13:37:17.828829 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:37:17.828833    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3587eab6-1c91-4a54-b13c-6c9e8785b847-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hh9ps\" (UID: \"3587eab6-1c91-4a54-b13c-6c9e8785b847\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hh9ps"
Sep 09 13:37:17.829035 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:37:17.828850    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3587eab6-1c91-4a54-b13c-6c9e8785b847-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hh9ps\" (UID: \"3587eab6-1c91-4a54-b13c-6c9e8785b847\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hh9ps"
Sep 09 13:37:17.829035 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:37:17.828930    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6b94x\" (UniqueName: \"kubernetes.io/projected/3587eab6-1c91-4a54-b13c-6c9e8785b847-kube-api-access-6b94x\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hh9ps\" (UID: \"3587eab6-1c91-4a54-b13c-6c9e8785b847\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hh9ps"
Sep 09 13:37:17.829035 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:37:17.828965    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3587eab6-1c91-4a54-b13c-6c9e8785b847-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hh9ps\" (UID: \"3587eab6-1c91-4a54-b13c-6c9e8785b847\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hh9ps"
Sep 09 13:37:17.829035 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:37:17.828996    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3587eab6-1c91-4a54-b13c-6c9e8785b847-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hh9ps\" (UID: \"3587eab6-1c91-4a54-b13c-6c9e8785b847\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hh9ps"
Sep 09 13:37:17.929486 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:37:17.929393    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3587eab6-1c91-4a54-b13c-6c9e8785b847-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hh9ps\" (UID: \"3587eab6-1c91-4a54-b13c-6c9e8785b847\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hh9ps"
Sep 09 13:37:17.929486 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:37:17.929442    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3587eab6-1c91-4a54-b13c-6c9e8785b847-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hh9ps\" (UID: \"3587eab6-1c91-4a54-b13c-6c9e8785b847\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hh9ps"
Sep 09 13:37:17.929675 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:37:17.929548    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3587eab6-1c91-4a54-b13c-6c9e8785b847-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hh9ps\" (UID: \"3587eab6-1c91-4a54-b13c-6c9e8785b847\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hh9ps"
Sep 09 13:37:17.929675 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:37:17.929601    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6b94x\" (UniqueName: \"kubernetes.io/projected/3587eab6-1c91-4a54-b13c-6c9e8785b847-kube-api-access-6b94x\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hh9ps\" (UID: \"3587eab6-1c91-4a54-b13c-6c9e8785b847\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hh9ps"
Sep 09 13:37:17.929675 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:37:17.929632    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3587eab6-1c91-4a54-b13c-6c9e8785b847-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hh9ps\" (UID: \"3587eab6-1c91-4a54-b13c-6c9e8785b847\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hh9ps"
Sep 09 13:37:17.929818 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:37:17.929763    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3587eab6-1c91-4a54-b13c-6c9e8785b847-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hh9ps\" (UID: \"3587eab6-1c91-4a54-b13c-6c9e8785b847\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hh9ps"
Sep 09 13:37:17.929818 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:37:17.929780    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3587eab6-1c91-4a54-b13c-6c9e8785b847-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hh9ps\" (UID: \"3587eab6-1c91-4a54-b13c-6c9e8785b847\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hh9ps"
Sep 09 13:37:17.929938 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:37:17.929921    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3587eab6-1c91-4a54-b13c-6c9e8785b847-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hh9ps\" (UID: \"3587eab6-1c91-4a54-b13c-6c9e8785b847\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hh9ps"
Sep 09 13:37:17.930088 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:37:17.930071    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3587eab6-1c91-4a54-b13c-6c9e8785b847-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hh9ps\" (UID: \"3587eab6-1c91-4a54-b13c-6c9e8785b847\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hh9ps"
Sep 09 13:37:17.931738 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:37:17.931714    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3587eab6-1c91-4a54-b13c-6c9e8785b847-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hh9ps\" (UID: \"3587eab6-1c91-4a54-b13c-6c9e8785b847\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hh9ps"
Sep 09 13:37:17.932001 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:37:17.931985    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3587eab6-1c91-4a54-b13c-6c9e8785b847-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hh9ps\" (UID: \"3587eab6-1c91-4a54-b13c-6c9e8785b847\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hh9ps"
Sep 09 13:37:17.937838 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:37:17.937821    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6b94x\" (UniqueName: \"kubernetes.io/projected/3587eab6-1c91-4a54-b13c-6c9e8785b847-kube-api-access-6b94x\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hh9ps\" (UID: \"3587eab6-1c91-4a54-b13c-6c9e8785b847\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hh9ps"
Sep 09 13:37:17.978991 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:37:17.978956    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hh9ps"
Sep 09 13:37:18.250526 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:37:18.250501    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-hh9ps"]
Sep 09 13:37:18.253217 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:37:18.253169    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3587eab6_1c91_4a54_b13c_6c9e8785b847.slice/crio-31aa5c4208aed8b34f19563730bf6237c8f4aa2b9eef515c36910249ecd53256 WatchSource:0}: Error finding container 31aa5c4208aed8b34f19563730bf6237c8f4aa2b9eef515c36910249ecd53256: Status 404 returned error can't find the container with id 31aa5c4208aed8b34f19563730bf6237c8f4aa2b9eef515c36910249ecd53256
Sep 09 13:37:18.370239 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:37:18.370206    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hh9ps" event={"ID":"3587eab6-1c91-4a54-b13c-6c9e8785b847","Type":"ContainerStarted","Data":"31aa5c4208aed8b34f19563730bf6237c8f4aa2b9eef515c36910249ecd53256"}
Sep 09 13:37:19.376392 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:37:19.376356    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hh9ps" event={"ID":"3587eab6-1c91-4a54-b13c-6c9e8785b847","Type":"ContainerStarted","Data":"c8159e1e5dc51a757509bee7101815879c5a04fd78884ecd98922b8978504d9c"}
Sep 09 13:37:19.396128 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:37:19.396071    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hh9ps" podStartSLOduration=2.156210414 podStartE2EDuration="2.396055731s" totalImagesPullingTime="239.845317ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 13:37:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 13:37:19.394681926 +0000 UTC m=+651.210206121" watchObservedRunningTime="2026-09-09 13:37:19.396055731 +0000 UTC m=+651.211579925"
Sep 09 13:37:19.469135 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:37:19.469099    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:37:20.978716 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:37:20.978681    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftq2bj"
Sep 09 13:37:20.979210 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:37:20.978782    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftq2bj"
Sep 09 13:37:20.991099 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:37:20.991069    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftq2bj"
Sep 09 13:37:21.396347 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:37:21.396319    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftq2bj"
Sep 09 13:37:25.498432 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:37:25.498397    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:37:27.665241 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:37:27.665207    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:37:27.980198 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:37:27.980094    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hh9ps"
Sep 09 13:37:27.980353 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:37:27.980265    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hh9ps"
Sep 09 13:37:27.993017 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:37:27.992990    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hh9ps"
Sep 09 13:37:28.425626 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:37:28.425599    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hh9ps"
Sep 09 13:37:44.961652 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:37:44.961610    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:37:45.024698 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:37:45.024662    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:38:32.391024 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:38:32.390951    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:38:32.497155 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:38:32.497121    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:38:41.993364 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:38:41.993330    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:38:42.092601 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:38:42.092567    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:38:43.088439 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:38:43.088405    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:38:43.196138 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:38:43.196101    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:38:59.419409 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:38:59.419374    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:38:59.511272 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:38:59.511238    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:38:59.725106 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:38:59.725013    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:38:59.884949 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:38:59.884921    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:00.772054 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:00.772021    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:00.871429 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:00.871399    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:01.222558 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:01.222522    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:02.491927 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:02.491894    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:02.591454 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:02.591419    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:03.169663 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:03.169625    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:39:03.673909 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:03.673874    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:03.776753 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:03.776720    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:03.876286 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:03.876258    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:04.180981 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:04.180948    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:04.278112 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:04.278076    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:04.298839 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:04.297212    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-4f59a0-64bd959987-b44w8"]
Sep 09 13:39:04.302106 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:04.302081    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-4f59a0-64bd959987-b44w8"
Sep 09 13:39:04.304653 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:04.304630    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-4f59a0\""
Sep 09 13:39:04.310914 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:04.310889    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-4f59a0-64bd959987-b44w8"]
Sep 09 13:39:04.454591 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:04.454511    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de00814d-c412-4d77-95cd-8c4a8d28d080-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-4f59a0-64bd959987-b44w8\" (UID: \"de00814d-c412-4d77-95cd-8c4a8d28d080\") " pod="openshift-ingress/payload-processing-e2e-inf-a-4f59a0-64bd959987-b44w8"
Sep 09 13:39:04.454591 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:04.454572    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trg6l\" (UniqueName: \"kubernetes.io/projected/de00814d-c412-4d77-95cd-8c4a8d28d080-kube-api-access-trg6l\") pod \"payload-processing-e2e-inf-a-4f59a0-64bd959987-b44w8\" (UID: \"de00814d-c412-4d77-95cd-8c4a8d28d080\") " pod="openshift-ingress/payload-processing-e2e-inf-a-4f59a0-64bd959987-b44w8"
Sep 09 13:39:04.555288 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:04.555248    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de00814d-c412-4d77-95cd-8c4a8d28d080-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-4f59a0-64bd959987-b44w8\" (UID: \"de00814d-c412-4d77-95cd-8c4a8d28d080\") " pod="openshift-ingress/payload-processing-e2e-inf-a-4f59a0-64bd959987-b44w8"
Sep 09 13:39:04.555456 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:04.555326    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trg6l\" (UniqueName: \"kubernetes.io/projected/de00814d-c412-4d77-95cd-8c4a8d28d080-kube-api-access-trg6l\") pod \"payload-processing-e2e-inf-a-4f59a0-64bd959987-b44w8\" (UID: \"de00814d-c412-4d77-95cd-8c4a8d28d080\") " pod="openshift-ingress/payload-processing-e2e-inf-a-4f59a0-64bd959987-b44w8"
Sep 09 13:39:04.556280 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:04.556254    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de00814d-c412-4d77-95cd-8c4a8d28d080-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-4f59a0-64bd959987-b44w8\" (UID: \"de00814d-c412-4d77-95cd-8c4a8d28d080\") " pod="openshift-ingress/payload-processing-e2e-inf-a-4f59a0-64bd959987-b44w8"
Sep 09 13:39:04.564157 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:04.564134    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trg6l\" (UniqueName: \"kubernetes.io/projected/de00814d-c412-4d77-95cd-8c4a8d28d080-kube-api-access-trg6l\") pod \"payload-processing-e2e-inf-a-4f59a0-64bd959987-b44w8\" (UID: \"de00814d-c412-4d77-95cd-8c4a8d28d080\") " pod="openshift-ingress/payload-processing-e2e-inf-a-4f59a0-64bd959987-b44w8"
Sep 09 13:39:04.613539 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:04.613502    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-4f59a0-64bd959987-b44w8"
Sep 09 13:39:04.889814 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:04.889787    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-4f59a0-64bd959987-b44w8"]
Sep 09 13:39:04.892313 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:39:04.892284    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde00814d_c412_4d77_95cd_8c4a8d28d080.slice/crio-450ac9b927c9cd520eb31f08ab9b6accb8a12859ba515553228d1c75edf95177 WatchSource:0}: Error finding container 450ac9b927c9cd520eb31f08ab9b6accb8a12859ba515553228d1c75edf95177: Status 404 returned error can't find the container with id 450ac9b927c9cd520eb31f08ab9b6accb8a12859ba515553228d1c75edf95177
Sep 09 13:39:05.844524 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:05.844480    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-4f59a0-64bd959987-b44w8" event={"ID":"de00814d-c412-4d77-95cd-8c4a8d28d080","Type":"ContainerStarted","Data":"450ac9b927c9cd520eb31f08ab9b6accb8a12859ba515553228d1c75edf95177"}
Sep 09 13:39:05.986070 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:05.986032    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:06.851560 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:06.851528    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-4f59a0-64bd959987-b44w8" event={"ID":"de00814d-c412-4d77-95cd-8c4a8d28d080","Type":"ContainerStarted","Data":"23d0f1191ecf962a806da76c48c60bbfb86fb86b4b0ea634ed5fc0d684eb382e"}
Sep 09 13:39:06.851748 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:06.851660    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-4f59a0-64bd959987-b44w8"
Sep 09 13:39:06.868716 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:06.868670    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-4f59a0-64bd959987-b44w8" podStartSLOduration=1.093023096 podStartE2EDuration="2.868651684s" totalImagesPullingTime="1.775628588s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 13:39:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 13:39:06.867510607 +0000 UTC m=+758.683034802" watchObservedRunningTime="2026-09-09 13:39:06.868651684 +0000 UTC m=+758.684175879"
Sep 09 13:39:06.990560 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:06.990464    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:07.090396 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:07.090366    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:07.198351 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:07.198318    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:07.618208 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:07.618165    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:07.932424 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:07.932373    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:10.183713 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:10.183666    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:10.933985 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:10.933951    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:11.109448 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:11.109416    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:11.573686 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:11.573650    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a649773d-87855967f-r9z6r"]
Sep 09 13:39:11.577142 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:11.577124    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a649773d-87855967f-r9z6r"
Sep 09 13:39:11.581912 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:11.581892    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-a649773d-serving-cert\""
Sep 09 13:39:11.582549 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:11.582528    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 09 13:39:11.582651 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:11.582550    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-s8jj8\""
Sep 09 13:39:11.582651 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:11.582572    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 09 13:39:11.594529 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:11.594507    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 09 13:39:11.723933 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:11.723902    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11883118-2198-488f-a185-edbab1028f72-maas-api-tls\") pod \"maas-api-e2e-ait-a649773d-87855967f-r9z6r\" (UID: \"11883118-2198-488f-a185-edbab1028f72\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a649773d-87855967f-r9z6r"
Sep 09 13:39:11.723933 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:11.723935    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/11883118-2198-488f-a185-edbab1028f72-openshift-service-ca\") pod \"maas-api-e2e-ait-a649773d-87855967f-r9z6r\" (UID: \"11883118-2198-488f-a185-edbab1028f72\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a649773d-87855967f-r9z6r"
Sep 09 13:39:11.724169 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:11.723956    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/11883118-2198-488f-a185-edbab1028f72-metrics-certs\") pod \"maas-api-e2e-ait-a649773d-87855967f-r9z6r\" (UID: \"11883118-2198-488f-a185-edbab1028f72\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a649773d-87855967f-r9z6r"
Sep 09 13:39:11.724169 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:11.724052    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkk7s\" (UniqueName: \"kubernetes.io/projected/11883118-2198-488f-a185-edbab1028f72-kube-api-access-pkk7s\") pod \"maas-api-e2e-ait-a649773d-87855967f-r9z6r\" (UID: \"11883118-2198-488f-a185-edbab1028f72\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a649773d-87855967f-r9z6r"
Sep 09 13:39:11.734838 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:11.734808    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a649773d-87855967f-r9z6r"]
Sep 09 13:39:11.820776 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:11.820734    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:11.824984 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:11.824924    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11883118-2198-488f-a185-edbab1028f72-maas-api-tls\") pod \"maas-api-e2e-ait-a649773d-87855967f-r9z6r\" (UID: \"11883118-2198-488f-a185-edbab1028f72\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a649773d-87855967f-r9z6r"
Sep 09 13:39:11.824984 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:11.824957    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/11883118-2198-488f-a185-edbab1028f72-openshift-service-ca\") pod \"maas-api-e2e-ait-a649773d-87855967f-r9z6r\" (UID: \"11883118-2198-488f-a185-edbab1028f72\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a649773d-87855967f-r9z6r"
Sep 09 13:39:11.824984 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:11.824982    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/11883118-2198-488f-a185-edbab1028f72-metrics-certs\") pod \"maas-api-e2e-ait-a649773d-87855967f-r9z6r\" (UID: \"11883118-2198-488f-a185-edbab1028f72\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a649773d-87855967f-r9z6r"
Sep 09 13:39:11.825240 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:11.825019    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkk7s\" (UniqueName: \"kubernetes.io/projected/11883118-2198-488f-a185-edbab1028f72-kube-api-access-pkk7s\") pod \"maas-api-e2e-ait-a649773d-87855967f-r9z6r\" (UID: \"11883118-2198-488f-a185-edbab1028f72\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a649773d-87855967f-r9z6r"
Sep 09 13:39:11.825639 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:11.825614    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/11883118-2198-488f-a185-edbab1028f72-openshift-service-ca\") pod \"maas-api-e2e-ait-a649773d-87855967f-r9z6r\" (UID: \"11883118-2198-488f-a185-edbab1028f72\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a649773d-87855967f-r9z6r"
Sep 09 13:39:11.827402 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:11.827385    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11883118-2198-488f-a185-edbab1028f72-maas-api-tls\") pod \"maas-api-e2e-ait-a649773d-87855967f-r9z6r\" (UID: \"11883118-2198-488f-a185-edbab1028f72\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a649773d-87855967f-r9z6r"
Sep 09 13:39:11.827524 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:11.827507    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/11883118-2198-488f-a185-edbab1028f72-metrics-certs\") pod \"maas-api-e2e-ait-a649773d-87855967f-r9z6r\" (UID: \"11883118-2198-488f-a185-edbab1028f72\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a649773d-87855967f-r9z6r"
Sep 09 13:39:11.854153 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:11.854122    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkk7s\" (UniqueName: \"kubernetes.io/projected/11883118-2198-488f-a185-edbab1028f72-kube-api-access-pkk7s\") pod \"maas-api-e2e-ait-a649773d-87855967f-r9z6r\" (UID: \"11883118-2198-488f-a185-edbab1028f72\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a649773d-87855967f-r9z6r"
Sep 09 13:39:11.886463 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:11.886431    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a649773d-87855967f-r9z6r"
Sep 09 13:39:12.031613 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:12.031579    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:12.171320 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:12.171264    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a649773d-87855967f-r9z6r"]
Sep 09 13:39:12.173700 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:39:12.173673    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11883118_2198_488f_a185_edbab1028f72.slice/crio-0f9a194e3e587db3afbcdeeea83026be16693b9902de264f23f2287fd94cf597 WatchSource:0}: Error finding container 0f9a194e3e587db3afbcdeeea83026be16693b9902de264f23f2287fd94cf597: Status 404 returned error can't find the container with id 0f9a194e3e587db3afbcdeeea83026be16693b9902de264f23f2287fd94cf597
Sep 09 13:39:12.652137 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:12.652103    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:12.755726 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:12.755687    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:12.883511 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:12.883469    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a649773d-87855967f-r9z6r" event={"ID":"11883118-2198-488f-a185-edbab1028f72","Type":"ContainerStarted","Data":"0f9a194e3e587db3afbcdeeea83026be16693b9902de264f23f2287fd94cf597"}
Sep 09 13:39:14.318979 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:14.318942    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:14.423112 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:14.423075    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:14.476759 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:14.476720    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:39:14.894195 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:14.894093    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a649773d-87855967f-r9z6r" event={"ID":"11883118-2198-488f-a185-edbab1028f72","Type":"ContainerStarted","Data":"0ebb1dc078908c07a60247bc63fe6a8b3899a3e72e6ce21ecb687f80d77a6b4a"}
Sep 09 13:39:14.894371 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:14.894246    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a649773d-87855967f-r9z6r"
Sep 09 13:39:14.915987 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:14.915941    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a649773d-87855967f-r9z6r" podStartSLOduration=1.45619322 podStartE2EDuration="3.915924373s" totalImagesPullingTime="2.459731153s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 13:39:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 13:39:14.915442409 +0000 UTC m=+766.730966602" watchObservedRunningTime="2026-09-09 13:39:14.915924373 +0000 UTC m=+766.731448568"
Sep 09 13:39:15.034664 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:15.034632    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:15.150704 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:15.150596    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:15.426804 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:15.426692    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:16.154680 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:16.154640    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:16.266380 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:16.266347    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:16.383462 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:16.383428    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-71c181-8cf76b9c4-gwq87"]
Sep 09 13:39:16.386772 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:16.386752    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-71c181-8cf76b9c4-gwq87"
Sep 09 13:39:16.391313 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:16.391292    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-71c181\""
Sep 09 13:39:16.391415 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:16.391335    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-71c181-dockercfg-kqrt4\""
Sep 09 13:39:16.407348 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:16.407286    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-71c181-8cf76b9c4-gwq87"]
Sep 09 13:39:16.571265 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:16.571219    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f3f383e-0c41-4c0f-9aad-90087626600c-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-71c181-8cf76b9c4-gwq87\" (UID: \"9f3f383e-0c41-4c0f-9aad-90087626600c\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-71c181-8cf76b9c4-gwq87"
Sep 09 13:39:16.571646 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:16.571324    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7vjw\" (UniqueName: \"kubernetes.io/projected/9f3f383e-0c41-4c0f-9aad-90087626600c-kube-api-access-c7vjw\") pod \"payload-pre-processing-e2e-autores-71c181-8cf76b9c4-gwq87\" (UID: \"9f3f383e-0c41-4c0f-9aad-90087626600c\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-71c181-8cf76b9c4-gwq87"
Sep 09 13:39:16.672779 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:16.672700    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7vjw\" (UniqueName: \"kubernetes.io/projected/9f3f383e-0c41-4c0f-9aad-90087626600c-kube-api-access-c7vjw\") pod \"payload-pre-processing-e2e-autores-71c181-8cf76b9c4-gwq87\" (UID: \"9f3f383e-0c41-4c0f-9aad-90087626600c\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-71c181-8cf76b9c4-gwq87"
Sep 09 13:39:16.672779 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:16.672761    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f3f383e-0c41-4c0f-9aad-90087626600c-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-71c181-8cf76b9c4-gwq87\" (UID: \"9f3f383e-0c41-4c0f-9aad-90087626600c\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-71c181-8cf76b9c4-gwq87"
Sep 09 13:39:16.673452 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:16.673434    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f3f383e-0c41-4c0f-9aad-90087626600c-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-71c181-8cf76b9c4-gwq87\" (UID: \"9f3f383e-0c41-4c0f-9aad-90087626600c\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-71c181-8cf76b9c4-gwq87"
Sep 09 13:39:16.686397 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:16.686365    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7vjw\" (UniqueName: \"kubernetes.io/projected/9f3f383e-0c41-4c0f-9aad-90087626600c-kube-api-access-c7vjw\") pod \"payload-pre-processing-e2e-autores-71c181-8cf76b9c4-gwq87\" (UID: \"9f3f383e-0c41-4c0f-9aad-90087626600c\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-71c181-8cf76b9c4-gwq87"
Sep 09 13:39:16.696290 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:16.696268    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-71c181-8cf76b9c4-gwq87"
Sep 09 13:39:16.978722 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:16.978691    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-71c181-8cf76b9c4-gwq87"]
Sep 09 13:39:16.982163 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:39:16.982135    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f3f383e_0c41_4c0f_9aad_90087626600c.slice/crio-7ffafd9bd4050c0b17a570e3b259212ab95627d27224399c14c307c0e13832c6 WatchSource:0}: Error finding container 7ffafd9bd4050c0b17a570e3b259212ab95627d27224399c14c307c0e13832c6: Status 404 returned error can't find the container with id 7ffafd9bd4050c0b17a570e3b259212ab95627d27224399c14c307c0e13832c6
Sep 09 13:39:17.858279 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:17.858241    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-4f59a0-64bd959987-b44w8"
Sep 09 13:39:17.911564 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:17.911522    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-71c181-8cf76b9c4-gwq87" event={"ID":"9f3f383e-0c41-4c0f-9aad-90087626600c","Type":"ContainerStarted","Data":"f27e80c92c653ba3df577ab26f31ac8c8f5dbeabaa0d135ff7bd6a856bb0d659"}
Sep 09 13:39:17.911752 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:17.911587    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-71c181-8cf76b9c4-gwq87" event={"ID":"9f3f383e-0c41-4c0f-9aad-90087626600c","Type":"ContainerStarted","Data":"7ffafd9bd4050c0b17a570e3b259212ab95627d27224399c14c307c0e13832c6"}
Sep 09 13:39:17.911752 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:17.911733    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-71c181-8cf76b9c4-gwq87"
Sep 09 13:39:17.932557 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:17.932509    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-autores-71c181-8cf76b9c4-gwq87" podStartSLOduration=1.932493784 podStartE2EDuration="1.932493784s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 13:39:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 13:39:17.930262385 +0000 UTC m=+769.745786580" watchObservedRunningTime="2026-09-09 13:39:17.932493784 +0000 UTC m=+769.748017978"
Sep 09 13:39:18.456743 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:18.456714    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:18.693257 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:18.693228    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:18.812369 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:18.812280    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:19.021825 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:19.021793    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:20.611595 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:20.611553    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:20.904761 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:20.904732    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a649773d-87855967f-r9z6r"
Sep 09 13:39:21.081486 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:21.081449    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:21.208517 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:21.208433    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:21.577483 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:21.577409    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:23.394201 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:23.394149    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:24.635762 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:24.635727    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:24.862387 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:24.862342    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:25.908345 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:25.908317    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:39:27.433630 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:27.433596    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:27.691000 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:27.690916    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:27.838210 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:27.838154    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:27.935586 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:27.935551    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:28.076469 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:28.076383    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:28.252385 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:28.252350    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:28.413564 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:28.413531    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:28.917278 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:28.917249    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-71c181-8cf76b9c4-gwq87"
Sep 09 13:39:31.834398 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:31.834370    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:31.932514 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:31.932484    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:32.951775 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:32.951743    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-093e38-875656d78-65dhb"]
Sep 09 13:39:32.956185 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:32.956157    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-093e38-875656d78-65dhb"
Sep 09 13:39:32.961535 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:32.961512    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-093e38-serving-cert\""
Sep 09 13:39:32.973414 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:32.973382    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-093e38-875656d78-65dhb"]
Sep 09 13:39:33.008539 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:33.008509    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5894b9d-67f3-40f8-b2d2-a07cb588dd6f-openshift-service-ca\") pod \"maas-api-e2e-inf-b-093e38-875656d78-65dhb\" (UID: \"f5894b9d-67f3-40f8-b2d2-a07cb588dd6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-093e38-875656d78-65dhb"
Sep 09 13:39:33.008738 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:33.008547    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f5894b9d-67f3-40f8-b2d2-a07cb588dd6f-maas-api-tls\") pod \"maas-api-e2e-inf-b-093e38-875656d78-65dhb\" (UID: \"f5894b9d-67f3-40f8-b2d2-a07cb588dd6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-093e38-875656d78-65dhb"
Sep 09 13:39:33.008738 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:33.008597    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5894b9d-67f3-40f8-b2d2-a07cb588dd6f-metrics-certs\") pod \"maas-api-e2e-inf-b-093e38-875656d78-65dhb\" (UID: \"f5894b9d-67f3-40f8-b2d2-a07cb588dd6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-093e38-875656d78-65dhb"
Sep 09 13:39:33.008738 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:33.008693    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p799g\" (UniqueName: \"kubernetes.io/projected/f5894b9d-67f3-40f8-b2d2-a07cb588dd6f-kube-api-access-p799g\") pod \"maas-api-e2e-inf-b-093e38-875656d78-65dhb\" (UID: \"f5894b9d-67f3-40f8-b2d2-a07cb588dd6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-093e38-875656d78-65dhb"
Sep 09 13:39:33.053200 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:33.053145    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:33.110043 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:33.109949    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p799g\" (UniqueName: \"kubernetes.io/projected/f5894b9d-67f3-40f8-b2d2-a07cb588dd6f-kube-api-access-p799g\") pod \"maas-api-e2e-inf-b-093e38-875656d78-65dhb\" (UID: \"f5894b9d-67f3-40f8-b2d2-a07cb588dd6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-093e38-875656d78-65dhb"
Sep 09 13:39:33.110283 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:33.110159    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5894b9d-67f3-40f8-b2d2-a07cb588dd6f-openshift-service-ca\") pod \"maas-api-e2e-inf-b-093e38-875656d78-65dhb\" (UID: \"f5894b9d-67f3-40f8-b2d2-a07cb588dd6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-093e38-875656d78-65dhb"
Sep 09 13:39:33.110374 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:33.110354    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f5894b9d-67f3-40f8-b2d2-a07cb588dd6f-maas-api-tls\") pod \"maas-api-e2e-inf-b-093e38-875656d78-65dhb\" (UID: \"f5894b9d-67f3-40f8-b2d2-a07cb588dd6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-093e38-875656d78-65dhb"
Sep 09 13:39:33.110442 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:33.110427    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5894b9d-67f3-40f8-b2d2-a07cb588dd6f-metrics-certs\") pod \"maas-api-e2e-inf-b-093e38-875656d78-65dhb\" (UID: \"f5894b9d-67f3-40f8-b2d2-a07cb588dd6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-093e38-875656d78-65dhb"
Sep 09 13:39:33.110524 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:39:33.110498    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-093e38-serving-cert: secret "maas-api-e2e-inf-b-093e38-serving-cert" not found
Sep 09 13:39:33.110580 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:39:33.110571    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5894b9d-67f3-40f8-b2d2-a07cb588dd6f-maas-api-tls podName:f5894b9d-67f3-40f8-b2d2-a07cb588dd6f nodeName:}" failed. No retries permitted until 2026-09-09 13:39:33.610555368 +0000 UTC m=+785.426079540 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f5894b9d-67f3-40f8-b2d2-a07cb588dd6f-maas-api-tls") pod "maas-api-e2e-inf-b-093e38-875656d78-65dhb" (UID: "f5894b9d-67f3-40f8-b2d2-a07cb588dd6f") : secret "maas-api-e2e-inf-b-093e38-serving-cert" not found
Sep 09 13:39:33.111078 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:33.111062    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5894b9d-67f3-40f8-b2d2-a07cb588dd6f-openshift-service-ca\") pod \"maas-api-e2e-inf-b-093e38-875656d78-65dhb\" (UID: \"f5894b9d-67f3-40f8-b2d2-a07cb588dd6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-093e38-875656d78-65dhb"
Sep 09 13:39:33.112785 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:33.112765    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5894b9d-67f3-40f8-b2d2-a07cb588dd6f-metrics-certs\") pod \"maas-api-e2e-inf-b-093e38-875656d78-65dhb\" (UID: \"f5894b9d-67f3-40f8-b2d2-a07cb588dd6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-093e38-875656d78-65dhb"
Sep 09 13:39:33.122443 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:33.122419    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p799g\" (UniqueName: \"kubernetes.io/projected/f5894b9d-67f3-40f8-b2d2-a07cb588dd6f-kube-api-access-p799g\") pod \"maas-api-e2e-inf-b-093e38-875656d78-65dhb\" (UID: \"f5894b9d-67f3-40f8-b2d2-a07cb588dd6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-093e38-875656d78-65dhb"
Sep 09 13:39:33.280254 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:33.280157    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:33.615243 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:33.615130    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f5894b9d-67f3-40f8-b2d2-a07cb588dd6f-maas-api-tls\") pod \"maas-api-e2e-inf-b-093e38-875656d78-65dhb\" (UID: \"f5894b9d-67f3-40f8-b2d2-a07cb588dd6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-093e38-875656d78-65dhb"
Sep 09 13:39:33.615460 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:39:33.615312    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-093e38-serving-cert: secret "maas-api-e2e-inf-b-093e38-serving-cert" not found
Sep 09 13:39:33.615460 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:39:33.615395    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5894b9d-67f3-40f8-b2d2-a07cb588dd6f-maas-api-tls podName:f5894b9d-67f3-40f8-b2d2-a07cb588dd6f nodeName:}" failed. No retries permitted until 2026-09-09 13:39:34.615374468 +0000 UTC m=+786.430898642 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f5894b9d-67f3-40f8-b2d2-a07cb588dd6f-maas-api-tls") pod "maas-api-e2e-inf-b-093e38-875656d78-65dhb" (UID: "f5894b9d-67f3-40f8-b2d2-a07cb588dd6f") : secret "maas-api-e2e-inf-b-093e38-serving-cert" not found
Sep 09 13:39:33.767070 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:33.767040    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:33.906438 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:33.906402    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:33.968999 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:33.968967    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-093e38-7df48679ff-wwkht"]
Sep 09 13:39:33.971361 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:33.971342    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-093e38-7df48679ff-wwkht"
Sep 09 13:39:34.001071 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:34.001044    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-093e38\""
Sep 09 13:39:34.006449 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:34.006417    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-093e38-7df48679ff-wwkht"]
Sep 09 13:39:34.018510 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:34.018476    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b1b9754f-380d-45ab-aeca-668ac9bc7ee4-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-093e38-7df48679ff-wwkht\" (UID: \"b1b9754f-380d-45ab-aeca-668ac9bc7ee4\") " pod="openshift-ingress/payload-processing-e2e-inf-b-093e38-7df48679ff-wwkht"
Sep 09 13:39:34.018661 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:34.018530    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7gc8\" (UniqueName: \"kubernetes.io/projected/b1b9754f-380d-45ab-aeca-668ac9bc7ee4-kube-api-access-g7gc8\") pod \"payload-processing-e2e-inf-b-093e38-7df48679ff-wwkht\" (UID: \"b1b9754f-380d-45ab-aeca-668ac9bc7ee4\") " pod="openshift-ingress/payload-processing-e2e-inf-b-093e38-7df48679ff-wwkht"
Sep 09 13:39:34.118984 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:34.118945    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b1b9754f-380d-45ab-aeca-668ac9bc7ee4-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-093e38-7df48679ff-wwkht\" (UID: \"b1b9754f-380d-45ab-aeca-668ac9bc7ee4\") " pod="openshift-ingress/payload-processing-e2e-inf-b-093e38-7df48679ff-wwkht"
Sep 09 13:39:34.118984 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:34.118989    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7gc8\" (UniqueName: \"kubernetes.io/projected/b1b9754f-380d-45ab-aeca-668ac9bc7ee4-kube-api-access-g7gc8\") pod \"payload-processing-e2e-inf-b-093e38-7df48679ff-wwkht\" (UID: \"b1b9754f-380d-45ab-aeca-668ac9bc7ee4\") " pod="openshift-ingress/payload-processing-e2e-inf-b-093e38-7df48679ff-wwkht"
Sep 09 13:39:34.119620 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:34.119599    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b1b9754f-380d-45ab-aeca-668ac9bc7ee4-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-093e38-7df48679ff-wwkht\" (UID: \"b1b9754f-380d-45ab-aeca-668ac9bc7ee4\") " pod="openshift-ingress/payload-processing-e2e-inf-b-093e38-7df48679ff-wwkht"
Sep 09 13:39:34.169237 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:34.169156    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7gc8\" (UniqueName: \"kubernetes.io/projected/b1b9754f-380d-45ab-aeca-668ac9bc7ee4-kube-api-access-g7gc8\") pod \"payload-processing-e2e-inf-b-093e38-7df48679ff-wwkht\" (UID: \"b1b9754f-380d-45ab-aeca-668ac9bc7ee4\") " pod="openshift-ingress/payload-processing-e2e-inf-b-093e38-7df48679ff-wwkht"
Sep 09 13:39:34.282274 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:34.282237    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-093e38-7df48679ff-wwkht"
Sep 09 13:39:34.557782 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:34.557753    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-093e38-7df48679ff-wwkht"]
Sep 09 13:39:34.560697 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:39:34.560669    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1b9754f_380d_45ab_aeca_668ac9bc7ee4.slice/crio-6b8c0aff78811f38d1ef86b20dc538fb9ecb9427eaa2260451c092f3c8c552a3 WatchSource:0}: Error finding container 6b8c0aff78811f38d1ef86b20dc538fb9ecb9427eaa2260451c092f3c8c552a3: Status 404 returned error can't find the container with id 6b8c0aff78811f38d1ef86b20dc538fb9ecb9427eaa2260451c092f3c8c552a3
Sep 09 13:39:34.624205 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:34.624160    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f5894b9d-67f3-40f8-b2d2-a07cb588dd6f-maas-api-tls\") pod \"maas-api-e2e-inf-b-093e38-875656d78-65dhb\" (UID: \"f5894b9d-67f3-40f8-b2d2-a07cb588dd6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-093e38-875656d78-65dhb"
Sep 09 13:39:34.626314 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:34.626293    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f5894b9d-67f3-40f8-b2d2-a07cb588dd6f-maas-api-tls\") pod \"maas-api-e2e-inf-b-093e38-875656d78-65dhb\" (UID: \"f5894b9d-67f3-40f8-b2d2-a07cb588dd6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-093e38-875656d78-65dhb"
Sep 09 13:39:34.766971 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:34.766936    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-093e38-875656d78-65dhb"
Sep 09 13:39:34.824751 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:34.824307    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:34.987655 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:34.987620    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-093e38-7df48679ff-wwkht" event={"ID":"b1b9754f-380d-45ab-aeca-668ac9bc7ee4","Type":"ContainerStarted","Data":"28140b168d043d20707e98812cb215420702805fcf504ec5fd9fc3eadb3d0f1a"}
Sep 09 13:39:34.988265 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:34.987671    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-093e38-7df48679ff-wwkht" event={"ID":"b1b9754f-380d-45ab-aeca-668ac9bc7ee4","Type":"ContainerStarted","Data":"6b8c0aff78811f38d1ef86b20dc538fb9ecb9427eaa2260451c092f3c8c552a3"}
Sep 09 13:39:34.988265 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:34.987753    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-093e38-7df48679ff-wwkht"
Sep 09 13:39:35.021861 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:35.021808    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-093e38-7df48679ff-wwkht" podStartSLOduration=2.021791407 podStartE2EDuration="2.021791407s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 13:39:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 13:39:35.019095034 +0000 UTC m=+786.834619229" watchObservedRunningTime="2026-09-09 13:39:35.021791407 +0000 UTC m=+786.837315612"
Sep 09 13:39:35.041159 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:35.041136    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-093e38-875656d78-65dhb"]
Sep 09 13:39:35.044192 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:39:35.044154    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5894b9d_67f3_40f8_b2d2_a07cb588dd6f.slice/crio-18d63ef7a7415b7802d1ff9c074a882e2fb3f6967e6ad750f5931898b6013802 WatchSource:0}: Error finding container 18d63ef7a7415b7802d1ff9c074a882e2fb3f6967e6ad750f5931898b6013802: Status 404 returned error can't find the container with id 18d63ef7a7415b7802d1ff9c074a882e2fb3f6967e6ad750f5931898b6013802
Sep 09 13:39:35.753576 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:35.753490    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:35.994219 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:35.994156    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-093e38-875656d78-65dhb" event={"ID":"f5894b9d-67f3-40f8-b2d2-a07cb588dd6f","Type":"ContainerStarted","Data":"48a611169dd2442a6753f3e27cbef5b06ab8c3278c2eee49dd78f7a0e72070b8"}
Sep 09 13:39:35.994670 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:35.994247    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-093e38-875656d78-65dhb" event={"ID":"f5894b9d-67f3-40f8-b2d2-a07cb588dd6f","Type":"ContainerStarted","Data":"18d63ef7a7415b7802d1ff9c074a882e2fb3f6967e6ad750f5931898b6013802"}
Sep 09 13:39:35.994670 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:35.994434    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-093e38-875656d78-65dhb"
Sep 09 13:39:36.703419 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:36.703386    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:36.871089 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:36.871058    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:36.971458 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:36.971370    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:38.615471 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:38.615427    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:40.686995 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:40.686962    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:42.004026 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:42.003998    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-093e38-875656d78-65dhb"
Sep 09 13:39:42.023772 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:42.023721    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-093e38-875656d78-65dhb" podStartSLOduration=9.651591377999999 podStartE2EDuration="10.023704379s" totalImagesPullingTime="372.113001ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 13:39:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 13:39:36.05966073 +0000 UTC m=+787.875184924" watchObservedRunningTime="2026-09-09 13:39:42.023704379 +0000 UTC m=+793.839228573"
Sep 09 13:39:43.071794 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:43.071759    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:39:43.749800 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:43.749767    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:45.996294 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:45.996261    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-093e38-7df48679ff-wwkht"
Sep 09 13:39:52.076330 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:52.076234    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a649773d-87855967f-r9z6r"]
Sep 09 13:39:52.076784 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:52.076473    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a649773d-87855967f-r9z6r" podUID="11883118-2198-488f-a185-edbab1028f72" containerName="maas-api" containerID="cri-o://0ebb1dc078908c07a60247bc63fe6a8b3899a3e72e6ce21ecb687f80d77a6b4a" gracePeriod=30
Sep 09 13:39:52.114151 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:52.114121    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:52.183945 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:52.183906    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:52.248848 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:52.248809    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:52.321133 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:52.321104    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a649773d-87855967f-r9z6r"
Sep 09 13:39:52.326422 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:52.326361    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:52.390165 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:52.390133    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pkk7s\" (UniqueName: \"kubernetes.io/projected/11883118-2198-488f-a185-edbab1028f72-kube-api-access-pkk7s\") pod \"11883118-2198-488f-a185-edbab1028f72\" (UID: \"11883118-2198-488f-a185-edbab1028f72\") "
Sep 09 13:39:52.390387 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:52.390211    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/11883118-2198-488f-a185-edbab1028f72-metrics-certs\") pod \"11883118-2198-488f-a185-edbab1028f72\" (UID: \"11883118-2198-488f-a185-edbab1028f72\") "
Sep 09 13:39:52.390387 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:52.390324    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11883118-2198-488f-a185-edbab1028f72-maas-api-tls\") pod \"11883118-2198-488f-a185-edbab1028f72\" (UID: \"11883118-2198-488f-a185-edbab1028f72\") "
Sep 09 13:39:52.390387 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:52.390368    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/11883118-2198-488f-a185-edbab1028f72-openshift-service-ca\") pod \"11883118-2198-488f-a185-edbab1028f72\" (UID: \"11883118-2198-488f-a185-edbab1028f72\") "
Sep 09 13:39:52.390762 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:52.390729    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11883118-2198-488f-a185-edbab1028f72-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "11883118-2198-488f-a185-edbab1028f72" (UID: "11883118-2198-488f-a185-edbab1028f72"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 13:39:52.392616 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:52.392590    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11883118-2198-488f-a185-edbab1028f72-kube-api-access-pkk7s" (OuterVolumeSpecName: "kube-api-access-pkk7s") pod "11883118-2198-488f-a185-edbab1028f72" (UID: "11883118-2198-488f-a185-edbab1028f72"). InnerVolumeSpecName "kube-api-access-pkk7s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 13:39:52.392616 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:52.392601    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11883118-2198-488f-a185-edbab1028f72-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "11883118-2198-488f-a185-edbab1028f72" (UID: "11883118-2198-488f-a185-edbab1028f72"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 13:39:52.392758 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:52.392587    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11883118-2198-488f-a185-edbab1028f72-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "11883118-2198-488f-a185-edbab1028f72" (UID: "11883118-2198-488f-a185-edbab1028f72"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 13:39:52.402746 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:52.402723    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:52.483482 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:52.483450    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:52.491639 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:52.491610    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11883118-2198-488f-a185-edbab1028f72-maas-api-tls\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:39:52.491639 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:52.491637    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/11883118-2198-488f-a185-edbab1028f72-openshift-service-ca\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:39:52.491803 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:52.491647    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pkk7s\" (UniqueName: \"kubernetes.io/projected/11883118-2198-488f-a185-edbab1028f72-kube-api-access-pkk7s\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:39:52.491803 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:52.491656    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/11883118-2198-488f-a185-edbab1028f72-metrics-certs\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:39:52.918465 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:52.918431    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:53.072039 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:53.071951    2578 generic.go:356] "Generic (PLEG): container finished" podID="11883118-2198-488f-a185-edbab1028f72" containerID="0ebb1dc078908c07a60247bc63fe6a8b3899a3e72e6ce21ecb687f80d77a6b4a" exitCode=0
Sep 09 13:39:53.072039 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:53.071996    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a649773d-87855967f-r9z6r"
Sep 09 13:39:53.072290 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:53.072039    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a649773d-87855967f-r9z6r" event={"ID":"11883118-2198-488f-a185-edbab1028f72","Type":"ContainerDied","Data":"0ebb1dc078908c07a60247bc63fe6a8b3899a3e72e6ce21ecb687f80d77a6b4a"}
Sep 09 13:39:53.072290 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:53.072089    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a649773d-87855967f-r9z6r" event={"ID":"11883118-2198-488f-a185-edbab1028f72","Type":"ContainerDied","Data":"0f9a194e3e587db3afbcdeeea83026be16693b9902de264f23f2287fd94cf597"}
Sep 09 13:39:53.072290 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:53.072113    2578 scope.go:117] "RemoveContainer" containerID="0ebb1dc078908c07a60247bc63fe6a8b3899a3e72e6ce21ecb687f80d77a6b4a"
Sep 09 13:39:53.080632 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:53.080464    2578 scope.go:117] "RemoveContainer" containerID="0ebb1dc078908c07a60247bc63fe6a8b3899a3e72e6ce21ecb687f80d77a6b4a"
Sep 09 13:39:53.080846 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:39:53.080764    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ebb1dc078908c07a60247bc63fe6a8b3899a3e72e6ce21ecb687f80d77a6b4a\": container with ID starting with 0ebb1dc078908c07a60247bc63fe6a8b3899a3e72e6ce21ecb687f80d77a6b4a not found: ID does not exist" containerID="0ebb1dc078908c07a60247bc63fe6a8b3899a3e72e6ce21ecb687f80d77a6b4a"
Sep 09 13:39:53.080846 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:53.080791    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ebb1dc078908c07a60247bc63fe6a8b3899a3e72e6ce21ecb687f80d77a6b4a"} err="failed to get container status \"0ebb1dc078908c07a60247bc63fe6a8b3899a3e72e6ce21ecb687f80d77a6b4a\": rpc error: code = NotFound desc = could not find container \"0ebb1dc078908c07a60247bc63fe6a8b3899a3e72e6ce21ecb687f80d77a6b4a\": container with ID starting with 0ebb1dc078908c07a60247bc63fe6a8b3899a3e72e6ce21ecb687f80d77a6b4a not found: ID does not exist"
Sep 09 13:39:53.102251 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:53.102225    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a649773d-87855967f-r9z6r"]
Sep 09 13:39:53.105220 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:53.105196    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a649773d-87855967f-r9z6r"]
Sep 09 13:39:53.141841 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:53.141812    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:53.393052 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:53.393021    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:53.472864 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:53.472834    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:54.051020 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:54.050987    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:54.525913 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:54.525874    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:54.660672 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:54.660641    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11883118-2198-488f-a185-edbab1028f72" path="/var/lib/kubelet/pods/11883118-2198-488f-a185-edbab1028f72/volumes"
Sep 09 13:39:56.551774 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:56.551740    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:56.755608 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:56.755575    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:56.782544 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:56.782514    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-219dfd41-fbcfb7786-ltkh4"]
Sep 09 13:39:56.782918 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:56.782906    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11883118-2198-488f-a185-edbab1028f72" containerName="maas-api"
Sep 09 13:39:56.782960 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:56.782922    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="11883118-2198-488f-a185-edbab1028f72" containerName="maas-api"
Sep 09 13:39:56.782998 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:56.782979    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="11883118-2198-488f-a185-edbab1028f72" containerName="maas-api"
Sep 09 13:39:56.785964 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:56.785941    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-219dfd41-fbcfb7786-ltkh4"
Sep 09 13:39:56.789923 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:56.789899    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-219dfd41-serving-cert\""
Sep 09 13:39:56.807490 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:56.807411    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-219dfd41-fbcfb7786-ltkh4"]
Sep 09 13:39:56.860458 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:56.860429    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:56.936302 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:56.936267    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzp4g\" (UniqueName: \"kubernetes.io/projected/32243490-adc0-4381-9fe5-2c24b5528a16-kube-api-access-mzp4g\") pod \"maas-api-e2e-migrate-219dfd41-fbcfb7786-ltkh4\" (UID: \"32243490-adc0-4381-9fe5-2c24b5528a16\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-219dfd41-fbcfb7786-ltkh4"
Sep 09 13:39:56.936302 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:56.936305    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/32243490-adc0-4381-9fe5-2c24b5528a16-openshift-service-ca\") pod \"maas-api-e2e-migrate-219dfd41-fbcfb7786-ltkh4\" (UID: \"32243490-adc0-4381-9fe5-2c24b5528a16\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-219dfd41-fbcfb7786-ltkh4"
Sep 09 13:39:56.936551 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:56.936337    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/32243490-adc0-4381-9fe5-2c24b5528a16-maas-api-tls\") pod \"maas-api-e2e-migrate-219dfd41-fbcfb7786-ltkh4\" (UID: \"32243490-adc0-4381-9fe5-2c24b5528a16\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-219dfd41-fbcfb7786-ltkh4"
Sep 09 13:39:56.936551 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:56.936427    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/32243490-adc0-4381-9fe5-2c24b5528a16-metrics-certs\") pod \"maas-api-e2e-migrate-219dfd41-fbcfb7786-ltkh4\" (UID: \"32243490-adc0-4381-9fe5-2c24b5528a16\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-219dfd41-fbcfb7786-ltkh4"
Sep 09 13:39:56.955118 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:56.955073    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:57.037414 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:57.037364    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/32243490-adc0-4381-9fe5-2c24b5528a16-metrics-certs\") pod \"maas-api-e2e-migrate-219dfd41-fbcfb7786-ltkh4\" (UID: \"32243490-adc0-4381-9fe5-2c24b5528a16\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-219dfd41-fbcfb7786-ltkh4"
Sep 09 13:39:57.037600 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:57.037456    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzp4g\" (UniqueName: \"kubernetes.io/projected/32243490-adc0-4381-9fe5-2c24b5528a16-kube-api-access-mzp4g\") pod \"maas-api-e2e-migrate-219dfd41-fbcfb7786-ltkh4\" (UID: \"32243490-adc0-4381-9fe5-2c24b5528a16\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-219dfd41-fbcfb7786-ltkh4"
Sep 09 13:39:57.037600 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:57.037480    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/32243490-adc0-4381-9fe5-2c24b5528a16-openshift-service-ca\") pod \"maas-api-e2e-migrate-219dfd41-fbcfb7786-ltkh4\" (UID: \"32243490-adc0-4381-9fe5-2c24b5528a16\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-219dfd41-fbcfb7786-ltkh4"
Sep 09 13:39:57.037600 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:57.037510    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/32243490-adc0-4381-9fe5-2c24b5528a16-maas-api-tls\") pod \"maas-api-e2e-migrate-219dfd41-fbcfb7786-ltkh4\" (UID: \"32243490-adc0-4381-9fe5-2c24b5528a16\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-219dfd41-fbcfb7786-ltkh4"
Sep 09 13:39:57.038226 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:57.038202    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/32243490-adc0-4381-9fe5-2c24b5528a16-openshift-service-ca\") pod \"maas-api-e2e-migrate-219dfd41-fbcfb7786-ltkh4\" (UID: \"32243490-adc0-4381-9fe5-2c24b5528a16\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-219dfd41-fbcfb7786-ltkh4"
Sep 09 13:39:57.039900 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:57.039881    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/32243490-adc0-4381-9fe5-2c24b5528a16-maas-api-tls\") pod \"maas-api-e2e-migrate-219dfd41-fbcfb7786-ltkh4\" (UID: \"32243490-adc0-4381-9fe5-2c24b5528a16\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-219dfd41-fbcfb7786-ltkh4"
Sep 09 13:39:57.040018 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:57.040001    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/32243490-adc0-4381-9fe5-2c24b5528a16-metrics-certs\") pod \"maas-api-e2e-migrate-219dfd41-fbcfb7786-ltkh4\" (UID: \"32243490-adc0-4381-9fe5-2c24b5528a16\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-219dfd41-fbcfb7786-ltkh4"
Sep 09 13:39:57.053525 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:57.053502    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzp4g\" (UniqueName: \"kubernetes.io/projected/32243490-adc0-4381-9fe5-2c24b5528a16-kube-api-access-mzp4g\") pod \"maas-api-e2e-migrate-219dfd41-fbcfb7786-ltkh4\" (UID: \"32243490-adc0-4381-9fe5-2c24b5528a16\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-219dfd41-fbcfb7786-ltkh4"
Sep 09 13:39:57.066472 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:57.066420    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:57.098701 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:57.098673    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-219dfd41-fbcfb7786-ltkh4"
Sep 09 13:39:57.369869 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:57.369796    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-219dfd41-fbcfb7786-ltkh4"]
Sep 09 13:39:57.372836 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:39:57.372812    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32243490_adc0_4381_9fe5_2c24b5528a16.slice/crio-b08f35527f6bae669191c7d3ce52377c8b95980eaba295956106793d30023057 WatchSource:0}: Error finding container b08f35527f6bae669191c7d3ce52377c8b95980eaba295956106793d30023057: Status 404 returned error can't find the container with id b08f35527f6bae669191c7d3ce52377c8b95980eaba295956106793d30023057
Sep 09 13:39:57.434074 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:57.434030    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:57.535349 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:57.535317    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:39:57.580049 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:57.580018    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-219dfd41-645fc8b998-5bx5c"]
Sep 09 13:39:57.584478 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:57.584460    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-219dfd41-645fc8b998-5bx5c"
Sep 09 13:39:57.587262 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:57.587238    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-219dfd41\""
Sep 09 13:39:57.587262 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:57.587258    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-219dfd41-dockercfg-v75pc\""
Sep 09 13:39:57.596415 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:57.596389    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-219dfd41-645fc8b998-5bx5c"]
Sep 09 13:39:57.744261 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:57.744220    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c09adb87-f3d0-4360-9ba9-768b1db22898-plugins-config-volume\") pod \"payload-processing-e2e-migrate-219dfd41-645fc8b998-5bx5c\" (UID: \"c09adb87-f3d0-4360-9ba9-768b1db22898\") " pod="openshift-ingress/payload-processing-e2e-migrate-219dfd41-645fc8b998-5bx5c"
Sep 09 13:39:57.744452 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:57.744306    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nb47h\" (UniqueName: \"kubernetes.io/projected/c09adb87-f3d0-4360-9ba9-768b1db22898-kube-api-access-nb47h\") pod \"payload-processing-e2e-migrate-219dfd41-645fc8b998-5bx5c\" (UID: \"c09adb87-f3d0-4360-9ba9-768b1db22898\") " pod="openshift-ingress/payload-processing-e2e-migrate-219dfd41-645fc8b998-5bx5c"
Sep 09 13:39:57.845194 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:57.845157    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c09adb87-f3d0-4360-9ba9-768b1db22898-plugins-config-volume\") pod \"payload-processing-e2e-migrate-219dfd41-645fc8b998-5bx5c\" (UID: \"c09adb87-f3d0-4360-9ba9-768b1db22898\") " pod="openshift-ingress/payload-processing-e2e-migrate-219dfd41-645fc8b998-5bx5c"
Sep 09 13:39:57.845285 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:57.845249    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nb47h\" (UniqueName: \"kubernetes.io/projected/c09adb87-f3d0-4360-9ba9-768b1db22898-kube-api-access-nb47h\") pod \"payload-processing-e2e-migrate-219dfd41-645fc8b998-5bx5c\" (UID: \"c09adb87-f3d0-4360-9ba9-768b1db22898\") " pod="openshift-ingress/payload-processing-e2e-migrate-219dfd41-645fc8b998-5bx5c"
Sep 09 13:39:57.846008 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:57.845941    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c09adb87-f3d0-4360-9ba9-768b1db22898-plugins-config-volume\") pod \"payload-processing-e2e-migrate-219dfd41-645fc8b998-5bx5c\" (UID: \"c09adb87-f3d0-4360-9ba9-768b1db22898\") " pod="openshift-ingress/payload-processing-e2e-migrate-219dfd41-645fc8b998-5bx5c"
Sep 09 13:39:57.862586 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:57.862557    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nb47h\" (UniqueName: \"kubernetes.io/projected/c09adb87-f3d0-4360-9ba9-768b1db22898-kube-api-access-nb47h\") pod \"payload-processing-e2e-migrate-219dfd41-645fc8b998-5bx5c\" (UID: \"c09adb87-f3d0-4360-9ba9-768b1db22898\") " pod="openshift-ingress/payload-processing-e2e-migrate-219dfd41-645fc8b998-5bx5c"
Sep 09 13:39:57.895168 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:57.895146    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-219dfd41-645fc8b998-5bx5c"
Sep 09 13:39:58.100251 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:58.100140    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-219dfd41-fbcfb7786-ltkh4" event={"ID":"32243490-adc0-4381-9fe5-2c24b5528a16","Type":"ContainerStarted","Data":"d1f7bbea068650384754e4ec66be53382fe491f68c1f444e4f06389e6587f4ae"}
Sep 09 13:39:58.100251 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:58.100229    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-219dfd41-fbcfb7786-ltkh4"
Sep 09 13:39:58.100447 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:58.100257    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-219dfd41-fbcfb7786-ltkh4" event={"ID":"32243490-adc0-4381-9fe5-2c24b5528a16","Type":"ContainerStarted","Data":"b08f35527f6bae669191c7d3ce52377c8b95980eaba295956106793d30023057"}
Sep 09 13:39:58.117635 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:58.117585    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-219dfd41-fbcfb7786-ltkh4" podStartSLOduration=1.659823635 podStartE2EDuration="2.117570684s" totalImagesPullingTime="457.747049ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 13:39:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 13:39:58.116502745 +0000 UTC m=+809.932026943" watchObservedRunningTime="2026-09-09 13:39:58.117570684 +0000 UTC m=+809.933094877"
Sep 09 13:39:58.168520 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:58.168493    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-219dfd41-645fc8b998-5bx5c"]
Sep 09 13:39:58.170051 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:39:58.170028    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc09adb87_f3d0_4360_9ba9_768b1db22898.slice/crio-a71a0a496aeb03658e459bbd3ad95cd300c0a04bbcaf5255f6549774e67ab278 WatchSource:0}: Error finding container a71a0a496aeb03658e459bbd3ad95cd300c0a04bbcaf5255f6549774e67ab278: Status 404 returned error can't find the container with id a71a0a496aeb03658e459bbd3ad95cd300c0a04bbcaf5255f6549774e67ab278
Sep 09 13:39:58.787770 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:58.787723    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:39:59.106925 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:59.106832    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-219dfd41-645fc8b998-5bx5c" event={"ID":"c09adb87-f3d0-4360-9ba9-768b1db22898","Type":"ContainerStarted","Data":"6867ff110f70edf7fe99ac4ed4bceb650866b6ba5973419a521ec00ca9bcc88e"}
Sep 09 13:39:59.106925 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:59.106885    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-219dfd41-645fc8b998-5bx5c" event={"ID":"c09adb87-f3d0-4360-9ba9-768b1db22898","Type":"ContainerStarted","Data":"a71a0a496aeb03658e459bbd3ad95cd300c0a04bbcaf5255f6549774e67ab278"}
Sep 09 13:39:59.107187 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:59.106992    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-219dfd41-645fc8b998-5bx5c"
Sep 09 13:39:59.133849 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:39:59.133792    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-219dfd41-645fc8b998-5bx5c" podStartSLOduration=2.13377504 podStartE2EDuration="2.13377504s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 13:39:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 13:39:59.13014241 +0000 UTC m=+810.945666604" watchObservedRunningTime="2026-09-09 13:39:59.13377504 +0000 UTC m=+810.949299230"
Sep 09 13:40:04.112445 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:04.112415    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-219dfd41-fbcfb7786-ltkh4"
Sep 09 13:40:10.115162 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:10.115131    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-219dfd41-645fc8b998-5bx5c"
Sep 09 13:40:16.808187 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:16.808141    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:40:21.080658 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:21.080627    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:40:28.033876 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:28.030666    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-219dfd41-fbcfb7786-ltkh4"]
Sep 09 13:40:28.033876 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:28.031012    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-219dfd41-fbcfb7786-ltkh4" podUID="32243490-adc0-4381-9fe5-2c24b5528a16" containerName="maas-api" containerID="cri-o://d1f7bbea068650384754e4ec66be53382fe491f68c1f444e4f06389e6587f4ae" gracePeriod=30
Sep 09 13:40:28.077807 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:28.077763    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:40:28.086673 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:28.086640    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-219dfd41-645fc8b998-5bx5c"]
Sep 09 13:40:28.086911 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:28.086862    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-219dfd41-645fc8b998-5bx5c" podUID="c09adb87-f3d0-4360-9ba9-768b1db22898" containerName="payload-processing" containerID="cri-o://6867ff110f70edf7fe99ac4ed4bceb650866b6ba5973419a521ec00ca9bcc88e" gracePeriod=30
Sep 09 13:40:28.177070 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:28.177039    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:40:28.250210 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:28.250163    2578 generic.go:356] "Generic (PLEG): container finished" podID="c09adb87-f3d0-4360-9ba9-768b1db22898" containerID="6867ff110f70edf7fe99ac4ed4bceb650866b6ba5973419a521ec00ca9bcc88e" exitCode=0
Sep 09 13:40:28.250350 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:28.250313    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-219dfd41-645fc8b998-5bx5c" event={"ID":"c09adb87-f3d0-4360-9ba9-768b1db22898","Type":"ContainerDied","Data":"6867ff110f70edf7fe99ac4ed4bceb650866b6ba5973419a521ec00ca9bcc88e"}
Sep 09 13:40:28.253197 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:28.253145    2578 generic.go:356] "Generic (PLEG): container finished" podID="32243490-adc0-4381-9fe5-2c24b5528a16" containerID="d1f7bbea068650384754e4ec66be53382fe491f68c1f444e4f06389e6587f4ae" exitCode=0
Sep 09 13:40:28.253312 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:28.253202    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-219dfd41-fbcfb7786-ltkh4" event={"ID":"32243490-adc0-4381-9fe5-2c24b5528a16","Type":"ContainerDied","Data":"d1f7bbea068650384754e4ec66be53382fe491f68c1f444e4f06389e6587f4ae"}
Sep 09 13:40:28.281575 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:28.281532    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:40:28.329955 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:28.329929    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-219dfd41-fbcfb7786-ltkh4"
Sep 09 13:40:28.357717 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:28.357691    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:40:28.364385 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:28.364361    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-219dfd41-645fc8b998-5bx5c"
Sep 09 13:40:28.424238 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:28.424201    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mzp4g\" (UniqueName: \"kubernetes.io/projected/32243490-adc0-4381-9fe5-2c24b5528a16-kube-api-access-mzp4g\") pod \"32243490-adc0-4381-9fe5-2c24b5528a16\" (UID: \"32243490-adc0-4381-9fe5-2c24b5528a16\") "
Sep 09 13:40:28.424430 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:28.424257    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/32243490-adc0-4381-9fe5-2c24b5528a16-maas-api-tls\") pod \"32243490-adc0-4381-9fe5-2c24b5528a16\" (UID: \"32243490-adc0-4381-9fe5-2c24b5528a16\") "
Sep 09 13:40:28.424430 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:28.424295    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/32243490-adc0-4381-9fe5-2c24b5528a16-openshift-service-ca\") pod \"32243490-adc0-4381-9fe5-2c24b5528a16\" (UID: \"32243490-adc0-4381-9fe5-2c24b5528a16\") "
Sep 09 13:40:28.424430 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:28.424319    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c09adb87-f3d0-4360-9ba9-768b1db22898-plugins-config-volume\") pod \"c09adb87-f3d0-4360-9ba9-768b1db22898\" (UID: \"c09adb87-f3d0-4360-9ba9-768b1db22898\") "
Sep 09 13:40:28.424430 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:28.424393    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nb47h\" (UniqueName: \"kubernetes.io/projected/c09adb87-f3d0-4360-9ba9-768b1db22898-kube-api-access-nb47h\") pod \"c09adb87-f3d0-4360-9ba9-768b1db22898\" (UID: \"c09adb87-f3d0-4360-9ba9-768b1db22898\") "
Sep 09 13:40:28.424638 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:28.424451    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/32243490-adc0-4381-9fe5-2c24b5528a16-metrics-certs\") pod \"32243490-adc0-4381-9fe5-2c24b5528a16\" (UID: \"32243490-adc0-4381-9fe5-2c24b5528a16\") "
Sep 09 13:40:28.424942 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:28.424891    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c09adb87-f3d0-4360-9ba9-768b1db22898-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c09adb87-f3d0-4360-9ba9-768b1db22898" (UID: "c09adb87-f3d0-4360-9ba9-768b1db22898"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 13:40:28.425314 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:28.425249    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32243490-adc0-4381-9fe5-2c24b5528a16-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "32243490-adc0-4381-9fe5-2c24b5528a16" (UID: "32243490-adc0-4381-9fe5-2c24b5528a16"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 13:40:28.427344 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:28.427321    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32243490-adc0-4381-9fe5-2c24b5528a16-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "32243490-adc0-4381-9fe5-2c24b5528a16" (UID: "32243490-adc0-4381-9fe5-2c24b5528a16"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 13:40:28.427545 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:28.427519    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32243490-adc0-4381-9fe5-2c24b5528a16-kube-api-access-mzp4g" (OuterVolumeSpecName: "kube-api-access-mzp4g") pod "32243490-adc0-4381-9fe5-2c24b5528a16" (UID: "32243490-adc0-4381-9fe5-2c24b5528a16"). InnerVolumeSpecName "kube-api-access-mzp4g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 13:40:28.428741 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:28.428713    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c09adb87-f3d0-4360-9ba9-768b1db22898-kube-api-access-nb47h" (OuterVolumeSpecName: "kube-api-access-nb47h") pod "c09adb87-f3d0-4360-9ba9-768b1db22898" (UID: "c09adb87-f3d0-4360-9ba9-768b1db22898"). InnerVolumeSpecName "kube-api-access-nb47h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 13:40:28.428844 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:28.428820    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32243490-adc0-4381-9fe5-2c24b5528a16-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "32243490-adc0-4381-9fe5-2c24b5528a16" (UID: "32243490-adc0-4381-9fe5-2c24b5528a16"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 13:40:28.525905 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:28.525866    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nb47h\" (UniqueName: \"kubernetes.io/projected/c09adb87-f3d0-4360-9ba9-768b1db22898-kube-api-access-nb47h\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:40:28.525905 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:28.525899    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/32243490-adc0-4381-9fe5-2c24b5528a16-metrics-certs\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:40:28.525905 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:28.525910    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mzp4g\" (UniqueName: \"kubernetes.io/projected/32243490-adc0-4381-9fe5-2c24b5528a16-kube-api-access-mzp4g\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:40:28.526125 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:28.525919    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/32243490-adc0-4381-9fe5-2c24b5528a16-maas-api-tls\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:40:28.526125 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:28.525948    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/32243490-adc0-4381-9fe5-2c24b5528a16-openshift-service-ca\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:40:28.526125 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:28.525957    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c09adb87-f3d0-4360-9ba9-768b1db22898-plugins-config-volume\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:40:28.953942 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:28.953866    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:40:29.055980 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:29.055928    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:40:29.129140 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:29.129109    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c"]
Sep 09 13:40:29.129479 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:29.129466    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32243490-adc0-4381-9fe5-2c24b5528a16" containerName="maas-api"
Sep 09 13:40:29.129527 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:29.129480    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="32243490-adc0-4381-9fe5-2c24b5528a16" containerName="maas-api"
Sep 09 13:40:29.129527 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:29.129503    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c09adb87-f3d0-4360-9ba9-768b1db22898" containerName="payload-processing"
Sep 09 13:40:29.129527 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:29.129509    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c09adb87-f3d0-4360-9ba9-768b1db22898" containerName="payload-processing"
Sep 09 13:40:29.129624 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:29.129560    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c09adb87-f3d0-4360-9ba9-768b1db22898" containerName="payload-processing"
Sep 09 13:40:29.129624 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:29.129567    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="32243490-adc0-4381-9fe5-2c24b5528a16" containerName="maas-api"
Sep 09 13:40:29.133722 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:29.133699    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c"
Sep 09 13:40:29.136212 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:29.136164    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-a9bbeff1-openshift-default-dockercfg-f2xnt\""
Sep 09 13:40:29.146151 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:29.146128    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c"]
Sep 09 13:40:29.171826 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:29.171791    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:40:29.232572 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:29.232476    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/803b566b-b66a-45e5-bf1f-20be0a978c32-workload-socket\") pod \"e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c\" (UID: \"803b566b-b66a-45e5-bf1f-20be0a978c32\") " pod="openshift-ingress/e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c"
Sep 09 13:40:29.232572 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:29.232526    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/803b566b-b66a-45e5-bf1f-20be0a978c32-istio-token\") pod \"e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c\" (UID: \"803b566b-b66a-45e5-bf1f-20be0a978c32\") " pod="openshift-ingress/e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c"
Sep 09 13:40:29.232796 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:29.232580    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/803b566b-b66a-45e5-bf1f-20be0a978c32-istio-envoy\") pod \"e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c\" (UID: \"803b566b-b66a-45e5-bf1f-20be0a978c32\") " pod="openshift-ingress/e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c"
Sep 09 13:40:29.232796 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:29.232627    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/803b566b-b66a-45e5-bf1f-20be0a978c32-credential-socket\") pod \"e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c\" (UID: \"803b566b-b66a-45e5-bf1f-20be0a978c32\") " pod="openshift-ingress/e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c"
Sep 09 13:40:29.232796 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:29.232739    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6chh\" (UniqueName: \"kubernetes.io/projected/803b566b-b66a-45e5-bf1f-20be0a978c32-kube-api-access-m6chh\") pod \"e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c\" (UID: \"803b566b-b66a-45e5-bf1f-20be0a978c32\") " pod="openshift-ingress/e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c"
Sep 09 13:40:29.232796 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:29.232770    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/803b566b-b66a-45e5-bf1f-20be0a978c32-istio-data\") pod \"e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c\" (UID: \"803b566b-b66a-45e5-bf1f-20be0a978c32\") " pod="openshift-ingress/e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c"
Sep 09 13:40:29.232986 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:29.232830    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/803b566b-b66a-45e5-bf1f-20be0a978c32-workload-certs\") pod \"e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c\" (UID: \"803b566b-b66a-45e5-bf1f-20be0a978c32\") " pod="openshift-ingress/e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c"
Sep 09 13:40:29.232986 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:29.232865    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/803b566b-b66a-45e5-bf1f-20be0a978c32-istiod-ca-cert\") pod \"e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c\" (UID: \"803b566b-b66a-45e5-bf1f-20be0a978c32\") " pod="openshift-ingress/e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c"
Sep 09 13:40:29.232986 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:29.232925    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/803b566b-b66a-45e5-bf1f-20be0a978c32-istio-podinfo\") pod \"e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c\" (UID: \"803b566b-b66a-45e5-bf1f-20be0a978c32\") " pod="openshift-ingress/e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c"
Sep 09 13:40:29.259783 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:29.259749    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-219dfd41-fbcfb7786-ltkh4"
Sep 09 13:40:29.259955 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:29.259753    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-219dfd41-fbcfb7786-ltkh4" event={"ID":"32243490-adc0-4381-9fe5-2c24b5528a16","Type":"ContainerDied","Data":"b08f35527f6bae669191c7d3ce52377c8b95980eaba295956106793d30023057"}
Sep 09 13:40:29.259955 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:29.259888    2578 scope.go:117] "RemoveContainer" containerID="d1f7bbea068650384754e4ec66be53382fe491f68c1f444e4f06389e6587f4ae"
Sep 09 13:40:29.261337 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:29.261319    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-219dfd41-645fc8b998-5bx5c"
Sep 09 13:40:29.261433 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:29.261341    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-219dfd41-645fc8b998-5bx5c" event={"ID":"c09adb87-f3d0-4360-9ba9-768b1db22898","Type":"ContainerDied","Data":"a71a0a496aeb03658e459bbd3ad95cd300c0a04bbcaf5255f6549774e67ab278"}
Sep 09 13:40:29.268775 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:29.268759    2578 scope.go:117] "RemoveContainer" containerID="6867ff110f70edf7fe99ac4ed4bceb650866b6ba5973419a521ec00ca9bcc88e"
Sep 09 13:40:29.311501 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:29.311465    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-219dfd41-fbcfb7786-ltkh4"]
Sep 09 13:40:29.319042 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:29.319004    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-219dfd41-fbcfb7786-ltkh4"]
Sep 09 13:40:29.333605 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:29.333577    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6chh\" (UniqueName: \"kubernetes.io/projected/803b566b-b66a-45e5-bf1f-20be0a978c32-kube-api-access-m6chh\") pod \"e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c\" (UID: \"803b566b-b66a-45e5-bf1f-20be0a978c32\") " pod="openshift-ingress/e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c"
Sep 09 13:40:29.333761 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:29.333610    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/803b566b-b66a-45e5-bf1f-20be0a978c32-istio-data\") pod \"e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c\" (UID: \"803b566b-b66a-45e5-bf1f-20be0a978c32\") " pod="openshift-ingress/e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c"
Sep 09 13:40:29.333761 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:29.333640    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/803b566b-b66a-45e5-bf1f-20be0a978c32-workload-certs\") pod \"e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c\" (UID: \"803b566b-b66a-45e5-bf1f-20be0a978c32\") " pod="openshift-ingress/e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c"
Sep 09 13:40:29.333761 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:29.333655    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/803b566b-b66a-45e5-bf1f-20be0a978c32-istiod-ca-cert\") pod \"e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c\" (UID: \"803b566b-b66a-45e5-bf1f-20be0a978c32\") " pod="openshift-ingress/e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c"
Sep 09 13:40:29.333934 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:29.333774    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/803b566b-b66a-45e5-bf1f-20be0a978c32-istio-podinfo\") pod \"e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c\" (UID: \"803b566b-b66a-45e5-bf1f-20be0a978c32\") " pod="openshift-ingress/e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c"
Sep 09 13:40:29.333934 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:29.333819    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/803b566b-b66a-45e5-bf1f-20be0a978c32-workload-socket\") pod \"e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c\" (UID: \"803b566b-b66a-45e5-bf1f-20be0a978c32\") " pod="openshift-ingress/e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c"
Sep 09 13:40:29.333934 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:29.333852    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/803b566b-b66a-45e5-bf1f-20be0a978c32-istio-token\") pod \"e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c\" (UID: \"803b566b-b66a-45e5-bf1f-20be0a978c32\") " pod="openshift-ingress/e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c"
Sep 09 13:40:29.333934 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:29.333882    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/803b566b-b66a-45e5-bf1f-20be0a978c32-istio-envoy\") pod \"e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c\" (UID: \"803b566b-b66a-45e5-bf1f-20be0a978c32\") " pod="openshift-ingress/e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c"
Sep 09 13:40:29.333934 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:29.333927    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/803b566b-b66a-45e5-bf1f-20be0a978c32-credential-socket\") pod \"e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c\" (UID: \"803b566b-b66a-45e5-bf1f-20be0a978c32\") " pod="openshift-ingress/e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c"
Sep 09 13:40:29.334215 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:29.334072    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/803b566b-b66a-45e5-bf1f-20be0a978c32-istio-data\") pod \"e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c\" (UID: \"803b566b-b66a-45e5-bf1f-20be0a978c32\") " pod="openshift-ingress/e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c"
Sep 09 13:40:29.334215 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:29.334117    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/803b566b-b66a-45e5-bf1f-20be0a978c32-workload-certs\") pod \"e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c\" (UID: \"803b566b-b66a-45e5-bf1f-20be0a978c32\") " pod="openshift-ingress/e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c"
Sep 09 13:40:29.334696 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:29.334314    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/803b566b-b66a-45e5-bf1f-20be0a978c32-credential-socket\") pod \"e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c\" (UID: \"803b566b-b66a-45e5-bf1f-20be0a978c32\") " pod="openshift-ingress/e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c"
Sep 09 13:40:29.334817 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:29.334701    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/803b566b-b66a-45e5-bf1f-20be0a978c32-workload-socket\") pod \"e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c\" (UID: \"803b566b-b66a-45e5-bf1f-20be0a978c32\") " pod="openshift-ingress/e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c"
Sep 09 13:40:29.334883 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:29.334825    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/803b566b-b66a-45e5-bf1f-20be0a978c32-istiod-ca-cert\") pod \"e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c\" (UID: \"803b566b-b66a-45e5-bf1f-20be0a978c32\") " pod="openshift-ingress/e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c"
Sep 09 13:40:29.336898 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:29.336871    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/803b566b-b66a-45e5-bf1f-20be0a978c32-istio-podinfo\") pod \"e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c\" (UID: \"803b566b-b66a-45e5-bf1f-20be0a978c32\") " pod="openshift-ingress/e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c"
Sep 09 13:40:29.343304 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:29.343277    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/803b566b-b66a-45e5-bf1f-20be0a978c32-istio-envoy\") pod \"e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c\" (UID: \"803b566b-b66a-45e5-bf1f-20be0a978c32\") " pod="openshift-ingress/e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c"
Sep 09 13:40:29.350938 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:29.350914    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-219dfd41-645fc8b998-5bx5c"]
Sep 09 13:40:29.357010 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:29.356982    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/803b566b-b66a-45e5-bf1f-20be0a978c32-istio-token\") pod \"e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c\" (UID: \"803b566b-b66a-45e5-bf1f-20be0a978c32\") " pod="openshift-ingress/e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c"
Sep 09 13:40:29.357928 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:29.357910    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6chh\" (UniqueName: \"kubernetes.io/projected/803b566b-b66a-45e5-bf1f-20be0a978c32-kube-api-access-m6chh\") pod \"e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c\" (UID: \"803b566b-b66a-45e5-bf1f-20be0a978c32\") " pod="openshift-ingress/e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c"
Sep 09 13:40:29.362567 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:29.362547    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-219dfd41-645fc8b998-5bx5c"]
Sep 09 13:40:29.407864 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:29.407828    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:40:29.443940 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:29.443908    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c"
Sep 09 13:40:29.756866 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:29.756780    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c"]
Sep 09 13:40:29.759700 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:40:29.759668    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod803b566b_b66a_45e5_bf1f_20be0a978c32.slice/crio-0ab7c3f726028e2c38e1cdfe449697e513acccfe8d44573fec70f316a158cbe4 WatchSource:0}: Error finding container 0ab7c3f726028e2c38e1cdfe449697e513acccfe8d44573fec70f316a158cbe4: Status 404 returned error can't find the container with id 0ab7c3f726028e2c38e1cdfe449697e513acccfe8d44573fec70f316a158cbe4
Sep 09 13:40:30.267089 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:30.267051    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c" event={"ID":"803b566b-b66a-45e5-bf1f-20be0a978c32","Type":"ContainerStarted","Data":"0ab7c3f726028e2c38e1cdfe449697e513acccfe8d44573fec70f316a158cbe4"}
Sep 09 13:40:30.661459 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:30.661426    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32243490-adc0-4381-9fe5-2c24b5528a16" path="/var/lib/kubelet/pods/32243490-adc0-4381-9fe5-2c24b5528a16/volumes"
Sep 09 13:40:30.661787 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:30.661774    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c09adb87-f3d0-4360-9ba9-768b1db22898" path="/var/lib/kubelet/pods/c09adb87-f3d0-4360-9ba9-768b1db22898/volumes"
Sep 09 13:40:32.762535 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:32.762493    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 13:40:32.762815 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:32.762569    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 13:40:32.762815 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:32.762598    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 13:40:33.291268 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:33.291225    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c" event={"ID":"803b566b-b66a-45e5-bf1f-20be0a978c32","Type":"ContainerStarted","Data":"5cb4f2b770e0d6b8933ff10d9a6d38e9a419f67559a7bf3d4f3ed8e970918145"}
Sep 09 13:40:33.313964 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:33.313912    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c" podStartSLOduration=1.3135334300000001 podStartE2EDuration="4.313896121s" totalImagesPullingTime="3.000362691s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 13:40:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 13:40:33.312083734 +0000 UTC m=+845.127607943" watchObservedRunningTime="2026-09-09 13:40:33.313896121 +0000 UTC m=+845.129420314"
Sep 09 13:40:33.444409 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:33.444369    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c"
Sep 09 13:40:33.449731 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:33.449707    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c"
Sep 09 13:40:34.296245 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:34.296214    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c"
Sep 09 13:40:34.297139 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:34.297118    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c"
Sep 09 13:40:34.673647 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:34.673617    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:40:34.769591 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:34.769557    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:40:35.797378 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:35.797349    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a9bbeff1-6dffc6987b-rgvt8"]
Sep 09 13:40:35.801739 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:35.801715    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a9bbeff1-6dffc6987b-rgvt8"
Sep 09 13:40:35.806319 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:35.806297    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-a9bbeff1-serving-cert\""
Sep 09 13:40:35.815556 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:35.815527    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a9bbeff1-6dffc6987b-rgvt8"]
Sep 09 13:40:35.844053 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:35.844022    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:40:35.897145 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:35.897115    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n89vr\" (UniqueName: \"kubernetes.io/projected/240d25af-b957-415b-a0cb-463608583c22-kube-api-access-n89vr\") pod \"maas-api-e2e-ait-a9bbeff1-6dffc6987b-rgvt8\" (UID: \"240d25af-b957-415b-a0cb-463608583c22\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a9bbeff1-6dffc6987b-rgvt8"
Sep 09 13:40:35.897145 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:35.897148    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/240d25af-b957-415b-a0cb-463608583c22-openshift-service-ca\") pod \"maas-api-e2e-ait-a9bbeff1-6dffc6987b-rgvt8\" (UID: \"240d25af-b957-415b-a0cb-463608583c22\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a9bbeff1-6dffc6987b-rgvt8"
Sep 09 13:40:35.897356 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:35.897276    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/240d25af-b957-415b-a0cb-463608583c22-metrics-certs\") pod \"maas-api-e2e-ait-a9bbeff1-6dffc6987b-rgvt8\" (UID: \"240d25af-b957-415b-a0cb-463608583c22\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a9bbeff1-6dffc6987b-rgvt8"
Sep 09 13:40:35.897356 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:35.897333    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/240d25af-b957-415b-a0cb-463608583c22-maas-api-tls\") pod \"maas-api-e2e-ait-a9bbeff1-6dffc6987b-rgvt8\" (UID: \"240d25af-b957-415b-a0cb-463608583c22\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a9bbeff1-6dffc6987b-rgvt8"
Sep 09 13:40:35.927992 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:35.927959    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:40:35.998709 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:35.998677    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n89vr\" (UniqueName: \"kubernetes.io/projected/240d25af-b957-415b-a0cb-463608583c22-kube-api-access-n89vr\") pod \"maas-api-e2e-ait-a9bbeff1-6dffc6987b-rgvt8\" (UID: \"240d25af-b957-415b-a0cb-463608583c22\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a9bbeff1-6dffc6987b-rgvt8"
Sep 09 13:40:35.998860 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:35.998715    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/240d25af-b957-415b-a0cb-463608583c22-openshift-service-ca\") pod \"maas-api-e2e-ait-a9bbeff1-6dffc6987b-rgvt8\" (UID: \"240d25af-b957-415b-a0cb-463608583c22\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a9bbeff1-6dffc6987b-rgvt8"
Sep 09 13:40:35.998860 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:35.998776    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/240d25af-b957-415b-a0cb-463608583c22-metrics-certs\") pod \"maas-api-e2e-ait-a9bbeff1-6dffc6987b-rgvt8\" (UID: \"240d25af-b957-415b-a0cb-463608583c22\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a9bbeff1-6dffc6987b-rgvt8"
Sep 09 13:40:35.998860 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:35.998802    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/240d25af-b957-415b-a0cb-463608583c22-maas-api-tls\") pod \"maas-api-e2e-ait-a9bbeff1-6dffc6987b-rgvt8\" (UID: \"240d25af-b957-415b-a0cb-463608583c22\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a9bbeff1-6dffc6987b-rgvt8"
Sep 09 13:40:35.999400 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:35.999377    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/240d25af-b957-415b-a0cb-463608583c22-openshift-service-ca\") pod \"maas-api-e2e-ait-a9bbeff1-6dffc6987b-rgvt8\" (UID: \"240d25af-b957-415b-a0cb-463608583c22\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a9bbeff1-6dffc6987b-rgvt8"
Sep 09 13:40:36.001225 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:36.001207    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/240d25af-b957-415b-a0cb-463608583c22-metrics-certs\") pod \"maas-api-e2e-ait-a9bbeff1-6dffc6987b-rgvt8\" (UID: \"240d25af-b957-415b-a0cb-463608583c22\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a9bbeff1-6dffc6987b-rgvt8"
Sep 09 13:40:36.001318 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:36.001284    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/240d25af-b957-415b-a0cb-463608583c22-maas-api-tls\") pod \"maas-api-e2e-ait-a9bbeff1-6dffc6987b-rgvt8\" (UID: \"240d25af-b957-415b-a0cb-463608583c22\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a9bbeff1-6dffc6987b-rgvt8"
Sep 09 13:40:36.007153 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:36.007128    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n89vr\" (UniqueName: \"kubernetes.io/projected/240d25af-b957-415b-a0cb-463608583c22-kube-api-access-n89vr\") pod \"maas-api-e2e-ait-a9bbeff1-6dffc6987b-rgvt8\" (UID: \"240d25af-b957-415b-a0cb-463608583c22\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a9bbeff1-6dffc6987b-rgvt8"
Sep 09 13:40:36.054775 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:36.054706    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:40:36.111976 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:36.111948    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a9bbeff1-6dffc6987b-rgvt8"
Sep 09 13:40:36.344384 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:36.344294    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:40:36.388725 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:36.388702    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a9bbeff1-6dffc6987b-rgvt8"]
Sep 09 13:40:36.390789 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:40:36.390762    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod240d25af_b957_415b_a0cb_463608583c22.slice/crio-f0166b07e7e03a864e77c4fe4b43b4297625789a2b87e1b1f5fbe98a7d4b08e2 WatchSource:0}: Error finding container f0166b07e7e03a864e77c4fe4b43b4297625789a2b87e1b1f5fbe98a7d4b08e2: Status 404 returned error can't find the container with id f0166b07e7e03a864e77c4fe4b43b4297625789a2b87e1b1f5fbe98a7d4b08e2
Sep 09 13:40:36.438517 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:36.438481    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:40:36.454232 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:36.454199    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-a9bbeff1-7f7c56445d-w6mcd"]
Sep 09 13:40:36.458854 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:36.458832    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-a9bbeff1-7f7c56445d-w6mcd"
Sep 09 13:40:36.461597 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:36.461578    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-a9bbeff1-dockercfg-pvc5h\""
Sep 09 13:40:36.461699 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:36.461637    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-a9bbeff1\""
Sep 09 13:40:36.470310 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:36.470289    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-a9bbeff1-7f7c56445d-w6mcd"]
Sep 09 13:40:36.478320 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:36.478298    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-a9bbeff1-f747c59f5-6xczc"]
Sep 09 13:40:36.481608 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:36.481591    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-a9bbeff1-f747c59f5-6xczc"
Sep 09 13:40:36.495845 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:36.495821    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-a9bbeff1-f747c59f5-6xczc"]
Sep 09 13:40:36.605402 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:36.605314    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72w5c\" (UniqueName: \"kubernetes.io/projected/a09304a7-1604-4b6f-a3d4-24379ca0303b-kube-api-access-72w5c\") pod \"payload-processing-e2e-ait-a9bbeff1-f747c59f5-6xczc\" (UID: \"a09304a7-1604-4b6f-a3d4-24379ca0303b\") " pod="openshift-ingress/payload-processing-e2e-ait-a9bbeff1-f747c59f5-6xczc"
Sep 09 13:40:36.605402 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:36.605375    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a5dceb4c-f0a7-4a79-a923-2bd4c3b7b4a6-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-a9bbeff1-7f7c56445d-w6mcd\" (UID: \"a5dceb4c-f0a7-4a79-a923-2bd4c3b7b4a6\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-a9bbeff1-7f7c56445d-w6mcd"
Sep 09 13:40:36.605402 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:36.605396    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a09304a7-1604-4b6f-a3d4-24379ca0303b-plugins-config-volume\") pod \"payload-processing-e2e-ait-a9bbeff1-f747c59f5-6xczc\" (UID: \"a09304a7-1604-4b6f-a3d4-24379ca0303b\") " pod="openshift-ingress/payload-processing-e2e-ait-a9bbeff1-f747c59f5-6xczc"
Sep 09 13:40:36.605612 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:36.605508    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pw528\" (UniqueName: \"kubernetes.io/projected/a5dceb4c-f0a7-4a79-a923-2bd4c3b7b4a6-kube-api-access-pw528\") pod \"payload-pre-processing-e2e-ait-a9bbeff1-7f7c56445d-w6mcd\" (UID: \"a5dceb4c-f0a7-4a79-a923-2bd4c3b7b4a6\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-a9bbeff1-7f7c56445d-w6mcd"
Sep 09 13:40:36.706206 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:36.706154    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pw528\" (UniqueName: \"kubernetes.io/projected/a5dceb4c-f0a7-4a79-a923-2bd4c3b7b4a6-kube-api-access-pw528\") pod \"payload-pre-processing-e2e-ait-a9bbeff1-7f7c56445d-w6mcd\" (UID: \"a5dceb4c-f0a7-4a79-a923-2bd4c3b7b4a6\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-a9bbeff1-7f7c56445d-w6mcd"
Sep 09 13:40:36.706412 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:36.706221    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72w5c\" (UniqueName: \"kubernetes.io/projected/a09304a7-1604-4b6f-a3d4-24379ca0303b-kube-api-access-72w5c\") pod \"payload-processing-e2e-ait-a9bbeff1-f747c59f5-6xczc\" (UID: \"a09304a7-1604-4b6f-a3d4-24379ca0303b\") " pod="openshift-ingress/payload-processing-e2e-ait-a9bbeff1-f747c59f5-6xczc"
Sep 09 13:40:36.706412 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:36.706270    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a5dceb4c-f0a7-4a79-a923-2bd4c3b7b4a6-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-a9bbeff1-7f7c56445d-w6mcd\" (UID: \"a5dceb4c-f0a7-4a79-a923-2bd4c3b7b4a6\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-a9bbeff1-7f7c56445d-w6mcd"
Sep 09 13:40:36.706412 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:36.706289    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a09304a7-1604-4b6f-a3d4-24379ca0303b-plugins-config-volume\") pod \"payload-processing-e2e-ait-a9bbeff1-f747c59f5-6xczc\" (UID: \"a09304a7-1604-4b6f-a3d4-24379ca0303b\") " pod="openshift-ingress/payload-processing-e2e-ait-a9bbeff1-f747c59f5-6xczc"
Sep 09 13:40:36.706920 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:36.706895    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a5dceb4c-f0a7-4a79-a923-2bd4c3b7b4a6-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-a9bbeff1-7f7c56445d-w6mcd\" (UID: \"a5dceb4c-f0a7-4a79-a923-2bd4c3b7b4a6\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-a9bbeff1-7f7c56445d-w6mcd"
Sep 09 13:40:36.707023 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:36.706902    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a09304a7-1604-4b6f-a3d4-24379ca0303b-plugins-config-volume\") pod \"payload-processing-e2e-ait-a9bbeff1-f747c59f5-6xczc\" (UID: \"a09304a7-1604-4b6f-a3d4-24379ca0303b\") " pod="openshift-ingress/payload-processing-e2e-ait-a9bbeff1-f747c59f5-6xczc"
Sep 09 13:40:36.719606 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:36.719576    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72w5c\" (UniqueName: \"kubernetes.io/projected/a09304a7-1604-4b6f-a3d4-24379ca0303b-kube-api-access-72w5c\") pod \"payload-processing-e2e-ait-a9bbeff1-f747c59f5-6xczc\" (UID: \"a09304a7-1604-4b6f-a3d4-24379ca0303b\") " pod="openshift-ingress/payload-processing-e2e-ait-a9bbeff1-f747c59f5-6xczc"
Sep 09 13:40:36.719728 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:36.719703    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pw528\" (UniqueName: \"kubernetes.io/projected/a5dceb4c-f0a7-4a79-a923-2bd4c3b7b4a6-kube-api-access-pw528\") pod \"payload-pre-processing-e2e-ait-a9bbeff1-7f7c56445d-w6mcd\" (UID: \"a5dceb4c-f0a7-4a79-a923-2bd4c3b7b4a6\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-a9bbeff1-7f7c56445d-w6mcd"
Sep 09 13:40:36.769789 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:36.769768    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-a9bbeff1-7f7c56445d-w6mcd"
Sep 09 13:40:36.794782 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:36.794751    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-a9bbeff1-f747c59f5-6xczc"
Sep 09 13:40:37.042732 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:37.042708    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-a9bbeff1-7f7c56445d-w6mcd"]
Sep 09 13:40:37.044681 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:40:37.044650    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5dceb4c_f0a7_4a79_a923_2bd4c3b7b4a6.slice/crio-55aaa2f16e72d39cbd735a044dcc863e4a1362508f0e84c35bfd488243c491d0 WatchSource:0}: Error finding container 55aaa2f16e72d39cbd735a044dcc863e4a1362508f0e84c35bfd488243c491d0: Status 404 returned error can't find the container with id 55aaa2f16e72d39cbd735a044dcc863e4a1362508f0e84c35bfd488243c491d0
Sep 09 13:40:37.077356 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:37.077329    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-a9bbeff1-f747c59f5-6xczc"]
Sep 09 13:40:37.080278 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:40:37.080254    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda09304a7_1604_4b6f_a3d4_24379ca0303b.slice/crio-24ada0c03d29090af88b39bdd9bdd281a978195a8bd543a3b622f7bbe3b92580 WatchSource:0}: Error finding container 24ada0c03d29090af88b39bdd9bdd281a978195a8bd543a3b622f7bbe3b92580: Status 404 returned error can't find the container with id 24ada0c03d29090af88b39bdd9bdd281a978195a8bd543a3b622f7bbe3b92580
Sep 09 13:40:37.316830 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:37.316800    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-a9bbeff1-7f7c56445d-w6mcd" event={"ID":"a5dceb4c-f0a7-4a79-a923-2bd4c3b7b4a6","Type":"ContainerStarted","Data":"8a6f8477d5e0a561b3c07e1e1e80307c338e3b826c533e0abb3cc6f9754ec552"}
Sep 09 13:40:37.317018 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:37.316857    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-a9bbeff1-7f7c56445d-w6mcd" event={"ID":"a5dceb4c-f0a7-4a79-a923-2bd4c3b7b4a6","Type":"ContainerStarted","Data":"55aaa2f16e72d39cbd735a044dcc863e4a1362508f0e84c35bfd488243c491d0"}
Sep 09 13:40:37.317018 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:37.316889    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-a9bbeff1-7f7c56445d-w6mcd"
Sep 09 13:40:37.318661 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:37.318632    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a9bbeff1-6dffc6987b-rgvt8" event={"ID":"240d25af-b957-415b-a0cb-463608583c22","Type":"ContainerStarted","Data":"1db962cb4c4e7aa4b29406cf4782106de09493a20866126da04a508abb12c7e9"}
Sep 09 13:40:37.318802 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:37.318688    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a9bbeff1-6dffc6987b-rgvt8" event={"ID":"240d25af-b957-415b-a0cb-463608583c22","Type":"ContainerStarted","Data":"f0166b07e7e03a864e77c4fe4b43b4297625789a2b87e1b1f5fbe98a7d4b08e2"}
Sep 09 13:40:37.318802 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:37.318717    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a9bbeff1-6dffc6987b-rgvt8"
Sep 09 13:40:37.320411 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:37.320383    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-a9bbeff1-f747c59f5-6xczc" event={"ID":"a09304a7-1604-4b6f-a3d4-24379ca0303b","Type":"ContainerStarted","Data":"1bcff7688c6b68f2af58dd3f7dbbf48965f9a9e476f7b102a00758707791ead2"}
Sep 09 13:40:37.320523 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:37.320432    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-a9bbeff1-f747c59f5-6xczc" event={"ID":"a09304a7-1604-4b6f-a3d4-24379ca0303b","Type":"ContainerStarted","Data":"24ada0c03d29090af88b39bdd9bdd281a978195a8bd543a3b622f7bbe3b92580"}
Sep 09 13:40:37.320523 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:37.320460    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-a9bbeff1-f747c59f5-6xczc"
Sep 09 13:40:37.338101 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:37.338048    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-a9bbeff1-7f7c56445d-w6mcd" podStartSLOduration=1.3380310899999999 podStartE2EDuration="1.33803109s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 13:40:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 13:40:37.336104323 +0000 UTC m=+849.151628538" watchObservedRunningTime="2026-09-09 13:40:37.33803109 +0000 UTC m=+849.153555284"
Sep 09 13:40:37.357906 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:37.357853    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a9bbeff1-6dffc6987b-rgvt8" podStartSLOduration=2.026471506 podStartE2EDuration="2.35783639s" totalImagesPullingTime="331.364884ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 13:40:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 13:40:37.357122421 +0000 UTC m=+849.172646618" watchObservedRunningTime="2026-09-09 13:40:37.35783639 +0000 UTC m=+849.173360584"
Sep 09 13:40:37.376915 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:37.376856    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-a9bbeff1-f747c59f5-6xczc" podStartSLOduration=1.376838737 podStartE2EDuration="1.376838737s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 13:40:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 13:40:37.376202499 +0000 UTC m=+849.191726721" watchObservedRunningTime="2026-09-09 13:40:37.376838737 +0000 UTC m=+849.192362931"
Sep 09 13:40:42.876399 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:42.876364    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:40:43.331702 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:43.331612    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a9bbeff1-6dffc6987b-rgvt8"
Sep 09 13:40:43.858435 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:43.858407    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:40:48.328916 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:48.328881    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-a9bbeff1-7f7c56445d-w6mcd"
Sep 09 13:40:48.329318 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:48.328974    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-a9bbeff1-f747c59f5-6xczc"
Sep 09 13:40:50.161949 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:50.161861    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:40:53.418153 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:53.418111    2578 generic.go:356] "Generic (PLEG): container finished" podID="803b566b-b66a-45e5-bf1f-20be0a978c32" containerID="5cb4f2b770e0d6b8933ff10d9a6d38e9a419f67559a7bf3d4f3ed8e970918145" exitCode=0
Sep 09 13:40:53.418568 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:53.418170    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c" event={"ID":"803b566b-b66a-45e5-bf1f-20be0a978c32","Type":"ContainerDied","Data":"5cb4f2b770e0d6b8933ff10d9a6d38e9a419f67559a7bf3d4f3ed8e970918145"}
Sep 09 13:40:53.418620 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:53.418603    2578 scope.go:117] "RemoveContainer" containerID="5cb4f2b770e0d6b8933ff10d9a6d38e9a419f67559a7bf3d4f3ed8e970918145"
Sep 09 13:40:53.420691 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:53.420660    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 13:40:53.420752 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:53.420728    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 13:40:53.420788 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:53.420758    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 13:40:54.426136 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:54.426101    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c" event={"ID":"803b566b-b66a-45e5-bf1f-20be0a978c32","Type":"ContainerStarted","Data":"b79f097474b7790c63c88d1295154e8a0696bffcc0664c005d768106ffa527e9"}
Sep 09 13:40:54.444478 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:54.444454    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c"
Sep 09 13:40:54.444718 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:54.444697    2578 patch_prober.go:28] interesting pod/e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Sep 09 13:40:54.444765 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:54.444742    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c" podUID="803b566b-b66a-45e5-bf1f-20be0a978c32" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Sep 09 13:40:55.445076 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:55.445043    2578 patch_prober.go:28] interesting pod/e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Sep 09 13:40:55.445476 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:55.445108    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c" podUID="803b566b-b66a-45e5-bf1f-20be0a978c32" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Sep 09 13:40:56.444503 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:56.444468    2578 patch_prober.go:28] interesting pod/e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Sep 09 13:40:56.444683 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:56.444528    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c" podUID="803b566b-b66a-45e5-bf1f-20be0a978c32" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Sep 09 13:40:57.445083 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:57.445043    2578 patch_prober.go:28] interesting pod/e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Sep 09 13:40:57.445612 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:57.445107    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c" podUID="803b566b-b66a-45e5-bf1f-20be0a978c32" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Sep 09 13:40:58.444329 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:58.444291    2578 patch_prober.go:28] interesting pod/e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Sep 09 13:40:58.444519 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:58.444356    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c" podUID="803b566b-b66a-45e5-bf1f-20be0a978c32" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Sep 09 13:40:59.444561 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:59.444525    2578 patch_prober.go:28] interesting pod/e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Sep 09 13:40:59.444960 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:59.444581    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c" podUID="803b566b-b66a-45e5-bf1f-20be0a978c32" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Sep 09 13:40:59.771659 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:40:59.771565    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:41:00.450442 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:00.450414    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c"
Sep 09 13:41:00.451294 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:00.451254    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c"
Sep 09 13:41:00.451747 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:00.451727    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c"
Sep 09 13:41:06.331911 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:06.331876    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a9bbeff1-6dffc6987b-rgvt8"]
Sep 09 13:41:06.332432 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:06.332122    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a9bbeff1-6dffc6987b-rgvt8" podUID="240d25af-b957-415b-a0cb-463608583c22" containerName="maas-api" containerID="cri-o://1db962cb4c4e7aa4b29406cf4782106de09493a20866126da04a508abb12c7e9" gracePeriod=30
Sep 09 13:41:06.362662 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:06.362630    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:41:06.385751 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:06.385723    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-a9bbeff1-f747c59f5-6xczc"]
Sep 09 13:41:06.385938 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:06.385914    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-a9bbeff1-f747c59f5-6xczc" podUID="a09304a7-1604-4b6f-a3d4-24379ca0303b" containerName="payload-processing" containerID="cri-o://1bcff7688c6b68f2af58dd3f7dbbf48965f9a9e476f7b102a00758707791ead2" gracePeriod=30
Sep 09 13:41:06.397048 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:06.397016    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-a9bbeff1-7f7c56445d-w6mcd"]
Sep 09 13:41:06.397299 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:06.397264    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-a9bbeff1-7f7c56445d-w6mcd" podUID="a5dceb4c-f0a7-4a79-a923-2bd4c3b7b4a6" containerName="payload-pre-processing" containerID="cri-o://8a6f8477d5e0a561b3c07e1e1e80307c338e3b826c533e0abb3cc6f9754ec552" gracePeriod=30
Sep 09 13:41:06.463012 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:06.462971    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:41:06.486936 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:06.486901    2578 generic.go:356] "Generic (PLEG): container finished" podID="240d25af-b957-415b-a0cb-463608583c22" containerID="1db962cb4c4e7aa4b29406cf4782106de09493a20866126da04a508abb12c7e9" exitCode=0
Sep 09 13:41:06.487114 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:06.486976    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a9bbeff1-6dffc6987b-rgvt8" event={"ID":"240d25af-b957-415b-a0cb-463608583c22","Type":"ContainerDied","Data":"1db962cb4c4e7aa4b29406cf4782106de09493a20866126da04a508abb12c7e9"}
Sep 09 13:41:06.549791 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:06.549754    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:41:06.612451 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:06.612422    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:41:06.685720 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:06.685698    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-a9bbeff1-f747c59f5-6xczc"
Sep 09 13:41:06.688912 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:06.688893    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a9bbeff1-6dffc6987b-rgvt8"
Sep 09 13:41:06.692398 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:06.692377    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-a9bbeff1-7f7c56445d-w6mcd"
Sep 09 13:41:06.776505 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:06.776475    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a5dceb4c-f0a7-4a79-a923-2bd4c3b7b4a6-plugins-config-volume\") pod \"a5dceb4c-f0a7-4a79-a923-2bd4c3b7b4a6\" (UID: \"a5dceb4c-f0a7-4a79-a923-2bd4c3b7b4a6\") "
Sep 09 13:41:06.776670 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:06.776516    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/240d25af-b957-415b-a0cb-463608583c22-metrics-certs\") pod \"240d25af-b957-415b-a0cb-463608583c22\" (UID: \"240d25af-b957-415b-a0cb-463608583c22\") "
Sep 09 13:41:06.776670 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:06.776549    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/240d25af-b957-415b-a0cb-463608583c22-openshift-service-ca\") pod \"240d25af-b957-415b-a0cb-463608583c22\" (UID: \"240d25af-b957-415b-a0cb-463608583c22\") "
Sep 09 13:41:06.776670 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:06.776579    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n89vr\" (UniqueName: \"kubernetes.io/projected/240d25af-b957-415b-a0cb-463608583c22-kube-api-access-n89vr\") pod \"240d25af-b957-415b-a0cb-463608583c22\" (UID: \"240d25af-b957-415b-a0cb-463608583c22\") "
Sep 09 13:41:06.776670 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:06.776635    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/240d25af-b957-415b-a0cb-463608583c22-maas-api-tls\") pod \"240d25af-b957-415b-a0cb-463608583c22\" (UID: \"240d25af-b957-415b-a0cb-463608583c22\") "
Sep 09 13:41:06.776670 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:06.776650    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-72w5c\" (UniqueName: \"kubernetes.io/projected/a09304a7-1604-4b6f-a3d4-24379ca0303b-kube-api-access-72w5c\") pod \"a09304a7-1604-4b6f-a3d4-24379ca0303b\" (UID: \"a09304a7-1604-4b6f-a3d4-24379ca0303b\") "
Sep 09 13:41:06.776932 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:06.776675    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pw528\" (UniqueName: \"kubernetes.io/projected/a5dceb4c-f0a7-4a79-a923-2bd4c3b7b4a6-kube-api-access-pw528\") pod \"a5dceb4c-f0a7-4a79-a923-2bd4c3b7b4a6\" (UID: \"a5dceb4c-f0a7-4a79-a923-2bd4c3b7b4a6\") "
Sep 09 13:41:06.776932 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:06.776723    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a09304a7-1604-4b6f-a3d4-24379ca0303b-plugins-config-volume\") pod \"a09304a7-1604-4b6f-a3d4-24379ca0303b\" (UID: \"a09304a7-1604-4b6f-a3d4-24379ca0303b\") "
Sep 09 13:41:06.777050 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:06.776986    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5dceb4c-f0a7-4a79-a923-2bd4c3b7b4a6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a5dceb4c-f0a7-4a79-a923-2bd4c3b7b4a6" (UID: "a5dceb4c-f0a7-4a79-a923-2bd4c3b7b4a6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 13:41:06.777317 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:06.777290    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/240d25af-b957-415b-a0cb-463608583c22-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "240d25af-b957-415b-a0cb-463608583c22" (UID: "240d25af-b957-415b-a0cb-463608583c22"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 13:41:06.777476 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:06.777313    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a09304a7-1604-4b6f-a3d4-24379ca0303b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a09304a7-1604-4b6f-a3d4-24379ca0303b" (UID: "a09304a7-1604-4b6f-a3d4-24379ca0303b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 13:41:06.778903 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:06.778881    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5dceb4c-f0a7-4a79-a923-2bd4c3b7b4a6-kube-api-access-pw528" (OuterVolumeSpecName: "kube-api-access-pw528") pod "a5dceb4c-f0a7-4a79-a923-2bd4c3b7b4a6" (UID: "a5dceb4c-f0a7-4a79-a923-2bd4c3b7b4a6"). InnerVolumeSpecName "kube-api-access-pw528". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 13:41:06.779093 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:06.779073    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/240d25af-b957-415b-a0cb-463608583c22-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "240d25af-b957-415b-a0cb-463608583c22" (UID: "240d25af-b957-415b-a0cb-463608583c22"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 13:41:06.779208 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:06.779069    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/240d25af-b957-415b-a0cb-463608583c22-kube-api-access-n89vr" (OuterVolumeSpecName: "kube-api-access-n89vr") pod "240d25af-b957-415b-a0cb-463608583c22" (UID: "240d25af-b957-415b-a0cb-463608583c22"). InnerVolumeSpecName "kube-api-access-n89vr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 13:41:06.779208 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:06.779165    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/240d25af-b957-415b-a0cb-463608583c22-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "240d25af-b957-415b-a0cb-463608583c22" (UID: "240d25af-b957-415b-a0cb-463608583c22"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 13:41:06.779333 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:06.779204    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a09304a7-1604-4b6f-a3d4-24379ca0303b-kube-api-access-72w5c" (OuterVolumeSpecName: "kube-api-access-72w5c") pod "a09304a7-1604-4b6f-a3d4-24379ca0303b" (UID: "a09304a7-1604-4b6f-a3d4-24379ca0303b"). InnerVolumeSpecName "kube-api-access-72w5c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 13:41:06.877602 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:06.877573    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a5dceb4c-f0a7-4a79-a923-2bd4c3b7b4a6-plugins-config-volume\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:41:06.877602 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:06.877603    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/240d25af-b957-415b-a0cb-463608583c22-metrics-certs\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:41:06.877784 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:06.877613    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/240d25af-b957-415b-a0cb-463608583c22-openshift-service-ca\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:41:06.877784 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:06.877627    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n89vr\" (UniqueName: \"kubernetes.io/projected/240d25af-b957-415b-a0cb-463608583c22-kube-api-access-n89vr\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:41:06.877784 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:06.877637    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/240d25af-b957-415b-a0cb-463608583c22-maas-api-tls\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:41:06.877784 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:06.877646    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-72w5c\" (UniqueName: \"kubernetes.io/projected/a09304a7-1604-4b6f-a3d4-24379ca0303b-kube-api-access-72w5c\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:41:06.877784 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:06.877654    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pw528\" (UniqueName: \"kubernetes.io/projected/a5dceb4c-f0a7-4a79-a923-2bd4c3b7b4a6-kube-api-access-pw528\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:41:06.877784 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:06.877663    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a09304a7-1604-4b6f-a3d4-24379ca0303b-plugins-config-volume\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:41:07.493356 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:07.493325    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a9bbeff1-6dffc6987b-rgvt8"
Sep 09 13:41:07.493821 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:07.493356    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a9bbeff1-6dffc6987b-rgvt8" event={"ID":"240d25af-b957-415b-a0cb-463608583c22","Type":"ContainerDied","Data":"f0166b07e7e03a864e77c4fe4b43b4297625789a2b87e1b1f5fbe98a7d4b08e2"}
Sep 09 13:41:07.493821 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:07.493423    2578 scope.go:117] "RemoveContainer" containerID="1db962cb4c4e7aa4b29406cf4782106de09493a20866126da04a508abb12c7e9"
Sep 09 13:41:07.494897 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:07.494827    2578 generic.go:356] "Generic (PLEG): container finished" podID="a09304a7-1604-4b6f-a3d4-24379ca0303b" containerID="1bcff7688c6b68f2af58dd3f7dbbf48965f9a9e476f7b102a00758707791ead2" exitCode=0
Sep 09 13:41:07.494897 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:07.494870    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-a9bbeff1-f747c59f5-6xczc"
Sep 09 13:41:07.495031 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:07.494936    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-a9bbeff1-f747c59f5-6xczc" event={"ID":"a09304a7-1604-4b6f-a3d4-24379ca0303b","Type":"ContainerDied","Data":"1bcff7688c6b68f2af58dd3f7dbbf48965f9a9e476f7b102a00758707791ead2"}
Sep 09 13:41:07.495031 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:07.495005    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-a9bbeff1-f747c59f5-6xczc" event={"ID":"a09304a7-1604-4b6f-a3d4-24379ca0303b","Type":"ContainerDied","Data":"24ada0c03d29090af88b39bdd9bdd281a978195a8bd543a3b622f7bbe3b92580"}
Sep 09 13:41:07.496371 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:07.496350    2578 generic.go:356] "Generic (PLEG): container finished" podID="a5dceb4c-f0a7-4a79-a923-2bd4c3b7b4a6" containerID="8a6f8477d5e0a561b3c07e1e1e80307c338e3b826c533e0abb3cc6f9754ec552" exitCode=0
Sep 09 13:41:07.496494 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:07.496377    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-a9bbeff1-7f7c56445d-w6mcd" event={"ID":"a5dceb4c-f0a7-4a79-a923-2bd4c3b7b4a6","Type":"ContainerDied","Data":"8a6f8477d5e0a561b3c07e1e1e80307c338e3b826c533e0abb3cc6f9754ec552"}
Sep 09 13:41:07.496494 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:07.496389    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-a9bbeff1-7f7c56445d-w6mcd"
Sep 09 13:41:07.496494 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:07.496425    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-a9bbeff1-7f7c56445d-w6mcd" event={"ID":"a5dceb4c-f0a7-4a79-a923-2bd4c3b7b4a6","Type":"ContainerDied","Data":"55aaa2f16e72d39cbd735a044dcc863e4a1362508f0e84c35bfd488243c491d0"}
Sep 09 13:41:07.504590 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:07.504564    2578 scope.go:117] "RemoveContainer" containerID="1bcff7688c6b68f2af58dd3f7dbbf48965f9a9e476f7b102a00758707791ead2"
Sep 09 13:41:07.516636 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:07.516616    2578 scope.go:117] "RemoveContainer" containerID="1bcff7688c6b68f2af58dd3f7dbbf48965f9a9e476f7b102a00758707791ead2"
Sep 09 13:41:07.516935 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:41:07.516915    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1bcff7688c6b68f2af58dd3f7dbbf48965f9a9e476f7b102a00758707791ead2\": container with ID starting with 1bcff7688c6b68f2af58dd3f7dbbf48965f9a9e476f7b102a00758707791ead2 not found: ID does not exist" containerID="1bcff7688c6b68f2af58dd3f7dbbf48965f9a9e476f7b102a00758707791ead2"
Sep 09 13:41:07.516996 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:07.516943    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bcff7688c6b68f2af58dd3f7dbbf48965f9a9e476f7b102a00758707791ead2"} err="failed to get container status \"1bcff7688c6b68f2af58dd3f7dbbf48965f9a9e476f7b102a00758707791ead2\": rpc error: code = NotFound desc = could not find container \"1bcff7688c6b68f2af58dd3f7dbbf48965f9a9e476f7b102a00758707791ead2\": container with ID starting with 1bcff7688c6b68f2af58dd3f7dbbf48965f9a9e476f7b102a00758707791ead2 not found: ID does not exist"
Sep 09 13:41:07.516996 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:07.516959    2578 scope.go:117] "RemoveContainer" containerID="8a6f8477d5e0a561b3c07e1e1e80307c338e3b826c533e0abb3cc6f9754ec552"
Sep 09 13:41:07.525684 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:07.525633    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a9bbeff1-6dffc6987b-rgvt8"]
Sep 09 13:41:07.525734 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:07.525711    2578 scope.go:117] "RemoveContainer" containerID="8a6f8477d5e0a561b3c07e1e1e80307c338e3b826c533e0abb3cc6f9754ec552"
Sep 09 13:41:07.525981 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:41:07.525963    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a6f8477d5e0a561b3c07e1e1e80307c338e3b826c533e0abb3cc6f9754ec552\": container with ID starting with 8a6f8477d5e0a561b3c07e1e1e80307c338e3b826c533e0abb3cc6f9754ec552 not found: ID does not exist" containerID="8a6f8477d5e0a561b3c07e1e1e80307c338e3b826c533e0abb3cc6f9754ec552"
Sep 09 13:41:07.526037 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:07.525984    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a6f8477d5e0a561b3c07e1e1e80307c338e3b826c533e0abb3cc6f9754ec552"} err="failed to get container status \"8a6f8477d5e0a561b3c07e1e1e80307c338e3b826c533e0abb3cc6f9754ec552\": rpc error: code = NotFound desc = could not find container \"8a6f8477d5e0a561b3c07e1e1e80307c338e3b826c533e0abb3cc6f9754ec552\": container with ID starting with 8a6f8477d5e0a561b3c07e1e1e80307c338e3b826c533e0abb3cc6f9754ec552 not found: ID does not exist"
Sep 09 13:41:07.528963 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:07.528942    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a9bbeff1-6dffc6987b-rgvt8"]
Sep 09 13:41:07.539673 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:07.539649    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-a9bbeff1-7f7c56445d-w6mcd"]
Sep 09 13:41:07.544218 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:07.544199    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-a9bbeff1-7f7c56445d-w6mcd"]
Sep 09 13:41:07.555027 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:07.554999    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-a9bbeff1-f747c59f5-6xczc"]
Sep 09 13:41:07.561475 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:07.561454    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-a9bbeff1-f747c59f5-6xczc"]
Sep 09 13:41:07.648168 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:07.648141    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c"]
Sep 09 13:41:07.648462 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:07.648439    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c" podUID="803b566b-b66a-45e5-bf1f-20be0a978c32" containerName="istio-proxy" containerID="cri-o://b79f097474b7790c63c88d1295154e8a0696bffcc0664c005d768106ffa527e9" gracePeriod=30
Sep 09 13:41:07.673576 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:07.673543    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:41:08.077807 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:08.077723    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:41:08.345873 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:08.345802    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx"]
Sep 09 13:41:08.346222 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:08.346206    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="240d25af-b957-415b-a0cb-463608583c22" containerName="maas-api"
Sep 09 13:41:08.346222 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:08.346222    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="240d25af-b957-415b-a0cb-463608583c22" containerName="maas-api"
Sep 09 13:41:08.346317 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:08.346247    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a09304a7-1604-4b6f-a3d4-24379ca0303b" containerName="payload-processing"
Sep 09 13:41:08.346317 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:08.346254    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a09304a7-1604-4b6f-a3d4-24379ca0303b" containerName="payload-processing"
Sep 09 13:41:08.346317 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:08.346264    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5dceb4c-f0a7-4a79-a923-2bd4c3b7b4a6" containerName="payload-pre-processing"
Sep 09 13:41:08.346317 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:08.346269    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5dceb4c-f0a7-4a79-a923-2bd4c3b7b4a6" containerName="payload-pre-processing"
Sep 09 13:41:08.346436 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:08.346328    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5dceb4c-f0a7-4a79-a923-2bd4c3b7b4a6" containerName="payload-pre-processing"
Sep 09 13:41:08.346436 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:08.346339    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a09304a7-1604-4b6f-a3d4-24379ca0303b" containerName="payload-processing"
Sep 09 13:41:08.346436 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:08.346348    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="240d25af-b957-415b-a0cb-463608583c22" containerName="maas-api"
Sep 09 13:41:08.349060 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:08.349040    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx"
Sep 09 13:41:08.351769 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:08.351748    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-4ecd209d-openshift-default-dockercfg-djqql\""
Sep 09 13:41:08.362952 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:08.362924    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx"]
Sep 09 13:41:08.377792 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:08.377759    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:41:08.387029 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:08.386993    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c-istio-data\") pod \"e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx\" (UID: \"ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c\") " pod="openshift-ingress/e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx"
Sep 09 13:41:08.387159 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:08.387042    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c-credential-socket\") pod \"e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx\" (UID: \"ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c\") " pod="openshift-ingress/e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx"
Sep 09 13:41:08.387159 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:08.387092    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c-workload-socket\") pod \"e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx\" (UID: \"ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c\") " pod="openshift-ingress/e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx"
Sep 09 13:41:08.387159 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:08.387122    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c-istio-envoy\") pod \"e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx\" (UID: \"ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c\") " pod="openshift-ingress/e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx"
Sep 09 13:41:08.387159 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:08.387146    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c-istiod-ca-cert\") pod \"e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx\" (UID: \"ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c\") " pod="openshift-ingress/e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx"
Sep 09 13:41:08.387359 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:08.387344    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c-workload-certs\") pod \"e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx\" (UID: \"ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c\") " pod="openshift-ingress/e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx"
Sep 09 13:41:08.387397 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:08.387387    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c-istio-podinfo\") pod \"e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx\" (UID: \"ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c\") " pod="openshift-ingress/e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx"
Sep 09 13:41:08.387452 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:08.387440    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bd7m2\" (UniqueName: \"kubernetes.io/projected/ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c-kube-api-access-bd7m2\") pod \"e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx\" (UID: \"ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c\") " pod="openshift-ingress/e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx"
Sep 09 13:41:08.387529 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:08.387518    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c-istio-token\") pod \"e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx\" (UID: \"ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c\") " pod="openshift-ingress/e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx"
Sep 09 13:41:08.488518 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:08.488478    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c-istio-token\") pod \"e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx\" (UID: \"ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c\") " pod="openshift-ingress/e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx"
Sep 09 13:41:08.488518 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:08.488523    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c-istio-data\") pod \"e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx\" (UID: \"ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c\") " pod="openshift-ingress/e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx"
Sep 09 13:41:08.488754 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:08.488552    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c-credential-socket\") pod \"e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx\" (UID: \"ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c\") " pod="openshift-ingress/e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx"
Sep 09 13:41:08.488754 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:08.488577    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c-workload-socket\") pod \"e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx\" (UID: \"ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c\") " pod="openshift-ingress/e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx"
Sep 09 13:41:08.488754 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:08.488592    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c-istio-envoy\") pod \"e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx\" (UID: \"ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c\") " pod="openshift-ingress/e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx"
Sep 09 13:41:08.488754 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:08.488608    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c-istiod-ca-cert\") pod \"e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx\" (UID: \"ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c\") " pod="openshift-ingress/e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx"
Sep 09 13:41:08.488754 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:08.488642    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c-workload-certs\") pod \"e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx\" (UID: \"ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c\") " pod="openshift-ingress/e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx"
Sep 09 13:41:08.488754 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:08.488677    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c-istio-podinfo\") pod \"e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx\" (UID: \"ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c\") " pod="openshift-ingress/e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx"
Sep 09 13:41:08.488754 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:08.488726    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bd7m2\" (UniqueName: \"kubernetes.io/projected/ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c-kube-api-access-bd7m2\") pod \"e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx\" (UID: \"ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c\") " pod="openshift-ingress/e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx"
Sep 09 13:41:08.489126 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:08.489029    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c-istio-data\") pod \"e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx\" (UID: \"ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c\") " pod="openshift-ingress/e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx"
Sep 09 13:41:08.489126 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:08.489079    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c-workload-certs\") pod \"e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx\" (UID: \"ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c\") " pod="openshift-ingress/e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx"
Sep 09 13:41:08.489126 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:08.489111    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c-credential-socket\") pod \"e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx\" (UID: \"ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c\") " pod="openshift-ingress/e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx"
Sep 09 13:41:08.489255 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:08.489147    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c-workload-socket\") pod \"e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx\" (UID: \"ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c\") " pod="openshift-ingress/e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx"
Sep 09 13:41:08.489645 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:08.489626    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c-istiod-ca-cert\") pod \"e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx\" (UID: \"ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c\") " pod="openshift-ingress/e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx"
Sep 09 13:41:08.490836 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:08.490815    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c-istio-envoy\") pod \"e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx\" (UID: \"ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c\") " pod="openshift-ingress/e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx"
Sep 09 13:41:08.491137 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:08.491121    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c-istio-podinfo\") pod \"e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx\" (UID: \"ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c\") " pod="openshift-ingress/e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx"
Sep 09 13:41:08.496528 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:08.496507    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c-istio-token\") pod \"e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx\" (UID: \"ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c\") " pod="openshift-ingress/e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx"
Sep 09 13:41:08.496884 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:08.496753    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bd7m2\" (UniqueName: \"kubernetes.io/projected/ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c-kube-api-access-bd7m2\") pod \"e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx\" (UID: \"ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c\") " pod="openshift-ingress/e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx"
Sep 09 13:41:08.659092 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:08.659059    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx"
Sep 09 13:41:08.662188 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:08.662145    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="240d25af-b957-415b-a0cb-463608583c22" path="/var/lib/kubelet/pods/240d25af-b957-415b-a0cb-463608583c22/volumes"
Sep 09 13:41:08.662562 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:08.662547    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a09304a7-1604-4b6f-a3d4-24379ca0303b" path="/var/lib/kubelet/pods/a09304a7-1604-4b6f-a3d4-24379ca0303b/volumes"
Sep 09 13:41:08.662864 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:08.662849    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5dceb4c-f0a7-4a79-a923-2bd4c3b7b4a6" path="/var/lib/kubelet/pods/a5dceb4c-f0a7-4a79-a923-2bd4c3b7b4a6/volumes"
Sep 09 13:41:08.666586 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:08.666563    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:41:08.939998 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:08.939973    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx"]
Sep 09 13:41:08.941936 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:41:08.941908    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce5bd2e6_b943_4fe4_80ac_5ea5d21f4f5c.slice/crio-c8e2ecec0a93d4f0be3479b22147857df6094484393e912873253aad334fb771 WatchSource:0}: Error finding container c8e2ecec0a93d4f0be3479b22147857df6094484393e912873253aad334fb771: Status 404 returned error can't find the container with id c8e2ecec0a93d4f0be3479b22147857df6094484393e912873253aad334fb771
Sep 09 13:41:08.944154 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:08.944121    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 13:41:08.944276 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:08.944204    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 13:41:08.944276 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:08.944235    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 13:41:09.509797 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:09.509763    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx" event={"ID":"ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c","Type":"ContainerStarted","Data":"819c57626c98e004a2468cad6b1ebb8c7b7f021647cf0cb0dd12d9125e059bee"}
Sep 09 13:41:09.510128 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:09.509824    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx" event={"ID":"ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c","Type":"ContainerStarted","Data":"c8e2ecec0a93d4f0be3479b22147857df6094484393e912873253aad334fb771"}
Sep 09 13:41:09.530796 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:09.530745    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx" podStartSLOduration=1.530728106 podStartE2EDuration="1.530728106s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 13:41:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 13:41:09.52914409 +0000 UTC m=+881.344668298" watchObservedRunningTime="2026-09-09 13:41:09.530728106 +0000 UTC m=+881.346252300"
Sep 09 13:41:09.659727 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:09.659688    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx"
Sep 09 13:41:10.665005 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:10.664980    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx"
Sep 09 13:41:10.920360 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:10.920274    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:41:11.046334 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:11.046299    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:41:11.519842 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:11.519814    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx"
Sep 09 13:41:11.521240 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:11.521217    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx"
Sep 09 13:41:12.080502 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:12.080469    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:41:12.182531 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:12.182499    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:41:12.279516 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:12.279476    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:41:12.616466 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:12.616430    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:41:12.708081 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:12.708047    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-4ecd209d-798c694874-8rmbf"]
Sep 09 13:41:12.710396 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:12.710380    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-4ecd209d-798c694874-8rmbf"
Sep 09 13:41:12.712473 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:12.712451    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:41:12.713044 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:12.713027    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-4ecd209d\""
Sep 09 13:41:12.721848 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:12.721819    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-4ecd209d-798c694874-8rmbf"]
Sep 09 13:41:12.726133 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:12.726105    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6h44\" (UniqueName: \"kubernetes.io/projected/7be31b12-1686-4918-a80f-3032004c2505-kube-api-access-b6h44\") pod \"payload-pre-processing-e2e-derive-4ecd209d-798c694874-8rmbf\" (UID: \"7be31b12-1686-4918-a80f-3032004c2505\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-4ecd209d-798c694874-8rmbf"
Sep 09 13:41:12.726255 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:12.726158    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7be31b12-1686-4918-a80f-3032004c2505-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-4ecd209d-798c694874-8rmbf\" (UID: \"7be31b12-1686-4918-a80f-3032004c2505\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-4ecd209d-798c694874-8rmbf"
Sep 09 13:41:12.740822 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:12.740792    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-4ecd209d-66d5b677c-tst6v"]
Sep 09 13:41:12.743758 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:12.743735    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-4ecd209d-66d5b677c-tst6v"
Sep 09 13:41:12.746647 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:12.746627    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-4ecd209d-dockercfg-rbx94\""
Sep 09 13:41:12.754972 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:12.754938    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-4ecd209d-66d5b677c-tst6v"]
Sep 09 13:41:12.827983 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:12.827806    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjq5s\" (UniqueName: \"kubernetes.io/projected/6626dbbf-216d-49fd-af8a-2ad0b6b57369-kube-api-access-kjq5s\") pod \"payload-processing-e2e-derive-4ecd209d-66d5b677c-tst6v\" (UID: \"6626dbbf-216d-49fd-af8a-2ad0b6b57369\") " pod="openshift-ingress/payload-processing-e2e-derive-4ecd209d-66d5b677c-tst6v"
Sep 09 13:41:12.827983 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:12.827870    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7be31b12-1686-4918-a80f-3032004c2505-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-4ecd209d-798c694874-8rmbf\" (UID: \"7be31b12-1686-4918-a80f-3032004c2505\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-4ecd209d-798c694874-8rmbf"
Sep 09 13:41:12.827983 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:12.827931    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6626dbbf-216d-49fd-af8a-2ad0b6b57369-plugins-config-volume\") pod \"payload-processing-e2e-derive-4ecd209d-66d5b677c-tst6v\" (UID: \"6626dbbf-216d-49fd-af8a-2ad0b6b57369\") " pod="openshift-ingress/payload-processing-e2e-derive-4ecd209d-66d5b677c-tst6v"
Sep 09 13:41:12.828271 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:12.828067    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6h44\" (UniqueName: \"kubernetes.io/projected/7be31b12-1686-4918-a80f-3032004c2505-kube-api-access-b6h44\") pod \"payload-pre-processing-e2e-derive-4ecd209d-798c694874-8rmbf\" (UID: \"7be31b12-1686-4918-a80f-3032004c2505\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-4ecd209d-798c694874-8rmbf"
Sep 09 13:41:12.829280 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:12.829255    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7be31b12-1686-4918-a80f-3032004c2505-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-4ecd209d-798c694874-8rmbf\" (UID: \"7be31b12-1686-4918-a80f-3032004c2505\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-4ecd209d-798c694874-8rmbf"
Sep 09 13:41:12.837430 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:12.837378    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6h44\" (UniqueName: \"kubernetes.io/projected/7be31b12-1686-4918-a80f-3032004c2505-kube-api-access-b6h44\") pod \"payload-pre-processing-e2e-derive-4ecd209d-798c694874-8rmbf\" (UID: \"7be31b12-1686-4918-a80f-3032004c2505\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-4ecd209d-798c694874-8rmbf"
Sep 09 13:41:12.904244 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:12.904221    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c"
Sep 09 13:41:12.928849 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:12.928819    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/803b566b-b66a-45e5-bf1f-20be0a978c32-istio-podinfo\") pod \"803b566b-b66a-45e5-bf1f-20be0a978c32\" (UID: \"803b566b-b66a-45e5-bf1f-20be0a978c32\") "
Sep 09 13:41:12.928992 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:12.928891    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/803b566b-b66a-45e5-bf1f-20be0a978c32-workload-certs\") pod \"803b566b-b66a-45e5-bf1f-20be0a978c32\" (UID: \"803b566b-b66a-45e5-bf1f-20be0a978c32\") "
Sep 09 13:41:12.928992 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:12.928925    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/803b566b-b66a-45e5-bf1f-20be0a978c32-istio-token\") pod \"803b566b-b66a-45e5-bf1f-20be0a978c32\" (UID: \"803b566b-b66a-45e5-bf1f-20be0a978c32\") "
Sep 09 13:41:12.928992 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:12.928954    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/803b566b-b66a-45e5-bf1f-20be0a978c32-istio-data\") pod \"803b566b-b66a-45e5-bf1f-20be0a978c32\" (UID: \"803b566b-b66a-45e5-bf1f-20be0a978c32\") "
Sep 09 13:41:12.928992 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:12.928976    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/803b566b-b66a-45e5-bf1f-20be0a978c32-istiod-ca-cert\") pod \"803b566b-b66a-45e5-bf1f-20be0a978c32\" (UID: \"803b566b-b66a-45e5-bf1f-20be0a978c32\") "
Sep 09 13:41:12.929240 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:12.929005    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/803b566b-b66a-45e5-bf1f-20be0a978c32-istio-envoy\") pod \"803b566b-b66a-45e5-bf1f-20be0a978c32\" (UID: \"803b566b-b66a-45e5-bf1f-20be0a978c32\") "
Sep 09 13:41:12.929240 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:12.929051    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m6chh\" (UniqueName: \"kubernetes.io/projected/803b566b-b66a-45e5-bf1f-20be0a978c32-kube-api-access-m6chh\") pod \"803b566b-b66a-45e5-bf1f-20be0a978c32\" (UID: \"803b566b-b66a-45e5-bf1f-20be0a978c32\") "
Sep 09 13:41:12.929240 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:12.929087    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/803b566b-b66a-45e5-bf1f-20be0a978c32-workload-socket\") pod \"803b566b-b66a-45e5-bf1f-20be0a978c32\" (UID: \"803b566b-b66a-45e5-bf1f-20be0a978c32\") "
Sep 09 13:41:12.929240 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:12.929129    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/803b566b-b66a-45e5-bf1f-20be0a978c32-credential-socket\") pod \"803b566b-b66a-45e5-bf1f-20be0a978c32\" (UID: \"803b566b-b66a-45e5-bf1f-20be0a978c32\") "
Sep 09 13:41:12.929439 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:12.929288    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/803b566b-b66a-45e5-bf1f-20be0a978c32-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "803b566b-b66a-45e5-bf1f-20be0a978c32" (UID: "803b566b-b66a-45e5-bf1f-20be0a978c32"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 13:41:12.929439 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:12.929359    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/803b566b-b66a-45e5-bf1f-20be0a978c32-istio-data" (OuterVolumeSpecName: "istio-data") pod "803b566b-b66a-45e5-bf1f-20be0a978c32" (UID: "803b566b-b66a-45e5-bf1f-20be0a978c32"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 13:41:12.929439 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:12.929391    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjq5s\" (UniqueName: \"kubernetes.io/projected/6626dbbf-216d-49fd-af8a-2ad0b6b57369-kube-api-access-kjq5s\") pod \"payload-processing-e2e-derive-4ecd209d-66d5b677c-tst6v\" (UID: \"6626dbbf-216d-49fd-af8a-2ad0b6b57369\") " pod="openshift-ingress/payload-processing-e2e-derive-4ecd209d-66d5b677c-tst6v"
Sep 09 13:41:12.929597 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:12.929451    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/803b566b-b66a-45e5-bf1f-20be0a978c32-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "803b566b-b66a-45e5-bf1f-20be0a978c32" (UID: "803b566b-b66a-45e5-bf1f-20be0a978c32"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 13:41:12.929597 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:12.929467    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6626dbbf-216d-49fd-af8a-2ad0b6b57369-plugins-config-volume\") pod \"payload-processing-e2e-derive-4ecd209d-66d5b677c-tst6v\" (UID: \"6626dbbf-216d-49fd-af8a-2ad0b6b57369\") " pod="openshift-ingress/payload-processing-e2e-derive-4ecd209d-66d5b677c-tst6v"
Sep 09 13:41:12.929597 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:12.929492    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/803b566b-b66a-45e5-bf1f-20be0a978c32-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "803b566b-b66a-45e5-bf1f-20be0a978c32" (UID: "803b566b-b66a-45e5-bf1f-20be0a978c32"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 13:41:12.929597 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:12.929593    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/803b566b-b66a-45e5-bf1f-20be0a978c32-workload-certs\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:41:12.929807 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:12.929607    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/803b566b-b66a-45e5-bf1f-20be0a978c32-istio-data\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:41:12.929807 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:12.929619    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/803b566b-b66a-45e5-bf1f-20be0a978c32-workload-socket\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:41:12.929807 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:12.929631    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/803b566b-b66a-45e5-bf1f-20be0a978c32-credential-socket\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:41:12.929807 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:12.929652    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/803b566b-b66a-45e5-bf1f-20be0a978c32-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "803b566b-b66a-45e5-bf1f-20be0a978c32" (UID: "803b566b-b66a-45e5-bf1f-20be0a978c32"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 13:41:12.930373 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:12.930346    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6626dbbf-216d-49fd-af8a-2ad0b6b57369-plugins-config-volume\") pod \"payload-processing-e2e-derive-4ecd209d-66d5b677c-tst6v\" (UID: \"6626dbbf-216d-49fd-af8a-2ad0b6b57369\") " pod="openshift-ingress/payload-processing-e2e-derive-4ecd209d-66d5b677c-tst6v"
Sep 09 13:41:12.931285 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:12.931258    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/803b566b-b66a-45e5-bf1f-20be0a978c32-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "803b566b-b66a-45e5-bf1f-20be0a978c32" (UID: "803b566b-b66a-45e5-bf1f-20be0a978c32"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 13:41:12.931742 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:12.931719    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/803b566b-b66a-45e5-bf1f-20be0a978c32-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "803b566b-b66a-45e5-bf1f-20be0a978c32" (UID: "803b566b-b66a-45e5-bf1f-20be0a978c32"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 13:41:12.931841 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:12.931825    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/803b566b-b66a-45e5-bf1f-20be0a978c32-istio-token" (OuterVolumeSpecName: "istio-token") pod "803b566b-b66a-45e5-bf1f-20be0a978c32" (UID: "803b566b-b66a-45e5-bf1f-20be0a978c32"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 13:41:12.931991 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:12.931963    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/803b566b-b66a-45e5-bf1f-20be0a978c32-kube-api-access-m6chh" (OuterVolumeSpecName: "kube-api-access-m6chh") pod "803b566b-b66a-45e5-bf1f-20be0a978c32" (UID: "803b566b-b66a-45e5-bf1f-20be0a978c32"). InnerVolumeSpecName "kube-api-access-m6chh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 13:41:12.938121 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:12.938097    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjq5s\" (UniqueName: \"kubernetes.io/projected/6626dbbf-216d-49fd-af8a-2ad0b6b57369-kube-api-access-kjq5s\") pod \"payload-processing-e2e-derive-4ecd209d-66d5b677c-tst6v\" (UID: \"6626dbbf-216d-49fd-af8a-2ad0b6b57369\") " pod="openshift-ingress/payload-processing-e2e-derive-4ecd209d-66d5b677c-tst6v"
Sep 09 13:41:13.031129 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:13.031091    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/803b566b-b66a-45e5-bf1f-20be0a978c32-istio-token\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:41:13.031129 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:13.031125    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/803b566b-b66a-45e5-bf1f-20be0a978c32-istiod-ca-cert\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:41:13.031129 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:13.031136    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/803b566b-b66a-45e5-bf1f-20be0a978c32-istio-envoy\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:41:13.031377 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:13.031145    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m6chh\" (UniqueName: \"kubernetes.io/projected/803b566b-b66a-45e5-bf1f-20be0a978c32-kube-api-access-m6chh\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:41:13.031377 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:13.031155    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/803b566b-b66a-45e5-bf1f-20be0a978c32-istio-podinfo\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:41:13.042003 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:13.041967    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-4ecd209d-798c694874-8rmbf"
Sep 09 13:41:13.055983 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:13.055961    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-4ecd209d-66d5b677c-tst6v"
Sep 09 13:41:13.317470 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:13.317442    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-4ecd209d-798c694874-8rmbf"]
Sep 09 13:41:13.319615 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:41:13.319585    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7be31b12_1686_4918_a80f_3032004c2505.slice/crio-b0f6e8936431d851afb756fe0439ae77769965ed2741a1ac5856178739c53799 WatchSource:0}: Error finding container b0f6e8936431d851afb756fe0439ae77769965ed2741a1ac5856178739c53799: Status 404 returned error can't find the container with id b0f6e8936431d851afb756fe0439ae77769965ed2741a1ac5856178739c53799
Sep 09 13:41:13.334075 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:13.334053    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-4ecd209d-66d5b677c-tst6v"]
Sep 09 13:41:13.335977 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:41:13.335948    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6626dbbf_216d_49fd_af8a_2ad0b6b57369.slice/crio-18685cca156d74997e9c8c18f6d3ea134daa7fb079d7e1e550382a774fc275ad WatchSource:0}: Error finding container 18685cca156d74997e9c8c18f6d3ea134daa7fb079d7e1e550382a774fc275ad: Status 404 returned error can't find the container with id 18685cca156d74997e9c8c18f6d3ea134daa7fb079d7e1e550382a774fc275ad
Sep 09 13:41:13.531490 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:13.531459    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-4ecd209d-66d5b677c-tst6v" event={"ID":"6626dbbf-216d-49fd-af8a-2ad0b6b57369","Type":"ContainerStarted","Data":"7de73d87f9dbb791542a2993ae4c301d053a4b9ee6582c245d52fa5419a60272"}
Sep 09 13:41:13.531666 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:13.531525    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-4ecd209d-66d5b677c-tst6v"
Sep 09 13:41:13.531666 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:13.531545    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-4ecd209d-66d5b677c-tst6v" event={"ID":"6626dbbf-216d-49fd-af8a-2ad0b6b57369","Type":"ContainerStarted","Data":"18685cca156d74997e9c8c18f6d3ea134daa7fb079d7e1e550382a774fc275ad"}
Sep 09 13:41:13.533267 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:13.533237    2578 generic.go:356] "Generic (PLEG): container finished" podID="803b566b-b66a-45e5-bf1f-20be0a978c32" containerID="b79f097474b7790c63c88d1295154e8a0696bffcc0664c005d768106ffa527e9" exitCode=0
Sep 09 13:41:13.533369 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:13.533269    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c"
Sep 09 13:41:13.533369 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:13.533315    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c" event={"ID":"803b566b-b66a-45e5-bf1f-20be0a978c32","Type":"ContainerDied","Data":"b79f097474b7790c63c88d1295154e8a0696bffcc0664c005d768106ffa527e9"}
Sep 09 13:41:13.533487 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:13.533375    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c" event={"ID":"803b566b-b66a-45e5-bf1f-20be0a978c32","Type":"ContainerDied","Data":"0ab7c3f726028e2c38e1cdfe449697e513acccfe8d44573fec70f316a158cbe4"}
Sep 09 13:41:13.533487 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:13.533412    2578 scope.go:117] "RemoveContainer" containerID="b79f097474b7790c63c88d1295154e8a0696bffcc0664c005d768106ffa527e9"
Sep 09 13:41:13.535230 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:13.535204    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-4ecd209d-798c694874-8rmbf" event={"ID":"7be31b12-1686-4918-a80f-3032004c2505","Type":"ContainerStarted","Data":"46944eb624264b642a24bbabeeeae1659a49b80d0632c19bef28b34be95dd416"}
Sep 09 13:41:13.535342 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:13.535254    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-4ecd209d-798c694874-8rmbf" event={"ID":"7be31b12-1686-4918-a80f-3032004c2505","Type":"ContainerStarted","Data":"b0f6e8936431d851afb756fe0439ae77769965ed2741a1ac5856178739c53799"}
Sep 09 13:41:13.542753 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:13.542730    2578 scope.go:117] "RemoveContainer" containerID="5cb4f2b770e0d6b8933ff10d9a6d38e9a419f67559a7bf3d4f3ed8e970918145"
Sep 09 13:41:13.547779 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:13.547730    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-4ecd209d-66d5b677c-tst6v" podStartSLOduration=1.547711922 podStartE2EDuration="1.547711922s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 13:41:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 13:41:13.54715908 +0000 UTC m=+885.362683290" watchObservedRunningTime="2026-09-09 13:41:13.547711922 +0000 UTC m=+885.363236099"
Sep 09 13:41:13.551787 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:13.551765    2578 scope.go:117] "RemoveContainer" containerID="b79f097474b7790c63c88d1295154e8a0696bffcc0664c005d768106ffa527e9"
Sep 09 13:41:13.552082 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:41:13.552064    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b79f097474b7790c63c88d1295154e8a0696bffcc0664c005d768106ffa527e9\": container with ID starting with b79f097474b7790c63c88d1295154e8a0696bffcc0664c005d768106ffa527e9 not found: ID does not exist" containerID="b79f097474b7790c63c88d1295154e8a0696bffcc0664c005d768106ffa527e9"
Sep 09 13:41:13.552126 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:13.552090    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b79f097474b7790c63c88d1295154e8a0696bffcc0664c005d768106ffa527e9"} err="failed to get container status \"b79f097474b7790c63c88d1295154e8a0696bffcc0664c005d768106ffa527e9\": rpc error: code = NotFound desc = could not find container \"b79f097474b7790c63c88d1295154e8a0696bffcc0664c005d768106ffa527e9\": container with ID starting with b79f097474b7790c63c88d1295154e8a0696bffcc0664c005d768106ffa527e9 not found: ID does not exist"
Sep 09 13:41:13.552126 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:13.552109    2578 scope.go:117] "RemoveContainer" containerID="5cb4f2b770e0d6b8933ff10d9a6d38e9a419f67559a7bf3d4f3ed8e970918145"
Sep 09 13:41:13.552390 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:41:13.552368    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5cb4f2b770e0d6b8933ff10d9a6d38e9a419f67559a7bf3d4f3ed8e970918145\": container with ID starting with 5cb4f2b770e0d6b8933ff10d9a6d38e9a419f67559a7bf3d4f3ed8e970918145 not found: ID does not exist" containerID="5cb4f2b770e0d6b8933ff10d9a6d38e9a419f67559a7bf3d4f3ed8e970918145"
Sep 09 13:41:13.552428 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:13.552396    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cb4f2b770e0d6b8933ff10d9a6d38e9a419f67559a7bf3d4f3ed8e970918145"} err="failed to get container status \"5cb4f2b770e0d6b8933ff10d9a6d38e9a419f67559a7bf3d4f3ed8e970918145\": rpc error: code = NotFound desc = could not find container \"5cb4f2b770e0d6b8933ff10d9a6d38e9a419f67559a7bf3d4f3ed8e970918145\": container with ID starting with 5cb4f2b770e0d6b8933ff10d9a6d38e9a419f67559a7bf3d4f3ed8e970918145 not found: ID does not exist"
Sep 09 13:41:13.563273 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:13.563228    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-4ecd209d-798c694874-8rmbf" podStartSLOduration=1.563210744 podStartE2EDuration="1.563210744s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 13:41:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 13:41:13.561899798 +0000 UTC m=+885.377423995" watchObservedRunningTime="2026-09-09 13:41:13.563210744 +0000 UTC m=+885.378734954"
Sep 09 13:41:13.575734 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:13.575666    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c"]
Sep 09 13:41:13.585230 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:13.581616    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-a9bbeff1-openshift-default-65b5cc44fb-kv68c"]
Sep 09 13:41:14.541469 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:14.541439    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-4ecd209d-798c694874-8rmbf"
Sep 09 13:41:14.661104 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:14.661075    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="803b566b-b66a-45e5-bf1f-20be0a978c32" path="/var/lib/kubelet/pods/803b566b-b66a-45e5-bf1f-20be0a978c32/volumes"
Sep 09 13:41:15.953514 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:15.953477    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:41:16.355218 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:16.355121    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:41:17.571158 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:17.571117    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:41:19.437413 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:19.437383    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:41:19.669018 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:19.668978    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:41:20.575027 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:20.574997    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:41:23.267006 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:23.266976    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:41:24.543352 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:24.543319    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-4ecd209d-66d5b677c-tst6v"
Sep 09 13:41:25.548519 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:25.548484    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-4ecd209d-798c694874-8rmbf"
Sep 09 13:41:27.562343 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:27.562301    2578 patch_prober.go:28] interesting pod/e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 09 13:41:27.562723 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:27.562382    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx" podUID="ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 09 13:41:27.900789 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:27.900749    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:41:27.933352 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:27.933319    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-71c181-8cf76b9c4-gwq87"]
Sep 09 13:41:27.933578 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:27.933546    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-autores-71c181-8cf76b9c4-gwq87" podUID="9f3f383e-0c41-4c0f-9aad-90087626600c" containerName="payload-pre-processing" containerID="cri-o://f27e80c92c653ba3df577ab26f31ac8c8f5dbeabaa0d135ff7bd6a856bb0d659" gracePeriod=30
Sep 09 13:41:28.010114 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:28.010077    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:41:28.108839 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:28.108812    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:41:28.188963 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:28.188938    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:41:28.195335 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:28.195314    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-71c181-8cf76b9c4-gwq87"
Sep 09 13:41:28.281945 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:28.281867    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f3f383e-0c41-4c0f-9aad-90087626600c-plugins-config-volume\") pod \"9f3f383e-0c41-4c0f-9aad-90087626600c\" (UID: \"9f3f383e-0c41-4c0f-9aad-90087626600c\") "
Sep 09 13:41:28.281945 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:28.281912    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c7vjw\" (UniqueName: \"kubernetes.io/projected/9f3f383e-0c41-4c0f-9aad-90087626600c-kube-api-access-c7vjw\") pod \"9f3f383e-0c41-4c0f-9aad-90087626600c\" (UID: \"9f3f383e-0c41-4c0f-9aad-90087626600c\") "
Sep 09 13:41:28.282292 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:28.282268    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f3f383e-0c41-4c0f-9aad-90087626600c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9f3f383e-0c41-4c0f-9aad-90087626600c" (UID: "9f3f383e-0c41-4c0f-9aad-90087626600c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 13:41:28.284056 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:28.284036    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f3f383e-0c41-4c0f-9aad-90087626600c-kube-api-access-c7vjw" (OuterVolumeSpecName: "kube-api-access-c7vjw") pod "9f3f383e-0c41-4c0f-9aad-90087626600c" (UID: "9f3f383e-0c41-4c0f-9aad-90087626600c"). InnerVolumeSpecName "kube-api-access-c7vjw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 13:41:28.382961 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:28.382926    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f3f383e-0c41-4c0f-9aad-90087626600c-plugins-config-volume\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:41:28.382961 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:28.382957    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c7vjw\" (UniqueName: \"kubernetes.io/projected/9f3f383e-0c41-4c0f-9aad-90087626600c-kube-api-access-c7vjw\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:41:28.510060 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:28.509952    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:41:28.631396 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:28.631366    2578 generic.go:356] "Generic (PLEG): container finished" podID="9f3f383e-0c41-4c0f-9aad-90087626600c" containerID="f27e80c92c653ba3df577ab26f31ac8c8f5dbeabaa0d135ff7bd6a856bb0d659" exitCode=0
Sep 09 13:41:28.631828 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:28.631414    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-71c181-8cf76b9c4-gwq87"
Sep 09 13:41:28.631828 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:28.631447    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-71c181-8cf76b9c4-gwq87" event={"ID":"9f3f383e-0c41-4c0f-9aad-90087626600c","Type":"ContainerDied","Data":"f27e80c92c653ba3df577ab26f31ac8c8f5dbeabaa0d135ff7bd6a856bb0d659"}
Sep 09 13:41:28.631828 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:28.631498    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-71c181-8cf76b9c4-gwq87" event={"ID":"9f3f383e-0c41-4c0f-9aad-90087626600c","Type":"ContainerDied","Data":"7ffafd9bd4050c0b17a570e3b259212ab95627d27224399c14c307c0e13832c6"}
Sep 09 13:41:28.631828 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:28.631522    2578 scope.go:117] "RemoveContainer" containerID="f27e80c92c653ba3df577ab26f31ac8c8f5dbeabaa0d135ff7bd6a856bb0d659"
Sep 09 13:41:28.633408 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:28.633387    2578 generic.go:356] "Generic (PLEG): container finished" podID="ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c" containerID="819c57626c98e004a2468cad6b1ebb8c7b7f021647cf0cb0dd12d9125e059bee" exitCode=0
Sep 09 13:41:28.633537 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:28.633468    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx" event={"ID":"ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c","Type":"ContainerDied","Data":"819c57626c98e004a2468cad6b1ebb8c7b7f021647cf0cb0dd12d9125e059bee"}
Sep 09 13:41:28.633827 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:28.633810    2578 scope.go:117] "RemoveContainer" containerID="819c57626c98e004a2468cad6b1ebb8c7b7f021647cf0cb0dd12d9125e059bee"
Sep 09 13:41:28.634971 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:28.634934    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 13:41:28.635076 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:28.635025    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 13:41:28.635143 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:28.635072    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 13:41:28.641378 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:28.641360    2578 scope.go:117] "RemoveContainer" containerID="f27e80c92c653ba3df577ab26f31ac8c8f5dbeabaa0d135ff7bd6a856bb0d659"
Sep 09 13:41:28.641638 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:41:28.641622    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f27e80c92c653ba3df577ab26f31ac8c8f5dbeabaa0d135ff7bd6a856bb0d659\": container with ID starting with f27e80c92c653ba3df577ab26f31ac8c8f5dbeabaa0d135ff7bd6a856bb0d659 not found: ID does not exist" containerID="f27e80c92c653ba3df577ab26f31ac8c8f5dbeabaa0d135ff7bd6a856bb0d659"
Sep 09 13:41:28.641685 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:28.641648    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f27e80c92c653ba3df577ab26f31ac8c8f5dbeabaa0d135ff7bd6a856bb0d659"} err="failed to get container status \"f27e80c92c653ba3df577ab26f31ac8c8f5dbeabaa0d135ff7bd6a856bb0d659\": rpc error: code = NotFound desc = could not find container \"f27e80c92c653ba3df577ab26f31ac8c8f5dbeabaa0d135ff7bd6a856bb0d659\": container with ID starting with f27e80c92c653ba3df577ab26f31ac8c8f5dbeabaa0d135ff7bd6a856bb0d659 not found: ID does not exist"
Sep 09 13:41:28.689372 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:28.689341    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-71c181-8cf76b9c4-gwq87"]
Sep 09 13:41:28.693522 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:28.693497    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-71c181-8cf76b9c4-gwq87"]
Sep 09 13:41:29.639592 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:29.639559    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx" event={"ID":"ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c","Type":"ContainerStarted","Data":"d7d88b4822e0ff83a7de04e1c6d9f9834de2a7c0916d25e57ae6eca0fe47b593"}
Sep 09 13:41:29.660193 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:29.660149    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx"
Sep 09 13:41:29.660401 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:29.660381    2578 patch_prober.go:28] interesting pod/e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Sep 09 13:41:29.660444 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:29.660426    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx" podUID="ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Sep 09 13:41:30.659413 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:30.659382    2578 patch_prober.go:28] interesting pod/e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Sep 09 13:41:30.659804 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:30.659435    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx" podUID="ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Sep 09 13:41:30.661640 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:30.661616    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f3f383e-0c41-4c0f-9aad-90087626600c" path="/var/lib/kubelet/pods/9f3f383e-0c41-4c0f-9aad-90087626600c/volumes"
Sep 09 13:41:31.659446 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:31.659409    2578 patch_prober.go:28] interesting pod/e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Sep 09 13:41:31.659867 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:31.659472    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx" podUID="ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Sep 09 13:41:32.659813 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:32.659778    2578 patch_prober.go:28] interesting pod/e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Sep 09 13:41:32.660207 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:32.659848    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx" podUID="ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Sep 09 13:41:33.022739 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:33.022652    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:41:33.583942 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:33.583910    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:41:33.660356 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:33.660324    2578 patch_prober.go:28] interesting pod/e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Sep 09 13:41:33.660758 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:33.660375    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx" podUID="ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Sep 09 13:41:34.659712 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:34.659671    2578 patch_prober.go:28] interesting pod/e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Sep 09 13:41:34.659919 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:34.659744    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx" podUID="ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Sep 09 13:41:35.663168 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:35.663138    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx"
Sep 09 13:41:35.663656 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:35.663516    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx"
Sep 09 13:41:35.664241 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:35.664222    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx"
Sep 09 13:41:36.857677 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:36.857639    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:41:38.773448 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:38.773410    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:41:42.200750 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:42.200698    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:41:42.909009 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:42.908978    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:41:42.933669 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:42.933634    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-4ecd209d-66d5b677c-tst6v"]
Sep 09 13:41:42.933901 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:42.933875    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-4ecd209d-66d5b677c-tst6v" podUID="6626dbbf-216d-49fd-af8a-2ad0b6b57369" containerName="payload-processing" containerID="cri-o://7de73d87f9dbb791542a2993ae4c301d053a4b9ee6582c245d52fa5419a60272" gracePeriod=30
Sep 09 13:41:42.940050 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:42.940019    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-4ecd209d-798c694874-8rmbf"]
Sep 09 13:41:42.940364 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:42.940338    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-4ecd209d-798c694874-8rmbf" podUID="7be31b12-1686-4918-a80f-3032004c2505" containerName="payload-pre-processing" containerID="cri-o://46944eb624264b642a24bbabeeeae1659a49b80d0632c19bef28b34be95dd416" gracePeriod=30
Sep 09 13:41:43.007225 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:43.007170    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:41:43.107889 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:43.107860    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:41:43.186892 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:43.186860    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-4ecd209d-66d5b677c-tst6v"
Sep 09 13:41:43.209705 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:43.209562    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-4ecd209d-798c694874-8rmbf"
Sep 09 13:41:43.215424 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:43.215378    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:41:43.250236 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:43.250204    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx"]
Sep 09 13:41:43.250459 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:43.250435    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx" podUID="ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c" containerName="istio-proxy" containerID="cri-o://d7d88b4822e0ff83a7de04e1c6d9f9834de2a7c0916d25e57ae6eca0fe47b593" gracePeriod=30
Sep 09 13:41:43.304877 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:43.304814    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:41:43.338686 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:43.338655    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kjq5s\" (UniqueName: \"kubernetes.io/projected/6626dbbf-216d-49fd-af8a-2ad0b6b57369-kube-api-access-kjq5s\") pod \"6626dbbf-216d-49fd-af8a-2ad0b6b57369\" (UID: \"6626dbbf-216d-49fd-af8a-2ad0b6b57369\") "
Sep 09 13:41:43.338686 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:43.338691    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b6h44\" (UniqueName: \"kubernetes.io/projected/7be31b12-1686-4918-a80f-3032004c2505-kube-api-access-b6h44\") pod \"7be31b12-1686-4918-a80f-3032004c2505\" (UID: \"7be31b12-1686-4918-a80f-3032004c2505\") "
Sep 09 13:41:43.338961 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:43.338810    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6626dbbf-216d-49fd-af8a-2ad0b6b57369-plugins-config-volume\") pod \"6626dbbf-216d-49fd-af8a-2ad0b6b57369\" (UID: \"6626dbbf-216d-49fd-af8a-2ad0b6b57369\") "
Sep 09 13:41:43.338961 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:43.338907    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7be31b12-1686-4918-a80f-3032004c2505-plugins-config-volume\") pod \"7be31b12-1686-4918-a80f-3032004c2505\" (UID: \"7be31b12-1686-4918-a80f-3032004c2505\") "
Sep 09 13:41:43.339507 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:43.339449    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6626dbbf-216d-49fd-af8a-2ad0b6b57369-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6626dbbf-216d-49fd-af8a-2ad0b6b57369" (UID: "6626dbbf-216d-49fd-af8a-2ad0b6b57369"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 13:41:43.341439 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:43.341347    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7be31b12-1686-4918-a80f-3032004c2505-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7be31b12-1686-4918-a80f-3032004c2505" (UID: "7be31b12-1686-4918-a80f-3032004c2505"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 13:41:43.342144 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:43.342103    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6626dbbf-216d-49fd-af8a-2ad0b6b57369-kube-api-access-kjq5s" (OuterVolumeSpecName: "kube-api-access-kjq5s") pod "6626dbbf-216d-49fd-af8a-2ad0b6b57369" (UID: "6626dbbf-216d-49fd-af8a-2ad0b6b57369"). InnerVolumeSpecName "kube-api-access-kjq5s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 13:41:43.343891 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:43.343865    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7be31b12-1686-4918-a80f-3032004c2505-kube-api-access-b6h44" (OuterVolumeSpecName: "kube-api-access-b6h44") pod "7be31b12-1686-4918-a80f-3032004c2505" (UID: "7be31b12-1686-4918-a80f-3032004c2505"). InnerVolumeSpecName "kube-api-access-b6h44". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 13:41:43.440643 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:43.440543    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7be31b12-1686-4918-a80f-3032004c2505-plugins-config-volume\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:41:43.440643 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:43.440588    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kjq5s\" (UniqueName: \"kubernetes.io/projected/6626dbbf-216d-49fd-af8a-2ad0b6b57369-kube-api-access-kjq5s\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:41:43.440643 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:43.440597    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b6h44\" (UniqueName: \"kubernetes.io/projected/7be31b12-1686-4918-a80f-3032004c2505-kube-api-access-b6h44\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:41:43.440643 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:43.440607    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6626dbbf-216d-49fd-af8a-2ad0b6b57369-plugins-config-volume\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:41:43.708992 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:43.708908    2578 generic.go:356] "Generic (PLEG): container finished" podID="7be31b12-1686-4918-a80f-3032004c2505" containerID="46944eb624264b642a24bbabeeeae1659a49b80d0632c19bef28b34be95dd416" exitCode=0
Sep 09 13:41:43.708992 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:43.708951    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-4ecd209d-798c694874-8rmbf"
Sep 09 13:41:43.709218 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:43.709000    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-4ecd209d-798c694874-8rmbf" event={"ID":"7be31b12-1686-4918-a80f-3032004c2505","Type":"ContainerDied","Data":"46944eb624264b642a24bbabeeeae1659a49b80d0632c19bef28b34be95dd416"}
Sep 09 13:41:43.709218 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:43.709065    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-4ecd209d-798c694874-8rmbf" event={"ID":"7be31b12-1686-4918-a80f-3032004c2505","Type":"ContainerDied","Data":"b0f6e8936431d851afb756fe0439ae77769965ed2741a1ac5856178739c53799"}
Sep 09 13:41:43.709218 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:43.709100    2578 scope.go:117] "RemoveContainer" containerID="46944eb624264b642a24bbabeeeae1659a49b80d0632c19bef28b34be95dd416"
Sep 09 13:41:43.710473 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:43.710451    2578 generic.go:356] "Generic (PLEG): container finished" podID="6626dbbf-216d-49fd-af8a-2ad0b6b57369" containerID="7de73d87f9dbb791542a2993ae4c301d053a4b9ee6582c245d52fa5419a60272" exitCode=0
Sep 09 13:41:43.710579 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:43.710519    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-4ecd209d-66d5b677c-tst6v" event={"ID":"6626dbbf-216d-49fd-af8a-2ad0b6b57369","Type":"ContainerDied","Data":"7de73d87f9dbb791542a2993ae4c301d053a4b9ee6582c245d52fa5419a60272"}
Sep 09 13:41:43.710579 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:43.710559    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-4ecd209d-66d5b677c-tst6v" event={"ID":"6626dbbf-216d-49fd-af8a-2ad0b6b57369","Type":"ContainerDied","Data":"18685cca156d74997e9c8c18f6d3ea134daa7fb079d7e1e550382a774fc275ad"}
Sep 09 13:41:43.710667 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:43.710523    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-4ecd209d-66d5b677c-tst6v"
Sep 09 13:41:43.717517 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:43.717502    2578 scope.go:117] "RemoveContainer" containerID="46944eb624264b642a24bbabeeeae1659a49b80d0632c19bef28b34be95dd416"
Sep 09 13:41:43.717781 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:41:43.717760    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46944eb624264b642a24bbabeeeae1659a49b80d0632c19bef28b34be95dd416\": container with ID starting with 46944eb624264b642a24bbabeeeae1659a49b80d0632c19bef28b34be95dd416 not found: ID does not exist" containerID="46944eb624264b642a24bbabeeeae1659a49b80d0632c19bef28b34be95dd416"
Sep 09 13:41:43.717851 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:43.717793    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46944eb624264b642a24bbabeeeae1659a49b80d0632c19bef28b34be95dd416"} err="failed to get container status \"46944eb624264b642a24bbabeeeae1659a49b80d0632c19bef28b34be95dd416\": rpc error: code = NotFound desc = could not find container \"46944eb624264b642a24bbabeeeae1659a49b80d0632c19bef28b34be95dd416\": container with ID starting with 46944eb624264b642a24bbabeeeae1659a49b80d0632c19bef28b34be95dd416 not found: ID does not exist"
Sep 09 13:41:43.717851 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:43.717809    2578 scope.go:117] "RemoveContainer" containerID="7de73d87f9dbb791542a2993ae4c301d053a4b9ee6582c245d52fa5419a60272"
Sep 09 13:41:43.725484 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:43.725459    2578 scope.go:117] "RemoveContainer" containerID="7de73d87f9dbb791542a2993ae4c301d053a4b9ee6582c245d52fa5419a60272"
Sep 09 13:41:43.725741 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:41:43.725723    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7de73d87f9dbb791542a2993ae4c301d053a4b9ee6582c245d52fa5419a60272\": container with ID starting with 7de73d87f9dbb791542a2993ae4c301d053a4b9ee6582c245d52fa5419a60272 not found: ID does not exist" containerID="7de73d87f9dbb791542a2993ae4c301d053a4b9ee6582c245d52fa5419a60272"
Sep 09 13:41:43.725799 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:43.725748    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7de73d87f9dbb791542a2993ae4c301d053a4b9ee6582c245d52fa5419a60272"} err="failed to get container status \"7de73d87f9dbb791542a2993ae4c301d053a4b9ee6582c245d52fa5419a60272\": rpc error: code = NotFound desc = could not find container \"7de73d87f9dbb791542a2993ae4c301d053a4b9ee6582c245d52fa5419a60272\": container with ID starting with 7de73d87f9dbb791542a2993ae4c301d053a4b9ee6582c245d52fa5419a60272 not found: ID does not exist"
Sep 09 13:41:43.735611 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:43.735591    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-4ecd209d-798c694874-8rmbf"]
Sep 09 13:41:43.740816 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:43.740792    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-4ecd209d-798c694874-8rmbf"]
Sep 09 13:41:43.751055 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:43.751034    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-4ecd209d-66d5b677c-tst6v"]
Sep 09 13:41:43.757062 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:43.757039    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-4ecd209d-66d5b677c-tst6v"]
Sep 09 13:41:43.890814 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:43.890784    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:41:44.002140 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:44.002059    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:41:44.139513 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:44.139470    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:41:44.660863 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:44.660833    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6626dbbf-216d-49fd-af8a-2ad0b6b57369" path="/var/lib/kubelet/pods/6626dbbf-216d-49fd-af8a-2ad0b6b57369/volumes"
Sep 09 13:41:44.661246 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:44.661202    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7be31b12-1686-4918-a80f-3032004c2505" path="/var/lib/kubelet/pods/7be31b12-1686-4918-a80f-3032004c2505/volumes"
Sep 09 13:41:45.498768 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:45.498711    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:41:48.499609 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:48.499577    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx"
Sep 09 13:41:48.590620 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:48.590533    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c-credential-socket\") pod \"ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c\" (UID: \"ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c\") "
Sep 09 13:41:48.590620 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:48.590564    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c-istiod-ca-cert\") pod \"ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c\" (UID: \"ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c\") "
Sep 09 13:41:48.590620 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:48.590586    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c-istio-data\") pod \"ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c\" (UID: \"ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c\") "
Sep 09 13:41:48.590620 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:48.590621    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c-istio-envoy\") pod \"ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c\" (UID: \"ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c\") "
Sep 09 13:41:48.590958 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:48.590654    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c-istio-podinfo\") pod \"ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c\" (UID: \"ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c\") "
Sep 09 13:41:48.590958 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:48.590669    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c-istio-token\") pod \"ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c\" (UID: \"ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c\") "
Sep 09 13:41:48.590958 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:48.590696    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c-workload-certs\") pod \"ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c\" (UID: \"ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c\") "
Sep 09 13:41:48.590958 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:48.590743    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c-workload-socket\") pod \"ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c\" (UID: \"ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c\") "
Sep 09 13:41:48.590958 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:48.590783    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bd7m2\" (UniqueName: \"kubernetes.io/projected/ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c-kube-api-access-bd7m2\") pod \"ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c\" (UID: \"ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c\") "
Sep 09 13:41:48.590958 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:48.590878    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c" (UID: "ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 13:41:48.590958 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:48.590902    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c-istio-data" (OuterVolumeSpecName: "istio-data") pod "ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c" (UID: "ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 13:41:48.590958 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:48.590949    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c" (UID: "ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 13:41:48.591379 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:48.591096    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c-credential-socket\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:41:48.591379 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:48.591106    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c" (UID: "ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 13:41:48.591379 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:48.591116    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c-istiod-ca-cert\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:41:48.591379 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:48.591130    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c-istio-data\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:41:48.591379 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:48.591231    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c" (UID: "ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 13:41:48.592976 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:48.592956    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c" (UID: "ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 13:41:48.593070 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:48.593049    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c-istio-token" (OuterVolumeSpecName: "istio-token") pod "ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c" (UID: "ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 13:41:48.593338 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:48.593315    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c" (UID: "ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 13:41:48.593338 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:48.593323    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c-kube-api-access-bd7m2" (OuterVolumeSpecName: "kube-api-access-bd7m2") pod "ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c" (UID: "ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c"). InnerVolumeSpecName "kube-api-access-bd7m2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 13:41:48.692535 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:48.692508    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c-workload-certs\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:41:48.692535 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:48.692536    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c-workload-socket\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:41:48.692701 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:48.692548    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bd7m2\" (UniqueName: \"kubernetes.io/projected/ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c-kube-api-access-bd7m2\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:41:48.692701 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:48.692558    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c-istio-envoy\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:41:48.692701 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:48.692566    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c-istio-podinfo\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:41:48.692701 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:48.692574    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c-istio-token\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:41:48.735024 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:48.734988    2578 generic.go:356] "Generic (PLEG): container finished" podID="ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c" containerID="d7d88b4822e0ff83a7de04e1c6d9f9834de2a7c0916d25e57ae6eca0fe47b593" exitCode=0
Sep 09 13:41:48.735170 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:48.735049    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx"
Sep 09 13:41:48.735170 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:48.735068    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx" event={"ID":"ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c","Type":"ContainerDied","Data":"d7d88b4822e0ff83a7de04e1c6d9f9834de2a7c0916d25e57ae6eca0fe47b593"}
Sep 09 13:41:48.735170 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:48.735123    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx" event={"ID":"ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c","Type":"ContainerDied","Data":"c8e2ecec0a93d4f0be3479b22147857df6094484393e912873253aad334fb771"}
Sep 09 13:41:48.735170 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:48.735146    2578 scope.go:117] "RemoveContainer" containerID="d7d88b4822e0ff83a7de04e1c6d9f9834de2a7c0916d25e57ae6eca0fe47b593"
Sep 09 13:41:48.743695 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:48.743680    2578 scope.go:117] "RemoveContainer" containerID="819c57626c98e004a2468cad6b1ebb8c7b7f021647cf0cb0dd12d9125e059bee"
Sep 09 13:41:48.751516 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:48.751424    2578 scope.go:117] "RemoveContainer" containerID="d7d88b4822e0ff83a7de04e1c6d9f9834de2a7c0916d25e57ae6eca0fe47b593"
Sep 09 13:41:48.751972 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:41:48.751949    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7d88b4822e0ff83a7de04e1c6d9f9834de2a7c0916d25e57ae6eca0fe47b593\": container with ID starting with d7d88b4822e0ff83a7de04e1c6d9f9834de2a7c0916d25e57ae6eca0fe47b593 not found: ID does not exist" containerID="d7d88b4822e0ff83a7de04e1c6d9f9834de2a7c0916d25e57ae6eca0fe47b593"
Sep 09 13:41:48.752071 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:48.751981    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7d88b4822e0ff83a7de04e1c6d9f9834de2a7c0916d25e57ae6eca0fe47b593"} err="failed to get container status \"d7d88b4822e0ff83a7de04e1c6d9f9834de2a7c0916d25e57ae6eca0fe47b593\": rpc error: code = NotFound desc = could not find container \"d7d88b4822e0ff83a7de04e1c6d9f9834de2a7c0916d25e57ae6eca0fe47b593\": container with ID starting with d7d88b4822e0ff83a7de04e1c6d9f9834de2a7c0916d25e57ae6eca0fe47b593 not found: ID does not exist"
Sep 09 13:41:48.752071 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:48.752005    2578 scope.go:117] "RemoveContainer" containerID="819c57626c98e004a2468cad6b1ebb8c7b7f021647cf0cb0dd12d9125e059bee"
Sep 09 13:41:48.752357 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:41:48.752335    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"819c57626c98e004a2468cad6b1ebb8c7b7f021647cf0cb0dd12d9125e059bee\": container with ID starting with 819c57626c98e004a2468cad6b1ebb8c7b7f021647cf0cb0dd12d9125e059bee not found: ID does not exist" containerID="819c57626c98e004a2468cad6b1ebb8c7b7f021647cf0cb0dd12d9125e059bee"
Sep 09 13:41:48.752419 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:48.752368    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"819c57626c98e004a2468cad6b1ebb8c7b7f021647cf0cb0dd12d9125e059bee"} err="failed to get container status \"819c57626c98e004a2468cad6b1ebb8c7b7f021647cf0cb0dd12d9125e059bee\": rpc error: code = NotFound desc = could not find container \"819c57626c98e004a2468cad6b1ebb8c7b7f021647cf0cb0dd12d9125e059bee\": container with ID starting with 819c57626c98e004a2468cad6b1ebb8c7b7f021647cf0cb0dd12d9125e059bee not found: ID does not exist"
Sep 09 13:41:48.753281 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:48.753263    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx"]
Sep 09 13:41:48.759912 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:48.759891    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-4ecd209d-openshift-default-75df7c88d8-wnwsx"]
Sep 09 13:41:50.255579 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:50.255551    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:41:50.660310 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:50.660279    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c" path="/var/lib/kubelet/pods/ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c/volumes"
Sep 09 13:41:51.618741 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:51.618706    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:41:51.727306 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:51.727268    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:41:51.820018 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:51.819951    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:41:51.919380 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:51.919344    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:41:52.316372 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:52.316277    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:41:55.966580 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:41:55.966544    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:42:10.921470 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:10.921433    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:42:11.200238 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:11.200124    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:42:11.617762 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:11.617677    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:42:11.946949 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:11.946913    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj"]
Sep 09 13:42:11.947360 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:11.947269    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="803b566b-b66a-45e5-bf1f-20be0a978c32" containerName="istio-proxy"
Sep 09 13:42:11.947360 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:11.947281    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="803b566b-b66a-45e5-bf1f-20be0a978c32" containerName="istio-proxy"
Sep 09 13:42:11.947360 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:11.947292    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c" containerName="istio-proxy"
Sep 09 13:42:11.947360 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:11.947297    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c" containerName="istio-proxy"
Sep 09 13:42:11.947360 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:11.947304    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6626dbbf-216d-49fd-af8a-2ad0b6b57369" containerName="payload-processing"
Sep 09 13:42:11.947360 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:11.947310    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6626dbbf-216d-49fd-af8a-2ad0b6b57369" containerName="payload-processing"
Sep 09 13:42:11.947360 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:11.947321    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f3f383e-0c41-4c0f-9aad-90087626600c" containerName="payload-pre-processing"
Sep 09 13:42:11.947360 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:11.947327    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f3f383e-0c41-4c0f-9aad-90087626600c" containerName="payload-pre-processing"
Sep 09 13:42:11.947360 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:11.947333    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7be31b12-1686-4918-a80f-3032004c2505" containerName="payload-pre-processing"
Sep 09 13:42:11.947360 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:11.947338    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7be31b12-1686-4918-a80f-3032004c2505" containerName="payload-pre-processing"
Sep 09 13:42:11.947734 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:11.947424    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="7be31b12-1686-4918-a80f-3032004c2505" containerName="payload-pre-processing"
Sep 09 13:42:11.947734 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:11.947430    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6626dbbf-216d-49fd-af8a-2ad0b6b57369" containerName="payload-processing"
Sep 09 13:42:11.947734 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:11.947437    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="803b566b-b66a-45e5-bf1f-20be0a978c32" containerName="istio-proxy"
Sep 09 13:42:11.947734 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:11.947444    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c" containerName="istio-proxy"
Sep 09 13:42:11.947734 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:11.947451    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="803b566b-b66a-45e5-bf1f-20be0a978c32" containerName="istio-proxy"
Sep 09 13:42:11.947734 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:11.947457    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f3f383e-0c41-4c0f-9aad-90087626600c" containerName="payload-pre-processing"
Sep 09 13:42:11.949404 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:11.949388    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj"
Sep 09 13:42:11.953220 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:11.953203    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-c5f375-openshift-default-dockercfg-r5kzg\""
Sep 09 13:42:11.975810 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:11.975779    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj"]
Sep 09 13:42:12.006530 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:12.006470    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:42:12.103427 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:12.103387    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5qjx\" (UniqueName: \"kubernetes.io/projected/330bba01-13f6-4444-9cd5-8bec11aa10f3-kube-api-access-h5qjx\") pod \"e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj\" (UID: \"330bba01-13f6-4444-9cd5-8bec11aa10f3\") " pod="openshift-ingress/e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj"
Sep 09 13:42:12.103601 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:12.103459    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/330bba01-13f6-4444-9cd5-8bec11aa10f3-credential-socket\") pod \"e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj\" (UID: \"330bba01-13f6-4444-9cd5-8bec11aa10f3\") " pod="openshift-ingress/e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj"
Sep 09 13:42:12.103601 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:12.103488    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/330bba01-13f6-4444-9cd5-8bec11aa10f3-workload-certs\") pod \"e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj\" (UID: \"330bba01-13f6-4444-9cd5-8bec11aa10f3\") " pod="openshift-ingress/e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj"
Sep 09 13:42:12.103601 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:12.103530    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/330bba01-13f6-4444-9cd5-8bec11aa10f3-istio-data\") pod \"e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj\" (UID: \"330bba01-13f6-4444-9cd5-8bec11aa10f3\") " pod="openshift-ingress/e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj"
Sep 09 13:42:12.103601 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:12.103545    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/330bba01-13f6-4444-9cd5-8bec11aa10f3-istio-token\") pod \"e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj\" (UID: \"330bba01-13f6-4444-9cd5-8bec11aa10f3\") " pod="openshift-ingress/e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj"
Sep 09 13:42:12.103601 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:12.103567    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/330bba01-13f6-4444-9cd5-8bec11aa10f3-workload-socket\") pod \"e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj\" (UID: \"330bba01-13f6-4444-9cd5-8bec11aa10f3\") " pod="openshift-ingress/e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj"
Sep 09 13:42:12.103601 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:12.103593    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/330bba01-13f6-4444-9cd5-8bec11aa10f3-istio-podinfo\") pod \"e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj\" (UID: \"330bba01-13f6-4444-9cd5-8bec11aa10f3\") " pod="openshift-ingress/e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj"
Sep 09 13:42:12.103803 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:12.103662    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/330bba01-13f6-4444-9cd5-8bec11aa10f3-istiod-ca-cert\") pod \"e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj\" (UID: \"330bba01-13f6-4444-9cd5-8bec11aa10f3\") " pod="openshift-ingress/e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj"
Sep 09 13:42:12.103803 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:12.103683    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/330bba01-13f6-4444-9cd5-8bec11aa10f3-istio-envoy\") pod \"e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj\" (UID: \"330bba01-13f6-4444-9cd5-8bec11aa10f3\") " pod="openshift-ingress/e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj"
Sep 09 13:42:12.204844 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:12.204747    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/330bba01-13f6-4444-9cd5-8bec11aa10f3-istiod-ca-cert\") pod \"e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj\" (UID: \"330bba01-13f6-4444-9cd5-8bec11aa10f3\") " pod="openshift-ingress/e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj"
Sep 09 13:42:12.204844 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:12.204791    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/330bba01-13f6-4444-9cd5-8bec11aa10f3-istio-envoy\") pod \"e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj\" (UID: \"330bba01-13f6-4444-9cd5-8bec11aa10f3\") " pod="openshift-ingress/e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj"
Sep 09 13:42:12.204844 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:12.204816    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5qjx\" (UniqueName: \"kubernetes.io/projected/330bba01-13f6-4444-9cd5-8bec11aa10f3-kube-api-access-h5qjx\") pod \"e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj\" (UID: \"330bba01-13f6-4444-9cd5-8bec11aa10f3\") " pod="openshift-ingress/e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj"
Sep 09 13:42:12.205133 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:12.204869    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/330bba01-13f6-4444-9cd5-8bec11aa10f3-credential-socket\") pod \"e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj\" (UID: \"330bba01-13f6-4444-9cd5-8bec11aa10f3\") " pod="openshift-ingress/e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj"
Sep 09 13:42:12.205133 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:12.204887    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/330bba01-13f6-4444-9cd5-8bec11aa10f3-workload-certs\") pod \"e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj\" (UID: \"330bba01-13f6-4444-9cd5-8bec11aa10f3\") " pod="openshift-ingress/e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj"
Sep 09 13:42:12.205133 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:12.204953    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/330bba01-13f6-4444-9cd5-8bec11aa10f3-istio-data\") pod \"e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj\" (UID: \"330bba01-13f6-4444-9cd5-8bec11aa10f3\") " pod="openshift-ingress/e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj"
Sep 09 13:42:12.205133 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:12.204977    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/330bba01-13f6-4444-9cd5-8bec11aa10f3-istio-token\") pod \"e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj\" (UID: \"330bba01-13f6-4444-9cd5-8bec11aa10f3\") " pod="openshift-ingress/e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj"
Sep 09 13:42:12.205133 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:12.205003    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/330bba01-13f6-4444-9cd5-8bec11aa10f3-workload-socket\") pod \"e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj\" (UID: \"330bba01-13f6-4444-9cd5-8bec11aa10f3\") " pod="openshift-ingress/e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj"
Sep 09 13:42:12.205133 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:12.205039    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/330bba01-13f6-4444-9cd5-8bec11aa10f3-istio-podinfo\") pod \"e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj\" (UID: \"330bba01-13f6-4444-9cd5-8bec11aa10f3\") " pod="openshift-ingress/e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj"
Sep 09 13:42:12.205465 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:12.205354    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/330bba01-13f6-4444-9cd5-8bec11aa10f3-credential-socket\") pod \"e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj\" (UID: \"330bba01-13f6-4444-9cd5-8bec11aa10f3\") " pod="openshift-ingress/e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj"
Sep 09 13:42:12.205465 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:12.205402    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/330bba01-13f6-4444-9cd5-8bec11aa10f3-workload-certs\") pod \"e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj\" (UID: \"330bba01-13f6-4444-9cd5-8bec11aa10f3\") " pod="openshift-ingress/e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj"
Sep 09 13:42:12.205586 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:12.205538    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/330bba01-13f6-4444-9cd5-8bec11aa10f3-istio-data\") pod \"e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj\" (UID: \"330bba01-13f6-4444-9cd5-8bec11aa10f3\") " pod="openshift-ingress/e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj"
Sep 09 13:42:12.205642 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:12.205587    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/330bba01-13f6-4444-9cd5-8bec11aa10f3-workload-socket\") pod \"e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj\" (UID: \"330bba01-13f6-4444-9cd5-8bec11aa10f3\") " pod="openshift-ingress/e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj"
Sep 09 13:42:12.205790 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:12.205767    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/330bba01-13f6-4444-9cd5-8bec11aa10f3-istiod-ca-cert\") pod \"e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj\" (UID: \"330bba01-13f6-4444-9cd5-8bec11aa10f3\") " pod="openshift-ingress/e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj"
Sep 09 13:42:12.207402 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:12.207376    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/330bba01-13f6-4444-9cd5-8bec11aa10f3-istio-envoy\") pod \"e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj\" (UID: \"330bba01-13f6-4444-9cd5-8bec11aa10f3\") " pod="openshift-ingress/e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj"
Sep 09 13:42:12.207505 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:12.207485    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/330bba01-13f6-4444-9cd5-8bec11aa10f3-istio-podinfo\") pod \"e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj\" (UID: \"330bba01-13f6-4444-9cd5-8bec11aa10f3\") " pod="openshift-ingress/e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj"
Sep 09 13:42:12.216252 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:12.216227    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/330bba01-13f6-4444-9cd5-8bec11aa10f3-istio-token\") pod \"e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj\" (UID: \"330bba01-13f6-4444-9cd5-8bec11aa10f3\") " pod="openshift-ingress/e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj"
Sep 09 13:42:12.216346 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:12.216218    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5qjx\" (UniqueName: \"kubernetes.io/projected/330bba01-13f6-4444-9cd5-8bec11aa10f3-kube-api-access-h5qjx\") pod \"e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj\" (UID: \"330bba01-13f6-4444-9cd5-8bec11aa10f3\") " pod="openshift-ingress/e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj"
Sep 09 13:42:12.259514 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:12.259468    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj"
Sep 09 13:42:12.546337 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:12.546261    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj"]
Sep 09 13:42:12.552208 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:42:12.552165    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod330bba01_13f6_4444_9cd5_8bec11aa10f3.slice/crio-ee39c1f1b66705e162920006650cae4735f3a85bdc83424a5ac045f5160e7646 WatchSource:0}: Error finding container ee39c1f1b66705e162920006650cae4735f3a85bdc83424a5ac045f5160e7646: Status 404 returned error can't find the container with id ee39c1f1b66705e162920006650cae4735f3a85bdc83424a5ac045f5160e7646
Sep 09 13:42:12.554326 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:12.554289    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 13:42:12.554409 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:12.554373    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 13:42:12.554409 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:12.554400    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 13:42:12.692077 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:12.692045    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:42:12.850945 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:12.850867    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj" event={"ID":"330bba01-13f6-4444-9cd5-8bec11aa10f3","Type":"ContainerStarted","Data":"30ce1a7c9ba95d1dd9dccde866f3151b273d4332d19f337368a599eb5f5e87c1"}
Sep 09 13:42:12.850945 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:12.850917    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj" event={"ID":"330bba01-13f6-4444-9cd5-8bec11aa10f3","Type":"ContainerStarted","Data":"ee39c1f1b66705e162920006650cae4735f3a85bdc83424a5ac045f5160e7646"}
Sep 09 13:42:12.876185 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:12.876120    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj" podStartSLOduration=1.876104283 podStartE2EDuration="1.876104283s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 13:42:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 13:42:12.873785415 +0000 UTC m=+944.689309644" watchObservedRunningTime="2026-09-09 13:42:12.876104283 +0000 UTC m=+944.691628478"
Sep 09 13:42:12.990501 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:12.990469    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:42:13.259626 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:13.259592    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj"
Sep 09 13:42:13.264709 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:13.264680    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj"
Sep 09 13:42:13.856594 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:13.856565    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj"
Sep 09 13:42:13.857695 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:13.857671    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj"
Sep 09 13:42:14.801641 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:14.801608    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:42:14.915432 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:14.915402    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:42:15.962223 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:15.962192    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:42:16.063183 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:16.063152    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:42:16.275205 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:16.275102    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:42:16.560635 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:16.560539    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:42:16.655495 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:16.655460    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:42:16.834630 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:16.834556    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-c5f375-8598dfd9c-rl2nr"]
Sep 09 13:42:16.834923 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:16.834911    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="803b566b-b66a-45e5-bf1f-20be0a978c32" containerName="istio-proxy"
Sep 09 13:42:16.834970 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:16.834925    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="803b566b-b66a-45e5-bf1f-20be0a978c32" containerName="istio-proxy"
Sep 09 13:42:16.834970 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:16.834937    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c" containerName="istio-proxy"
Sep 09 13:42:16.834970 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:16.834942    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c" containerName="istio-proxy"
Sep 09 13:42:16.835061 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:16.835007    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce5bd2e6-b943-4fe4-80ac-5ea5d21f4f5c" containerName="istio-proxy"
Sep 09 13:42:16.837104 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:16.837089    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-c5f375-8598dfd9c-rl2nr"
Sep 09 13:42:16.839568 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:16.839545    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-c5f375\""
Sep 09 13:42:16.839700 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:16.839650    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-c5f375-dockercfg-kt9tx\""
Sep 09 13:42:16.849243 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:16.849221    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-c5f375-8598dfd9c-rl2nr"]
Sep 09 13:42:16.949027 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:16.948982    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzmfq\" (UniqueName: \"kubernetes.io/projected/274bfac5-9b6e-4a1f-b9cc-e21cff926491-kube-api-access-hzmfq\") pod \"payload-processing-e2e-explicit-c5f375-8598dfd9c-rl2nr\" (UID: \"274bfac5-9b6e-4a1f-b9cc-e21cff926491\") " pod="openshift-ingress/payload-processing-e2e-explicit-c5f375-8598dfd9c-rl2nr"
Sep 09 13:42:16.949237 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:16.949135    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/274bfac5-9b6e-4a1f-b9cc-e21cff926491-plugins-config-volume\") pod \"payload-processing-e2e-explicit-c5f375-8598dfd9c-rl2nr\" (UID: \"274bfac5-9b6e-4a1f-b9cc-e21cff926491\") " pod="openshift-ingress/payload-processing-e2e-explicit-c5f375-8598dfd9c-rl2nr"
Sep 09 13:42:17.050548 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:17.050511    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/274bfac5-9b6e-4a1f-b9cc-e21cff926491-plugins-config-volume\") pod \"payload-processing-e2e-explicit-c5f375-8598dfd9c-rl2nr\" (UID: \"274bfac5-9b6e-4a1f-b9cc-e21cff926491\") " pod="openshift-ingress/payload-processing-e2e-explicit-c5f375-8598dfd9c-rl2nr"
Sep 09 13:42:17.050548 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:17.050553    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzmfq\" (UniqueName: \"kubernetes.io/projected/274bfac5-9b6e-4a1f-b9cc-e21cff926491-kube-api-access-hzmfq\") pod \"payload-processing-e2e-explicit-c5f375-8598dfd9c-rl2nr\" (UID: \"274bfac5-9b6e-4a1f-b9cc-e21cff926491\") " pod="openshift-ingress/payload-processing-e2e-explicit-c5f375-8598dfd9c-rl2nr"
Sep 09 13:42:17.051189 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:17.051156    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/274bfac5-9b6e-4a1f-b9cc-e21cff926491-plugins-config-volume\") pod \"payload-processing-e2e-explicit-c5f375-8598dfd9c-rl2nr\" (UID: \"274bfac5-9b6e-4a1f-b9cc-e21cff926491\") " pod="openshift-ingress/payload-processing-e2e-explicit-c5f375-8598dfd9c-rl2nr"
Sep 09 13:42:17.060295 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:17.060270    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzmfq\" (UniqueName: \"kubernetes.io/projected/274bfac5-9b6e-4a1f-b9cc-e21cff926491-kube-api-access-hzmfq\") pod \"payload-processing-e2e-explicit-c5f375-8598dfd9c-rl2nr\" (UID: \"274bfac5-9b6e-4a1f-b9cc-e21cff926491\") " pod="openshift-ingress/payload-processing-e2e-explicit-c5f375-8598dfd9c-rl2nr"
Sep 09 13:42:17.147109 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:17.147073    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-c5f375-8598dfd9c-rl2nr"
Sep 09 13:42:17.418538 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:17.418510    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-c5f375-8598dfd9c-rl2nr"]
Sep 09 13:42:17.420797 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:42:17.420763    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod274bfac5_9b6e_4a1f_b9cc_e21cff926491.slice/crio-792b02b5277f30e232efcb53103193090f75d89700782eb9e4d7fb76e56948d0 WatchSource:0}: Error finding container 792b02b5277f30e232efcb53103193090f75d89700782eb9e4d7fb76e56948d0: Status 404 returned error can't find the container with id 792b02b5277f30e232efcb53103193090f75d89700782eb9e4d7fb76e56948d0
Sep 09 13:42:17.878586 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:17.878549    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-c5f375-8598dfd9c-rl2nr" event={"ID":"274bfac5-9b6e-4a1f-b9cc-e21cff926491","Type":"ContainerStarted","Data":"d63da121aed0779a47269b7efd8380ad30f38826eaf5c8934c64e732da7ac2cc"}
Sep 09 13:42:17.878773 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:17.878599    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-c5f375-8598dfd9c-rl2nr" event={"ID":"274bfac5-9b6e-4a1f-b9cc-e21cff926491","Type":"ContainerStarted","Data":"792b02b5277f30e232efcb53103193090f75d89700782eb9e4d7fb76e56948d0"}
Sep 09 13:42:17.878773 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:17.878631    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-explicit-c5f375-8598dfd9c-rl2nr"
Sep 09 13:42:17.894876 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:17.894823    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-explicit-c5f375-8598dfd9c-rl2nr" podStartSLOduration=1.8948066670000001 podStartE2EDuration="1.894806667s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 13:42:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 13:42:17.894097505 +0000 UTC m=+949.709621716" watchObservedRunningTime="2026-09-09 13:42:17.894806667 +0000 UTC m=+949.710330861"
Sep 09 13:42:18.202492 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:18.202400    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:42:23.973693 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:23.973650    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:42:24.078874 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:24.078838    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:42:24.174771 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:24.174726    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:42:28.871866 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:28.871835    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:42:28.885715 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:28.885689    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-explicit-c5f375-8598dfd9c-rl2nr"
Sep 09 13:42:29.898330 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:29.898297    2578 patch_prober.go:28] interesting pod/e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 09 13:42:29.898683 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:29.898370    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj" podUID="330bba01-13f6-4444-9cd5-8bec11aa10f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 09 13:42:30.947108 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:30.947073    2578 generic.go:356] "Generic (PLEG): container finished" podID="330bba01-13f6-4444-9cd5-8bec11aa10f3" containerID="30ce1a7c9ba95d1dd9dccde866f3151b273d4332d19f337368a599eb5f5e87c1" exitCode=0
Sep 09 13:42:30.947573 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:30.947145    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj" event={"ID":"330bba01-13f6-4444-9cd5-8bec11aa10f3","Type":"ContainerDied","Data":"30ce1a7c9ba95d1dd9dccde866f3151b273d4332d19f337368a599eb5f5e87c1"}
Sep 09 13:42:30.947573 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:30.947533    2578 scope.go:117] "RemoveContainer" containerID="30ce1a7c9ba95d1dd9dccde866f3151b273d4332d19f337368a599eb5f5e87c1"
Sep 09 13:42:30.948575 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:30.948546    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 13:42:30.948683 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:30.948648    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 13:42:30.948748 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:30.948697    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 13:42:31.954083 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:31.954044    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj" event={"ID":"330bba01-13f6-4444-9cd5-8bec11aa10f3","Type":"ContainerStarted","Data":"ca8a9ac85b9725fb82b311de8947af959a785f2d45b88d289f347d4ee64a26b9"}
Sep 09 13:42:32.260715 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:32.260628    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj"
Sep 09 13:42:32.260950 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:32.260924    2578 patch_prober.go:28] interesting pod/e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 09 13:42:32.261035 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:32.260982    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj" podUID="330bba01-13f6-4444-9cd5-8bec11aa10f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 09 13:42:33.260220 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:33.260160    2578 patch_prober.go:28] interesting pod/e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 09 13:42:33.260677 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:33.260270    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj" podUID="330bba01-13f6-4444-9cd5-8bec11aa10f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 09 13:42:34.260700 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:34.260659    2578 patch_prober.go:28] interesting pod/e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 09 13:42:34.261084 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:34.260720    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj" podUID="330bba01-13f6-4444-9cd5-8bec11aa10f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 09 13:42:35.260796 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:35.260757    2578 patch_prober.go:28] interesting pod/e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 09 13:42:35.261235 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:35.260833    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj" podUID="330bba01-13f6-4444-9cd5-8bec11aa10f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 09 13:42:36.260847 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:36.260807    2578 patch_prober.go:28] interesting pod/e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 09 13:42:36.261267 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:36.260891    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj" podUID="330bba01-13f6-4444-9cd5-8bec11aa10f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 09 13:42:37.263423 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:37.263391    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj"
Sep 09 13:42:37.263883 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:37.263681    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj"
Sep 09 13:42:37.264455 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:37.264435    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj"
Sep 09 13:42:39.695516 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:39.695483    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:42:39.986434 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:39.986358    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:42:43.272213 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:43.271267    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:42:45.973996 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:45.973962    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:42:46.077592 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:46.077562    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:42:46.211013 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:46.210984    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:42:56.698749 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:56.698665    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:42:57.258307 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:57.258275    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:42:57.436804 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:42:57.436766    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:43:03.512661 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:03.512621    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:43:03.668613 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:03.668559    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:43:03.767087 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:03.767004    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:43:04.428800 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:04.428765    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:43:04.525307 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:04.525272    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:43:04.625947 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:04.625918    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:43:06.045623 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:06.045584    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:43:07.102532 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:07.102498    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:43:09.458368 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:09.458335    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:43:09.565682 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:09.565645    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:43:11.883401 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:11.883363    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:43:11.981049 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:11.981019    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:43:12.513811 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:12.513777    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:43:18.753510 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:18.753458    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:43:18.854032 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:18.853977    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:43:18.981734 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:18.981702    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:43:19.377951 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:19.377922    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:43:19.523817 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:19.523787    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:43:21.942313 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:21.942276    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:43:22.042258 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:22.042229    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:43:23.200545 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:23.200506    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:43:23.301911 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:23.301877    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:43:23.430952 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:23.430921    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:43:23.779857 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:23.779827    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:43:23.902633 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:23.902604    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-905b058d-776879fffd-2fpjs"]
Sep 09 13:43:23.906314 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:23.906296    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-905b058d-776879fffd-2fpjs"
Sep 09 13:43:23.909287 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:23.909256    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-905b058d-dockercfg-c7kb6\""
Sep 09 13:43:23.909287 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:23.909256    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-905b058d\""
Sep 09 13:43:23.921149 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:23.921124    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-905b058d-776879fffd-2fpjs"]
Sep 09 13:43:23.927120 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:23.927096    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-905b058d-677cc4f79c-xfcs8"]
Sep 09 13:43:23.930423 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:23.930407    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-905b058d-677cc4f79c-xfcs8"
Sep 09 13:43:23.942929 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:23.942903    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-905b058d-677cc4f79c-xfcs8"]
Sep 09 13:43:23.961746 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:23.961717    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7011a2ad-2f9e-45d8-8fd7-bd14b4d934c2-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-905b058d-776879fffd-2fpjs\" (UID: \"7011a2ad-2f9e-45d8-8fd7-bd14b4d934c2\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-905b058d-776879fffd-2fpjs"
Sep 09 13:43:23.961897 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:23.961768    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8c9m\" (UniqueName: \"kubernetes.io/projected/7011a2ad-2f9e-45d8-8fd7-bd14b4d934c2-kube-api-access-t8c9m\") pod \"payload-pre-processing-e2e-mt-905b058d-776879fffd-2fpjs\" (UID: \"7011a2ad-2f9e-45d8-8fd7-bd14b4d934c2\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-905b058d-776879fffd-2fpjs"
Sep 09 13:43:23.961897 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:23.961788    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9khcs\" (UniqueName: \"kubernetes.io/projected/bd1ea363-c74f-4799-b316-c1045b6e4a5a-kube-api-access-9khcs\") pod \"payload-processing-e2e-mt-905b058d-677cc4f79c-xfcs8\" (UID: \"bd1ea363-c74f-4799-b316-c1045b6e4a5a\") " pod="openshift-ingress/payload-processing-e2e-mt-905b058d-677cc4f79c-xfcs8"
Sep 09 13:43:23.961974 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:23.961914    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bd1ea363-c74f-4799-b316-c1045b6e4a5a-plugins-config-volume\") pod \"payload-processing-e2e-mt-905b058d-677cc4f79c-xfcs8\" (UID: \"bd1ea363-c74f-4799-b316-c1045b6e4a5a\") " pod="openshift-ingress/payload-processing-e2e-mt-905b058d-677cc4f79c-xfcs8"
Sep 09 13:43:24.062590 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:24.062509    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bd1ea363-c74f-4799-b316-c1045b6e4a5a-plugins-config-volume\") pod \"payload-processing-e2e-mt-905b058d-677cc4f79c-xfcs8\" (UID: \"bd1ea363-c74f-4799-b316-c1045b6e4a5a\") " pod="openshift-ingress/payload-processing-e2e-mt-905b058d-677cc4f79c-xfcs8"
Sep 09 13:43:24.062590 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:24.062553    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7011a2ad-2f9e-45d8-8fd7-bd14b4d934c2-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-905b058d-776879fffd-2fpjs\" (UID: \"7011a2ad-2f9e-45d8-8fd7-bd14b4d934c2\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-905b058d-776879fffd-2fpjs"
Sep 09 13:43:24.062771 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:24.062622    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8c9m\" (UniqueName: \"kubernetes.io/projected/7011a2ad-2f9e-45d8-8fd7-bd14b4d934c2-kube-api-access-t8c9m\") pod \"payload-pre-processing-e2e-mt-905b058d-776879fffd-2fpjs\" (UID: \"7011a2ad-2f9e-45d8-8fd7-bd14b4d934c2\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-905b058d-776879fffd-2fpjs"
Sep 09 13:43:24.062771 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:24.062736    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9khcs\" (UniqueName: \"kubernetes.io/projected/bd1ea363-c74f-4799-b316-c1045b6e4a5a-kube-api-access-9khcs\") pod \"payload-processing-e2e-mt-905b058d-677cc4f79c-xfcs8\" (UID: \"bd1ea363-c74f-4799-b316-c1045b6e4a5a\") " pod="openshift-ingress/payload-processing-e2e-mt-905b058d-677cc4f79c-xfcs8"
Sep 09 13:43:24.063312 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:24.063293    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bd1ea363-c74f-4799-b316-c1045b6e4a5a-plugins-config-volume\") pod \"payload-processing-e2e-mt-905b058d-677cc4f79c-xfcs8\" (UID: \"bd1ea363-c74f-4799-b316-c1045b6e4a5a\") " pod="openshift-ingress/payload-processing-e2e-mt-905b058d-677cc4f79c-xfcs8"
Sep 09 13:43:24.063361 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:24.063333    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7011a2ad-2f9e-45d8-8fd7-bd14b4d934c2-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-905b058d-776879fffd-2fpjs\" (UID: \"7011a2ad-2f9e-45d8-8fd7-bd14b4d934c2\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-905b058d-776879fffd-2fpjs"
Sep 09 13:43:24.070676 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:24.070652    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9khcs\" (UniqueName: \"kubernetes.io/projected/bd1ea363-c74f-4799-b316-c1045b6e4a5a-kube-api-access-9khcs\") pod \"payload-processing-e2e-mt-905b058d-677cc4f79c-xfcs8\" (UID: \"bd1ea363-c74f-4799-b316-c1045b6e4a5a\") " pod="openshift-ingress/payload-processing-e2e-mt-905b058d-677cc4f79c-xfcs8"
Sep 09 13:43:24.070862 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:24.070839    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8c9m\" (UniqueName: \"kubernetes.io/projected/7011a2ad-2f9e-45d8-8fd7-bd14b4d934c2-kube-api-access-t8c9m\") pod \"payload-pre-processing-e2e-mt-905b058d-776879fffd-2fpjs\" (UID: \"7011a2ad-2f9e-45d8-8fd7-bd14b4d934c2\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-905b058d-776879fffd-2fpjs"
Sep 09 13:43:24.216669 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:24.216630    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-905b058d-776879fffd-2fpjs"
Sep 09 13:43:24.241951 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:24.241920    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-905b058d-677cc4f79c-xfcs8"
Sep 09 13:43:24.243665 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:24.243633    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:43:24.361998 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:24.361913    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:43:24.489443 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:24.489419    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-905b058d-776879fffd-2fpjs"]
Sep 09 13:43:24.491238 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:43:24.491212    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7011a2ad_2f9e_45d8_8fd7_bd14b4d934c2.slice/crio-b00878e29fd2c8f3ff10428a4b3aa77b1ce0c4fa90fe1af987794b770a584358 WatchSource:0}: Error finding container b00878e29fd2c8f3ff10428a4b3aa77b1ce0c4fa90fe1af987794b770a584358: Status 404 returned error can't find the container with id b00878e29fd2c8f3ff10428a4b3aa77b1ce0c4fa90fe1af987794b770a584358
Sep 09 13:43:24.523330 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:24.523307    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-905b058d-677cc4f79c-xfcs8"]
Sep 09 13:43:24.526306 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:43:24.526281    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd1ea363_c74f_4799_b316_c1045b6e4a5a.slice/crio-a6d252ea31cba8dbc77f88f6a3ad49612c97c35fa6aaf12f614483d59197dcc0 WatchSource:0}: Error finding container a6d252ea31cba8dbc77f88f6a3ad49612c97c35fa6aaf12f614483d59197dcc0: Status 404 returned error can't find the container with id a6d252ea31cba8dbc77f88f6a3ad49612c97c35fa6aaf12f614483d59197dcc0
Sep 09 13:43:25.205682 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:25.205646    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-905b058d-776879fffd-2fpjs" event={"ID":"7011a2ad-2f9e-45d8-8fd7-bd14b4d934c2","Type":"ContainerStarted","Data":"da445816a337b2cfcccd8285c9b7a335bb69c1cfe0bec39f0480f16d5028cc84"}
Sep 09 13:43:25.205894 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:25.205716    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-905b058d-776879fffd-2fpjs" event={"ID":"7011a2ad-2f9e-45d8-8fd7-bd14b4d934c2","Type":"ContainerStarted","Data":"b00878e29fd2c8f3ff10428a4b3aa77b1ce0c4fa90fe1af987794b770a584358"}
Sep 09 13:43:25.205894 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:25.205749    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-905b058d-776879fffd-2fpjs"
Sep 09 13:43:25.207321 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:25.207296    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-905b058d-677cc4f79c-xfcs8" event={"ID":"bd1ea363-c74f-4799-b316-c1045b6e4a5a","Type":"ContainerStarted","Data":"e7eeb1863633082900f8cdb30a3fbc0e4bb91cc6977c71d34e7f7cb34772ea01"}
Sep 09 13:43:25.207427 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:25.207345    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-905b058d-677cc4f79c-xfcs8" event={"ID":"bd1ea363-c74f-4799-b316-c1045b6e4a5a","Type":"ContainerStarted","Data":"a6d252ea31cba8dbc77f88f6a3ad49612c97c35fa6aaf12f614483d59197dcc0"}
Sep 09 13:43:25.207427 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:25.207373    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-905b058d-677cc4f79c-xfcs8"
Sep 09 13:43:25.224443 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:25.224398    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-905b058d-776879fffd-2fpjs" podStartSLOduration=2.224383589 podStartE2EDuration="2.224383589s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 13:43:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 13:43:25.222854981 +0000 UTC m=+1017.038379175" watchObservedRunningTime="2026-09-09 13:43:25.224383589 +0000 UTC m=+1017.039907782"
Sep 09 13:43:25.240534 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:25.240477    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-905b058d-677cc4f79c-xfcs8" podStartSLOduration=2.240463948 podStartE2EDuration="2.240463948s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 13:43:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 13:43:25.23881117 +0000 UTC m=+1017.054335391" watchObservedRunningTime="2026-09-09 13:43:25.240463948 +0000 UTC m=+1017.055988144"
Sep 09 13:43:26.715798 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:26.715765    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:43:30.833987 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:30.833952    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:43:31.071961 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:31.071923    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:43:31.979881 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:31.979852    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:43:32.397403 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:32.397371    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:43:36.214330 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:36.214300    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-905b058d-776879fffd-2fpjs"
Sep 09 13:43:36.214718 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:36.214368    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-905b058d-677cc4f79c-xfcs8"
Sep 09 13:43:38.967714 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:38.967674    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:43:41.117541 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:41.117503    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:43:41.722669 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:41.722639    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:43:41.763808 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:41.763769    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-4f59a0-64bd959987-b44w8"]
Sep 09 13:43:41.764033 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:41.763998    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-4f59a0-64bd959987-b44w8" podUID="de00814d-c412-4d77-95cd-8c4a8d28d080" containerName="payload-processing" containerID="cri-o://23d0f1191ecf962a806da76c48c60bbfb86fb86b4b0ea634ed5fc0d684eb382e" gracePeriod=30
Sep 09 13:43:41.851449 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:41.851411    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:43:41.979401 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:41.979318    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:43:42.016335 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:42.016303    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-4f59a0-64bd959987-b44w8"
Sep 09 13:43:42.063527 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:42.063494    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:43:42.133850 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:42.133821    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de00814d-c412-4d77-95cd-8c4a8d28d080-plugins-config-volume\") pod \"de00814d-c412-4d77-95cd-8c4a8d28d080\" (UID: \"de00814d-c412-4d77-95cd-8c4a8d28d080\") "
Sep 09 13:43:42.134235 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:42.133913    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-trg6l\" (UniqueName: \"kubernetes.io/projected/de00814d-c412-4d77-95cd-8c4a8d28d080-kube-api-access-trg6l\") pod \"de00814d-c412-4d77-95cd-8c4a8d28d080\" (UID: \"de00814d-c412-4d77-95cd-8c4a8d28d080\") "
Sep 09 13:43:42.134235 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:42.134207    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de00814d-c412-4d77-95cd-8c4a8d28d080-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "de00814d-c412-4d77-95cd-8c4a8d28d080" (UID: "de00814d-c412-4d77-95cd-8c4a8d28d080"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 13:43:42.135968 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:42.135941    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de00814d-c412-4d77-95cd-8c4a8d28d080-kube-api-access-trg6l" (OuterVolumeSpecName: "kube-api-access-trg6l") pod "de00814d-c412-4d77-95cd-8c4a8d28d080" (UID: "de00814d-c412-4d77-95cd-8c4a8d28d080"). InnerVolumeSpecName "kube-api-access-trg6l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 13:43:42.136999 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:42.136974    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:43:42.235148 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:42.235064    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de00814d-c412-4d77-95cd-8c4a8d28d080-plugins-config-volume\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:43:42.235148 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:42.235093    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-trg6l\" (UniqueName: \"kubernetes.io/projected/de00814d-c412-4d77-95cd-8c4a8d28d080-kube-api-access-trg6l\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:43:42.288525 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:42.288490    2578 generic.go:356] "Generic (PLEG): container finished" podID="de00814d-c412-4d77-95cd-8c4a8d28d080" containerID="23d0f1191ecf962a806da76c48c60bbfb86fb86b4b0ea634ed5fc0d684eb382e" exitCode=0
Sep 09 13:43:42.288698 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:42.288538    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-4f59a0-64bd959987-b44w8"
Sep 09 13:43:42.288698 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:42.288564    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-4f59a0-64bd959987-b44w8" event={"ID":"de00814d-c412-4d77-95cd-8c4a8d28d080","Type":"ContainerDied","Data":"23d0f1191ecf962a806da76c48c60bbfb86fb86b4b0ea634ed5fc0d684eb382e"}
Sep 09 13:43:42.288698 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:42.288613    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-4f59a0-64bd959987-b44w8" event={"ID":"de00814d-c412-4d77-95cd-8c4a8d28d080","Type":"ContainerDied","Data":"450ac9b927c9cd520eb31f08ab9b6accb8a12859ba515553228d1c75edf95177"}
Sep 09 13:43:42.288698 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:42.288635    2578 scope.go:117] "RemoveContainer" containerID="23d0f1191ecf962a806da76c48c60bbfb86fb86b4b0ea634ed5fc0d684eb382e"
Sep 09 13:43:42.297276 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:42.297262    2578 scope.go:117] "RemoveContainer" containerID="23d0f1191ecf962a806da76c48c60bbfb86fb86b4b0ea634ed5fc0d684eb382e"
Sep 09 13:43:42.297540 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:43:42.297517    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23d0f1191ecf962a806da76c48c60bbfb86fb86b4b0ea634ed5fc0d684eb382e\": container with ID starting with 23d0f1191ecf962a806da76c48c60bbfb86fb86b4b0ea634ed5fc0d684eb382e not found: ID does not exist" containerID="23d0f1191ecf962a806da76c48c60bbfb86fb86b4b0ea634ed5fc0d684eb382e"
Sep 09 13:43:42.297640 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:42.297547    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23d0f1191ecf962a806da76c48c60bbfb86fb86b4b0ea634ed5fc0d684eb382e"} err="failed to get container status \"23d0f1191ecf962a806da76c48c60bbfb86fb86b4b0ea634ed5fc0d684eb382e\": rpc error: code = NotFound desc = could not find container \"23d0f1191ecf962a806da76c48c60bbfb86fb86b4b0ea634ed5fc0d684eb382e\": container with ID starting with 23d0f1191ecf962a806da76c48c60bbfb86fb86b4b0ea634ed5fc0d684eb382e not found: ID does not exist"
Sep 09 13:43:42.309378 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:42.309354    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-4f59a0-64bd959987-b44w8"]
Sep 09 13:43:42.315964 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:42.315940    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-4f59a0-64bd959987-b44w8"]
Sep 09 13:43:42.427920 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:42.427881    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:43:42.497821 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:42.497743    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:43:42.661272 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:42.661243    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de00814d-c412-4d77-95cd-8c4a8d28d080" path="/var/lib/kubelet/pods/de00814d-c412-4d77-95cd-8c4a8d28d080/volumes"
Sep 09 13:43:42.993481 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:42.993450    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:43:43.030082 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:43.030048    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-c5f375-8598dfd9c-rl2nr"]
Sep 09 13:43:43.030291 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:43.030270    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-explicit-c5f375-8598dfd9c-rl2nr" podUID="274bfac5-9b6e-4a1f-b9cc-e21cff926491" containerName="payload-processing" containerID="cri-o://d63da121aed0779a47269b7efd8380ad30f38826eaf5c8934c64e732da7ac2cc" gracePeriod=30
Sep 09 13:43:43.097108 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:43.097075    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:43:43.207078 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:43.207050    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:43:43.284824 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:43.284801    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-c5f375-8598dfd9c-rl2nr"
Sep 09 13:43:43.294023 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:43.293997    2578 generic.go:356] "Generic (PLEG): container finished" podID="274bfac5-9b6e-4a1f-b9cc-e21cff926491" containerID="d63da121aed0779a47269b7efd8380ad30f38826eaf5c8934c64e732da7ac2cc" exitCode=0
Sep 09 13:43:43.294163 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:43.294035    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-c5f375-8598dfd9c-rl2nr" event={"ID":"274bfac5-9b6e-4a1f-b9cc-e21cff926491","Type":"ContainerDied","Data":"d63da121aed0779a47269b7efd8380ad30f38826eaf5c8934c64e732da7ac2cc"}
Sep 09 13:43:43.294163 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:43.294094    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-c5f375-8598dfd9c-rl2nr" event={"ID":"274bfac5-9b6e-4a1f-b9cc-e21cff926491","Type":"ContainerDied","Data":"792b02b5277f30e232efcb53103193090f75d89700782eb9e4d7fb76e56948d0"}
Sep 09 13:43:43.294163 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:43.294044    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-c5f375-8598dfd9c-rl2nr"
Sep 09 13:43:43.294163 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:43.294125    2578 scope.go:117] "RemoveContainer" containerID="d63da121aed0779a47269b7efd8380ad30f38826eaf5c8934c64e732da7ac2cc"
Sep 09 13:43:43.302236 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:43.302219    2578 scope.go:117] "RemoveContainer" containerID="d63da121aed0779a47269b7efd8380ad30f38826eaf5c8934c64e732da7ac2cc"
Sep 09 13:43:43.302508 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:43:43.302489    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d63da121aed0779a47269b7efd8380ad30f38826eaf5c8934c64e732da7ac2cc\": container with ID starting with d63da121aed0779a47269b7efd8380ad30f38826eaf5c8934c64e732da7ac2cc not found: ID does not exist" containerID="d63da121aed0779a47269b7efd8380ad30f38826eaf5c8934c64e732da7ac2cc"
Sep 09 13:43:43.302559 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:43.302517    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d63da121aed0779a47269b7efd8380ad30f38826eaf5c8934c64e732da7ac2cc"} err="failed to get container status \"d63da121aed0779a47269b7efd8380ad30f38826eaf5c8934c64e732da7ac2cc\": rpc error: code = NotFound desc = could not find container \"d63da121aed0779a47269b7efd8380ad30f38826eaf5c8934c64e732da7ac2cc\": container with ID starting with d63da121aed0779a47269b7efd8380ad30f38826eaf5c8934c64e732da7ac2cc not found: ID does not exist"
Sep 09 13:43:43.310422 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:43.310392    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:43:43.378448 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:43.378415    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:43:43.448379 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:43.448344    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/274bfac5-9b6e-4a1f-b9cc-e21cff926491-plugins-config-volume\") pod \"274bfac5-9b6e-4a1f-b9cc-e21cff926491\" (UID: \"274bfac5-9b6e-4a1f-b9cc-e21cff926491\") "
Sep 09 13:43:43.448553 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:43.448390    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hzmfq\" (UniqueName: \"kubernetes.io/projected/274bfac5-9b6e-4a1f-b9cc-e21cff926491-kube-api-access-hzmfq\") pod \"274bfac5-9b6e-4a1f-b9cc-e21cff926491\" (UID: \"274bfac5-9b6e-4a1f-b9cc-e21cff926491\") "
Sep 09 13:43:43.448764 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:43.448738    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/274bfac5-9b6e-4a1f-b9cc-e21cff926491-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "274bfac5-9b6e-4a1f-b9cc-e21cff926491" (UID: "274bfac5-9b6e-4a1f-b9cc-e21cff926491"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 13:43:43.450444 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:43.450417    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/274bfac5-9b6e-4a1f-b9cc-e21cff926491-kube-api-access-hzmfq" (OuterVolumeSpecName: "kube-api-access-hzmfq") pod "274bfac5-9b6e-4a1f-b9cc-e21cff926491" (UID: "274bfac5-9b6e-4a1f-b9cc-e21cff926491"). InnerVolumeSpecName "kube-api-access-hzmfq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 13:43:43.549660 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:43.549578    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/274bfac5-9b6e-4a1f-b9cc-e21cff926491-plugins-config-volume\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:43:43.549660 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:43.549606    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hzmfq\" (UniqueName: \"kubernetes.io/projected/274bfac5-9b6e-4a1f-b9cc-e21cff926491-kube-api-access-hzmfq\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:43:43.622374 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:43.622342    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-c5f375-8598dfd9c-rl2nr"]
Sep 09 13:43:43.629535 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:43.629509    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-c5f375-8598dfd9c-rl2nr"]
Sep 09 13:43:43.666186 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:43.666150    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:43:44.180039 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:44.180003    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:43:44.660905 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:44.660863    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="274bfac5-9b6e-4a1f-b9cc-e21cff926491" path="/var/lib/kubelet/pods/274bfac5-9b6e-4a1f-b9cc-e21cff926491/volumes"
Sep 09 13:43:46.894518 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:46.894484    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:43:47.601127 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:47.601091    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:43:47.700427 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:47.700375    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:43:47.995345 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:47.995309    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:43:48.964431 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:48.964402    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:43:49.063517 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:49.063481    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:43:49.252502 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:49.252406    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:43:49.804092 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:49.804059    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:43:50.647931 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:50.647898    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:43:50.751575 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:50.751536    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:43:50.860828 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:50.860797    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj"]
Sep 09 13:43:50.861079 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:50.861051    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj" podUID="330bba01-13f6-4444-9cd5-8bec11aa10f3" containerName="istio-proxy" containerID="cri-o://ca8a9ac85b9725fb82b311de8947af959a785f2d45b88d289f347d4ee64a26b9" gracePeriod=30
Sep 09 13:43:50.889130 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:50.889104    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:43:51.317159 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:51.317110    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:43:51.469375 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:51.469337    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:43:51.630048 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:51.630019    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:43:51.783503 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:51.783465    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:43:52.266359 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:52.266320    2578 patch_prober.go:28] interesting pod/e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 09 13:43:52.266520 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:52.266393    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj" podUID="330bba01-13f6-4444-9cd5-8bec11aa10f3" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 13:43:52.570651 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:52.570544    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:43:52.661938 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:52.661901    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:43:52.762033 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:52.761992    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:43:54.220905 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:54.220871    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:43:54.295015 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:54.294984    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:43:54.532810 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:54.532732    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:43:56.113634 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:56.113611    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj"
Sep 09 13:43:56.170296 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:56.170218    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/330bba01-13f6-4444-9cd5-8bec11aa10f3-workload-socket\") pod \"330bba01-13f6-4444-9cd5-8bec11aa10f3\" (UID: \"330bba01-13f6-4444-9cd5-8bec11aa10f3\") "
Sep 09 13:43:56.170296 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:56.170250    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/330bba01-13f6-4444-9cd5-8bec11aa10f3-istio-envoy\") pod \"330bba01-13f6-4444-9cd5-8bec11aa10f3\" (UID: \"330bba01-13f6-4444-9cd5-8bec11aa10f3\") "
Sep 09 13:43:56.170296 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:56.170279    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/330bba01-13f6-4444-9cd5-8bec11aa10f3-credential-socket\") pod \"330bba01-13f6-4444-9cd5-8bec11aa10f3\" (UID: \"330bba01-13f6-4444-9cd5-8bec11aa10f3\") "
Sep 09 13:43:56.170560 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:56.170320    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/330bba01-13f6-4444-9cd5-8bec11aa10f3-istio-data\") pod \"330bba01-13f6-4444-9cd5-8bec11aa10f3\" (UID: \"330bba01-13f6-4444-9cd5-8bec11aa10f3\") "
Sep 09 13:43:56.170560 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:56.170356    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/330bba01-13f6-4444-9cd5-8bec11aa10f3-istio-token\") pod \"330bba01-13f6-4444-9cd5-8bec11aa10f3\" (UID: \"330bba01-13f6-4444-9cd5-8bec11aa10f3\") "
Sep 09 13:43:56.170560 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:56.170414    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/330bba01-13f6-4444-9cd5-8bec11aa10f3-workload-certs\") pod \"330bba01-13f6-4444-9cd5-8bec11aa10f3\" (UID: \"330bba01-13f6-4444-9cd5-8bec11aa10f3\") "
Sep 09 13:43:56.170560 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:56.170443    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/330bba01-13f6-4444-9cd5-8bec11aa10f3-istiod-ca-cert\") pod \"330bba01-13f6-4444-9cd5-8bec11aa10f3\" (UID: \"330bba01-13f6-4444-9cd5-8bec11aa10f3\") "
Sep 09 13:43:56.170560 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:56.170493    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/330bba01-13f6-4444-9cd5-8bec11aa10f3-istio-podinfo\") pod \"330bba01-13f6-4444-9cd5-8bec11aa10f3\" (UID: \"330bba01-13f6-4444-9cd5-8bec11aa10f3\") "
Sep 09 13:43:56.170560 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:56.170538    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h5qjx\" (UniqueName: \"kubernetes.io/projected/330bba01-13f6-4444-9cd5-8bec11aa10f3-kube-api-access-h5qjx\") pod \"330bba01-13f6-4444-9cd5-8bec11aa10f3\" (UID: \"330bba01-13f6-4444-9cd5-8bec11aa10f3\") "
Sep 09 13:43:56.170871 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:56.170548    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/330bba01-13f6-4444-9cd5-8bec11aa10f3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "330bba01-13f6-4444-9cd5-8bec11aa10f3" (UID: "330bba01-13f6-4444-9cd5-8bec11aa10f3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 13:43:56.170871 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:56.170632    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/330bba01-13f6-4444-9cd5-8bec11aa10f3-istio-data" (OuterVolumeSpecName: "istio-data") pod "330bba01-13f6-4444-9cd5-8bec11aa10f3" (UID: "330bba01-13f6-4444-9cd5-8bec11aa10f3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 13:43:56.170871 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:56.170644    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/330bba01-13f6-4444-9cd5-8bec11aa10f3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "330bba01-13f6-4444-9cd5-8bec11aa10f3" (UID: "330bba01-13f6-4444-9cd5-8bec11aa10f3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 13:43:56.170871 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:56.170738    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/330bba01-13f6-4444-9cd5-8bec11aa10f3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "330bba01-13f6-4444-9cd5-8bec11aa10f3" (UID: "330bba01-13f6-4444-9cd5-8bec11aa10f3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 13:43:56.170871 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:56.170830    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/330bba01-13f6-4444-9cd5-8bec11aa10f3-workload-socket\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:43:56.170871 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:56.170850    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/330bba01-13f6-4444-9cd5-8bec11aa10f3-credential-socket\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:43:56.170871 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:56.170864    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/330bba01-13f6-4444-9cd5-8bec11aa10f3-istio-data\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:43:56.171197 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:56.170899    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/330bba01-13f6-4444-9cd5-8bec11aa10f3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "330bba01-13f6-4444-9cd5-8bec11aa10f3" (UID: "330bba01-13f6-4444-9cd5-8bec11aa10f3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 13:43:56.172585 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:56.172559    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/330bba01-13f6-4444-9cd5-8bec11aa10f3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "330bba01-13f6-4444-9cd5-8bec11aa10f3" (UID: "330bba01-13f6-4444-9cd5-8bec11aa10f3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 13:43:56.172771 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:56.172744    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/330bba01-13f6-4444-9cd5-8bec11aa10f3-istio-token" (OuterVolumeSpecName: "istio-token") pod "330bba01-13f6-4444-9cd5-8bec11aa10f3" (UID: "330bba01-13f6-4444-9cd5-8bec11aa10f3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 13:43:56.172838 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:56.172762    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/330bba01-13f6-4444-9cd5-8bec11aa10f3-kube-api-access-h5qjx" (OuterVolumeSpecName: "kube-api-access-h5qjx") pod "330bba01-13f6-4444-9cd5-8bec11aa10f3" (UID: "330bba01-13f6-4444-9cd5-8bec11aa10f3"). InnerVolumeSpecName "kube-api-access-h5qjx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 13:43:56.172838 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:56.172757    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/330bba01-13f6-4444-9cd5-8bec11aa10f3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "330bba01-13f6-4444-9cd5-8bec11aa10f3" (UID: "330bba01-13f6-4444-9cd5-8bec11aa10f3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 13:43:56.271921 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:56.271888    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/330bba01-13f6-4444-9cd5-8bec11aa10f3-istio-token\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:43:56.271921 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:56.271914    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/330bba01-13f6-4444-9cd5-8bec11aa10f3-workload-certs\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:43:56.271921 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:56.271923    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/330bba01-13f6-4444-9cd5-8bec11aa10f3-istiod-ca-cert\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:43:56.271921 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:56.271931    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/330bba01-13f6-4444-9cd5-8bec11aa10f3-istio-podinfo\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:43:56.272202 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:56.271941    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h5qjx\" (UniqueName: \"kubernetes.io/projected/330bba01-13f6-4444-9cd5-8bec11aa10f3-kube-api-access-h5qjx\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:43:56.272202 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:56.271950    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/330bba01-13f6-4444-9cd5-8bec11aa10f3-istio-envoy\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:43:56.359959 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:56.359929    2578 generic.go:356] "Generic (PLEG): container finished" podID="330bba01-13f6-4444-9cd5-8bec11aa10f3" containerID="ca8a9ac85b9725fb82b311de8947af959a785f2d45b88d289f347d4ee64a26b9" exitCode=0
Sep 09 13:43:56.360129 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:56.359975    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj"
Sep 09 13:43:56.360129 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:56.359975    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj" event={"ID":"330bba01-13f6-4444-9cd5-8bec11aa10f3","Type":"ContainerDied","Data":"ca8a9ac85b9725fb82b311de8947af959a785f2d45b88d289f347d4ee64a26b9"}
Sep 09 13:43:56.360129 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:56.360106    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj" event={"ID":"330bba01-13f6-4444-9cd5-8bec11aa10f3","Type":"ContainerDied","Data":"ee39c1f1b66705e162920006650cae4735f3a85bdc83424a5ac045f5160e7646"}
Sep 09 13:43:56.360248 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:56.360138    2578 scope.go:117] "RemoveContainer" containerID="ca8a9ac85b9725fb82b311de8947af959a785f2d45b88d289f347d4ee64a26b9"
Sep 09 13:43:56.369364 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:56.369340    2578 scope.go:117] "RemoveContainer" containerID="30ce1a7c9ba95d1dd9dccde866f3151b273d4332d19f337368a599eb5f5e87c1"
Sep 09 13:43:56.377027 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:56.377009    2578 scope.go:117] "RemoveContainer" containerID="ca8a9ac85b9725fb82b311de8947af959a785f2d45b88d289f347d4ee64a26b9"
Sep 09 13:43:56.377292 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:43:56.377272    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca8a9ac85b9725fb82b311de8947af959a785f2d45b88d289f347d4ee64a26b9\": container with ID starting with ca8a9ac85b9725fb82b311de8947af959a785f2d45b88d289f347d4ee64a26b9 not found: ID does not exist" containerID="ca8a9ac85b9725fb82b311de8947af959a785f2d45b88d289f347d4ee64a26b9"
Sep 09 13:43:56.377369 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:56.377304    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca8a9ac85b9725fb82b311de8947af959a785f2d45b88d289f347d4ee64a26b9"} err="failed to get container status \"ca8a9ac85b9725fb82b311de8947af959a785f2d45b88d289f347d4ee64a26b9\": rpc error: code = NotFound desc = could not find container \"ca8a9ac85b9725fb82b311de8947af959a785f2d45b88d289f347d4ee64a26b9\": container with ID starting with ca8a9ac85b9725fb82b311de8947af959a785f2d45b88d289f347d4ee64a26b9 not found: ID does not exist"
Sep 09 13:43:56.377369 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:56.377325    2578 scope.go:117] "RemoveContainer" containerID="30ce1a7c9ba95d1dd9dccde866f3151b273d4332d19f337368a599eb5f5e87c1"
Sep 09 13:43:56.377612 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:43:56.377595    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30ce1a7c9ba95d1dd9dccde866f3151b273d4332d19f337368a599eb5f5e87c1\": container with ID starting with 30ce1a7c9ba95d1dd9dccde866f3151b273d4332d19f337368a599eb5f5e87c1 not found: ID does not exist" containerID="30ce1a7c9ba95d1dd9dccde866f3151b273d4332d19f337368a599eb5f5e87c1"
Sep 09 13:43:56.377655 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:56.377619    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30ce1a7c9ba95d1dd9dccde866f3151b273d4332d19f337368a599eb5f5e87c1"} err="failed to get container status \"30ce1a7c9ba95d1dd9dccde866f3151b273d4332d19f337368a599eb5f5e87c1\": rpc error: code = NotFound desc = could not find container \"30ce1a7c9ba95d1dd9dccde866f3151b273d4332d19f337368a599eb5f5e87c1\": container with ID starting with 30ce1a7c9ba95d1dd9dccde866f3151b273d4332d19f337368a599eb5f5e87c1 not found: ID does not exist"
Sep 09 13:43:56.385879 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:56.385859    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj"]
Sep 09 13:43:56.394926 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:56.394905    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-c5f375-openshift-default-d55b7b76d-zqczj"]
Sep 09 13:43:56.661115 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:56.661084    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="330bba01-13f6-4444-9cd5-8bec11aa10f3" path="/var/lib/kubelet/pods/330bba01-13f6-4444-9cd5-8bec11aa10f3/volumes"
Sep 09 13:43:59.749118 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:43:59.749079    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:00.344355 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:00.344322    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-093e38-875656d78-65dhb"]
Sep 09 13:44:00.344589 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:00.344563    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-093e38-875656d78-65dhb" podUID="f5894b9d-67f3-40f8-b2d2-a07cb588dd6f" containerName="maas-api" containerID="cri-o://48a611169dd2442a6753f3e27cbef5b06ab8c3278c2eee49dd78f7a0e72070b8" gracePeriod=30
Sep 09 13:44:00.370877 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:00.370843    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:00.392195 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:00.392149    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-093e38-7df48679ff-wwkht"]
Sep 09 13:44:00.392447 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:00.392399    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-093e38-7df48679ff-wwkht" podUID="b1b9754f-380d-45ab-aeca-668ac9bc7ee4" containerName="payload-processing" containerID="cri-o://28140b168d043d20707e98812cb215420702805fcf504ec5fd9fc3eadb3d0f1a" gracePeriod=30
Sep 09 13:44:00.469601 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:00.469572    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:00.570630 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:00.570535    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:00.636612 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:00.636574    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:00.648831 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:00.648803    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-093e38-875656d78-65dhb"
Sep 09 13:44:00.674926 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:00.674902    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-093e38-7df48679ff-wwkht"
Sep 09 13:44:00.713780 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:00.713755    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5894b9d-67f3-40f8-b2d2-a07cb588dd6f-openshift-service-ca\") pod \"f5894b9d-67f3-40f8-b2d2-a07cb588dd6f\" (UID: \"f5894b9d-67f3-40f8-b2d2-a07cb588dd6f\") "
Sep 09 13:44:00.713963 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:00.713804    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f5894b9d-67f3-40f8-b2d2-a07cb588dd6f-maas-api-tls\") pod \"f5894b9d-67f3-40f8-b2d2-a07cb588dd6f\" (UID: \"f5894b9d-67f3-40f8-b2d2-a07cb588dd6f\") "
Sep 09 13:44:00.713963 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:00.713860    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g7gc8\" (UniqueName: \"kubernetes.io/projected/b1b9754f-380d-45ab-aeca-668ac9bc7ee4-kube-api-access-g7gc8\") pod \"b1b9754f-380d-45ab-aeca-668ac9bc7ee4\" (UID: \"b1b9754f-380d-45ab-aeca-668ac9bc7ee4\") "
Sep 09 13:44:00.713963 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:00.713907    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b1b9754f-380d-45ab-aeca-668ac9bc7ee4-plugins-config-volume\") pod \"b1b9754f-380d-45ab-aeca-668ac9bc7ee4\" (UID: \"b1b9754f-380d-45ab-aeca-668ac9bc7ee4\") "
Sep 09 13:44:00.713963 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:00.713949    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5894b9d-67f3-40f8-b2d2-a07cb588dd6f-metrics-certs\") pod \"f5894b9d-67f3-40f8-b2d2-a07cb588dd6f\" (UID: \"f5894b9d-67f3-40f8-b2d2-a07cb588dd6f\") "
Sep 09 13:44:00.714208 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:00.713973    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p799g\" (UniqueName: \"kubernetes.io/projected/f5894b9d-67f3-40f8-b2d2-a07cb588dd6f-kube-api-access-p799g\") pod \"f5894b9d-67f3-40f8-b2d2-a07cb588dd6f\" (UID: \"f5894b9d-67f3-40f8-b2d2-a07cb588dd6f\") "
Sep 09 13:44:00.714290 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:00.714264    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5894b9d-67f3-40f8-b2d2-a07cb588dd6f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f5894b9d-67f3-40f8-b2d2-a07cb588dd6f" (UID: "f5894b9d-67f3-40f8-b2d2-a07cb588dd6f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 13:44:00.714386 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:00.714360    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1b9754f-380d-45ab-aeca-668ac9bc7ee4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b1b9754f-380d-45ab-aeca-668ac9bc7ee4" (UID: "b1b9754f-380d-45ab-aeca-668ac9bc7ee4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 13:44:00.716276 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:00.716240    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5894b9d-67f3-40f8-b2d2-a07cb588dd6f-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f5894b9d-67f3-40f8-b2d2-a07cb588dd6f" (UID: "f5894b9d-67f3-40f8-b2d2-a07cb588dd6f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 13:44:00.716411 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:00.716385    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1b9754f-380d-45ab-aeca-668ac9bc7ee4-kube-api-access-g7gc8" (OuterVolumeSpecName: "kube-api-access-g7gc8") pod "b1b9754f-380d-45ab-aeca-668ac9bc7ee4" (UID: "b1b9754f-380d-45ab-aeca-668ac9bc7ee4"). InnerVolumeSpecName "kube-api-access-g7gc8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 13:44:00.716509 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:00.716490    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5894b9d-67f3-40f8-b2d2-a07cb588dd6f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f5894b9d-67f3-40f8-b2d2-a07cb588dd6f" (UID: "f5894b9d-67f3-40f8-b2d2-a07cb588dd6f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 13:44:00.716583 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:00.716560    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5894b9d-67f3-40f8-b2d2-a07cb588dd6f-kube-api-access-p799g" (OuterVolumeSpecName: "kube-api-access-p799g") pod "f5894b9d-67f3-40f8-b2d2-a07cb588dd6f" (UID: "f5894b9d-67f3-40f8-b2d2-a07cb588dd6f"). InnerVolumeSpecName "kube-api-access-p799g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 13:44:00.814885 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:00.814837    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5894b9d-67f3-40f8-b2d2-a07cb588dd6f-openshift-service-ca\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:44:00.814885 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:00.814878    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f5894b9d-67f3-40f8-b2d2-a07cb588dd6f-maas-api-tls\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:44:00.814885 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:00.814889    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g7gc8\" (UniqueName: \"kubernetes.io/projected/b1b9754f-380d-45ab-aeca-668ac9bc7ee4-kube-api-access-g7gc8\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:44:00.814885 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:00.814898    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b1b9754f-380d-45ab-aeca-668ac9bc7ee4-plugins-config-volume\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:44:00.814885 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:00.814908    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5894b9d-67f3-40f8-b2d2-a07cb588dd6f-metrics-certs\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:44:00.815408 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:00.814917    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p799g\" (UniqueName: \"kubernetes.io/projected/f5894b9d-67f3-40f8-b2d2-a07cb588dd6f-kube-api-access-p799g\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:44:00.915957 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:00.915878    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:01.387891 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:01.387856    2578 generic.go:356] "Generic (PLEG): container finished" podID="f5894b9d-67f3-40f8-b2d2-a07cb588dd6f" containerID="48a611169dd2442a6753f3e27cbef5b06ab8c3278c2eee49dd78f7a0e72070b8" exitCode=0
Sep 09 13:44:01.388032 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:01.387904    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-093e38-875656d78-65dhb"
Sep 09 13:44:01.388032 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:01.387945    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-093e38-875656d78-65dhb" event={"ID":"f5894b9d-67f3-40f8-b2d2-a07cb588dd6f","Type":"ContainerDied","Data":"48a611169dd2442a6753f3e27cbef5b06ab8c3278c2eee49dd78f7a0e72070b8"}
Sep 09 13:44:01.388032 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:01.388007    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-093e38-875656d78-65dhb" event={"ID":"f5894b9d-67f3-40f8-b2d2-a07cb588dd6f","Type":"ContainerDied","Data":"18d63ef7a7415b7802d1ff9c074a882e2fb3f6967e6ad750f5931898b6013802"}
Sep 09 13:44:01.388294 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:01.388038    2578 scope.go:117] "RemoveContainer" containerID="48a611169dd2442a6753f3e27cbef5b06ab8c3278c2eee49dd78f7a0e72070b8"
Sep 09 13:44:01.389500 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:01.389457    2578 generic.go:356] "Generic (PLEG): container finished" podID="b1b9754f-380d-45ab-aeca-668ac9bc7ee4" containerID="28140b168d043d20707e98812cb215420702805fcf504ec5fd9fc3eadb3d0f1a" exitCode=0
Sep 09 13:44:01.389560 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:01.389499    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-093e38-7df48679ff-wwkht" event={"ID":"b1b9754f-380d-45ab-aeca-668ac9bc7ee4","Type":"ContainerDied","Data":"28140b168d043d20707e98812cb215420702805fcf504ec5fd9fc3eadb3d0f1a"}
Sep 09 13:44:01.389560 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:01.389513    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-093e38-7df48679ff-wwkht"
Sep 09 13:44:01.389560 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:01.389539    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-093e38-7df48679ff-wwkht" event={"ID":"b1b9754f-380d-45ab-aeca-668ac9bc7ee4","Type":"ContainerDied","Data":"6b8c0aff78811f38d1ef86b20dc538fb9ecb9427eaa2260451c092f3c8c552a3"}
Sep 09 13:44:01.399072 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:01.399048    2578 scope.go:117] "RemoveContainer" containerID="48a611169dd2442a6753f3e27cbef5b06ab8c3278c2eee49dd78f7a0e72070b8"
Sep 09 13:44:01.400562 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:44:01.400480    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48a611169dd2442a6753f3e27cbef5b06ab8c3278c2eee49dd78f7a0e72070b8\": container with ID starting with 48a611169dd2442a6753f3e27cbef5b06ab8c3278c2eee49dd78f7a0e72070b8 not found: ID does not exist" containerID="48a611169dd2442a6753f3e27cbef5b06ab8c3278c2eee49dd78f7a0e72070b8"
Sep 09 13:44:01.400562 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:01.400527    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48a611169dd2442a6753f3e27cbef5b06ab8c3278c2eee49dd78f7a0e72070b8"} err="failed to get container status \"48a611169dd2442a6753f3e27cbef5b06ab8c3278c2eee49dd78f7a0e72070b8\": rpc error: code = NotFound desc = could not find container \"48a611169dd2442a6753f3e27cbef5b06ab8c3278c2eee49dd78f7a0e72070b8\": container with ID starting with 48a611169dd2442a6753f3e27cbef5b06ab8c3278c2eee49dd78f7a0e72070b8 not found: ID does not exist"
Sep 09 13:44:01.400562 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:01.400550    2578 scope.go:117] "RemoveContainer" containerID="28140b168d043d20707e98812cb215420702805fcf504ec5fd9fc3eadb3d0f1a"
Sep 09 13:44:01.409946 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:01.409927    2578 scope.go:117] "RemoveContainer" containerID="28140b168d043d20707e98812cb215420702805fcf504ec5fd9fc3eadb3d0f1a"
Sep 09 13:44:01.410285 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:44:01.410263    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28140b168d043d20707e98812cb215420702805fcf504ec5fd9fc3eadb3d0f1a\": container with ID starting with 28140b168d043d20707e98812cb215420702805fcf504ec5fd9fc3eadb3d0f1a not found: ID does not exist" containerID="28140b168d043d20707e98812cb215420702805fcf504ec5fd9fc3eadb3d0f1a"
Sep 09 13:44:01.410328 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:01.410293    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28140b168d043d20707e98812cb215420702805fcf504ec5fd9fc3eadb3d0f1a"} err="failed to get container status \"28140b168d043d20707e98812cb215420702805fcf504ec5fd9fc3eadb3d0f1a\": rpc error: code = NotFound desc = could not find container \"28140b168d043d20707e98812cb215420702805fcf504ec5fd9fc3eadb3d0f1a\": container with ID starting with 28140b168d043d20707e98812cb215420702805fcf504ec5fd9fc3eadb3d0f1a not found: ID does not exist"
Sep 09 13:44:01.415374 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:01.415353    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-093e38-875656d78-65dhb"]
Sep 09 13:44:01.419385 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:01.419360    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-093e38-875656d78-65dhb"]
Sep 09 13:44:01.429978 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:01.429959    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-093e38-7df48679ff-wwkht"]
Sep 09 13:44:01.433990 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:01.433972    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-093e38-7df48679ff-wwkht"]
Sep 09 13:44:02.660465 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:02.660432    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1b9754f-380d-45ab-aeca-668ac9bc7ee4" path="/var/lib/kubelet/pods/b1b9754f-380d-45ab-aeca-668ac9bc7ee4/volumes"
Sep 09 13:44:02.660924 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:02.660802    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5894b9d-67f3-40f8-b2d2-a07cb588dd6f" path="/var/lib/kubelet/pods/f5894b9d-67f3-40f8-b2d2-a07cb588dd6f/volumes"
Sep 09 13:44:03.669227 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:03.669190    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:44:04.568702 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:04.568665    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:05.170719 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:05.170684    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:05.192383 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:05.192353    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-905b058d-677cc4f79c-xfcs8"]
Sep 09 13:44:05.192609 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:05.192584    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-905b058d-677cc4f79c-xfcs8" podUID="bd1ea363-c74f-4799-b316-c1045b6e4a5a" containerName="payload-processing" containerID="cri-o://e7eeb1863633082900f8cdb30a3fbc0e4bb91cc6977c71d34e7f7cb34772ea01" gracePeriod=30
Sep 09 13:44:05.200753 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:05.200702    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-905b058d-776879fffd-2fpjs"]
Sep 09 13:44:05.201190 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:05.201151    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-905b058d-776879fffd-2fpjs" podUID="7011a2ad-2f9e-45d8-8fd7-bd14b4d934c2" containerName="payload-pre-processing" containerID="cri-o://da445816a337b2cfcccd8285c9b7a335bb69c1cfe0bec39f0480f16d5028cc84" gracePeriod=30
Sep 09 13:44:05.239647 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:05.239608    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:05.303223 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:05.303193    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:05.402298 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:05.402211    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:05.411894 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:05.411865    2578 generic.go:356] "Generic (PLEG): container finished" podID="7011a2ad-2f9e-45d8-8fd7-bd14b4d934c2" containerID="da445816a337b2cfcccd8285c9b7a335bb69c1cfe0bec39f0480f16d5028cc84" exitCode=0
Sep 09 13:44:05.412051 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:05.411936    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-905b058d-776879fffd-2fpjs" event={"ID":"7011a2ad-2f9e-45d8-8fd7-bd14b4d934c2","Type":"ContainerDied","Data":"da445816a337b2cfcccd8285c9b7a335bb69c1cfe0bec39f0480f16d5028cc84"}
Sep 09 13:44:05.413886 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:05.413861    2578 generic.go:356] "Generic (PLEG): container finished" podID="bd1ea363-c74f-4799-b316-c1045b6e4a5a" containerID="e7eeb1863633082900f8cdb30a3fbc0e4bb91cc6977c71d34e7f7cb34772ea01" exitCode=0
Sep 09 13:44:05.414020 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:05.413946    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-905b058d-677cc4f79c-xfcs8" event={"ID":"bd1ea363-c74f-4799-b316-c1045b6e4a5a","Type":"ContainerDied","Data":"e7eeb1863633082900f8cdb30a3fbc0e4bb91cc6977c71d34e7f7cb34772ea01"}
Sep 09 13:44:05.463621 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:05.463598    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-905b058d-677cc4f79c-xfcs8"
Sep 09 13:44:05.466384 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:05.466361    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-905b058d-776879fffd-2fpjs"
Sep 09 13:44:05.467587 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:05.467565    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:05.557560 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:05.557532    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t8c9m\" (UniqueName: \"kubernetes.io/projected/7011a2ad-2f9e-45d8-8fd7-bd14b4d934c2-kube-api-access-t8c9m\") pod \"7011a2ad-2f9e-45d8-8fd7-bd14b4d934c2\" (UID: \"7011a2ad-2f9e-45d8-8fd7-bd14b4d934c2\") "
Sep 09 13:44:05.557725 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:05.557599    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9khcs\" (UniqueName: \"kubernetes.io/projected/bd1ea363-c74f-4799-b316-c1045b6e4a5a-kube-api-access-9khcs\") pod \"bd1ea363-c74f-4799-b316-c1045b6e4a5a\" (UID: \"bd1ea363-c74f-4799-b316-c1045b6e4a5a\") "
Sep 09 13:44:05.557725 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:05.557632    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7011a2ad-2f9e-45d8-8fd7-bd14b4d934c2-plugins-config-volume\") pod \"7011a2ad-2f9e-45d8-8fd7-bd14b4d934c2\" (UID: \"7011a2ad-2f9e-45d8-8fd7-bd14b4d934c2\") "
Sep 09 13:44:05.557725 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:05.557683    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bd1ea363-c74f-4799-b316-c1045b6e4a5a-plugins-config-volume\") pod \"bd1ea363-c74f-4799-b316-c1045b6e4a5a\" (UID: \"bd1ea363-c74f-4799-b316-c1045b6e4a5a\") "
Sep 09 13:44:05.557990 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:05.557963    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7011a2ad-2f9e-45d8-8fd7-bd14b4d934c2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7011a2ad-2f9e-45d8-8fd7-bd14b4d934c2" (UID: "7011a2ad-2f9e-45d8-8fd7-bd14b4d934c2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 13:44:05.558119 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:05.558049    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd1ea363-c74f-4799-b316-c1045b6e4a5a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "bd1ea363-c74f-4799-b316-c1045b6e4a5a" (UID: "bd1ea363-c74f-4799-b316-c1045b6e4a5a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 13:44:05.559739 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:05.559716    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd1ea363-c74f-4799-b316-c1045b6e4a5a-kube-api-access-9khcs" (OuterVolumeSpecName: "kube-api-access-9khcs") pod "bd1ea363-c74f-4799-b316-c1045b6e4a5a" (UID: "bd1ea363-c74f-4799-b316-c1045b6e4a5a"). InnerVolumeSpecName "kube-api-access-9khcs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 13:44:05.559799 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:05.559741    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7011a2ad-2f9e-45d8-8fd7-bd14b4d934c2-kube-api-access-t8c9m" (OuterVolumeSpecName: "kube-api-access-t8c9m") pod "7011a2ad-2f9e-45d8-8fd7-bd14b4d934c2" (UID: "7011a2ad-2f9e-45d8-8fd7-bd14b4d934c2"). InnerVolumeSpecName "kube-api-access-t8c9m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 13:44:05.659278 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:05.659239    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t8c9m\" (UniqueName: \"kubernetes.io/projected/7011a2ad-2f9e-45d8-8fd7-bd14b4d934c2-kube-api-access-t8c9m\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:44:05.659278 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:05.659271    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9khcs\" (UniqueName: \"kubernetes.io/projected/bd1ea363-c74f-4799-b316-c1045b6e4a5a-kube-api-access-9khcs\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:44:05.659278 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:05.659281    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7011a2ad-2f9e-45d8-8fd7-bd14b4d934c2-plugins-config-volume\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:44:05.659278 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:05.659289    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bd1ea363-c74f-4799-b316-c1045b6e4a5a-plugins-config-volume\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:44:05.794744 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:05.794658    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:06.420311 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:06.420277    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-905b058d-776879fffd-2fpjs"
Sep 09 13:44:06.420311 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:06.420304    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-905b058d-776879fffd-2fpjs" event={"ID":"7011a2ad-2f9e-45d8-8fd7-bd14b4d934c2","Type":"ContainerDied","Data":"b00878e29fd2c8f3ff10428a4b3aa77b1ce0c4fa90fe1af987794b770a584358"}
Sep 09 13:44:06.420840 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:06.420370    2578 scope.go:117] "RemoveContainer" containerID="da445816a337b2cfcccd8285c9b7a335bb69c1cfe0bec39f0480f16d5028cc84"
Sep 09 13:44:06.421676 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:06.421654    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-905b058d-677cc4f79c-xfcs8"
Sep 09 13:44:06.421817 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:06.421683    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-905b058d-677cc4f79c-xfcs8" event={"ID":"bd1ea363-c74f-4799-b316-c1045b6e4a5a","Type":"ContainerDied","Data":"a6d252ea31cba8dbc77f88f6a3ad49612c97c35fa6aaf12f614483d59197dcc0"}
Sep 09 13:44:06.428720 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:06.428700    2578 scope.go:117] "RemoveContainer" containerID="e7eeb1863633082900f8cdb30a3fbc0e4bb91cc6977c71d34e7f7cb34772ea01"
Sep 09 13:44:06.445197 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:06.445160    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-905b058d-776879fffd-2fpjs"]
Sep 09 13:44:06.455861 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:06.455829    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-905b058d-776879fffd-2fpjs"]
Sep 09 13:44:06.469246 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:06.469224    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-905b058d-677cc4f79c-xfcs8"]
Sep 09 13:44:06.473292 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:06.473272    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-905b058d-677cc4f79c-xfcs8"]
Sep 09 13:44:06.661143 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:06.661111    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7011a2ad-2f9e-45d8-8fd7-bd14b4d934c2" path="/var/lib/kubelet/pods/7011a2ad-2f9e-45d8-8fd7-bd14b4d934c2/volumes"
Sep 09 13:44:06.661505 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:06.661491    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd1ea363-c74f-4799-b316-c1045b6e4a5a" path="/var/lib/kubelet/pods/bd1ea363-c74f-4799-b316-c1045b6e4a5a/volumes"
Sep 09 13:44:07.274889 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:07.274829    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:07.380800 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:07.380768    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:07.544978 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:07.544897    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:08.069332 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:08.069299    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:08.346634 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:08.346548    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9"]
Sep 09 13:44:08.346897 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:08.346883    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="330bba01-13f6-4444-9cd5-8bec11aa10f3" containerName="istio-proxy"
Sep 09 13:44:08.346980 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:08.346898    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="330bba01-13f6-4444-9cd5-8bec11aa10f3" containerName="istio-proxy"
Sep 09 13:44:08.346980 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:08.346906    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="274bfac5-9b6e-4a1f-b9cc-e21cff926491" containerName="payload-processing"
Sep 09 13:44:08.346980 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:08.346913    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="274bfac5-9b6e-4a1f-b9cc-e21cff926491" containerName="payload-processing"
Sep 09 13:44:08.346980 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:08.346921    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7011a2ad-2f9e-45d8-8fd7-bd14b4d934c2" containerName="payload-pre-processing"
Sep 09 13:44:08.346980 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:08.346931    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7011a2ad-2f9e-45d8-8fd7-bd14b4d934c2" containerName="payload-pre-processing"
Sep 09 13:44:08.346980 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:08.346943    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de00814d-c412-4d77-95cd-8c4a8d28d080" containerName="payload-processing"
Sep 09 13:44:08.346980 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:08.346949    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="de00814d-c412-4d77-95cd-8c4a8d28d080" containerName="payload-processing"
Sep 09 13:44:08.346980 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:08.346962    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1b9754f-380d-45ab-aeca-668ac9bc7ee4" containerName="payload-processing"
Sep 09 13:44:08.346980 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:08.346967    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1b9754f-380d-45ab-aeca-668ac9bc7ee4" containerName="payload-processing"
Sep 09 13:44:08.346980 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:08.346978    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5894b9d-67f3-40f8-b2d2-a07cb588dd6f" containerName="maas-api"
Sep 09 13:44:08.346980 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:08.346984    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5894b9d-67f3-40f8-b2d2-a07cb588dd6f" containerName="maas-api"
Sep 09 13:44:08.347568 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:08.346990    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd1ea363-c74f-4799-b316-c1045b6e4a5a" containerName="payload-processing"
Sep 09 13:44:08.347568 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:08.346995    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd1ea363-c74f-4799-b316-c1045b6e4a5a" containerName="payload-processing"
Sep 09 13:44:08.347568 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:08.347057    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1b9754f-380d-45ab-aeca-668ac9bc7ee4" containerName="payload-processing"
Sep 09 13:44:08.347568 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:08.347065    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="330bba01-13f6-4444-9cd5-8bec11aa10f3" containerName="istio-proxy"
Sep 09 13:44:08.347568 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:08.347071    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="274bfac5-9b6e-4a1f-b9cc-e21cff926491" containerName="payload-processing"
Sep 09 13:44:08.347568 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:08.347077    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5894b9d-67f3-40f8-b2d2-a07cb588dd6f" containerName="maas-api"
Sep 09 13:44:08.347568 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:08.347087    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd1ea363-c74f-4799-b316-c1045b6e4a5a" containerName="payload-processing"
Sep 09 13:44:08.347568 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:08.347096    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="de00814d-c412-4d77-95cd-8c4a8d28d080" containerName="payload-processing"
Sep 09 13:44:08.347568 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:08.347102    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="7011a2ad-2f9e-45d8-8fd7-bd14b4d934c2" containerName="payload-pre-processing"
Sep 09 13:44:08.347568 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:08.347108    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="330bba01-13f6-4444-9cd5-8bec11aa10f3" containerName="istio-proxy"
Sep 09 13:44:08.351524 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:08.351502    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9"
Sep 09 13:44:08.354258 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:08.354236    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-8f2df2-openshift-default-dockercfg-r8qfx\""
Sep 09 13:44:08.366913 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:08.366890    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9"]
Sep 09 13:44:08.405836 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:08.405800    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:08.483701 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:08.483659    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8f28789-061f-4f6e-a274-9c3b3a919cb0-credential-socket\") pod \"e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9\" (UID: \"e8f28789-061f-4f6e-a274-9c3b3a919cb0\") " pod="openshift-ingress/e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9"
Sep 09 13:44:08.483906 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:08.483709    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8f28789-061f-4f6e-a274-9c3b3a919cb0-istio-envoy\") pod \"e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9\" (UID: \"e8f28789-061f-4f6e-a274-9c3b3a919cb0\") " pod="openshift-ingress/e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9"
Sep 09 13:44:08.483906 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:08.483811    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8f28789-061f-4f6e-a274-9c3b3a919cb0-istio-podinfo\") pod \"e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9\" (UID: \"e8f28789-061f-4f6e-a274-9c3b3a919cb0\") " pod="openshift-ingress/e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9"
Sep 09 13:44:08.483906 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:08.483871    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8f28789-061f-4f6e-a274-9c3b3a919cb0-workload-socket\") pod \"e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9\" (UID: \"e8f28789-061f-4f6e-a274-9c3b3a919cb0\") " pod="openshift-ingress/e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9"
Sep 09 13:44:08.483906 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:08.483900    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8f28789-061f-4f6e-a274-9c3b3a919cb0-istio-data\") pod \"e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9\" (UID: \"e8f28789-061f-4f6e-a274-9c3b3a919cb0\") " pod="openshift-ingress/e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9"
Sep 09 13:44:08.484072 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:08.483929    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8f28789-061f-4f6e-a274-9c3b3a919cb0-workload-certs\") pod \"e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9\" (UID: \"e8f28789-061f-4f6e-a274-9c3b3a919cb0\") " pod="openshift-ingress/e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9"
Sep 09 13:44:08.484072 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:08.484029    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8f28789-061f-4f6e-a274-9c3b3a919cb0-istiod-ca-cert\") pod \"e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9\" (UID: \"e8f28789-061f-4f6e-a274-9c3b3a919cb0\") " pod="openshift-ingress/e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9"
Sep 09 13:44:08.484072 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:08.484063    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8f28789-061f-4f6e-a274-9c3b3a919cb0-istio-token\") pod \"e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9\" (UID: \"e8f28789-061f-4f6e-a274-9c3b3a919cb0\") " pod="openshift-ingress/e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9"
Sep 09 13:44:08.484195 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:08.484088    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47jsg\" (UniqueName: \"kubernetes.io/projected/e8f28789-061f-4f6e-a274-9c3b3a919cb0-kube-api-access-47jsg\") pod \"e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9\" (UID: \"e8f28789-061f-4f6e-a274-9c3b3a919cb0\") " pod="openshift-ingress/e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9"
Sep 09 13:44:08.584938 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:08.584901    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8f28789-061f-4f6e-a274-9c3b3a919cb0-istio-podinfo\") pod \"e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9\" (UID: \"e8f28789-061f-4f6e-a274-9c3b3a919cb0\") " pod="openshift-ingress/e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9"
Sep 09 13:44:08.585407 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:08.584949    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8f28789-061f-4f6e-a274-9c3b3a919cb0-workload-socket\") pod \"e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9\" (UID: \"e8f28789-061f-4f6e-a274-9c3b3a919cb0\") " pod="openshift-ingress/e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9"
Sep 09 13:44:08.585407 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:08.585087    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8f28789-061f-4f6e-a274-9c3b3a919cb0-istio-data\") pod \"e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9\" (UID: \"e8f28789-061f-4f6e-a274-9c3b3a919cb0\") " pod="openshift-ingress/e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9"
Sep 09 13:44:08.585407 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:08.585132    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8f28789-061f-4f6e-a274-9c3b3a919cb0-workload-certs\") pod \"e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9\" (UID: \"e8f28789-061f-4f6e-a274-9c3b3a919cb0\") " pod="openshift-ingress/e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9"
Sep 09 13:44:08.585407 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:08.585253    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8f28789-061f-4f6e-a274-9c3b3a919cb0-istiod-ca-cert\") pod \"e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9\" (UID: \"e8f28789-061f-4f6e-a274-9c3b3a919cb0\") " pod="openshift-ingress/e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9"
Sep 09 13:44:08.585407 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:08.585292    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8f28789-061f-4f6e-a274-9c3b3a919cb0-istio-token\") pod \"e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9\" (UID: \"e8f28789-061f-4f6e-a274-9c3b3a919cb0\") " pod="openshift-ingress/e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9"
Sep 09 13:44:08.585407 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:08.585326    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47jsg\" (UniqueName: \"kubernetes.io/projected/e8f28789-061f-4f6e-a274-9c3b3a919cb0-kube-api-access-47jsg\") pod \"e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9\" (UID: \"e8f28789-061f-4f6e-a274-9c3b3a919cb0\") " pod="openshift-ingress/e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9"
Sep 09 13:44:08.585407 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:08.585367    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8f28789-061f-4f6e-a274-9c3b3a919cb0-credential-socket\") pod \"e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9\" (UID: \"e8f28789-061f-4f6e-a274-9c3b3a919cb0\") " pod="openshift-ingress/e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9"
Sep 09 13:44:08.585407 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:08.585370    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8f28789-061f-4f6e-a274-9c3b3a919cb0-workload-socket\") pod \"e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9\" (UID: \"e8f28789-061f-4f6e-a274-9c3b3a919cb0\") " pod="openshift-ingress/e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9"
Sep 09 13:44:08.585407 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:08.585388    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8f28789-061f-4f6e-a274-9c3b3a919cb0-istio-envoy\") pod \"e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9\" (UID: \"e8f28789-061f-4f6e-a274-9c3b3a919cb0\") " pod="openshift-ingress/e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9"
Sep 09 13:44:08.585837 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:08.585438    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8f28789-061f-4f6e-a274-9c3b3a919cb0-istio-data\") pod \"e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9\" (UID: \"e8f28789-061f-4f6e-a274-9c3b3a919cb0\") " pod="openshift-ingress/e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9"
Sep 09 13:44:08.585837 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:08.585515    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8f28789-061f-4f6e-a274-9c3b3a919cb0-workload-certs\") pod \"e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9\" (UID: \"e8f28789-061f-4f6e-a274-9c3b3a919cb0\") " pod="openshift-ingress/e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9"
Sep 09 13:44:08.585837 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:08.585755    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8f28789-061f-4f6e-a274-9c3b3a919cb0-credential-socket\") pod \"e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9\" (UID: \"e8f28789-061f-4f6e-a274-9c3b3a919cb0\") " pod="openshift-ingress/e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9"
Sep 09 13:44:08.585960 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:08.585915    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8f28789-061f-4f6e-a274-9c3b3a919cb0-istiod-ca-cert\") pod \"e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9\" (UID: \"e8f28789-061f-4f6e-a274-9c3b3a919cb0\") " pod="openshift-ingress/e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9"
Sep 09 13:44:08.587533 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:08.587507    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8f28789-061f-4f6e-a274-9c3b3a919cb0-istio-envoy\") pod \"e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9\" (UID: \"e8f28789-061f-4f6e-a274-9c3b3a919cb0\") " pod="openshift-ingress/e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9"
Sep 09 13:44:08.587638 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:08.587565    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8f28789-061f-4f6e-a274-9c3b3a919cb0-istio-podinfo\") pod \"e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9\" (UID: \"e8f28789-061f-4f6e-a274-9c3b3a919cb0\") " pod="openshift-ingress/e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9"
Sep 09 13:44:08.594551 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:08.594526    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8f28789-061f-4f6e-a274-9c3b3a919cb0-istio-token\") pod \"e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9\" (UID: \"e8f28789-061f-4f6e-a274-9c3b3a919cb0\") " pod="openshift-ingress/e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9"
Sep 09 13:44:08.594748 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:08.594726    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47jsg\" (UniqueName: \"kubernetes.io/projected/e8f28789-061f-4f6e-a274-9c3b3a919cb0-kube-api-access-47jsg\") pod \"e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9\" (UID: \"e8f28789-061f-4f6e-a274-9c3b3a919cb0\") " pod="openshift-ingress/e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9"
Sep 09 13:44:08.661405 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:08.661372    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9"
Sep 09 13:44:08.726609 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:08.726581    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:08.936770 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:08.936644    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9"]
Sep 09 13:44:08.939009 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:44:08.938981    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8f28789_061f_4f6e_a274_9c3b3a919cb0.slice/crio-ad47417f98ae461d49d7bf92241a54ddf83903051c6089f0ad75aeef39be1392 WatchSource:0}: Error finding container ad47417f98ae461d49d7bf92241a54ddf83903051c6089f0ad75aeef39be1392: Status 404 returned error can't find the container with id ad47417f98ae461d49d7bf92241a54ddf83903051c6089f0ad75aeef39be1392
Sep 09 13:44:08.941224 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:08.941190    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 13:44:08.941309 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:08.941272    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 13:44:08.941367 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:08.941318    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 13:44:09.444047 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:09.444010    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9" event={"ID":"e8f28789-061f-4f6e-a274-9c3b3a919cb0","Type":"ContainerStarted","Data":"e60d979e70819f674828de6c024123388a7cee168e3b0fed0f3a23a92c94eee5"}
Sep 09 13:44:09.444262 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:09.444069    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9" event={"ID":"e8f28789-061f-4f6e-a274-9c3b3a919cb0","Type":"ContainerStarted","Data":"ad47417f98ae461d49d7bf92241a54ddf83903051c6089f0ad75aeef39be1392"}
Sep 09 13:44:09.467621 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:09.467570    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9" podStartSLOduration=1.467554143 podStartE2EDuration="1.467554143s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 13:44:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 13:44:09.465916073 +0000 UTC m=+1061.281440267" watchObservedRunningTime="2026-09-09 13:44:09.467554143 +0000 UTC m=+1061.283078337"
Sep 09 13:44:09.661873 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:09.661842    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9"
Sep 09 13:44:09.667288 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:09.667262    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9"
Sep 09 13:44:10.449137 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:10.449101    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9"
Sep 09 13:44:10.450205 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:10.450167    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9"
Sep 09 13:44:10.668674 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:10.668644    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:44:11.349642 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:11.349606    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:11.454133 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:11.454095    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:12.244695 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:12.244661    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:12.346100 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:12.346058    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:12.481641 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:12.481607    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8f2df2-8f6bf598-mzhjs"]
Sep 09 13:44:12.482136 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:12.482117    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="330bba01-13f6-4444-9cd5-8bec11aa10f3" containerName="istio-proxy"
Sep 09 13:44:12.482245 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:12.482140    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="330bba01-13f6-4444-9cd5-8bec11aa10f3" containerName="istio-proxy"
Sep 09 13:44:12.485729 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:12.485704    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8f2df2-8f6bf598-mzhjs"
Sep 09 13:44:12.488965 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:12.488946    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-8f2df2-serving-cert\""
Sep 09 13:44:12.489163 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:12.489149    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 09 13:44:12.490220 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:12.490199    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 09 13:44:12.490379 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:12.490256    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 09 13:44:12.490634 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:12.490612    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-s8jj8\""
Sep 09 13:44:12.501402 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:12.501332    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8f2df2-8f6bf598-mzhjs"]
Sep 09 13:44:12.517427 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:12.517397    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:12.619626 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:12.619591    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:12.622728 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:12.622705    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ec09ff1-8d79-4194-a05d-67f26d0ff1f1-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-8f2df2-8f6bf598-mzhjs\" (UID: \"1ec09ff1-8d79-4194-a05d-67f26d0ff1f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8f2df2-8f6bf598-mzhjs"
Sep 09 13:44:12.622813 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:12.622764    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pc7xz\" (UniqueName: \"kubernetes.io/projected/1ec09ff1-8d79-4194-a05d-67f26d0ff1f1-kube-api-access-pc7xz\") pod \"maas-api-e2e-shared-a-w3-8f2df2-8f6bf598-mzhjs\" (UID: \"1ec09ff1-8d79-4194-a05d-67f26d0ff1f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8f2df2-8f6bf598-mzhjs"
Sep 09 13:44:12.622852 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:12.622817    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ec09ff1-8d79-4194-a05d-67f26d0ff1f1-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-8f2df2-8f6bf598-mzhjs\" (UID: \"1ec09ff1-8d79-4194-a05d-67f26d0ff1f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8f2df2-8f6bf598-mzhjs"
Sep 09 13:44:12.622852 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:12.622837    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ec09ff1-8d79-4194-a05d-67f26d0ff1f1-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-8f2df2-8f6bf598-mzhjs\" (UID: \"1ec09ff1-8d79-4194-a05d-67f26d0ff1f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8f2df2-8f6bf598-mzhjs"
Sep 09 13:44:12.723769 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:12.723734    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ec09ff1-8d79-4194-a05d-67f26d0ff1f1-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-8f2df2-8f6bf598-mzhjs\" (UID: \"1ec09ff1-8d79-4194-a05d-67f26d0ff1f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8f2df2-8f6bf598-mzhjs"
Sep 09 13:44:12.723960 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:12.723785    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pc7xz\" (UniqueName: \"kubernetes.io/projected/1ec09ff1-8d79-4194-a05d-67f26d0ff1f1-kube-api-access-pc7xz\") pod \"maas-api-e2e-shared-a-w3-8f2df2-8f6bf598-mzhjs\" (UID: \"1ec09ff1-8d79-4194-a05d-67f26d0ff1f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8f2df2-8f6bf598-mzhjs"
Sep 09 13:44:12.723960 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:12.723821    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ec09ff1-8d79-4194-a05d-67f26d0ff1f1-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-8f2df2-8f6bf598-mzhjs\" (UID: \"1ec09ff1-8d79-4194-a05d-67f26d0ff1f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8f2df2-8f6bf598-mzhjs"
Sep 09 13:44:12.723960 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:12.723846    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ec09ff1-8d79-4194-a05d-67f26d0ff1f1-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-8f2df2-8f6bf598-mzhjs\" (UID: \"1ec09ff1-8d79-4194-a05d-67f26d0ff1f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8f2df2-8f6bf598-mzhjs"
Sep 09 13:44:12.724403 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:12.724381    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ec09ff1-8d79-4194-a05d-67f26d0ff1f1-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-8f2df2-8f6bf598-mzhjs\" (UID: \"1ec09ff1-8d79-4194-a05d-67f26d0ff1f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8f2df2-8f6bf598-mzhjs"
Sep 09 13:44:12.726321 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:12.726304    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ec09ff1-8d79-4194-a05d-67f26d0ff1f1-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-8f2df2-8f6bf598-mzhjs\" (UID: \"1ec09ff1-8d79-4194-a05d-67f26d0ff1f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8f2df2-8f6bf598-mzhjs"
Sep 09 13:44:12.726393 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:12.726316    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ec09ff1-8d79-4194-a05d-67f26d0ff1f1-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-8f2df2-8f6bf598-mzhjs\" (UID: \"1ec09ff1-8d79-4194-a05d-67f26d0ff1f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8f2df2-8f6bf598-mzhjs"
Sep 09 13:44:12.732918 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:12.732892    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pc7xz\" (UniqueName: \"kubernetes.io/projected/1ec09ff1-8d79-4194-a05d-67f26d0ff1f1-kube-api-access-pc7xz\") pod \"maas-api-e2e-shared-a-w3-8f2df2-8f6bf598-mzhjs\" (UID: \"1ec09ff1-8d79-4194-a05d-67f26d0ff1f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8f2df2-8f6bf598-mzhjs"
Sep 09 13:44:12.798511 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:12.798428    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8f2df2-8f6bf598-mzhjs"
Sep 09 13:44:13.048603 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:13.048500    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:13.086057 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:13.086024    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8f2df2-8f6bf598-mzhjs"]
Sep 09 13:44:13.089667 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:44:13.089639    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ec09ff1_8d79_4194_a05d_67f26d0ff1f1.slice/crio-a2372a535fc77c50b48e2092ca4151d973426c0f4f459d055ef449d8a7a139bf WatchSource:0}: Error finding container a2372a535fc77c50b48e2092ca4151d973426c0f4f459d055ef449d8a7a139bf: Status 404 returned error can't find the container with id a2372a535fc77c50b48e2092ca4151d973426c0f4f459d055ef449d8a7a139bf
Sep 09 13:44:13.091137 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:13.091117    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 13:44:13.148484 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:13.148452    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:13.237228 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:13.237197    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8f2df2-7d95599dcd-lnw5d"]
Sep 09 13:44:13.241760 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:13.241738    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8f2df2-7d95599dcd-lnw5d"
Sep 09 13:44:13.245630 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:13.245606    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-8f2df2\""
Sep 09 13:44:13.253515 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:13.253494    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8f2df2-7d95599dcd-lnw5d"]
Sep 09 13:44:13.271504 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:13.271482    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:13.330170 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:13.330071    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8f0d5673-3e94-4ab3-a707-b5c5fe92581f-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-8f2df2-7d95599dcd-lnw5d\" (UID: \"8f0d5673-3e94-4ab3-a707-b5c5fe92581f\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8f2df2-7d95599dcd-lnw5d"
Sep 09 13:44:13.330170 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:13.330160    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmf4x\" (UniqueName: \"kubernetes.io/projected/8f0d5673-3e94-4ab3-a707-b5c5fe92581f-kube-api-access-fmf4x\") pod \"payload-pre-processing-e2e-shared-a-w3-8f2df2-7d95599dcd-lnw5d\" (UID: \"8f0d5673-3e94-4ab3-a707-b5c5fe92581f\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8f2df2-7d95599dcd-lnw5d"
Sep 09 13:44:13.431162 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:13.431125    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmf4x\" (UniqueName: \"kubernetes.io/projected/8f0d5673-3e94-4ab3-a707-b5c5fe92581f-kube-api-access-fmf4x\") pod \"payload-pre-processing-e2e-shared-a-w3-8f2df2-7d95599dcd-lnw5d\" (UID: \"8f0d5673-3e94-4ab3-a707-b5c5fe92581f\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8f2df2-7d95599dcd-lnw5d"
Sep 09 13:44:13.431360 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:13.431232    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8f0d5673-3e94-4ab3-a707-b5c5fe92581f-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-8f2df2-7d95599dcd-lnw5d\" (UID: \"8f0d5673-3e94-4ab3-a707-b5c5fe92581f\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8f2df2-7d95599dcd-lnw5d"
Sep 09 13:44:13.431878 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:13.431857    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8f0d5673-3e94-4ab3-a707-b5c5fe92581f-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-8f2df2-7d95599dcd-lnw5d\" (UID: \"8f0d5673-3e94-4ab3-a707-b5c5fe92581f\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8f2df2-7d95599dcd-lnw5d"
Sep 09 13:44:13.442030 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:13.441998    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmf4x\" (UniqueName: \"kubernetes.io/projected/8f0d5673-3e94-4ab3-a707-b5c5fe92581f-kube-api-access-fmf4x\") pod \"payload-pre-processing-e2e-shared-a-w3-8f2df2-7d95599dcd-lnw5d\" (UID: \"8f0d5673-3e94-4ab3-a707-b5c5fe92581f\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8f2df2-7d95599dcd-lnw5d"
Sep 09 13:44:13.464942 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:13.464916    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8f2df2-8f6bf598-mzhjs" event={"ID":"1ec09ff1-8d79-4194-a05d-67f26d0ff1f1","Type":"ContainerStarted","Data":"a2372a535fc77c50b48e2092ca4151d973426c0f4f459d055ef449d8a7a139bf"}
Sep 09 13:44:13.553672 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:13.553638    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8f2df2-7d95599dcd-lnw5d"
Sep 09 13:44:13.839587 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:13.839550    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8f2df2-7d95599dcd-lnw5d"]
Sep 09 13:44:13.841501 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:44:13.841471    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f0d5673_3e94_4ab3_a707_b5c5fe92581f.slice/crio-aaa8d72aefb934308d2ab092845dcdc5c5eda0e0edcaf0fdea3f429a07a915b9 WatchSource:0}: Error finding container aaa8d72aefb934308d2ab092845dcdc5c5eda0e0edcaf0fdea3f429a07a915b9: Status 404 returned error can't find the container with id aaa8d72aefb934308d2ab092845dcdc5c5eda0e0edcaf0fdea3f429a07a915b9
Sep 09 13:44:14.470908 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:14.470867    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8f2df2-8f6bf598-mzhjs" event={"ID":"1ec09ff1-8d79-4194-a05d-67f26d0ff1f1","Type":"ContainerStarted","Data":"d291a0327002636cf1a60b33ac480195f7bff752f115cb570cb239919ca10d28"}
Sep 09 13:44:14.471379 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:14.470981    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8f2df2-8f6bf598-mzhjs"
Sep 09 13:44:14.472528 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:14.472504    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8f2df2-7d95599dcd-lnw5d" event={"ID":"8f0d5673-3e94-4ab3-a707-b5c5fe92581f","Type":"ContainerStarted","Data":"303787bd57cab9d584690c0e3ed36e2eb87865b86034dd160ef89a51ea29a74d"}
Sep 09 13:44:14.472642 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:14.472543    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8f2df2-7d95599dcd-lnw5d" event={"ID":"8f0d5673-3e94-4ab3-a707-b5c5fe92581f","Type":"ContainerStarted","Data":"aaa8d72aefb934308d2ab092845dcdc5c5eda0e0edcaf0fdea3f429a07a915b9"}
Sep 09 13:44:14.472642 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:14.472572    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8f2df2-7d95599dcd-lnw5d"
Sep 09 13:44:14.492403 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:14.492363    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8f2df2-8f6bf598-mzhjs" podStartSLOduration=2.112070386 podStartE2EDuration="2.492347494s" totalImagesPullingTime="380.277108ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 13:44:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 13:44:14.490742021 +0000 UTC m=+1066.306266216" watchObservedRunningTime="2026-09-09 13:44:14.492347494 +0000 UTC m=+1066.307871723"
Sep 09 13:44:14.524194 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:14.524123    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8f2df2-7d95599dcd-lnw5d" podStartSLOduration=1.5241091070000001 podStartE2EDuration="1.524109107s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 13:44:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 13:44:14.523466432 +0000 UTC m=+1066.338990647" watchObservedRunningTime="2026-09-09 13:44:14.524109107 +0000 UTC m=+1066.339633301"
Sep 09 13:44:19.140708 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:19.140672    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:19.248086 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:19.248048    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:19.350595 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:19.350553    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:19.497549 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:19.497429    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:20.483765 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:20.483736    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8f2df2-8f6bf598-mzhjs"
Sep 09 13:44:21.265321 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:21.265280    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:44:23.735164 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:23.735128    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:23.793462 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:23.793426    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:25.294877 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:25.294814    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:25.395094 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:25.395061    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:25.480040 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:25.480005    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8f2df2-7d95599dcd-lnw5d"
Sep 09 13:44:26.162936 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:26.162883    2578 patch_prober.go:28] interesting pod/e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": read tcp 10.134.0.2:57866->10.134.0.46:15021: read: connection reset by peer" start-of-body=
Sep 09 13:44:26.163117 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:26.162990    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9" podUID="e8f28789-061f-4f6e-a274-9c3b3a919cb0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": read tcp 10.134.0.2:57866->10.134.0.46:15021: read: connection reset by peer"
Sep 09 13:44:26.541359 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:26.541265    2578 generic.go:356] "Generic (PLEG): container finished" podID="e8f28789-061f-4f6e-a274-9c3b3a919cb0" containerID="e60d979e70819f674828de6c024123388a7cee168e3b0fed0f3a23a92c94eee5" exitCode=0
Sep 09 13:44:26.541359 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:26.541335    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9" event={"ID":"e8f28789-061f-4f6e-a274-9c3b3a919cb0","Type":"ContainerDied","Data":"e60d979e70819f674828de6c024123388a7cee168e3b0fed0f3a23a92c94eee5"}
Sep 09 13:44:26.541802 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:26.541759    2578 scope.go:117] "RemoveContainer" containerID="e60d979e70819f674828de6c024123388a7cee168e3b0fed0f3a23a92c94eee5"
Sep 09 13:44:26.543000 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:26.542968    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 13:44:26.543076 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:26.543058    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 13:44:26.543128 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:26.543113    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 13:44:26.749866 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:26.749834    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:26.814043 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:26.813948    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:27.547941 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:27.547905    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9" event={"ID":"e8f28789-061f-4f6e-a274-9c3b3a919cb0","Type":"ContainerStarted","Data":"af9e0e11aa8a7883530166713255a03a9c62eea4d9725085e01e1a8e951a2dc2"}
Sep 09 13:44:27.662317 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:27.662273    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9"
Sep 09 13:44:27.662533 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:27.662509    2578 patch_prober.go:28] interesting pod/e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 09 13:44:27.662581 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:27.662560    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9" podUID="e8f28789-061f-4f6e-a274-9c3b3a919cb0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 09 13:44:27.853993 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:27.853903    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:28.662170 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:28.662141    2578 patch_prober.go:28] interesting pod/e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 09 13:44:28.662540 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:28.662204    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9" podUID="e8f28789-061f-4f6e-a274-9c3b3a919cb0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 09 13:44:29.662745 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:29.662708    2578 patch_prober.go:28] interesting pod/e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 09 13:44:29.663141 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:29.662769    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9" podUID="e8f28789-061f-4f6e-a274-9c3b3a919cb0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 09 13:44:30.000046 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:29.999944    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:30.101438 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:30.101392    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:30.585382 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:30.585344    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:30.661987 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:30.661953    2578 patch_prober.go:28] interesting pod/e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 09 13:44:30.662147 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:30.662015    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9" podUID="e8f28789-061f-4f6e-a274-9c3b3a919cb0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 09 13:44:30.718099 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:30.718062    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:30.812526 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:30.812378    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:30.908454 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:30.908336    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:31.014917 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:31.014872    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:31.108473 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:31.108432    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:31.214110 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:31.213964    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:31.284094 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:31.284061    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:31.322047 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:31.322014    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b5cba4-6dc466cd74-5nmml"]
Sep 09 13:44:31.326436 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:31.326418    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b5cba4-6dc466cd74-5nmml"
Sep 09 13:44:31.329042 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:31.329015    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-b5cba4\""
Sep 09 13:44:31.329185 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:31.329041    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-b5cba4-dockercfg-2w6qw\""
Sep 09 13:44:31.337413 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:31.337388    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b5cba4-6dc466cd74-5nmml"]
Sep 09 13:44:31.360244 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:31.360214    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-b5cba4-9746d8f6c-42ptf"]
Sep 09 13:44:31.363327 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:31.363304    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-b5cba4-9746d8f6c-42ptf"
Sep 09 13:44:31.374825 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:31.374796    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-b5cba4-9746d8f6c-42ptf"]
Sep 09 13:44:31.518851 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:31.518774    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e9a12b65-fb55-42c3-ad39-21fae172c962-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-b5cba4-6dc466cd74-5nmml\" (UID: \"e9a12b65-fb55-42c3-ad39-21fae172c962\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b5cba4-6dc466cd74-5nmml"
Sep 09 13:44:31.518851 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:31.518805    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gvq6\" (UniqueName: \"kubernetes.io/projected/e9a12b65-fb55-42c3-ad39-21fae172c962-kube-api-access-4gvq6\") pod \"payload-pre-processing-e2e-shared-a-w2-b5cba4-6dc466cd74-5nmml\" (UID: \"e9a12b65-fb55-42c3-ad39-21fae172c962\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b5cba4-6dc466cd74-5nmml"
Sep 09 13:44:31.519036 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:31.518857    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b0eed683-b4d8-4415-8604-826429fba8c1-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-b5cba4-9746d8f6c-42ptf\" (UID: \"b0eed683-b4d8-4415-8604-826429fba8c1\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-b5cba4-9746d8f6c-42ptf"
Sep 09 13:44:31.519036 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:31.518943    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvbdk\" (UniqueName: \"kubernetes.io/projected/b0eed683-b4d8-4415-8604-826429fba8c1-kube-api-access-tvbdk\") pod \"payload-processing-e2e-shared-a-w2-b5cba4-9746d8f6c-42ptf\" (UID: \"b0eed683-b4d8-4415-8604-826429fba8c1\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-b5cba4-9746d8f6c-42ptf"
Sep 09 13:44:31.620240 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:31.620200    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvbdk\" (UniqueName: \"kubernetes.io/projected/b0eed683-b4d8-4415-8604-826429fba8c1-kube-api-access-tvbdk\") pod \"payload-processing-e2e-shared-a-w2-b5cba4-9746d8f6c-42ptf\" (UID: \"b0eed683-b4d8-4415-8604-826429fba8c1\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-b5cba4-9746d8f6c-42ptf"
Sep 09 13:44:31.620420 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:31.620263    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e9a12b65-fb55-42c3-ad39-21fae172c962-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-b5cba4-6dc466cd74-5nmml\" (UID: \"e9a12b65-fb55-42c3-ad39-21fae172c962\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b5cba4-6dc466cd74-5nmml"
Sep 09 13:44:31.620420 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:31.620292    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gvq6\" (UniqueName: \"kubernetes.io/projected/e9a12b65-fb55-42c3-ad39-21fae172c962-kube-api-access-4gvq6\") pod \"payload-pre-processing-e2e-shared-a-w2-b5cba4-6dc466cd74-5nmml\" (UID: \"e9a12b65-fb55-42c3-ad39-21fae172c962\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b5cba4-6dc466cd74-5nmml"
Sep 09 13:44:31.620420 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:31.620359    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b0eed683-b4d8-4415-8604-826429fba8c1-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-b5cba4-9746d8f6c-42ptf\" (UID: \"b0eed683-b4d8-4415-8604-826429fba8c1\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-b5cba4-9746d8f6c-42ptf"
Sep 09 13:44:31.621047 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:31.621019    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e9a12b65-fb55-42c3-ad39-21fae172c962-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-b5cba4-6dc466cd74-5nmml\" (UID: \"e9a12b65-fb55-42c3-ad39-21fae172c962\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b5cba4-6dc466cd74-5nmml"
Sep 09 13:44:31.621158 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:31.621078    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b0eed683-b4d8-4415-8604-826429fba8c1-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-b5cba4-9746d8f6c-42ptf\" (UID: \"b0eed683-b4d8-4415-8604-826429fba8c1\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-b5cba4-9746d8f6c-42ptf"
Sep 09 13:44:31.628783 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:31.628756    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gvq6\" (UniqueName: \"kubernetes.io/projected/e9a12b65-fb55-42c3-ad39-21fae172c962-kube-api-access-4gvq6\") pod \"payload-pre-processing-e2e-shared-a-w2-b5cba4-6dc466cd74-5nmml\" (UID: \"e9a12b65-fb55-42c3-ad39-21fae172c962\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b5cba4-6dc466cd74-5nmml"
Sep 09 13:44:31.628899 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:31.628881    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvbdk\" (UniqueName: \"kubernetes.io/projected/b0eed683-b4d8-4415-8604-826429fba8c1-kube-api-access-tvbdk\") pod \"payload-processing-e2e-shared-a-w2-b5cba4-9746d8f6c-42ptf\" (UID: \"b0eed683-b4d8-4415-8604-826429fba8c1\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-b5cba4-9746d8f6c-42ptf"
Sep 09 13:44:31.637732 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:31.637711    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b5cba4-6dc466cd74-5nmml"
Sep 09 13:44:31.662326 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:31.662297    2578 patch_prober.go:28] interesting pod/e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 09 13:44:31.662446 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:31.662347    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9" podUID="e8f28789-061f-4f6e-a274-9c3b3a919cb0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 09 13:44:31.673429 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:31.673339    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-b5cba4-9746d8f6c-42ptf"
Sep 09 13:44:31.930623 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:31.930597    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b5cba4-6dc466cd74-5nmml"]
Sep 09 13:44:31.932812 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:44:31.932783    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9a12b65_fb55_42c3_ad39_21fae172c962.slice/crio-a4740e9d2b2954e2400f2d94b926a5cac44fd14a57f02ea0a33bca62522c2de7 WatchSource:0}: Error finding container a4740e9d2b2954e2400f2d94b926a5cac44fd14a57f02ea0a33bca62522c2de7: Status 404 returned error can't find the container with id a4740e9d2b2954e2400f2d94b926a5cac44fd14a57f02ea0a33bca62522c2de7
Sep 09 13:44:32.006353 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:32.006247    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-b5cba4-9746d8f6c-42ptf"]
Sep 09 13:44:32.017787 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:44:32.017754    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0eed683_b4d8_4415_8604_826429fba8c1.slice/crio-a3e18d1a8cb5681e2f188033f42b9c731f2c678b87ae1313bea6b4f6782867fd WatchSource:0}: Error finding container a3e18d1a8cb5681e2f188033f42b9c731f2c678b87ae1313bea6b4f6782867fd: Status 404 returned error can't find the container with id a3e18d1a8cb5681e2f188033f42b9c731f2c678b87ae1313bea6b4f6782867fd
Sep 09 13:44:32.575100 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:32.575049    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b5cba4-6dc466cd74-5nmml" event={"ID":"e9a12b65-fb55-42c3-ad39-21fae172c962","Type":"ContainerStarted","Data":"ca0a01b8b3642d2996683acc08405b843e2e92a6130e019672f1d43aca0116df"}
Sep 09 13:44:32.575318 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:32.575114    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b5cba4-6dc466cd74-5nmml" event={"ID":"e9a12b65-fb55-42c3-ad39-21fae172c962","Type":"ContainerStarted","Data":"a4740e9d2b2954e2400f2d94b926a5cac44fd14a57f02ea0a33bca62522c2de7"}
Sep 09 13:44:32.575318 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:32.575148    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b5cba4-6dc466cd74-5nmml"
Sep 09 13:44:32.576839 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:32.576805    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-b5cba4-9746d8f6c-42ptf" event={"ID":"b0eed683-b4d8-4415-8604-826429fba8c1","Type":"ContainerStarted","Data":"a3e79008e449991de13cfdb896ce4e61415bc470175703be373d20b93dbc87bd"}
Sep 09 13:44:32.576939 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:32.576856    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-b5cba4-9746d8f6c-42ptf" event={"ID":"b0eed683-b4d8-4415-8604-826429fba8c1","Type":"ContainerStarted","Data":"a3e18d1a8cb5681e2f188033f42b9c731f2c678b87ae1313bea6b4f6782867fd"}
Sep 09 13:44:32.576939 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:32.576902    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-b5cba4-9746d8f6c-42ptf"
Sep 09 13:44:32.597058 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:32.596975    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b5cba4-6dc466cd74-5nmml" podStartSLOduration=1.596949687 podStartE2EDuration="1.596949687s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 13:44:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 13:44:32.595907334 +0000 UTC m=+1084.411431530" watchObservedRunningTime="2026-09-09 13:44:32.596949687 +0000 UTC m=+1084.412473882"
Sep 09 13:44:32.617165 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:32.617098    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-b5cba4-9746d8f6c-42ptf" podStartSLOduration=1.61707321 podStartE2EDuration="1.61707321s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 13:44:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 13:44:32.613475268 +0000 UTC m=+1084.428999463" watchObservedRunningTime="2026-09-09 13:44:32.61707321 +0000 UTC m=+1084.432597405"
Sep 09 13:44:32.691697 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:32.690820    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9"
Sep 09 13:44:32.692228 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:32.692205    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9"
Sep 09 13:44:32.693607 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:32.693580    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9"
Sep 09 13:44:35.005930 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:35.005894    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:35.563132 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:35.563097    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:44:36.032033 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:36.032002    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:36.766526 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:36.766494    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:36.871953 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:36.871922    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:36.939013 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:36.938982    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:37.061246 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:37.061127    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:37.160606 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:37.160568    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:37.260494 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:37.260454    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:40.453695 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:40.453660    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:40.550888 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:40.550854    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:41.622367 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:41.622334    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:41.722463 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:41.722429    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:42.120547 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:42.120468    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:42.221673 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:42.221642    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:42.297996 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:42.297963    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-df48ae-7d4cfcd78-qpwqf"]
Sep 09 13:44:42.300801 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:42.300775    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:42.302551 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:42.302535    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-df48ae-7d4cfcd78-qpwqf"
Sep 09 13:44:42.305184 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:42.305152    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-df48ae\""
Sep 09 13:44:42.305292 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:42.305195    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-df48ae-dockercfg-njwgd\""
Sep 09 13:44:42.316672 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:42.316647    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-df48ae-7d4cfcd78-qpwqf"]
Sep 09 13:44:42.412307 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:42.412264    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c55f4880-614b-4be0-bf2a-ec2302571381-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-df48ae-7d4cfcd78-qpwqf\" (UID: \"c55f4880-614b-4be0-bf2a-ec2302571381\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-df48ae-7d4cfcd78-qpwqf"
Sep 09 13:44:42.412478 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:42.412368    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5b7r\" (UniqueName: \"kubernetes.io/projected/c55f4880-614b-4be0-bf2a-ec2302571381-kube-api-access-m5b7r\") pod \"payload-pre-processing-e2e-shared-b-w3-df48ae-7d4cfcd78-qpwqf\" (UID: \"c55f4880-614b-4be0-bf2a-ec2302571381\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-df48ae-7d4cfcd78-qpwqf"
Sep 09 13:44:42.513461 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:42.513399    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5b7r\" (UniqueName: \"kubernetes.io/projected/c55f4880-614b-4be0-bf2a-ec2302571381-kube-api-access-m5b7r\") pod \"payload-pre-processing-e2e-shared-b-w3-df48ae-7d4cfcd78-qpwqf\" (UID: \"c55f4880-614b-4be0-bf2a-ec2302571381\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-df48ae-7d4cfcd78-qpwqf"
Sep 09 13:44:42.513670 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:42.513536    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c55f4880-614b-4be0-bf2a-ec2302571381-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-df48ae-7d4cfcd78-qpwqf\" (UID: \"c55f4880-614b-4be0-bf2a-ec2302571381\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-df48ae-7d4cfcd78-qpwqf"
Sep 09 13:44:42.514274 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:42.514250    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c55f4880-614b-4be0-bf2a-ec2302571381-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-df48ae-7d4cfcd78-qpwqf\" (UID: \"c55f4880-614b-4be0-bf2a-ec2302571381\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-df48ae-7d4cfcd78-qpwqf"
Sep 09 13:44:42.521585 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:42.521566    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5b7r\" (UniqueName: \"kubernetes.io/projected/c55f4880-614b-4be0-bf2a-ec2302571381-kube-api-access-m5b7r\") pod \"payload-pre-processing-e2e-shared-b-w3-df48ae-7d4cfcd78-qpwqf\" (UID: \"c55f4880-614b-4be0-bf2a-ec2302571381\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-df48ae-7d4cfcd78-qpwqf"
Sep 09 13:44:42.613073 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:42.613025    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-df48ae-7d4cfcd78-qpwqf"
Sep 09 13:44:42.884295 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:42.884268    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-df48ae-7d4cfcd78-qpwqf"]
Sep 09 13:44:42.886254 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:44:42.886225    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc55f4880_614b_4be0_bf2a_ec2302571381.slice/crio-e85497cbf099ffa6bbc81cff47a778f2474cd67d2c5f8a3cc42782317e1bf92e WatchSource:0}: Error finding container e85497cbf099ffa6bbc81cff47a778f2474cd67d2c5f8a3cc42782317e1bf92e: Status 404 returned error can't find the container with id e85497cbf099ffa6bbc81cff47a778f2474cd67d2c5f8a3cc42782317e1bf92e
Sep 09 13:44:43.584271 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:43.584244    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-b5cba4-9746d8f6c-42ptf"
Sep 09 13:44:43.584444 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:43.584315    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b5cba4-6dc466cd74-5nmml"
Sep 09 13:44:43.634508 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:43.634467    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-df48ae-7d4cfcd78-qpwqf" event={"ID":"c55f4880-614b-4be0-bf2a-ec2302571381","Type":"ContainerStarted","Data":"9205609cf2dbb540bafd2e5b0897a9c16146a19069a85bfc3e790e7fbd658478"}
Sep 09 13:44:43.634703 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:43.634565    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-df48ae-7d4cfcd78-qpwqf" event={"ID":"c55f4880-614b-4be0-bf2a-ec2302571381","Type":"ContainerStarted","Data":"e85497cbf099ffa6bbc81cff47a778f2474cd67d2c5f8a3cc42782317e1bf92e"}
Sep 09 13:44:43.634703 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:43.634693    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-df48ae-7d4cfcd78-qpwqf"
Sep 09 13:44:43.652899 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:43.652845    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-df48ae-7d4cfcd78-qpwqf" podStartSLOduration=1.652830204 podStartE2EDuration="1.652830204s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 13:44:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 13:44:43.651441622 +0000 UTC m=+1095.466965817" watchObservedRunningTime="2026-09-09 13:44:43.652830204 +0000 UTC m=+1095.468354450"
Sep 09 13:44:46.366723 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:46.366686    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:44:51.632833 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:51.632795    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:54.353682 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:54.353642    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:54.642161 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:54.642127    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-df48ae-7d4cfcd78-qpwqf"
Sep 09 13:44:55.011093 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:55.011000    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:55.114629 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:55.114601    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:55.213790 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:55.213758    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:57.618760 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:57.618727    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:57.710387 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:57.710356    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:58.778363 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:58.778333    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:58.858974 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:58.858929    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:59.127561 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:59.127528    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:59.293449 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:59.293414    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:59.384243 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:59.384150    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6a7dbc-6dbd476758-ztf6n"]
Sep 09 13:44:59.384559 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:59.384532    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:44:59.387283 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:59.387267    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6a7dbc-6dbd476758-ztf6n"
Sep 09 13:44:59.389988 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:59.389968    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-6a7dbc\""
Sep 09 13:44:59.390101 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:59.390000    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-6a7dbc-dockercfg-l7cmk\""
Sep 09 13:44:59.399462 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:59.399439    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6a7dbc-6dbd476758-ztf6n"]
Sep 09 13:44:59.429523 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:59.429488    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-6a7dbc-67c9f8b4fc-2zqwp"]
Sep 09 13:44:59.432676 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:59.432660    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-6a7dbc-67c9f8b4fc-2zqwp"
Sep 09 13:44:59.447995 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:59.447969    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-6a7dbc-67c9f8b4fc-2zqwp"]
Sep 09 13:44:59.472869 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:59.472838    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gr5t9\" (UniqueName: \"kubernetes.io/projected/36327c8a-9f94-4cb7-ba8b-2e63a8f934b1-kube-api-access-gr5t9\") pod \"payload-pre-processing-e2e-shared-b-w2-6a7dbc-6dbd476758-ztf6n\" (UID: \"36327c8a-9f94-4cb7-ba8b-2e63a8f934b1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6a7dbc-6dbd476758-ztf6n"
Sep 09 13:44:59.473021 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:59.472894    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/36327c8a-9f94-4cb7-ba8b-2e63a8f934b1-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-6a7dbc-6dbd476758-ztf6n\" (UID: \"36327c8a-9f94-4cb7-ba8b-2e63a8f934b1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6a7dbc-6dbd476758-ztf6n"
Sep 09 13:44:59.573939 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:59.573897    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gr5t9\" (UniqueName: \"kubernetes.io/projected/36327c8a-9f94-4cb7-ba8b-2e63a8f934b1-kube-api-access-gr5t9\") pod \"payload-pre-processing-e2e-shared-b-w2-6a7dbc-6dbd476758-ztf6n\" (UID: \"36327c8a-9f94-4cb7-ba8b-2e63a8f934b1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6a7dbc-6dbd476758-ztf6n"
Sep 09 13:44:59.573939 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:59.573938    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5d7a7a09-1db4-4e34-802b-70754cd75ead-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-6a7dbc-67c9f8b4fc-2zqwp\" (UID: \"5d7a7a09-1db4-4e34-802b-70754cd75ead\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-6a7dbc-67c9f8b4fc-2zqwp"
Sep 09 13:44:59.574247 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:59.574066    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/36327c8a-9f94-4cb7-ba8b-2e63a8f934b1-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-6a7dbc-6dbd476758-ztf6n\" (UID: \"36327c8a-9f94-4cb7-ba8b-2e63a8f934b1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6a7dbc-6dbd476758-ztf6n"
Sep 09 13:44:59.574247 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:59.574157    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7bkh\" (UniqueName: \"kubernetes.io/projected/5d7a7a09-1db4-4e34-802b-70754cd75ead-kube-api-access-k7bkh\") pod \"payload-processing-e2e-shared-b-w2-6a7dbc-67c9f8b4fc-2zqwp\" (UID: \"5d7a7a09-1db4-4e34-802b-70754cd75ead\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-6a7dbc-67c9f8b4fc-2zqwp"
Sep 09 13:44:59.574745 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:59.574725    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/36327c8a-9f94-4cb7-ba8b-2e63a8f934b1-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-6a7dbc-6dbd476758-ztf6n\" (UID: \"36327c8a-9f94-4cb7-ba8b-2e63a8f934b1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6a7dbc-6dbd476758-ztf6n"
Sep 09 13:44:59.582926 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:59.582903    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gr5t9\" (UniqueName: \"kubernetes.io/projected/36327c8a-9f94-4cb7-ba8b-2e63a8f934b1-kube-api-access-gr5t9\") pod \"payload-pre-processing-e2e-shared-b-w2-6a7dbc-6dbd476758-ztf6n\" (UID: \"36327c8a-9f94-4cb7-ba8b-2e63a8f934b1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6a7dbc-6dbd476758-ztf6n"
Sep 09 13:44:59.675201 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:59.675077    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5d7a7a09-1db4-4e34-802b-70754cd75ead-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-6a7dbc-67c9f8b4fc-2zqwp\" (UID: \"5d7a7a09-1db4-4e34-802b-70754cd75ead\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-6a7dbc-67c9f8b4fc-2zqwp"
Sep 09 13:44:59.675370 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:59.675214    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7bkh\" (UniqueName: \"kubernetes.io/projected/5d7a7a09-1db4-4e34-802b-70754cd75ead-kube-api-access-k7bkh\") pod \"payload-processing-e2e-shared-b-w2-6a7dbc-67c9f8b4fc-2zqwp\" (UID: \"5d7a7a09-1db4-4e34-802b-70754cd75ead\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-6a7dbc-67c9f8b4fc-2zqwp"
Sep 09 13:44:59.675823 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:59.675805    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5d7a7a09-1db4-4e34-802b-70754cd75ead-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-6a7dbc-67c9f8b4fc-2zqwp\" (UID: \"5d7a7a09-1db4-4e34-802b-70754cd75ead\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-6a7dbc-67c9f8b4fc-2zqwp"
Sep 09 13:44:59.684376 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:59.684351    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7bkh\" (UniqueName: \"kubernetes.io/projected/5d7a7a09-1db4-4e34-802b-70754cd75ead-kube-api-access-k7bkh\") pod \"payload-processing-e2e-shared-b-w2-6a7dbc-67c9f8b4fc-2zqwp\" (UID: \"5d7a7a09-1db4-4e34-802b-70754cd75ead\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-6a7dbc-67c9f8b4fc-2zqwp"
Sep 09 13:44:59.697241 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:59.697208    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6a7dbc-6dbd476758-ztf6n"
Sep 09 13:44:59.742738 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:59.742676    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-6a7dbc-67c9f8b4fc-2zqwp"
Sep 09 13:44:59.967953 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:44:59.967925    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6a7dbc-6dbd476758-ztf6n"]
Sep 09 13:44:59.970325 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:44:59.970296    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36327c8a_9f94_4cb7_ba8b_2e63a8f934b1.slice/crio-9bf0f58b7dc27213acc2e5c31fc6e185c1c1723eef302a123281da1db5fd3116 WatchSource:0}: Error finding container 9bf0f58b7dc27213acc2e5c31fc6e185c1c1723eef302a123281da1db5fd3116: Status 404 returned error can't find the container with id 9bf0f58b7dc27213acc2e5c31fc6e185c1c1723eef302a123281da1db5fd3116
Sep 09 13:45:00.023919 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:00.023890    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-6a7dbc-67c9f8b4fc-2zqwp"]
Sep 09 13:45:00.025456 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:45:00.025434    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d7a7a09_1db4_4e34_802b_70754cd75ead.slice/crio-244ee54876a64fe673650bb572931a915310d6676574bc15ee3852f87d03c2e6 WatchSource:0}: Error finding container 244ee54876a64fe673650bb572931a915310d6676574bc15ee3852f87d03c2e6: Status 404 returned error can't find the container with id 244ee54876a64fe673650bb572931a915310d6676574bc15ee3852f87d03c2e6
Sep 09 13:45:00.143777 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:00.143739    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-8f2df2-29816025-pjm2q"]
Sep 09 13:45:00.152207 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:00.152145    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-b5cba4-29816025-bzlm9"]
Sep 09 13:45:00.152585 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:00.152543    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-8f2df2-29816025-pjm2q"
Sep 09 13:45:00.156041 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:00.156017    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-lh487\""
Sep 09 13:45:00.156634 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:00.156611    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-b5cba4-29816025-bzlm9"
Sep 09 13:45:00.163694 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:00.162548    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-8f2df2-29816025-pjm2q"]
Sep 09 13:45:00.165336 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:00.165308    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-b5cba4-29816025-bzlm9"]
Sep 09 13:45:00.168233 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:00.168212    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-8f2df2-29816025-pjm2q"
Sep 09 13:45:00.179975 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:00.179867    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-b5cba4-29816025-bzlm9"
Sep 09 13:45:00.451750 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:00.451647    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-8f2df2-29816025-pjm2q"]
Sep 09 13:45:00.454337 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:45:00.454310    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c5a538b_6d4b_460f_9109_947d0de43343.slice/crio-e2aa05855e22081aea7d105701f0426660ff58095e4cc667dd57b8062a9cb804 WatchSource:0}: Error finding container e2aa05855e22081aea7d105701f0426660ff58095e4cc667dd57b8062a9cb804: Status 404 returned error can't find the container with id e2aa05855e22081aea7d105701f0426660ff58095e4cc667dd57b8062a9cb804
Sep 09 13:45:00.468400 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:00.468377    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-b5cba4-29816025-bzlm9"]
Sep 09 13:45:00.469888 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:45:00.469860    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9e41768_e595_4020_8bb5_5b08918ad7c4.slice/crio-43ce354c1bbac0815c5aea8c743365d74489e851cb71e84be69dd7085c2eae80 WatchSource:0}: Error finding container 43ce354c1bbac0815c5aea8c743365d74489e851cb71e84be69dd7085c2eae80: Status 404 returned error can't find the container with id 43ce354c1bbac0815c5aea8c743365d74489e851cb71e84be69dd7085c2eae80
Sep 09 13:45:00.717989 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:00.717954    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-6a7dbc-67c9f8b4fc-2zqwp" event={"ID":"5d7a7a09-1db4-4e34-802b-70754cd75ead","Type":"ContainerStarted","Data":"66eb31e1f4697834253a0967a97927a416426daf1d67b7857543a00f14054e39"}
Sep 09 13:45:00.718236 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:00.718016    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-6a7dbc-67c9f8b4fc-2zqwp" event={"ID":"5d7a7a09-1db4-4e34-802b-70754cd75ead","Type":"ContainerStarted","Data":"244ee54876a64fe673650bb572931a915310d6676574bc15ee3852f87d03c2e6"}
Sep 09 13:45:00.718236 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:00.718049    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-6a7dbc-67c9f8b4fc-2zqwp"
Sep 09 13:45:00.719411 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:00.719386    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-8f2df2-29816025-pjm2q" event={"ID":"5c5a538b-6d4b-460f-9109-947d0de43343","Type":"ContainerStarted","Data":"e2aa05855e22081aea7d105701f0426660ff58095e4cc667dd57b8062a9cb804"}
Sep 09 13:45:00.721013 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:00.720985    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6a7dbc-6dbd476758-ztf6n" event={"ID":"36327c8a-9f94-4cb7-ba8b-2e63a8f934b1","Type":"ContainerStarted","Data":"34e5af9b75bb5486bd0593f5b5a0a8114c29e2714807d60927ef5b62b499690b"}
Sep 09 13:45:00.721132 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:00.721041    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6a7dbc-6dbd476758-ztf6n"
Sep 09 13:45:00.721132 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:00.721067    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6a7dbc-6dbd476758-ztf6n" event={"ID":"36327c8a-9f94-4cb7-ba8b-2e63a8f934b1","Type":"ContainerStarted","Data":"9bf0f58b7dc27213acc2e5c31fc6e185c1c1723eef302a123281da1db5fd3116"}
Sep 09 13:45:00.722433 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:00.722407    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-b5cba4-29816025-bzlm9" event={"ID":"f9e41768-e595-4020-8bb5-5b08918ad7c4","Type":"ContainerStarted","Data":"43ce354c1bbac0815c5aea8c743365d74489e851cb71e84be69dd7085c2eae80"}
Sep 09 13:45:00.739302 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:00.739245    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-6a7dbc-67c9f8b4fc-2zqwp" podStartSLOduration=1.739224864 podStartE2EDuration="1.739224864s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 13:44:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 13:45:00.737220064 +0000 UTC m=+1112.552744279" watchObservedRunningTime="2026-09-09 13:45:00.739224864 +0000 UTC m=+1112.554749060"
Sep 09 13:45:00.753799 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:00.753741    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6a7dbc-6dbd476758-ztf6n" podStartSLOduration=1.753713039 podStartE2EDuration="1.753713039s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 13:44:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 13:45:00.753300887 +0000 UTC m=+1112.568825085" watchObservedRunningTime="2026-09-09 13:45:00.753713039 +0000 UTC m=+1112.569237234"
Sep 09 13:45:02.958385 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:02.958334    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:45:04.754335 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:04.754275    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-b5cba4-29816025-bzlm9" event={"ID":"f9e41768-e595-4020-8bb5-5b08918ad7c4","Type":"ContainerStarted","Data":"0adbeaedc2b274c14f1e00bcc4f64179513d93ff731e10621757d76e0eee41e3"}
Sep 09 13:45:04.773086 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:04.773034    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-b5cba4-29816025-bzlm9" podStartSLOduration=1.272378651 podStartE2EDuration="4.773018257s" totalImagesPullingTime="3.500639606s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 13:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 13:45:04.772309923 +0000 UTC m=+1116.587834137" watchObservedRunningTime="2026-09-09 13:45:04.773018257 +0000 UTC m=+1116.588542473"
Sep 09 13:45:04.777372 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:04.777347    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:45:05.383565 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:05.383534    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:45:05.761026 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:05.760940    2578 generic.go:356] "Generic (PLEG): container finished" podID="f9e41768-e595-4020-8bb5-5b08918ad7c4" containerID="0adbeaedc2b274c14f1e00bcc4f64179513d93ff731e10621757d76e0eee41e3" exitCode=0
Sep 09 13:45:05.761420 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:05.761023    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-b5cba4-29816025-bzlm9" event={"ID":"f9e41768-e595-4020-8bb5-5b08918ad7c4","Type":"ContainerDied","Data":"0adbeaedc2b274c14f1e00bcc4f64179513d93ff731e10621757d76e0eee41e3"}
Sep 09 13:45:06.898053 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:06.898020    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-b5cba4-29816025-bzlm9"
Sep 09 13:45:07.772325 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:07.772297    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-b5cba4-29816025-bzlm9"
Sep 09 13:45:07.772490 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:07.772343    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-b5cba4-29816025-bzlm9" event={"ID":"f9e41768-e595-4020-8bb5-5b08918ad7c4","Type":"ContainerDied","Data":"43ce354c1bbac0815c5aea8c743365d74489e851cb71e84be69dd7085c2eae80"}
Sep 09 13:45:07.772490 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:07.772391    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="43ce354c1bbac0815c5aea8c743365d74489e851cb71e84be69dd7085c2eae80"
Sep 09 13:45:10.799995 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:10.799957    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:45:11.729410 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:11.729378    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6a7dbc-6dbd476758-ztf6n"
Sep 09 13:45:11.729633 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:11.729554    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-6a7dbc-67c9f8b4fc-2zqwp"
Sep 09 13:45:13.023962 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:13.023926    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:45:14.173830 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:14.173794    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:45:14.810141 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:14.810113    2578 generic.go:356] "Generic (PLEG): container finished" podID="5c5a538b-6d4b-460f-9109-947d0de43343" containerID="44c5365f85a56418ade64787dcdc81489f5213d1e128cb2b3da827798c6acb26" exitCode=0
Sep 09 13:45:14.810316 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:14.810160    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-8f2df2-29816025-pjm2q" event={"ID":"5c5a538b-6d4b-460f-9109-947d0de43343","Type":"ContainerDied","Data":"44c5365f85a56418ade64787dcdc81489f5213d1e128cb2b3da827798c6acb26"}
Sep 09 13:45:15.940158 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:15.940133    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-8f2df2-29816025-pjm2q"
Sep 09 13:45:16.821336 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:16.821303    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-8f2df2-29816025-pjm2q"
Sep 09 13:45:16.821336 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:16.821316    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-8f2df2-29816025-pjm2q" event={"ID":"5c5a538b-6d4b-460f-9109-947d0de43343","Type":"ContainerDied","Data":"e2aa05855e22081aea7d105701f0426660ff58095e4cc667dd57b8062a9cb804"}
Sep 09 13:45:16.821552 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:16.821370    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e2aa05855e22081aea7d105701f0426660ff58095e4cc667dd57b8062a9cb804"
Sep 09 13:45:19.874840 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:19.874798    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:45:22.643438 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:22.643401    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:45:30.890716 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:30.890676    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:45:31.331648 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:31.331553    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:45:31.729057 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:31.729022    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2"]
Sep 09 13:45:31.729443 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:31.729429    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9e41768-e595-4020-8bb5-5b08918ad7c4" containerName="cleanup"
Sep 09 13:45:31.729499 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:31.729446    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9e41768-e595-4020-8bb5-5b08918ad7c4" containerName="cleanup"
Sep 09 13:45:31.729499 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:31.729462    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c5a538b-6d4b-460f-9109-947d0de43343" containerName="cleanup"
Sep 09 13:45:31.729499 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:31.729468    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c5a538b-6d4b-460f-9109-947d0de43343" containerName="cleanup"
Sep 09 13:45:31.729592 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:31.729545    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c5a538b-6d4b-460f-9109-947d0de43343" containerName="cleanup"
Sep 09 13:45:31.729592 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:31.729556    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9e41768-e595-4020-8bb5-5b08918ad7c4" containerName="cleanup"
Sep 09 13:45:31.732537 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:31.732521    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2"
Sep 09 13:45:31.735688 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:31.735659    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-638c40f1-openshift-default-dockercfg-4trpx\""
Sep 09 13:45:31.752038 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:31.752013    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2"]
Sep 09 13:45:31.762240 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:31.762193    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:45:31.776687 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:31.776648    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bda04cde-f16e-4262-b260-32feae304921-istio-data\") pod \"e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2\" (UID: \"bda04cde-f16e-4262-b260-32feae304921\") " pod="openshift-ingress/e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2"
Sep 09 13:45:31.776832 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:31.776711    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bda04cde-f16e-4262-b260-32feae304921-istiod-ca-cert\") pod \"e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2\" (UID: \"bda04cde-f16e-4262-b260-32feae304921\") " pod="openshift-ingress/e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2"
Sep 09 13:45:31.776832 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:31.776746    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bda04cde-f16e-4262-b260-32feae304921-istio-podinfo\") pod \"e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2\" (UID: \"bda04cde-f16e-4262-b260-32feae304921\") " pod="openshift-ingress/e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2"
Sep 09 13:45:31.776832 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:31.776774    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bda04cde-f16e-4262-b260-32feae304921-credential-socket\") pod \"e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2\" (UID: \"bda04cde-f16e-4262-b260-32feae304921\") " pod="openshift-ingress/e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2"
Sep 09 13:45:31.776832 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:31.776802    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bda04cde-f16e-4262-b260-32feae304921-workload-socket\") pod \"e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2\" (UID: \"bda04cde-f16e-4262-b260-32feae304921\") " pod="openshift-ingress/e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2"
Sep 09 13:45:31.777089 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:31.776883    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bda04cde-f16e-4262-b260-32feae304921-istio-envoy\") pod \"e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2\" (UID: \"bda04cde-f16e-4262-b260-32feae304921\") " pod="openshift-ingress/e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2"
Sep 09 13:45:31.777089 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:31.776924    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8zb8\" (UniqueName: \"kubernetes.io/projected/bda04cde-f16e-4262-b260-32feae304921-kube-api-access-g8zb8\") pod \"e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2\" (UID: \"bda04cde-f16e-4262-b260-32feae304921\") " pod="openshift-ingress/e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2"
Sep 09 13:45:31.777089 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:31.776964    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bda04cde-f16e-4262-b260-32feae304921-istio-token\") pod \"e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2\" (UID: \"bda04cde-f16e-4262-b260-32feae304921\") " pod="openshift-ingress/e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2"
Sep 09 13:45:31.777266 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:31.777110    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bda04cde-f16e-4262-b260-32feae304921-workload-certs\") pod \"e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2\" (UID: \"bda04cde-f16e-4262-b260-32feae304921\") " pod="openshift-ingress/e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2"
Sep 09 13:45:31.878682 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:31.878643    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bda04cde-f16e-4262-b260-32feae304921-istio-envoy\") pod \"e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2\" (UID: \"bda04cde-f16e-4262-b260-32feae304921\") " pod="openshift-ingress/e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2"
Sep 09 13:45:31.878682 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:31.878688    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8zb8\" (UniqueName: \"kubernetes.io/projected/bda04cde-f16e-4262-b260-32feae304921-kube-api-access-g8zb8\") pod \"e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2\" (UID: \"bda04cde-f16e-4262-b260-32feae304921\") " pod="openshift-ingress/e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2"
Sep 09 13:45:31.878927 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:31.878719    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bda04cde-f16e-4262-b260-32feae304921-istio-token\") pod \"e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2\" (UID: \"bda04cde-f16e-4262-b260-32feae304921\") " pod="openshift-ingress/e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2"
Sep 09 13:45:31.878927 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:31.878751    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bda04cde-f16e-4262-b260-32feae304921-workload-certs\") pod \"e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2\" (UID: \"bda04cde-f16e-4262-b260-32feae304921\") " pod="openshift-ingress/e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2"
Sep 09 13:45:31.878927 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:31.878805    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bda04cde-f16e-4262-b260-32feae304921-istio-data\") pod \"e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2\" (UID: \"bda04cde-f16e-4262-b260-32feae304921\") " pod="openshift-ingress/e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2"
Sep 09 13:45:31.878927 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:31.878843    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bda04cde-f16e-4262-b260-32feae304921-istiod-ca-cert\") pod \"e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2\" (UID: \"bda04cde-f16e-4262-b260-32feae304921\") " pod="openshift-ingress/e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2"
Sep 09 13:45:31.878927 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:31.878860    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bda04cde-f16e-4262-b260-32feae304921-istio-podinfo\") pod \"e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2\" (UID: \"bda04cde-f16e-4262-b260-32feae304921\") " pod="openshift-ingress/e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2"
Sep 09 13:45:31.878927 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:31.878883    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bda04cde-f16e-4262-b260-32feae304921-credential-socket\") pod \"e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2\" (UID: \"bda04cde-f16e-4262-b260-32feae304921\") " pod="openshift-ingress/e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2"
Sep 09 13:45:31.878927 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:31.878908    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bda04cde-f16e-4262-b260-32feae304921-workload-socket\") pod \"e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2\" (UID: \"bda04cde-f16e-4262-b260-32feae304921\") " pod="openshift-ingress/e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2"
Sep 09 13:45:31.879253 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:31.879159    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bda04cde-f16e-4262-b260-32feae304921-workload-certs\") pod \"e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2\" (UID: \"bda04cde-f16e-4262-b260-32feae304921\") " pod="openshift-ingress/e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2"
Sep 09 13:45:31.879253 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:31.879211    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bda04cde-f16e-4262-b260-32feae304921-workload-socket\") pod \"e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2\" (UID: \"bda04cde-f16e-4262-b260-32feae304921\") " pod="openshift-ingress/e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2"
Sep 09 13:45:31.879389 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:31.879369    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bda04cde-f16e-4262-b260-32feae304921-istio-data\") pod \"e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2\" (UID: \"bda04cde-f16e-4262-b260-32feae304921\") " pod="openshift-ingress/e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2"
Sep 09 13:45:31.879438 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:31.879417    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bda04cde-f16e-4262-b260-32feae304921-credential-socket\") pod \"e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2\" (UID: \"bda04cde-f16e-4262-b260-32feae304921\") " pod="openshift-ingress/e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2"
Sep 09 13:45:31.879693 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:31.879665    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bda04cde-f16e-4262-b260-32feae304921-istiod-ca-cert\") pod \"e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2\" (UID: \"bda04cde-f16e-4262-b260-32feae304921\") " pod="openshift-ingress/e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2"
Sep 09 13:45:31.881041 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:31.881019    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bda04cde-f16e-4262-b260-32feae304921-istio-envoy\") pod \"e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2\" (UID: \"bda04cde-f16e-4262-b260-32feae304921\") " pod="openshift-ingress/e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2"
Sep 09 13:45:31.881416 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:31.881396    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bda04cde-f16e-4262-b260-32feae304921-istio-podinfo\") pod \"e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2\" (UID: \"bda04cde-f16e-4262-b260-32feae304921\") " pod="openshift-ingress/e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2"
Sep 09 13:45:31.887282 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:31.887257    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8zb8\" (UniqueName: \"kubernetes.io/projected/bda04cde-f16e-4262-b260-32feae304921-kube-api-access-g8zb8\") pod \"e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2\" (UID: \"bda04cde-f16e-4262-b260-32feae304921\") " pod="openshift-ingress/e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2"
Sep 09 13:45:31.887395 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:31.887281    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bda04cde-f16e-4262-b260-32feae304921-istio-token\") pod \"e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2\" (UID: \"bda04cde-f16e-4262-b260-32feae304921\") " pod="openshift-ingress/e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2"
Sep 09 13:45:31.990811 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:31.990575    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:45:32.042657 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:32.042435    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2"
Sep 09 13:45:32.318722 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:32.318679    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2"]
Sep 09 13:45:32.320977 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:45:32.320947    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbda04cde_f16e_4262_b260_32feae304921.slice/crio-22f19afb017772f72034a641ee77097a644a1dc6eac607a5d8dafc4abc0ffe4a WatchSource:0}: Error finding container 22f19afb017772f72034a641ee77097a644a1dc6eac607a5d8dafc4abc0ffe4a: Status 404 returned error can't find the container with id 22f19afb017772f72034a641ee77097a644a1dc6eac607a5d8dafc4abc0ffe4a
Sep 09 13:45:32.323281 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:32.323246    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 13:45:32.323390 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:32.323316    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 13:45:32.323390 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:32.323344    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 13:45:32.905884 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:32.905851    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2" event={"ID":"bda04cde-f16e-4262-b260-32feae304921","Type":"ContainerStarted","Data":"0f6b6e7a029609fcaf18e354d4ee2acb0f225c6323fe4a5768371a0851f38d9c"}
Sep 09 13:45:32.906064 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:32.905904    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2" event={"ID":"bda04cde-f16e-4262-b260-32feae304921","Type":"ContainerStarted","Data":"22f19afb017772f72034a641ee77097a644a1dc6eac607a5d8dafc4abc0ffe4a"}
Sep 09 13:45:32.931687 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:32.931624    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2" podStartSLOduration=1.931606501 podStartE2EDuration="1.931606501s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 13:45:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 13:45:32.927387317 +0000 UTC m=+1144.742911511" watchObservedRunningTime="2026-09-09 13:45:32.931606501 +0000 UTC m=+1144.747130772"
Sep 09 13:45:33.043453 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:33.043415    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2"
Sep 09 13:45:33.051099 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:33.051067    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2"
Sep 09 13:45:33.911357 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:33.911330    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2"
Sep 09 13:45:33.912854 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:33.912835    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2"
Sep 09 13:45:34.845013 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:34.844983    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:45:34.943380 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:34.943337    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:45:36.018398 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:36.018364    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:45:36.115610 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:36.115578    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:45:36.218486 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:36.218453    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:45:36.482723 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:36.482691    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:45:36.589828 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:36.589795    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:45:37.178713 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:37.178678    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:45:45.455093 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:45.455046    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:45:57.063001 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:57.062961    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:45:59.043191 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:59.043153    2578 generic.go:356] "Generic (PLEG): container finished" podID="bda04cde-f16e-4262-b260-32feae304921" containerID="0f6b6e7a029609fcaf18e354d4ee2acb0f225c6323fe4a5768371a0851f38d9c" exitCode=0
Sep 09 13:45:59.043657 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:59.043227    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2" event={"ID":"bda04cde-f16e-4262-b260-32feae304921","Type":"ContainerDied","Data":"0f6b6e7a029609fcaf18e354d4ee2acb0f225c6323fe4a5768371a0851f38d9c"}
Sep 09 13:45:59.043756 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:59.043691    2578 scope.go:117] "RemoveContainer" containerID="0f6b6e7a029609fcaf18e354d4ee2acb0f225c6323fe4a5768371a0851f38d9c"
Sep 09 13:45:59.045009 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:59.044971    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 13:45:59.045086 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:59.045068    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 13:45:59.045134 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:59.045118    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 13:45:59.784031 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:45:59.783994    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:46:00.050039 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:46:00.049954    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2" event={"ID":"bda04cde-f16e-4262-b260-32feae304921","Type":"ContainerStarted","Data":"cfe517602b317ad1e73946cc474aa6a46af0608c6692f89fae656e2ecc538430"}
Sep 09 13:46:01.043508 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:46:01.043472    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2"
Sep 09 13:46:01.044720 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:46:01.044689    2578 patch_prober.go:28] interesting pod/e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 09 13:46:01.044859 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:46:01.044749    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2" podUID="bda04cde-f16e-4262-b260-32feae304921" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 09 13:46:01.748551 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:46:01.748519    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:46:02.043592 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:46:02.043509    2578 patch_prober.go:28] interesting pod/e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 09 13:46:02.043592 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:46:02.043562    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2" podUID="bda04cde-f16e-4262-b260-32feae304921" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 09 13:46:03.043291 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:46:03.043254    2578 patch_prober.go:28] interesting pod/e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 09 13:46:03.043687 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:46:03.043323    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2" podUID="bda04cde-f16e-4262-b260-32feae304921" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 09 13:46:03.912162 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:46:03.912116    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2"
Sep 09 13:46:04.043009 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:46:04.042974    2578 patch_prober.go:28] interesting pod/e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 09 13:46:04.043214 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:46:04.043025    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2" podUID="bda04cde-f16e-4262-b260-32feae304921" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 09 13:46:05.058935 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:46:05.058891    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2"
Sep 09 13:46:05.061513 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:46:05.061484    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2"
Sep 09 13:46:14.263373 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:46:14.263331    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:46:20.430661 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:46:20.430616    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:46:33.459799 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:46:33.459764    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:46:37.704426 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:46:37.704378    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:46:38.859462 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:46:38.859420    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:46:44.506005 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:46:44.505967    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:46:44.603002 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:46:44.602971    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:46:44.689881 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:46:44.689842    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:46:44.789904 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:46:44.789814    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:46:47.774666 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:46:47.774633    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:46:51.069135 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:46:51.069103    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:46:52.846323 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:46:52.846289    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:47:07.464299 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:47:07.464262    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:47:24.872358 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:47:24.872278    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:47:30.655137 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:47:30.655083    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:47:30.779461 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:47:30.779420    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:47:36.258115 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:47:36.258075    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:47:41.887980 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:47:41.887944    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:47:48.093091 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:47:48.093052    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:47:49.283975 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:47:49.283939    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:47:50.816360 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:47:50.816328    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:47:50.916579 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:47:50.916525    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:47:51.042777 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:47:51.042744    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2"]
Sep 09 13:47:51.042997 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:47:51.042967    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2" podUID="bda04cde-f16e-4262-b260-32feae304921" containerName="istio-proxy" containerID="cri-o://cfe517602b317ad1e73946cc474aa6a46af0608c6692f89fae656e2ecc538430" gracePeriod=30
Sep 09 13:47:51.062489 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:47:51.062462    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:47:52.314497 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:47:52.314457    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:47:52.419299 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:47:52.419270    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:47:52.515304 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:47:52.515269    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:47:53.084914 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:47:53.084869    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:47:53.198001 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:47:53.197966    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:47:53.292424 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:47:53.292373    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:47:54.467207 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:47:54.467160    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:47:54.469391 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:47:54.469364    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:47:56.290743 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:47:56.290715    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2"
Sep 09 13:47:56.356298 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:47:56.356195    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bda04cde-f16e-4262-b260-32feae304921-workload-socket\") pod \"bda04cde-f16e-4262-b260-32feae304921\" (UID: \"bda04cde-f16e-4262-b260-32feae304921\") "
Sep 09 13:47:56.356298 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:47:56.356271    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bda04cde-f16e-4262-b260-32feae304921-istio-token\") pod \"bda04cde-f16e-4262-b260-32feae304921\" (UID: \"bda04cde-f16e-4262-b260-32feae304921\") "
Sep 09 13:47:56.356537 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:47:56.356306    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bda04cde-f16e-4262-b260-32feae304921-istiod-ca-cert\") pod \"bda04cde-f16e-4262-b260-32feae304921\" (UID: \"bda04cde-f16e-4262-b260-32feae304921\") "
Sep 09 13:47:56.356537 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:47:56.356327    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bda04cde-f16e-4262-b260-32feae304921-credential-socket\") pod \"bda04cde-f16e-4262-b260-32feae304921\" (UID: \"bda04cde-f16e-4262-b260-32feae304921\") "
Sep 09 13:47:56.356537 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:47:56.356420    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bda04cde-f16e-4262-b260-32feae304921-istio-data\") pod \"bda04cde-f16e-4262-b260-32feae304921\" (UID: \"bda04cde-f16e-4262-b260-32feae304921\") "
Sep 09 13:47:56.356537 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:47:56.356472    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bda04cde-f16e-4262-b260-32feae304921-istio-podinfo\") pod \"bda04cde-f16e-4262-b260-32feae304921\" (UID: \"bda04cde-f16e-4262-b260-32feae304921\") "
Sep 09 13:47:56.356537 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:47:56.356487    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bda04cde-f16e-4262-b260-32feae304921-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bda04cde-f16e-4262-b260-32feae304921" (UID: "bda04cde-f16e-4262-b260-32feae304921"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 13:47:56.356537 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:47:56.356530    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bda04cde-f16e-4262-b260-32feae304921-istio-envoy\") pod \"bda04cde-f16e-4262-b260-32feae304921\" (UID: \"bda04cde-f16e-4262-b260-32feae304921\") "
Sep 09 13:47:56.356855 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:47:56.356575    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g8zb8\" (UniqueName: \"kubernetes.io/projected/bda04cde-f16e-4262-b260-32feae304921-kube-api-access-g8zb8\") pod \"bda04cde-f16e-4262-b260-32feae304921\" (UID: \"bda04cde-f16e-4262-b260-32feae304921\") "
Sep 09 13:47:56.356855 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:47:56.356611    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bda04cde-f16e-4262-b260-32feae304921-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bda04cde-f16e-4262-b260-32feae304921" (UID: "bda04cde-f16e-4262-b260-32feae304921"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 13:47:56.356855 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:47:56.356646    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bda04cde-f16e-4262-b260-32feae304921-workload-certs\") pod \"bda04cde-f16e-4262-b260-32feae304921\" (UID: \"bda04cde-f16e-4262-b260-32feae304921\") "
Sep 09 13:47:56.356855 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:47:56.356690    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bda04cde-f16e-4262-b260-32feae304921-istio-data" (OuterVolumeSpecName: "istio-data") pod "bda04cde-f16e-4262-b260-32feae304921" (UID: "bda04cde-f16e-4262-b260-32feae304921"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 13:47:56.356855 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:47:56.356699    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bda04cde-f16e-4262-b260-32feae304921-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bda04cde-f16e-4262-b260-32feae304921" (UID: "bda04cde-f16e-4262-b260-32feae304921"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 13:47:56.357121 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:47:56.356985    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bda04cde-f16e-4262-b260-32feae304921-istiod-ca-cert\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:47:56.357121 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:47:56.357004    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bda04cde-f16e-4262-b260-32feae304921-credential-socket\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:47:56.357121 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:47:56.357008    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bda04cde-f16e-4262-b260-32feae304921-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bda04cde-f16e-4262-b260-32feae304921" (UID: "bda04cde-f16e-4262-b260-32feae304921"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 13:47:56.357121 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:47:56.357020    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bda04cde-f16e-4262-b260-32feae304921-istio-data\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:47:56.357121 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:47:56.357033    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bda04cde-f16e-4262-b260-32feae304921-workload-socket\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:47:56.358522 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:47:56.358495    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bda04cde-f16e-4262-b260-32feae304921-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bda04cde-f16e-4262-b260-32feae304921" (UID: "bda04cde-f16e-4262-b260-32feae304921"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 13:47:56.358631 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:47:56.358586    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bda04cde-f16e-4262-b260-32feae304921-kube-api-access-g8zb8" (OuterVolumeSpecName: "kube-api-access-g8zb8") pod "bda04cde-f16e-4262-b260-32feae304921" (UID: "bda04cde-f16e-4262-b260-32feae304921"). InnerVolumeSpecName "kube-api-access-g8zb8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 13:47:56.358883 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:47:56.358867    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bda04cde-f16e-4262-b260-32feae304921-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bda04cde-f16e-4262-b260-32feae304921" (UID: "bda04cde-f16e-4262-b260-32feae304921"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 13:47:56.358925 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:47:56.358884    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bda04cde-f16e-4262-b260-32feae304921-istio-token" (OuterVolumeSpecName: "istio-token") pod "bda04cde-f16e-4262-b260-32feae304921" (UID: "bda04cde-f16e-4262-b260-32feae304921"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 13:47:56.458430 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:47:56.458400    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bda04cde-f16e-4262-b260-32feae304921-istio-token\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:47:56.458430 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:47:56.458428    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bda04cde-f16e-4262-b260-32feae304921-istio-podinfo\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:47:56.458634 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:47:56.458440    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bda04cde-f16e-4262-b260-32feae304921-istio-envoy\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:47:56.458634 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:47:56.458453    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g8zb8\" (UniqueName: \"kubernetes.io/projected/bda04cde-f16e-4262-b260-32feae304921-kube-api-access-g8zb8\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:47:56.458634 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:47:56.458467    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bda04cde-f16e-4262-b260-32feae304921-workload-certs\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:47:56.616972 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:47:56.616891    2578 generic.go:356] "Generic (PLEG): container finished" podID="bda04cde-f16e-4262-b260-32feae304921" containerID="cfe517602b317ad1e73946cc474aa6a46af0608c6692f89fae656e2ecc538430" exitCode=0
Sep 09 13:47:56.616972 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:47:56.616941    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2"
Sep 09 13:47:56.617160 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:47:56.616971    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2" event={"ID":"bda04cde-f16e-4262-b260-32feae304921","Type":"ContainerDied","Data":"cfe517602b317ad1e73946cc474aa6a46af0608c6692f89fae656e2ecc538430"}
Sep 09 13:47:56.617160 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:47:56.617020    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2" event={"ID":"bda04cde-f16e-4262-b260-32feae304921","Type":"ContainerDied","Data":"22f19afb017772f72034a641ee77097a644a1dc6eac607a5d8dafc4abc0ffe4a"}
Sep 09 13:47:56.617160 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:47:56.617043    2578 scope.go:117] "RemoveContainer" containerID="cfe517602b317ad1e73946cc474aa6a46af0608c6692f89fae656e2ecc538430"
Sep 09 13:47:56.626306 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:47:56.626289    2578 scope.go:117] "RemoveContainer" containerID="0f6b6e7a029609fcaf18e354d4ee2acb0f225c6323fe4a5768371a0851f38d9c"
Sep 09 13:47:56.634123 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:47:56.634106    2578 scope.go:117] "RemoveContainer" containerID="cfe517602b317ad1e73946cc474aa6a46af0608c6692f89fae656e2ecc538430"
Sep 09 13:47:56.634422 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:47:56.634400    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfe517602b317ad1e73946cc474aa6a46af0608c6692f89fae656e2ecc538430\": container with ID starting with cfe517602b317ad1e73946cc474aa6a46af0608c6692f89fae656e2ecc538430 not found: ID does not exist" containerID="cfe517602b317ad1e73946cc474aa6a46af0608c6692f89fae656e2ecc538430"
Sep 09 13:47:56.634465 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:47:56.634431    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfe517602b317ad1e73946cc474aa6a46af0608c6692f89fae656e2ecc538430"} err="failed to get container status \"cfe517602b317ad1e73946cc474aa6a46af0608c6692f89fae656e2ecc538430\": rpc error: code = NotFound desc = could not find container \"cfe517602b317ad1e73946cc474aa6a46af0608c6692f89fae656e2ecc538430\": container with ID starting with cfe517602b317ad1e73946cc474aa6a46af0608c6692f89fae656e2ecc538430 not found: ID does not exist"
Sep 09 13:47:56.634465 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:47:56.634448    2578 scope.go:117] "RemoveContainer" containerID="0f6b6e7a029609fcaf18e354d4ee2acb0f225c6323fe4a5768371a0851f38d9c"
Sep 09 13:47:56.634686 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:47:56.634669    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f6b6e7a029609fcaf18e354d4ee2acb0f225c6323fe4a5768371a0851f38d9c\": container with ID starting with 0f6b6e7a029609fcaf18e354d4ee2acb0f225c6323fe4a5768371a0851f38d9c not found: ID does not exist" containerID="0f6b6e7a029609fcaf18e354d4ee2acb0f225c6323fe4a5768371a0851f38d9c"
Sep 09 13:47:56.634728 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:47:56.634691    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f6b6e7a029609fcaf18e354d4ee2acb0f225c6323fe4a5768371a0851f38d9c"} err="failed to get container status \"0f6b6e7a029609fcaf18e354d4ee2acb0f225c6323fe4a5768371a0851f38d9c\": rpc error: code = NotFound desc = could not find container \"0f6b6e7a029609fcaf18e354d4ee2acb0f225c6323fe4a5768371a0851f38d9c\": container with ID starting with 0f6b6e7a029609fcaf18e354d4ee2acb0f225c6323fe4a5768371a0851f38d9c not found: ID does not exist"
Sep 09 13:47:56.648926 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:47:56.648900    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2"]
Sep 09 13:47:56.650812 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:47:56.650795    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-638c40f1-openshift-default-7bb7fd978d-76ms2"]
Sep 09 13:47:56.666857 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:47:56.662331    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bda04cde-f16e-4262-b260-32feae304921" path="/var/lib/kubelet/pods/bda04cde-f16e-4262-b260-32feae304921/volumes"
Sep 09 13:47:59.419666 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:47:59.419610    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:48:00.744581 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:48:00.744516    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:48:00.845704 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:48:00.845673    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:48:01.408200 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:48:01.408149    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:48:08.666999 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:48:08.666948    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:48:08.728262 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:48:08.728230    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:48:12.583594 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:48:12.583558    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:48:17.848999 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:48:17.848961    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:48:18.070300 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:48:18.070254    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:48:25.217115 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:48:25.217078    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:48:26.717318 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:48:26.717284    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:48:26.817951 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:48:26.817896    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:48:27.975621 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:48:27.975584    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:48:32.367623 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:48:32.367585    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:48:39.943209 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:48:39.943157    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:48:45.336411 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:48:45.336374    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz"]
Sep 09 13:48:45.337025 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:48:45.337008    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bda04cde-f16e-4262-b260-32feae304921" containerName="istio-proxy"
Sep 09 13:48:45.337069 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:48:45.337029    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="bda04cde-f16e-4262-b260-32feae304921" containerName="istio-proxy"
Sep 09 13:48:45.337069 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:48:45.337040    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bda04cde-f16e-4262-b260-32feae304921" containerName="istio-proxy"
Sep 09 13:48:45.337069 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:48:45.337047    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="bda04cde-f16e-4262-b260-32feae304921" containerName="istio-proxy"
Sep 09 13:48:45.337160 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:48:45.337139    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="bda04cde-f16e-4262-b260-32feae304921" containerName="istio-proxy"
Sep 09 13:48:45.337160 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:48:45.337152    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="bda04cde-f16e-4262-b260-32feae304921" containerName="istio-proxy"
Sep 09 13:48:45.342295 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:48:45.342270    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz"
Sep 09 13:48:45.345075 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:48:45.345043    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-464c54-openshift-default-dockercfg-fksjr\""
Sep 09 13:48:45.352696 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:48:45.352669    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz"]
Sep 09 13:48:45.409389 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:48:45.409357    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d53099fa-bd97-42bc-9f62-f3484717bf25-istio-data\") pod \"e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz\" (UID: \"d53099fa-bd97-42bc-9f62-f3484717bf25\") " pod="openshift-ingress/e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz"
Sep 09 13:48:45.409554 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:48:45.409411    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d53099fa-bd97-42bc-9f62-f3484717bf25-workload-certs\") pod \"e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz\" (UID: \"d53099fa-bd97-42bc-9f62-f3484717bf25\") " pod="openshift-ingress/e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz"
Sep 09 13:48:45.409554 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:48:45.409489    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d53099fa-bd97-42bc-9f62-f3484717bf25-istio-envoy\") pod \"e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz\" (UID: \"d53099fa-bd97-42bc-9f62-f3484717bf25\") " pod="openshift-ingress/e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz"
Sep 09 13:48:45.409554 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:48:45.409534    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d53099fa-bd97-42bc-9f62-f3484717bf25-credential-socket\") pod \"e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz\" (UID: \"d53099fa-bd97-42bc-9f62-f3484717bf25\") " pod="openshift-ingress/e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz"
Sep 09 13:48:45.409554 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:48:45.409552    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d53099fa-bd97-42bc-9f62-f3484717bf25-istio-token\") pod \"e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz\" (UID: \"d53099fa-bd97-42bc-9f62-f3484717bf25\") " pod="openshift-ingress/e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz"
Sep 09 13:48:45.409710 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:48:45.409577    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d53099fa-bd97-42bc-9f62-f3484717bf25-workload-socket\") pod \"e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz\" (UID: \"d53099fa-bd97-42bc-9f62-f3484717bf25\") " pod="openshift-ingress/e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz"
Sep 09 13:48:45.409710 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:48:45.409605    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnl28\" (UniqueName: \"kubernetes.io/projected/d53099fa-bd97-42bc-9f62-f3484717bf25-kube-api-access-gnl28\") pod \"e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz\" (UID: \"d53099fa-bd97-42bc-9f62-f3484717bf25\") " pod="openshift-ingress/e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz"
Sep 09 13:48:45.409710 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:48:45.409635    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d53099fa-bd97-42bc-9f62-f3484717bf25-istiod-ca-cert\") pod \"e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz\" (UID: \"d53099fa-bd97-42bc-9f62-f3484717bf25\") " pod="openshift-ingress/e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz"
Sep 09 13:48:45.409710 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:48:45.409665    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d53099fa-bd97-42bc-9f62-f3484717bf25-istio-podinfo\") pod \"e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz\" (UID: \"d53099fa-bd97-42bc-9f62-f3484717bf25\") " pod="openshift-ingress/e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz"
Sep 09 13:48:45.510720 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:48:45.510684    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d53099fa-bd97-42bc-9f62-f3484717bf25-workload-socket\") pod \"e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz\" (UID: \"d53099fa-bd97-42bc-9f62-f3484717bf25\") " pod="openshift-ingress/e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz"
Sep 09 13:48:45.510720 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:48:45.510730    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnl28\" (UniqueName: \"kubernetes.io/projected/d53099fa-bd97-42bc-9f62-f3484717bf25-kube-api-access-gnl28\") pod \"e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz\" (UID: \"d53099fa-bd97-42bc-9f62-f3484717bf25\") " pod="openshift-ingress/e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz"
Sep 09 13:48:45.510953 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:48:45.510752    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d53099fa-bd97-42bc-9f62-f3484717bf25-istiod-ca-cert\") pod \"e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz\" (UID: \"d53099fa-bd97-42bc-9f62-f3484717bf25\") " pod="openshift-ingress/e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz"
Sep 09 13:48:45.510953 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:48:45.510778    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d53099fa-bd97-42bc-9f62-f3484717bf25-istio-podinfo\") pod \"e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz\" (UID: \"d53099fa-bd97-42bc-9f62-f3484717bf25\") " pod="openshift-ingress/e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz"
Sep 09 13:48:45.510953 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:48:45.510817    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d53099fa-bd97-42bc-9f62-f3484717bf25-istio-data\") pod \"e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz\" (UID: \"d53099fa-bd97-42bc-9f62-f3484717bf25\") " pod="openshift-ingress/e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz"
Sep 09 13:48:45.510953 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:48:45.510844    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d53099fa-bd97-42bc-9f62-f3484717bf25-workload-certs\") pod \"e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz\" (UID: \"d53099fa-bd97-42bc-9f62-f3484717bf25\") " pod="openshift-ingress/e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz"
Sep 09 13:48:45.511151 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:48:45.510979    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d53099fa-bd97-42bc-9f62-f3484717bf25-istio-envoy\") pod \"e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz\" (UID: \"d53099fa-bd97-42bc-9f62-f3484717bf25\") " pod="openshift-ingress/e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz"
Sep 09 13:48:45.511151 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:48:45.511076    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d53099fa-bd97-42bc-9f62-f3484717bf25-credential-socket\") pod \"e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz\" (UID: \"d53099fa-bd97-42bc-9f62-f3484717bf25\") " pod="openshift-ingress/e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz"
Sep 09 13:48:45.511151 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:48:45.511105    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d53099fa-bd97-42bc-9f62-f3484717bf25-istio-token\") pod \"e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz\" (UID: \"d53099fa-bd97-42bc-9f62-f3484717bf25\") " pod="openshift-ingress/e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz"
Sep 09 13:48:45.511325 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:48:45.511149    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d53099fa-bd97-42bc-9f62-f3484717bf25-workload-socket\") pod \"e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz\" (UID: \"d53099fa-bd97-42bc-9f62-f3484717bf25\") " pod="openshift-ingress/e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz"
Sep 09 13:48:45.511325 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:48:45.511209    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d53099fa-bd97-42bc-9f62-f3484717bf25-istio-data\") pod \"e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz\" (UID: \"d53099fa-bd97-42bc-9f62-f3484717bf25\") " pod="openshift-ingress/e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz"
Sep 09 13:48:45.511325 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:48:45.511312    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d53099fa-bd97-42bc-9f62-f3484717bf25-workload-certs\") pod \"e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz\" (UID: \"d53099fa-bd97-42bc-9f62-f3484717bf25\") " pod="openshift-ingress/e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz"
Sep 09 13:48:45.511668 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:48:45.511491    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d53099fa-bd97-42bc-9f62-f3484717bf25-credential-socket\") pod \"e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz\" (UID: \"d53099fa-bd97-42bc-9f62-f3484717bf25\") " pod="openshift-ingress/e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz"
Sep 09 13:48:45.511763 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:48:45.511740    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d53099fa-bd97-42bc-9f62-f3484717bf25-istiod-ca-cert\") pod \"e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz\" (UID: \"d53099fa-bd97-42bc-9f62-f3484717bf25\") " pod="openshift-ingress/e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz"
Sep 09 13:48:45.513312 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:48:45.513288    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d53099fa-bd97-42bc-9f62-f3484717bf25-istio-envoy\") pod \"e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz\" (UID: \"d53099fa-bd97-42bc-9f62-f3484717bf25\") " pod="openshift-ingress/e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz"
Sep 09 13:48:45.513515 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:48:45.513496    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d53099fa-bd97-42bc-9f62-f3484717bf25-istio-podinfo\") pod \"e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz\" (UID: \"d53099fa-bd97-42bc-9f62-f3484717bf25\") " pod="openshift-ingress/e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz"
Sep 09 13:48:45.518612 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:48:45.518586    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d53099fa-bd97-42bc-9f62-f3484717bf25-istio-token\") pod \"e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz\" (UID: \"d53099fa-bd97-42bc-9f62-f3484717bf25\") " pod="openshift-ingress/e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz"
Sep 09 13:48:45.518906 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:48:45.518885    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnl28\" (UniqueName: \"kubernetes.io/projected/d53099fa-bd97-42bc-9f62-f3484717bf25-kube-api-access-gnl28\") pod \"e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz\" (UID: \"d53099fa-bd97-42bc-9f62-f3484717bf25\") " pod="openshift-ingress/e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz"
Sep 09 13:48:45.632204 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:48:45.632034    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:48:45.656295 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:48:45.656257    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz"
Sep 09 13:48:45.771129 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:48:45.771083    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:48:45.845492 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:48:45.845437    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:48:45.964410 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:48:45.964327    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz"]
Sep 09 13:48:45.967967 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:48:45.967931    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd53099fa_bd97_42bc_9f62_f3484717bf25.slice/crio-594e388be147ce13876f8dabc68cd3b7ca6035038abdcbf1a45c72abafe3dc92 WatchSource:0}: Error finding container 594e388be147ce13876f8dabc68cd3b7ca6035038abdcbf1a45c72abafe3dc92: Status 404 returned error can't find the container with id 594e388be147ce13876f8dabc68cd3b7ca6035038abdcbf1a45c72abafe3dc92
Sep 09 13:48:45.970435 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:48:45.970403    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 13:48:45.970527 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:48:45.970467    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 13:48:45.970527 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:48:45.970503    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 13:48:46.876257 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:48:46.873245    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz" event={"ID":"d53099fa-bd97-42bc-9f62-f3484717bf25","Type":"ContainerStarted","Data":"d303d4ad61d871aaf32b1169c38a70681cc21199c1c1f92312067c8c2c844162"}
Sep 09 13:48:46.876257 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:48:46.873312    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz" event={"ID":"d53099fa-bd97-42bc-9f62-f3484717bf25","Type":"ContainerStarted","Data":"594e388be147ce13876f8dabc68cd3b7ca6035038abdcbf1a45c72abafe3dc92"}
Sep 09 13:48:46.896578 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:48:46.896524    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz" podStartSLOduration=1.8965064090000001 podStartE2EDuration="1.896506409s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 13:48:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 13:48:46.894089008 +0000 UTC m=+1338.709613203" watchObservedRunningTime="2026-09-09 13:48:46.896506409 +0000 UTC m=+1338.712030603"
Sep 09 13:48:47.658830 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:48:47.658793    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz"
Sep 09 13:48:47.663916 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:48:47.663891    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz"
Sep 09 13:48:47.879523 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:48:47.879487    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz"
Sep 09 13:48:47.880522 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:48:47.880496    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz"
Sep 09 13:48:48.799303 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:48:48.799274    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:48:48.895752 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:48:48.895717    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:48:50.003820 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:48:50.003791    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:48:50.106960 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:48:50.106925    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:48:50.198390 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:48:50.198359    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:48:51.030053 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:48:51.029965    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:48:51.129884 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:48:51.129850    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:48:51.368928 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:48:51.368842    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:49:10.068788 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:10.068751    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:49:11.122862 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:11.122830    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:49:12.014984 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:12.014949    2578 generic.go:356] "Generic (PLEG): container finished" podID="d53099fa-bd97-42bc-9f62-f3484717bf25" containerID="d303d4ad61d871aaf32b1169c38a70681cc21199c1c1f92312067c8c2c844162" exitCode=0
Sep 09 13:49:12.015235 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:12.015021    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz" event={"ID":"d53099fa-bd97-42bc-9f62-f3484717bf25","Type":"ContainerDied","Data":"d303d4ad61d871aaf32b1169c38a70681cc21199c1c1f92312067c8c2c844162"}
Sep 09 13:49:12.015459 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:12.015445    2578 scope.go:117] "RemoveContainer" containerID="d303d4ad61d871aaf32b1169c38a70681cc21199c1c1f92312067c8c2c844162"
Sep 09 13:49:12.016674 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:12.016643    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 13:49:12.016735 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:12.016718    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 13:49:12.016775 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:12.016751    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 13:49:12.273625 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:12.273529    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:49:13.021611 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:13.021574    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz" event={"ID":"d53099fa-bd97-42bc-9f62-f3484717bf25","Type":"ContainerStarted","Data":"efe73670b678f7ed2a1f597a42e09146ffdcdb7de4c89e9a72d86080c932acf8"}
Sep 09 13:49:13.656650 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:13.656619    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz"
Sep 09 13:49:13.657854 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:13.657822    2578 patch_prober.go:28] interesting pod/e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Sep 09 13:49:13.657854 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:13.657875    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz" podUID="d53099fa-bd97-42bc-9f62-f3484717bf25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Sep 09 13:49:13.726853 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:13.726819    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:49:14.170654 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:14.170621    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:49:14.474116 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:14.474029    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:49:14.656950 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:14.656917    2578 patch_prober.go:28] interesting pod/e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Sep 09 13:49:14.657332 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:14.656968    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz" podUID="d53099fa-bd97-42bc-9f62-f3484717bf25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Sep 09 13:49:14.674533 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:14.674500    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:49:15.657458 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:15.657420    2578 patch_prober.go:28] interesting pod/e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Sep 09 13:49:15.657847 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:15.657474    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz" podUID="d53099fa-bd97-42bc-9f62-f3484717bf25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Sep 09 13:49:16.657482 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:16.657450    2578 patch_prober.go:28] interesting pod/e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Sep 09 13:49:16.657929 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:16.657514    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz" podUID="d53099fa-bd97-42bc-9f62-f3484717bf25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Sep 09 13:49:17.066288 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:17.066201    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:49:17.153611 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:17.153571    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:49:17.657616 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:17.657576    2578 patch_prober.go:28] interesting pod/e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Sep 09 13:49:17.658109 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:17.657629    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz" podUID="d53099fa-bd97-42bc-9f62-f3484717bf25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Sep 09 13:49:17.880098 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:17.880073    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz"
Sep 09 13:49:18.241647 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:18.241612    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:49:18.341320 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:18.341282    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:49:18.661286 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:18.661254    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz"
Sep 09 13:49:18.662457 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:18.662438    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz"
Sep 09 13:49:18.664493 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:18.664463    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:49:18.831578 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:18.831546    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:49:18.926551 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:18.926469    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:49:18.971433 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:18.971396    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-4bfe1d-86c6bd564f-4bq7k"]
Sep 09 13:49:18.975185 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:18.975149    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-4bfe1d-86c6bd564f-4bq7k"
Sep 09 13:49:18.978022 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:18.977991    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-4bfe1d\""
Sep 09 13:49:18.978122 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:18.978042    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-4bfe1d-dockercfg-2q82b\""
Sep 09 13:49:18.985091 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:18.985063    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-4bfe1d-86c6bd564f-4bq7k"]
Sep 09 13:49:19.019758 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:19.019724    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-4bfe1d-74f68d4cd6-nwn5z"]
Sep 09 13:49:19.023058 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:19.023043    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-4bfe1d-74f68d4cd6-nwn5z"
Sep 09 13:49:19.038292 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:19.038265    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-4bfe1d-74f68d4cd6-nwn5z"]
Sep 09 13:49:19.052950 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:19.052914    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcxrt\" (UniqueName: \"kubernetes.io/projected/30be15c0-e26a-436b-874c-0cdb6b6794a4-kube-api-access-kcxrt\") pod \"payload-processing-e2e-api-b-4bfe1d-86c6bd564f-4bq7k\" (UID: \"30be15c0-e26a-436b-874c-0cdb6b6794a4\") " pod="openshift-ingress/payload-processing-e2e-api-b-4bfe1d-86c6bd564f-4bq7k"
Sep 09 13:49:19.053392 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:19.053354    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30be15c0-e26a-436b-874c-0cdb6b6794a4-plugins-config-volume\") pod \"payload-processing-e2e-api-b-4bfe1d-86c6bd564f-4bq7k\" (UID: \"30be15c0-e26a-436b-874c-0cdb6b6794a4\") " pod="openshift-ingress/payload-processing-e2e-api-b-4bfe1d-86c6bd564f-4bq7k"
Sep 09 13:49:19.154497 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:19.154463    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcxrt\" (UniqueName: \"kubernetes.io/projected/30be15c0-e26a-436b-874c-0cdb6b6794a4-kube-api-access-kcxrt\") pod \"payload-processing-e2e-api-b-4bfe1d-86c6bd564f-4bq7k\" (UID: \"30be15c0-e26a-436b-874c-0cdb6b6794a4\") " pod="openshift-ingress/payload-processing-e2e-api-b-4bfe1d-86c6bd564f-4bq7k"
Sep 09 13:49:19.154663 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:19.154569    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/362a9559-29d6-41fe-abd6-da865f681a34-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-4bfe1d-74f68d4cd6-nwn5z\" (UID: \"362a9559-29d6-41fe-abd6-da865f681a34\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-4bfe1d-74f68d4cd6-nwn5z"
Sep 09 13:49:19.154663 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:19.154629    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bw72l\" (UniqueName: \"kubernetes.io/projected/362a9559-29d6-41fe-abd6-da865f681a34-kube-api-access-bw72l\") pod \"payload-pre-processing-e2e-api-b-4bfe1d-74f68d4cd6-nwn5z\" (UID: \"362a9559-29d6-41fe-abd6-da865f681a34\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-4bfe1d-74f68d4cd6-nwn5z"
Sep 09 13:49:19.154796 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:19.154765    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30be15c0-e26a-436b-874c-0cdb6b6794a4-plugins-config-volume\") pod \"payload-processing-e2e-api-b-4bfe1d-86c6bd564f-4bq7k\" (UID: \"30be15c0-e26a-436b-874c-0cdb6b6794a4\") " pod="openshift-ingress/payload-processing-e2e-api-b-4bfe1d-86c6bd564f-4bq7k"
Sep 09 13:49:19.155350 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:19.155332    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30be15c0-e26a-436b-874c-0cdb6b6794a4-plugins-config-volume\") pod \"payload-processing-e2e-api-b-4bfe1d-86c6bd564f-4bq7k\" (UID: \"30be15c0-e26a-436b-874c-0cdb6b6794a4\") " pod="openshift-ingress/payload-processing-e2e-api-b-4bfe1d-86c6bd564f-4bq7k"
Sep 09 13:49:19.170571 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:19.170546    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcxrt\" (UniqueName: \"kubernetes.io/projected/30be15c0-e26a-436b-874c-0cdb6b6794a4-kube-api-access-kcxrt\") pod \"payload-processing-e2e-api-b-4bfe1d-86c6bd564f-4bq7k\" (UID: \"30be15c0-e26a-436b-874c-0cdb6b6794a4\") " pod="openshift-ingress/payload-processing-e2e-api-b-4bfe1d-86c6bd564f-4bq7k"
Sep 09 13:49:19.256201 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:19.256080    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bw72l\" (UniqueName: \"kubernetes.io/projected/362a9559-29d6-41fe-abd6-da865f681a34-kube-api-access-bw72l\") pod \"payload-pre-processing-e2e-api-b-4bfe1d-74f68d4cd6-nwn5z\" (UID: \"362a9559-29d6-41fe-abd6-da865f681a34\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-4bfe1d-74f68d4cd6-nwn5z"
Sep 09 13:49:19.256359 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:19.256243    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/362a9559-29d6-41fe-abd6-da865f681a34-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-4bfe1d-74f68d4cd6-nwn5z\" (UID: \"362a9559-29d6-41fe-abd6-da865f681a34\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-4bfe1d-74f68d4cd6-nwn5z"
Sep 09 13:49:19.256858 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:19.256837    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/362a9559-29d6-41fe-abd6-da865f681a34-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-4bfe1d-74f68d4cd6-nwn5z\" (UID: \"362a9559-29d6-41fe-abd6-da865f681a34\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-4bfe1d-74f68d4cd6-nwn5z"
Sep 09 13:49:19.272158 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:19.272127    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bw72l\" (UniqueName: \"kubernetes.io/projected/362a9559-29d6-41fe-abd6-da865f681a34-kube-api-access-bw72l\") pod \"payload-pre-processing-e2e-api-b-4bfe1d-74f68d4cd6-nwn5z\" (UID: \"362a9559-29d6-41fe-abd6-da865f681a34\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-4bfe1d-74f68d4cd6-nwn5z"
Sep 09 13:49:19.285982 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:19.285962    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-4bfe1d-86c6bd564f-4bq7k"
Sep 09 13:49:19.333289 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:19.333256    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-4bfe1d-74f68d4cd6-nwn5z"
Sep 09 13:49:19.561911 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:19.561882    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-4bfe1d-86c6bd564f-4bq7k"]
Sep 09 13:49:19.563898 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:49:19.563874    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30be15c0_e26a_436b_874c_0cdb6b6794a4.slice/crio-a6228cf71dfefb498b760b84ae40aedb0c1dc5768b7600f517a05b0057fd3656 WatchSource:0}: Error finding container a6228cf71dfefb498b760b84ae40aedb0c1dc5768b7600f517a05b0057fd3656: Status 404 returned error can't find the container with id a6228cf71dfefb498b760b84ae40aedb0c1dc5768b7600f517a05b0057fd3656
Sep 09 13:49:19.616247 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:19.616220    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-4bfe1d-74f68d4cd6-nwn5z"]
Sep 09 13:49:19.618336 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:49:19.618313    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod362a9559_29d6_41fe_abd6_da865f681a34.slice/crio-659ee4fe2cf239064096a8be1aeb330cbedf5fe237959dcc810682d452854255 WatchSource:0}: Error finding container 659ee4fe2cf239064096a8be1aeb330cbedf5fe237959dcc810682d452854255: Status 404 returned error can't find the container with id 659ee4fe2cf239064096a8be1aeb330cbedf5fe237959dcc810682d452854255
Sep 09 13:49:20.063426 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:20.063389    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-4bfe1d-74f68d4cd6-nwn5z" event={"ID":"362a9559-29d6-41fe-abd6-da865f681a34","Type":"ContainerStarted","Data":"3d2d913379adce0dc725f207430786916ff744e9e37b10f5c2c01b32aef0e246"}
Sep 09 13:49:20.063897 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:20.063450    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-4bfe1d-74f68d4cd6-nwn5z"
Sep 09 13:49:20.063897 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:20.063475    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-4bfe1d-74f68d4cd6-nwn5z" event={"ID":"362a9559-29d6-41fe-abd6-da865f681a34","Type":"ContainerStarted","Data":"659ee4fe2cf239064096a8be1aeb330cbedf5fe237959dcc810682d452854255"}
Sep 09 13:49:20.064997 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:20.064969    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-4bfe1d-86c6bd564f-4bq7k" event={"ID":"30be15c0-e26a-436b-874c-0cdb6b6794a4","Type":"ContainerStarted","Data":"24f328db376f31698f90aedd415d0c583906322916e0b9cce98412adb00d80e1"}
Sep 09 13:49:20.065123 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:20.065017    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-4bfe1d-86c6bd564f-4bq7k" event={"ID":"30be15c0-e26a-436b-874c-0cdb6b6794a4","Type":"ContainerStarted","Data":"a6228cf71dfefb498b760b84ae40aedb0c1dc5768b7600f517a05b0057fd3656"}
Sep 09 13:49:20.065123 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:20.065047    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-4bfe1d-86c6bd564f-4bq7k"
Sep 09 13:49:20.082414 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:20.082364    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-4bfe1d-74f68d4cd6-nwn5z" podStartSLOduration=1.082348473 podStartE2EDuration="1.082348473s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 13:49:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 13:49:20.080773239 +0000 UTC m=+1371.896297436" watchObservedRunningTime="2026-09-09 13:49:20.082348473 +0000 UTC m=+1371.897872667"
Sep 09 13:49:26.876427 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:26.876361    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-4bfe1d-86c6bd564f-4bq7k" podStartSLOduration=8.876344659 podStartE2EDuration="8.876344659s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 13:49:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 13:49:20.097037291 +0000 UTC m=+1371.912561489" watchObservedRunningTime="2026-09-09 13:49:26.876344659 +0000 UTC m=+1378.691868853"
Sep 09 13:49:26.876812 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:26.876516    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:49:31.071634 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:31.071603    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-4bfe1d-74f68d4cd6-nwn5z"
Sep 09 13:49:31.072115 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:31.071732    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-4bfe1d-86c6bd564f-4bq7k"
Sep 09 13:49:35.811573 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:35.811528    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:49:38.594460 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:38.594413    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:49:40.503534 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:40.503497    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:49:42.014454 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:42.014421    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:49:43.760410 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:43.760370    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:49:45.052418 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:45.052388    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:49:52.373063 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:52.373029    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:49:54.992072 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:49:54.992037    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:50:00.591475 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:00.591442    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:50:00.679533 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:00.679498    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:50:00.780763 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:00.780728    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:50:00.847112 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:00.847038    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:50:01.491045 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:01.491012    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:50:03.123188 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:03.123137    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:50:03.278386 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:03.278352    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:50:03.877043 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:03.877012    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:50:05.561792 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:05.561759    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:50:07.216281 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:07.216249    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:50:07.294157 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:07.294122    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:50:07.448141 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:07.448107    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz"]
Sep 09 13:50:07.448390 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:07.448359    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz" podUID="d53099fa-bd97-42bc-9f62-f3484717bf25" containerName="istio-proxy" containerID="cri-o://efe73670b678f7ed2a1f597a42e09146ffdcdb7de4c89e9a72d86080c932acf8" gracePeriod=30
Sep 09 13:50:07.476536 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:07.476461    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:50:07.908056 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:07.908026    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:50:10.494637 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:10.494602    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:50:12.693647 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:12.693622    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz"
Sep 09 13:50:12.751794 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:12.751709    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d53099fa-bd97-42bc-9f62-f3484717bf25-workload-certs\") pod \"d53099fa-bd97-42bc-9f62-f3484717bf25\" (UID: \"d53099fa-bd97-42bc-9f62-f3484717bf25\") "
Sep 09 13:50:12.751794 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:12.751741    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d53099fa-bd97-42bc-9f62-f3484717bf25-istio-envoy\") pod \"d53099fa-bd97-42bc-9f62-f3484717bf25\" (UID: \"d53099fa-bd97-42bc-9f62-f3484717bf25\") "
Sep 09 13:50:12.751794 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:12.751760    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d53099fa-bd97-42bc-9f62-f3484717bf25-workload-socket\") pod \"d53099fa-bd97-42bc-9f62-f3484717bf25\" (UID: \"d53099fa-bd97-42bc-9f62-f3484717bf25\") "
Sep 09 13:50:12.752080 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:12.751803    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d53099fa-bd97-42bc-9f62-f3484717bf25-istio-podinfo\") pod \"d53099fa-bd97-42bc-9f62-f3484717bf25\" (UID: \"d53099fa-bd97-42bc-9f62-f3484717bf25\") "
Sep 09 13:50:12.752080 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:12.751825    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gnl28\" (UniqueName: \"kubernetes.io/projected/d53099fa-bd97-42bc-9f62-f3484717bf25-kube-api-access-gnl28\") pod \"d53099fa-bd97-42bc-9f62-f3484717bf25\" (UID: \"d53099fa-bd97-42bc-9f62-f3484717bf25\") "
Sep 09 13:50:12.752080 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:12.751893    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d53099fa-bd97-42bc-9f62-f3484717bf25-credential-socket\") pod \"d53099fa-bd97-42bc-9f62-f3484717bf25\" (UID: \"d53099fa-bd97-42bc-9f62-f3484717bf25\") "
Sep 09 13:50:12.752080 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:12.751948    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d53099fa-bd97-42bc-9f62-f3484717bf25-istio-data\") pod \"d53099fa-bd97-42bc-9f62-f3484717bf25\" (UID: \"d53099fa-bd97-42bc-9f62-f3484717bf25\") "
Sep 09 13:50:12.752080 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:12.751975    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d53099fa-bd97-42bc-9f62-f3484717bf25-istio-token\") pod \"d53099fa-bd97-42bc-9f62-f3484717bf25\" (UID: \"d53099fa-bd97-42bc-9f62-f3484717bf25\") "
Sep 09 13:50:12.752080 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:12.752018    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d53099fa-bd97-42bc-9f62-f3484717bf25-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d53099fa-bd97-42bc-9f62-f3484717bf25" (UID: "d53099fa-bd97-42bc-9f62-f3484717bf25"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 13:50:12.752429 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:12.752106    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d53099fa-bd97-42bc-9f62-f3484717bf25-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d53099fa-bd97-42bc-9f62-f3484717bf25" (UID: "d53099fa-bd97-42bc-9f62-f3484717bf25"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 13:50:12.752429 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:12.752238    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d53099fa-bd97-42bc-9f62-f3484717bf25-istio-data" (OuterVolumeSpecName: "istio-data") pod "d53099fa-bd97-42bc-9f62-f3484717bf25" (UID: "d53099fa-bd97-42bc-9f62-f3484717bf25"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 13:50:12.752429 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:12.752246    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d53099fa-bd97-42bc-9f62-f3484717bf25-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d53099fa-bd97-42bc-9f62-f3484717bf25" (UID: "d53099fa-bd97-42bc-9f62-f3484717bf25"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 13:50:12.752429 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:12.752340    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d53099fa-bd97-42bc-9f62-f3484717bf25-istiod-ca-cert\") pod \"d53099fa-bd97-42bc-9f62-f3484717bf25\" (UID: \"d53099fa-bd97-42bc-9f62-f3484717bf25\") "
Sep 09 13:50:12.752660 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:12.752638    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d53099fa-bd97-42bc-9f62-f3484717bf25-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d53099fa-bd97-42bc-9f62-f3484717bf25" (UID: "d53099fa-bd97-42bc-9f62-f3484717bf25"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 13:50:12.752773 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:12.752755    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d53099fa-bd97-42bc-9f62-f3484717bf25-istio-data\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:50:12.752815 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:12.752780    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d53099fa-bd97-42bc-9f62-f3484717bf25-istiod-ca-cert\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:50:12.752815 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:12.752796    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d53099fa-bd97-42bc-9f62-f3484717bf25-workload-certs\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:50:12.752815 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:12.752809    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d53099fa-bd97-42bc-9f62-f3484717bf25-workload-socket\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:50:12.752922 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:12.752822    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d53099fa-bd97-42bc-9f62-f3484717bf25-credential-socket\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:50:12.754146 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:12.754120    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d53099fa-bd97-42bc-9f62-f3484717bf25-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d53099fa-bd97-42bc-9f62-f3484717bf25" (UID: "d53099fa-bd97-42bc-9f62-f3484717bf25"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 13:50:12.754265 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:12.754244    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d53099fa-bd97-42bc-9f62-f3484717bf25-istio-token" (OuterVolumeSpecName: "istio-token") pod "d53099fa-bd97-42bc-9f62-f3484717bf25" (UID: "d53099fa-bd97-42bc-9f62-f3484717bf25"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 13:50:12.754431 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:12.754408    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d53099fa-bd97-42bc-9f62-f3484717bf25-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d53099fa-bd97-42bc-9f62-f3484717bf25" (UID: "d53099fa-bd97-42bc-9f62-f3484717bf25"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 13:50:12.754495 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:12.754469    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d53099fa-bd97-42bc-9f62-f3484717bf25-kube-api-access-gnl28" (OuterVolumeSpecName: "kube-api-access-gnl28") pod "d53099fa-bd97-42bc-9f62-f3484717bf25" (UID: "d53099fa-bd97-42bc-9f62-f3484717bf25"). InnerVolumeSpecName "kube-api-access-gnl28". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 13:50:12.853644 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:12.853601    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d53099fa-bd97-42bc-9f62-f3484717bf25-istio-envoy\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:50:12.853644 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:12.853637    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d53099fa-bd97-42bc-9f62-f3484717bf25-istio-podinfo\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:50:12.853644 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:12.853650    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gnl28\" (UniqueName: \"kubernetes.io/projected/d53099fa-bd97-42bc-9f62-f3484717bf25-kube-api-access-gnl28\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:50:12.853880 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:12.853663    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d53099fa-bd97-42bc-9f62-f3484717bf25-istio-token\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:50:13.340622 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:13.340587    2578 generic.go:356] "Generic (PLEG): container finished" podID="d53099fa-bd97-42bc-9f62-f3484717bf25" containerID="efe73670b678f7ed2a1f597a42e09146ffdcdb7de4c89e9a72d86080c932acf8" exitCode=0
Sep 09 13:50:13.340807 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:13.340639    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz"
Sep 09 13:50:13.340807 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:13.340667    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz" event={"ID":"d53099fa-bd97-42bc-9f62-f3484717bf25","Type":"ContainerDied","Data":"efe73670b678f7ed2a1f597a42e09146ffdcdb7de4c89e9a72d86080c932acf8"}
Sep 09 13:50:13.340807 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:13.340728    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz" event={"ID":"d53099fa-bd97-42bc-9f62-f3484717bf25","Type":"ContainerDied","Data":"594e388be147ce13876f8dabc68cd3b7ca6035038abdcbf1a45c72abafe3dc92"}
Sep 09 13:50:13.340807 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:13.340758    2578 scope.go:117] "RemoveContainer" containerID="efe73670b678f7ed2a1f597a42e09146ffdcdb7de4c89e9a72d86080c932acf8"
Sep 09 13:50:13.350377 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:13.350362    2578 scope.go:117] "RemoveContainer" containerID="d303d4ad61d871aaf32b1169c38a70681cc21199c1c1f92312067c8c2c844162"
Sep 09 13:50:13.358803 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:13.358784    2578 scope.go:117] "RemoveContainer" containerID="efe73670b678f7ed2a1f597a42e09146ffdcdb7de4c89e9a72d86080c932acf8"
Sep 09 13:50:13.359105 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:50:13.359086    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"efe73670b678f7ed2a1f597a42e09146ffdcdb7de4c89e9a72d86080c932acf8\": container with ID starting with efe73670b678f7ed2a1f597a42e09146ffdcdb7de4c89e9a72d86080c932acf8 not found: ID does not exist" containerID="efe73670b678f7ed2a1f597a42e09146ffdcdb7de4c89e9a72d86080c932acf8"
Sep 09 13:50:13.359153 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:13.359114    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efe73670b678f7ed2a1f597a42e09146ffdcdb7de4c89e9a72d86080c932acf8"} err="failed to get container status \"efe73670b678f7ed2a1f597a42e09146ffdcdb7de4c89e9a72d86080c932acf8\": rpc error: code = NotFound desc = could not find container \"efe73670b678f7ed2a1f597a42e09146ffdcdb7de4c89e9a72d86080c932acf8\": container with ID starting with efe73670b678f7ed2a1f597a42e09146ffdcdb7de4c89e9a72d86080c932acf8 not found: ID does not exist"
Sep 09 13:50:13.359153 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:13.359131    2578 scope.go:117] "RemoveContainer" containerID="d303d4ad61d871aaf32b1169c38a70681cc21199c1c1f92312067c8c2c844162"
Sep 09 13:50:13.359407 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:50:13.359390    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d303d4ad61d871aaf32b1169c38a70681cc21199c1c1f92312067c8c2c844162\": container with ID starting with d303d4ad61d871aaf32b1169c38a70681cc21199c1c1f92312067c8c2c844162 not found: ID does not exist" containerID="d303d4ad61d871aaf32b1169c38a70681cc21199c1c1f92312067c8c2c844162"
Sep 09 13:50:13.359448 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:13.359413    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d303d4ad61d871aaf32b1169c38a70681cc21199c1c1f92312067c8c2c844162"} err="failed to get container status \"d303d4ad61d871aaf32b1169c38a70681cc21199c1c1f92312067c8c2c844162\": rpc error: code = NotFound desc = could not find container \"d303d4ad61d871aaf32b1169c38a70681cc21199c1c1f92312067c8c2c844162\": container with ID starting with d303d4ad61d871aaf32b1169c38a70681cc21199c1c1f92312067c8c2c844162 not found: ID does not exist"
Sep 09 13:50:13.364667 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:13.364644    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz"]
Sep 09 13:50:13.369761 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:13.369740    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-464c54-openshift-default-cd7bb88cb-xf2rz"]
Sep 09 13:50:14.660910 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:14.660879    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d53099fa-bd97-42bc-9f62-f3484717bf25" path="/var/lib/kubelet/pods/d53099fa-bd97-42bc-9f62-f3484717bf25/volumes"
Sep 09 13:50:20.617939 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:20.617905    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:50:23.338964 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:23.338924    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:50:23.375778 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:23.375747    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-4bfe1d-86c6bd564f-4bq7k"]
Sep 09 13:50:23.375992 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:23.375968    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-4bfe1d-86c6bd564f-4bq7k" podUID="30be15c0-e26a-436b-874c-0cdb6b6794a4" containerName="payload-processing" containerID="cri-o://24f328db376f31698f90aedd415d0c583906322916e0b9cce98412adb00d80e1" gracePeriod=30
Sep 09 13:50:23.383191 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:23.383148    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-4bfe1d-74f68d4cd6-nwn5z"]
Sep 09 13:50:23.383586 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:23.383555    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-4bfe1d-74f68d4cd6-nwn5z" podUID="362a9559-29d6-41fe-abd6-da865f681a34" containerName="payload-pre-processing" containerID="cri-o://3d2d913379adce0dc725f207430786916ff744e9e37b10f5c2c01b32aef0e246" gracePeriod=30
Sep 09 13:50:23.465785 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:23.465757    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:50:23.567846 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:23.567784    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:50:23.657025 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:23.657004    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-4bfe1d-86c6bd564f-4bq7k"
Sep 09 13:50:23.659738 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:23.659720    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-4bfe1d-74f68d4cd6-nwn5z"
Sep 09 13:50:23.668424 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:23.668403    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:50:23.752679 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:23.752648    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bw72l\" (UniqueName: \"kubernetes.io/projected/362a9559-29d6-41fe-abd6-da865f681a34-kube-api-access-bw72l\") pod \"362a9559-29d6-41fe-abd6-da865f681a34\" (UID: \"362a9559-29d6-41fe-abd6-da865f681a34\") "
Sep 09 13:50:23.752853 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:23.752714    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kcxrt\" (UniqueName: \"kubernetes.io/projected/30be15c0-e26a-436b-874c-0cdb6b6794a4-kube-api-access-kcxrt\") pod \"30be15c0-e26a-436b-874c-0cdb6b6794a4\" (UID: \"30be15c0-e26a-436b-874c-0cdb6b6794a4\") "
Sep 09 13:50:23.752904 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:23.752877    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/362a9559-29d6-41fe-abd6-da865f681a34-plugins-config-volume\") pod \"362a9559-29d6-41fe-abd6-da865f681a34\" (UID: \"362a9559-29d6-41fe-abd6-da865f681a34\") "
Sep 09 13:50:23.752953 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:23.752929    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30be15c0-e26a-436b-874c-0cdb6b6794a4-plugins-config-volume\") pod \"30be15c0-e26a-436b-874c-0cdb6b6794a4\" (UID: \"30be15c0-e26a-436b-874c-0cdb6b6794a4\") "
Sep 09 13:50:23.753326 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:23.753294    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30be15c0-e26a-436b-874c-0cdb6b6794a4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "30be15c0-e26a-436b-874c-0cdb6b6794a4" (UID: "30be15c0-e26a-436b-874c-0cdb6b6794a4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 13:50:23.753326 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:23.753314    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/362a9559-29d6-41fe-abd6-da865f681a34-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "362a9559-29d6-41fe-abd6-da865f681a34" (UID: "362a9559-29d6-41fe-abd6-da865f681a34"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 13:50:23.754849 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:23.754819    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30be15c0-e26a-436b-874c-0cdb6b6794a4-kube-api-access-kcxrt" (OuterVolumeSpecName: "kube-api-access-kcxrt") pod "30be15c0-e26a-436b-874c-0cdb6b6794a4" (UID: "30be15c0-e26a-436b-874c-0cdb6b6794a4"). InnerVolumeSpecName "kube-api-access-kcxrt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 13:50:23.754956 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:23.754855    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/362a9559-29d6-41fe-abd6-da865f681a34-kube-api-access-bw72l" (OuterVolumeSpecName: "kube-api-access-bw72l") pod "362a9559-29d6-41fe-abd6-da865f681a34" (UID: "362a9559-29d6-41fe-abd6-da865f681a34"). InnerVolumeSpecName "kube-api-access-bw72l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 13:50:23.854557 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:23.854500    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kcxrt\" (UniqueName: \"kubernetes.io/projected/30be15c0-e26a-436b-874c-0cdb6b6794a4-kube-api-access-kcxrt\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:50:23.854557 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:23.854548    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/362a9559-29d6-41fe-abd6-da865f681a34-plugins-config-volume\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:50:23.854557 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:23.854563    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30be15c0-e26a-436b-874c-0cdb6b6794a4-plugins-config-volume\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:50:23.854810 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:23.854575    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bw72l\" (UniqueName: \"kubernetes.io/projected/362a9559-29d6-41fe-abd6-da865f681a34-kube-api-access-bw72l\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:50:23.961666 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:23.961532    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:50:24.399554 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:24.399523    2578 generic.go:356] "Generic (PLEG): container finished" podID="362a9559-29d6-41fe-abd6-da865f681a34" containerID="3d2d913379adce0dc725f207430786916ff744e9e37b10f5c2c01b32aef0e246" exitCode=0
Sep 09 13:50:24.400020 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:24.399575    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-4bfe1d-74f68d4cd6-nwn5z"
Sep 09 13:50:24.400020 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:24.399618    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-4bfe1d-74f68d4cd6-nwn5z" event={"ID":"362a9559-29d6-41fe-abd6-da865f681a34","Type":"ContainerDied","Data":"3d2d913379adce0dc725f207430786916ff744e9e37b10f5c2c01b32aef0e246"}
Sep 09 13:50:24.400020 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:24.399665    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-4bfe1d-74f68d4cd6-nwn5z" event={"ID":"362a9559-29d6-41fe-abd6-da865f681a34","Type":"ContainerDied","Data":"659ee4fe2cf239064096a8be1aeb330cbedf5fe237959dcc810682d452854255"}
Sep 09 13:50:24.400020 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:24.399699    2578 scope.go:117] "RemoveContainer" containerID="3d2d913379adce0dc725f207430786916ff744e9e37b10f5c2c01b32aef0e246"
Sep 09 13:50:24.400971 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:24.400875    2578 generic.go:356] "Generic (PLEG): container finished" podID="30be15c0-e26a-436b-874c-0cdb6b6794a4" containerID="24f328db376f31698f90aedd415d0c583906322916e0b9cce98412adb00d80e1" exitCode=0
Sep 09 13:50:24.400971 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:24.400918    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-4bfe1d-86c6bd564f-4bq7k" event={"ID":"30be15c0-e26a-436b-874c-0cdb6b6794a4","Type":"ContainerDied","Data":"24f328db376f31698f90aedd415d0c583906322916e0b9cce98412adb00d80e1"}
Sep 09 13:50:24.400971 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:24.400951    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-4bfe1d-86c6bd564f-4bq7k" event={"ID":"30be15c0-e26a-436b-874c-0cdb6b6794a4","Type":"ContainerDied","Data":"a6228cf71dfefb498b760b84ae40aedb0c1dc5768b7600f517a05b0057fd3656"}
Sep 09 13:50:24.400971 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:24.400924    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-4bfe1d-86c6bd564f-4bq7k"
Sep 09 13:50:24.411230 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:24.411198    2578 scope.go:117] "RemoveContainer" containerID="3d2d913379adce0dc725f207430786916ff744e9e37b10f5c2c01b32aef0e246"
Sep 09 13:50:24.411745 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:50:24.411701    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d2d913379adce0dc725f207430786916ff744e9e37b10f5c2c01b32aef0e246\": container with ID starting with 3d2d913379adce0dc725f207430786916ff744e9e37b10f5c2c01b32aef0e246 not found: ID does not exist" containerID="3d2d913379adce0dc725f207430786916ff744e9e37b10f5c2c01b32aef0e246"
Sep 09 13:50:24.411860 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:24.411739    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d2d913379adce0dc725f207430786916ff744e9e37b10f5c2c01b32aef0e246"} err="failed to get container status \"3d2d913379adce0dc725f207430786916ff744e9e37b10f5c2c01b32aef0e246\": rpc error: code = NotFound desc = could not find container \"3d2d913379adce0dc725f207430786916ff744e9e37b10f5c2c01b32aef0e246\": container with ID starting with 3d2d913379adce0dc725f207430786916ff744e9e37b10f5c2c01b32aef0e246 not found: ID does not exist"
Sep 09 13:50:24.411860 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:24.411764    2578 scope.go:117] "RemoveContainer" containerID="24f328db376f31698f90aedd415d0c583906322916e0b9cce98412adb00d80e1"
Sep 09 13:50:24.419587 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:24.419573    2578 scope.go:117] "RemoveContainer" containerID="24f328db376f31698f90aedd415d0c583906322916e0b9cce98412adb00d80e1"
Sep 09 13:50:24.419896 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:50:24.419876    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24f328db376f31698f90aedd415d0c583906322916e0b9cce98412adb00d80e1\": container with ID starting with 24f328db376f31698f90aedd415d0c583906322916e0b9cce98412adb00d80e1 not found: ID does not exist" containerID="24f328db376f31698f90aedd415d0c583906322916e0b9cce98412adb00d80e1"
Sep 09 13:50:24.419992 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:24.419904    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24f328db376f31698f90aedd415d0c583906322916e0b9cce98412adb00d80e1"} err="failed to get container status \"24f328db376f31698f90aedd415d0c583906322916e0b9cce98412adb00d80e1\": rpc error: code = NotFound desc = could not find container \"24f328db376f31698f90aedd415d0c583906322916e0b9cce98412adb00d80e1\": container with ID starting with 24f328db376f31698f90aedd415d0c583906322916e0b9cce98412adb00d80e1 not found: ID does not exist"
Sep 09 13:50:24.435480 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:24.435457    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-4bfe1d-86c6bd564f-4bq7k"]
Sep 09 13:50:24.442509 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:24.442490    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-4bfe1d-86c6bd564f-4bq7k"]
Sep 09 13:50:24.456740 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:24.456718    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-4bfe1d-74f68d4cd6-nwn5z"]
Sep 09 13:50:24.461554 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:24.461531    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-4bfe1d-74f68d4cd6-nwn5z"]
Sep 09 13:50:24.661168 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:24.661096    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30be15c0-e26a-436b-874c-0cdb6b6794a4" path="/var/lib/kubelet/pods/30be15c0-e26a-436b-874c-0cdb6b6794a4/volumes"
Sep 09 13:50:24.661463 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:24.661449    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="362a9559-29d6-41fe-abd6-da865f681a34" path="/var/lib/kubelet/pods/362a9559-29d6-41fe-abd6-da865f681a34/volumes"
Sep 09 13:50:26.882308 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:26.882275    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:50:34.164928 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:34.164894    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:50:34.272758 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:34.272712    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:50:41.385945 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:41.385904    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:50:41.391922 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:41.391894    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-b5cba4-29816025-bzlm9"]
Sep 09 13:50:41.401300 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:41.401274    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-b5cba4-29816025-bzlm9"]
Sep 09 13:50:41.437723 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:41.437693    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-b5cba4-9746d8f6c-42ptf"]
Sep 09 13:50:41.437969 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:41.437939    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-b5cba4-9746d8f6c-42ptf" podUID="b0eed683-b4d8-4415-8604-826429fba8c1" containerName="payload-processing" containerID="cri-o://a3e79008e449991de13cfdb896ce4e61415bc470175703be373d20b93dbc87bd" gracePeriod=30
Sep 09 13:50:41.454778 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:41.454745    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b5cba4-6dc466cd74-5nmml"]
Sep 09 13:50:41.455039 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:41.454987    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b5cba4-6dc466cd74-5nmml" podUID="e9a12b65-fb55-42c3-ad39-21fae172c962" containerName="payload-pre-processing" containerID="cri-o://ca0a01b8b3642d2996683acc08405b843e2e92a6130e019672f1d43aca0116df" gracePeriod=30
Sep 09 13:50:41.505766 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:41.505738    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:50:41.602804 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:41.602770    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:50:41.703494 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:41.703465    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:50:41.729229 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:41.729202    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-b5cba4-9746d8f6c-42ptf"
Sep 09 13:50:41.732293 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:41.732270    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b5cba4-6dc466cd74-5nmml"
Sep 09 13:50:41.823967 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:41.823937    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tvbdk\" (UniqueName: \"kubernetes.io/projected/b0eed683-b4d8-4415-8604-826429fba8c1-kube-api-access-tvbdk\") pod \"b0eed683-b4d8-4415-8604-826429fba8c1\" (UID: \"b0eed683-b4d8-4415-8604-826429fba8c1\") "
Sep 09 13:50:41.824151 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:41.823988    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e9a12b65-fb55-42c3-ad39-21fae172c962-plugins-config-volume\") pod \"e9a12b65-fb55-42c3-ad39-21fae172c962\" (UID: \"e9a12b65-fb55-42c3-ad39-21fae172c962\") "
Sep 09 13:50:41.824151 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:41.824064    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4gvq6\" (UniqueName: \"kubernetes.io/projected/e9a12b65-fb55-42c3-ad39-21fae172c962-kube-api-access-4gvq6\") pod \"e9a12b65-fb55-42c3-ad39-21fae172c962\" (UID: \"e9a12b65-fb55-42c3-ad39-21fae172c962\") "
Sep 09 13:50:41.824151 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:41.824091    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b0eed683-b4d8-4415-8604-826429fba8c1-plugins-config-volume\") pod \"b0eed683-b4d8-4415-8604-826429fba8c1\" (UID: \"b0eed683-b4d8-4415-8604-826429fba8c1\") "
Sep 09 13:50:41.824444 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:41.824412    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9a12b65-fb55-42c3-ad39-21fae172c962-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e9a12b65-fb55-42c3-ad39-21fae172c962" (UID: "e9a12b65-fb55-42c3-ad39-21fae172c962"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 13:50:41.824566 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:41.824478    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0eed683-b4d8-4415-8604-826429fba8c1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b0eed683-b4d8-4415-8604-826429fba8c1" (UID: "b0eed683-b4d8-4415-8604-826429fba8c1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 13:50:41.826077 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:41.826057    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9a12b65-fb55-42c3-ad39-21fae172c962-kube-api-access-4gvq6" (OuterVolumeSpecName: "kube-api-access-4gvq6") pod "e9a12b65-fb55-42c3-ad39-21fae172c962" (UID: "e9a12b65-fb55-42c3-ad39-21fae172c962"). InnerVolumeSpecName "kube-api-access-4gvq6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 13:50:41.826160 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:41.826103    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0eed683-b4d8-4415-8604-826429fba8c1-kube-api-access-tvbdk" (OuterVolumeSpecName: "kube-api-access-tvbdk") pod "b0eed683-b4d8-4415-8604-826429fba8c1" (UID: "b0eed683-b4d8-4415-8604-826429fba8c1"). InnerVolumeSpecName "kube-api-access-tvbdk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 13:50:41.842313 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:41.842274    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:50:41.925302 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:41.925226    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tvbdk\" (UniqueName: \"kubernetes.io/projected/b0eed683-b4d8-4415-8604-826429fba8c1-kube-api-access-tvbdk\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:50:41.925302 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:41.925252    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e9a12b65-fb55-42c3-ad39-21fae172c962-plugins-config-volume\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:50:41.925302 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:41.925261    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4gvq6\" (UniqueName: \"kubernetes.io/projected/e9a12b65-fb55-42c3-ad39-21fae172c962-kube-api-access-4gvq6\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:50:41.925302 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:41.925269    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b0eed683-b4d8-4415-8604-826429fba8c1-plugins-config-volume\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:50:42.078772 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:42.078736    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:50:42.492140 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:42.492108    2578 generic.go:356] "Generic (PLEG): container finished" podID="b0eed683-b4d8-4415-8604-826429fba8c1" containerID="a3e79008e449991de13cfdb896ce4e61415bc470175703be373d20b93dbc87bd" exitCode=0
Sep 09 13:50:42.492530 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:42.492152    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-b5cba4-9746d8f6c-42ptf"
Sep 09 13:50:42.492530 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:42.492202    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-b5cba4-9746d8f6c-42ptf" event={"ID":"b0eed683-b4d8-4415-8604-826429fba8c1","Type":"ContainerDied","Data":"a3e79008e449991de13cfdb896ce4e61415bc470175703be373d20b93dbc87bd"}
Sep 09 13:50:42.492530 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:42.492247    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-b5cba4-9746d8f6c-42ptf" event={"ID":"b0eed683-b4d8-4415-8604-826429fba8c1","Type":"ContainerDied","Data":"a3e18d1a8cb5681e2f188033f42b9c731f2c678b87ae1313bea6b4f6782867fd"}
Sep 09 13:50:42.492530 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:42.492269    2578 scope.go:117] "RemoveContainer" containerID="a3e79008e449991de13cfdb896ce4e61415bc470175703be373d20b93dbc87bd"
Sep 09 13:50:42.493681 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:42.493658    2578 generic.go:356] "Generic (PLEG): container finished" podID="e9a12b65-fb55-42c3-ad39-21fae172c962" containerID="ca0a01b8b3642d2996683acc08405b843e2e92a6130e019672f1d43aca0116df" exitCode=0
Sep 09 13:50:42.493798 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:42.493688    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b5cba4-6dc466cd74-5nmml" event={"ID":"e9a12b65-fb55-42c3-ad39-21fae172c962","Type":"ContainerDied","Data":"ca0a01b8b3642d2996683acc08405b843e2e92a6130e019672f1d43aca0116df"}
Sep 09 13:50:42.493798 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:42.493711    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b5cba4-6dc466cd74-5nmml"
Sep 09 13:50:42.493798 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:42.493725    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b5cba4-6dc466cd74-5nmml" event={"ID":"e9a12b65-fb55-42c3-ad39-21fae172c962","Type":"ContainerDied","Data":"a4740e9d2b2954e2400f2d94b926a5cac44fd14a57f02ea0a33bca62522c2de7"}
Sep 09 13:50:42.508252 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:42.508227    2578 scope.go:117] "RemoveContainer" containerID="a3e79008e449991de13cfdb896ce4e61415bc470175703be373d20b93dbc87bd"
Sep 09 13:50:42.508562 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:50:42.508542    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3e79008e449991de13cfdb896ce4e61415bc470175703be373d20b93dbc87bd\": container with ID starting with a3e79008e449991de13cfdb896ce4e61415bc470175703be373d20b93dbc87bd not found: ID does not exist" containerID="a3e79008e449991de13cfdb896ce4e61415bc470175703be373d20b93dbc87bd"
Sep 09 13:50:42.508647 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:42.508575    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3e79008e449991de13cfdb896ce4e61415bc470175703be373d20b93dbc87bd"} err="failed to get container status \"a3e79008e449991de13cfdb896ce4e61415bc470175703be373d20b93dbc87bd\": rpc error: code = NotFound desc = could not find container \"a3e79008e449991de13cfdb896ce4e61415bc470175703be373d20b93dbc87bd\": container with ID starting with a3e79008e449991de13cfdb896ce4e61415bc470175703be373d20b93dbc87bd not found: ID does not exist"
Sep 09 13:50:42.508647 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:42.508598    2578 scope.go:117] "RemoveContainer" containerID="ca0a01b8b3642d2996683acc08405b843e2e92a6130e019672f1d43aca0116df"
Sep 09 13:50:42.516133 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:42.516117    2578 scope.go:117] "RemoveContainer" containerID="ca0a01b8b3642d2996683acc08405b843e2e92a6130e019672f1d43aca0116df"
Sep 09 13:50:42.516405 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:50:42.516385    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca0a01b8b3642d2996683acc08405b843e2e92a6130e019672f1d43aca0116df\": container with ID starting with ca0a01b8b3642d2996683acc08405b843e2e92a6130e019672f1d43aca0116df not found: ID does not exist" containerID="ca0a01b8b3642d2996683acc08405b843e2e92a6130e019672f1d43aca0116df"
Sep 09 13:50:42.516453 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:42.516411    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca0a01b8b3642d2996683acc08405b843e2e92a6130e019672f1d43aca0116df"} err="failed to get container status \"ca0a01b8b3642d2996683acc08405b843e2e92a6130e019672f1d43aca0116df\": rpc error: code = NotFound desc = could not find container \"ca0a01b8b3642d2996683acc08405b843e2e92a6130e019672f1d43aca0116df\": container with ID starting with ca0a01b8b3642d2996683acc08405b843e2e92a6130e019672f1d43aca0116df not found: ID does not exist"
Sep 09 13:50:42.521168 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:42.521145    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-b5cba4-9746d8f6c-42ptf"]
Sep 09 13:50:42.527065 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:42.527040    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-b5cba4-9746d8f6c-42ptf"]
Sep 09 13:50:42.544132 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:42.544094    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b5cba4-6dc466cd74-5nmml"]
Sep 09 13:50:42.545742 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:42.545722    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b5cba4-6dc466cd74-5nmml"]
Sep 09 13:50:42.660736 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:42.660706    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0eed683-b4d8-4415-8604-826429fba8c1" path="/var/lib/kubelet/pods/b0eed683-b4d8-4415-8604-826429fba8c1/volumes"
Sep 09 13:50:42.661077 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:42.661064    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9a12b65-fb55-42c3-ad39-21fae172c962" path="/var/lib/kubelet/pods/e9a12b65-fb55-42c3-ad39-21fae172c962/volumes"
Sep 09 13:50:42.661345 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:42.661333    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9e41768-e595-4020-8bb5-5b08918ad7c4" path="/var/lib/kubelet/pods/f9e41768-e595-4020-8bb5-5b08918ad7c4/volumes"
Sep 09 13:50:45.561914 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:45.561883    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:50:47.803703 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:47.803660    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:50:47.903479 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:47.903440    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:50:48.067883 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:48.067811    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:50:48.496378 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:48.496346    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:50:50.611185 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:50.611151    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:50:50.710777 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:50.710744    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:50:53.079835 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:53.079803    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:50:58.953676 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:58.953636    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:50:58.990211 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:58.990162    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-6a7dbc-67c9f8b4fc-2zqwp"]
Sep 09 13:50:58.990516 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:58.990448    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-6a7dbc-67c9f8b4fc-2zqwp" podUID="5d7a7a09-1db4-4e34-802b-70754cd75ead" containerName="payload-processing" containerID="cri-o://66eb31e1f4697834253a0967a97927a416426daf1d67b7857543a00f14054e39" gracePeriod=30
Sep 09 13:50:59.004413 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:59.004375    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6a7dbc-6dbd476758-ztf6n"]
Sep 09 13:50:59.004651 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:59.004622    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6a7dbc-6dbd476758-ztf6n" podUID="36327c8a-9f94-4cb7-ba8b-2e63a8f934b1" containerName="payload-pre-processing" containerID="cri-o://34e5af9b75bb5486bd0593f5b5a0a8114c29e2714807d60927ef5b62b499690b" gracePeriod=30
Sep 09 13:50:59.046604 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:59.046575    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:50:59.125144 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:59.125106    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:50:59.196965 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:59.196547    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:50:59.260943 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:59.260899    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:50:59.271911 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:59.271884    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-6a7dbc-67c9f8b4fc-2zqwp"
Sep 09 13:50:59.275084 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:59.275062    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6a7dbc-6dbd476758-ztf6n"
Sep 09 13:50:59.389620 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:59.389584    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/36327c8a-9f94-4cb7-ba8b-2e63a8f934b1-plugins-config-volume\") pod \"36327c8a-9f94-4cb7-ba8b-2e63a8f934b1\" (UID: \"36327c8a-9f94-4cb7-ba8b-2e63a8f934b1\") "
Sep 09 13:50:59.389803 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:59.389631    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5d7a7a09-1db4-4e34-802b-70754cd75ead-plugins-config-volume\") pod \"5d7a7a09-1db4-4e34-802b-70754cd75ead\" (UID: \"5d7a7a09-1db4-4e34-802b-70754cd75ead\") "
Sep 09 13:50:59.389870 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:59.389821    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gr5t9\" (UniqueName: \"kubernetes.io/projected/36327c8a-9f94-4cb7-ba8b-2e63a8f934b1-kube-api-access-gr5t9\") pod \"36327c8a-9f94-4cb7-ba8b-2e63a8f934b1\" (UID: \"36327c8a-9f94-4cb7-ba8b-2e63a8f934b1\") "
Sep 09 13:50:59.389870 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:59.389858    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k7bkh\" (UniqueName: \"kubernetes.io/projected/5d7a7a09-1db4-4e34-802b-70754cd75ead-kube-api-access-k7bkh\") pod \"5d7a7a09-1db4-4e34-802b-70754cd75ead\" (UID: \"5d7a7a09-1db4-4e34-802b-70754cd75ead\") "
Sep 09 13:50:59.390021 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:59.389999    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36327c8a-9f94-4cb7-ba8b-2e63a8f934b1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "36327c8a-9f94-4cb7-ba8b-2e63a8f934b1" (UID: "36327c8a-9f94-4cb7-ba8b-2e63a8f934b1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 13:50:59.390070 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:59.389998    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d7a7a09-1db4-4e34-802b-70754cd75ead-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5d7a7a09-1db4-4e34-802b-70754cd75ead" (UID: "5d7a7a09-1db4-4e34-802b-70754cd75ead"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 13:50:59.390329 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:59.390305    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/36327c8a-9f94-4cb7-ba8b-2e63a8f934b1-plugins-config-volume\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:50:59.390329 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:59.390329    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5d7a7a09-1db4-4e34-802b-70754cd75ead-plugins-config-volume\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:50:59.391860 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:59.391836    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d7a7a09-1db4-4e34-802b-70754cd75ead-kube-api-access-k7bkh" (OuterVolumeSpecName: "kube-api-access-k7bkh") pod "5d7a7a09-1db4-4e34-802b-70754cd75ead" (UID: "5d7a7a09-1db4-4e34-802b-70754cd75ead"). InnerVolumeSpecName "kube-api-access-k7bkh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 13:50:59.391955 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:59.391872    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36327c8a-9f94-4cb7-ba8b-2e63a8f934b1-kube-api-access-gr5t9" (OuterVolumeSpecName: "kube-api-access-gr5t9") pod "36327c8a-9f94-4cb7-ba8b-2e63a8f934b1" (UID: "36327c8a-9f94-4cb7-ba8b-2e63a8f934b1"). InnerVolumeSpecName "kube-api-access-gr5t9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 13:50:59.491767 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:59.491731    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gr5t9\" (UniqueName: \"kubernetes.io/projected/36327c8a-9f94-4cb7-ba8b-2e63a8f934b1-kube-api-access-gr5t9\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:50:59.491767 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:59.491760    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k7bkh\" (UniqueName: \"kubernetes.io/projected/5d7a7a09-1db4-4e34-802b-70754cd75ead-kube-api-access-k7bkh\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:50:59.543091 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:59.543004    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:50:59.578767 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:59.578731    2578 generic.go:356] "Generic (PLEG): container finished" podID="36327c8a-9f94-4cb7-ba8b-2e63a8f934b1" containerID="34e5af9b75bb5486bd0593f5b5a0a8114c29e2714807d60927ef5b62b499690b" exitCode=0
Sep 09 13:50:59.578933 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:59.578776    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6a7dbc-6dbd476758-ztf6n"
Sep 09 13:50:59.578933 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:59.578817    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6a7dbc-6dbd476758-ztf6n" event={"ID":"36327c8a-9f94-4cb7-ba8b-2e63a8f934b1","Type":"ContainerDied","Data":"34e5af9b75bb5486bd0593f5b5a0a8114c29e2714807d60927ef5b62b499690b"}
Sep 09 13:50:59.578933 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:59.578864    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6a7dbc-6dbd476758-ztf6n" event={"ID":"36327c8a-9f94-4cb7-ba8b-2e63a8f934b1","Type":"ContainerDied","Data":"9bf0f58b7dc27213acc2e5c31fc6e185c1c1723eef302a123281da1db5fd3116"}
Sep 09 13:50:59.578933 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:59.578887    2578 scope.go:117] "RemoveContainer" containerID="34e5af9b75bb5486bd0593f5b5a0a8114c29e2714807d60927ef5b62b499690b"
Sep 09 13:50:59.580313 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:59.580290    2578 generic.go:356] "Generic (PLEG): container finished" podID="5d7a7a09-1db4-4e34-802b-70754cd75ead" containerID="66eb31e1f4697834253a0967a97927a416426daf1d67b7857543a00f14054e39" exitCode=0
Sep 09 13:50:59.580424 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:59.580324    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-6a7dbc-67c9f8b4fc-2zqwp" event={"ID":"5d7a7a09-1db4-4e34-802b-70754cd75ead","Type":"ContainerDied","Data":"66eb31e1f4697834253a0967a97927a416426daf1d67b7857543a00f14054e39"}
Sep 09 13:50:59.580424 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:59.580334    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-6a7dbc-67c9f8b4fc-2zqwp"
Sep 09 13:50:59.580424 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:59.580353    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-6a7dbc-67c9f8b4fc-2zqwp" event={"ID":"5d7a7a09-1db4-4e34-802b-70754cd75ead","Type":"ContainerDied","Data":"244ee54876a64fe673650bb572931a915310d6676574bc15ee3852f87d03c2e6"}
Sep 09 13:50:59.589494 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:59.589477    2578 scope.go:117] "RemoveContainer" containerID="34e5af9b75bb5486bd0593f5b5a0a8114c29e2714807d60927ef5b62b499690b"
Sep 09 13:50:59.590090 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:50:59.589825    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34e5af9b75bb5486bd0593f5b5a0a8114c29e2714807d60927ef5b62b499690b\": container with ID starting with 34e5af9b75bb5486bd0593f5b5a0a8114c29e2714807d60927ef5b62b499690b not found: ID does not exist" containerID="34e5af9b75bb5486bd0593f5b5a0a8114c29e2714807d60927ef5b62b499690b"
Sep 09 13:50:59.590090 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:59.589872    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34e5af9b75bb5486bd0593f5b5a0a8114c29e2714807d60927ef5b62b499690b"} err="failed to get container status \"34e5af9b75bb5486bd0593f5b5a0a8114c29e2714807d60927ef5b62b499690b\": rpc error: code = NotFound desc = could not find container \"34e5af9b75bb5486bd0593f5b5a0a8114c29e2714807d60927ef5b62b499690b\": container with ID starting with 34e5af9b75bb5486bd0593f5b5a0a8114c29e2714807d60927ef5b62b499690b not found: ID does not exist"
Sep 09 13:50:59.590090 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:59.589896    2578 scope.go:117] "RemoveContainer" containerID="66eb31e1f4697834253a0967a97927a416426daf1d67b7857543a00f14054e39"
Sep 09 13:50:59.598406 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:59.598382    2578 scope.go:117] "RemoveContainer" containerID="66eb31e1f4697834253a0967a97927a416426daf1d67b7857543a00f14054e39"
Sep 09 13:50:59.598702 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:50:59.598686    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66eb31e1f4697834253a0967a97927a416426daf1d67b7857543a00f14054e39\": container with ID starting with 66eb31e1f4697834253a0967a97927a416426daf1d67b7857543a00f14054e39 not found: ID does not exist" containerID="66eb31e1f4697834253a0967a97927a416426daf1d67b7857543a00f14054e39"
Sep 09 13:50:59.598762 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:59.598708    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66eb31e1f4697834253a0967a97927a416426daf1d67b7857543a00f14054e39"} err="failed to get container status \"66eb31e1f4697834253a0967a97927a416426daf1d67b7857543a00f14054e39\": rpc error: code = NotFound desc = could not find container \"66eb31e1f4697834253a0967a97927a416426daf1d67b7857543a00f14054e39\": container with ID starting with 66eb31e1f4697834253a0967a97927a416426daf1d67b7857543a00f14054e39 not found: ID does not exist"
Sep 09 13:50:59.604913 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:59.604885    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-6a7dbc-67c9f8b4fc-2zqwp"]
Sep 09 13:50:59.609417 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:59.609393    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-6a7dbc-67c9f8b4fc-2zqwp"]
Sep 09 13:50:59.621347 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:59.621317    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6a7dbc-6dbd476758-ztf6n"]
Sep 09 13:50:59.627810 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:50:59.627777    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6a7dbc-6dbd476758-ztf6n"]
Sep 09 13:51:00.661030 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:00.660997    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36327c8a-9f94-4cb7-ba8b-2e63a8f934b1" path="/var/lib/kubelet/pods/36327c8a-9f94-4cb7-ba8b-2e63a8f934b1/volumes"
Sep 09 13:51:00.661415 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:00.661386    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d7a7a09-1db4-4e34-802b-70754cd75ead" path="/var/lib/kubelet/pods/5d7a7a09-1db4-4e34-802b-70754cd75ead/volumes"
Sep 09 13:51:02.164420 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:02.164384    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:51:05.747513 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:05.747474    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:51:05.847879 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:05.847834    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:51:05.999903 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:05.999812    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:51:06.551576 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:06.551534    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:51:07.476633 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:07.476601    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:51:07.909076 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:07.909032    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:51:08.178341 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:08.178262    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6"]
Sep 09 13:51:08.178649 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:08.178637    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d7a7a09-1db4-4e34-802b-70754cd75ead" containerName="payload-processing"
Sep 09 13:51:08.178697 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:08.178650    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d7a7a09-1db4-4e34-802b-70754cd75ead" containerName="payload-processing"
Sep 09 13:51:08.178697 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:08.178666    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d53099fa-bd97-42bc-9f62-f3484717bf25" containerName="istio-proxy"
Sep 09 13:51:08.178697 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:08.178673    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d53099fa-bd97-42bc-9f62-f3484717bf25" containerName="istio-proxy"
Sep 09 13:51:08.178697 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:08.178684    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d53099fa-bd97-42bc-9f62-f3484717bf25" containerName="istio-proxy"
Sep 09 13:51:08.178697 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:08.178692    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d53099fa-bd97-42bc-9f62-f3484717bf25" containerName="istio-proxy"
Sep 09 13:51:08.178850 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:08.178704    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9a12b65-fb55-42c3-ad39-21fae172c962" containerName="payload-pre-processing"
Sep 09 13:51:08.178850 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:08.178712    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9a12b65-fb55-42c3-ad39-21fae172c962" containerName="payload-pre-processing"
Sep 09 13:51:08.178850 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:08.178720    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36327c8a-9f94-4cb7-ba8b-2e63a8f934b1" containerName="payload-pre-processing"
Sep 09 13:51:08.178850 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:08.178728    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="36327c8a-9f94-4cb7-ba8b-2e63a8f934b1" containerName="payload-pre-processing"
Sep 09 13:51:08.178850 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:08.178741    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30be15c0-e26a-436b-874c-0cdb6b6794a4" containerName="payload-processing"
Sep 09 13:51:08.178850 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:08.178749    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="30be15c0-e26a-436b-874c-0cdb6b6794a4" containerName="payload-processing"
Sep 09 13:51:08.178850 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:08.178765    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0eed683-b4d8-4415-8604-826429fba8c1" containerName="payload-processing"
Sep 09 13:51:08.178850 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:08.178776    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0eed683-b4d8-4415-8604-826429fba8c1" containerName="payload-processing"
Sep 09 13:51:08.178850 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:08.178790    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="362a9559-29d6-41fe-abd6-da865f681a34" containerName="payload-pre-processing"
Sep 09 13:51:08.178850 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:08.178800    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="362a9559-29d6-41fe-abd6-da865f681a34" containerName="payload-pre-processing"
Sep 09 13:51:08.179139 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:08.178893    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9a12b65-fb55-42c3-ad39-21fae172c962" containerName="payload-pre-processing"
Sep 09 13:51:08.179139 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:08.178902    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d53099fa-bd97-42bc-9f62-f3484717bf25" containerName="istio-proxy"
Sep 09 13:51:08.179139 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:08.178909    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="362a9559-29d6-41fe-abd6-da865f681a34" containerName="payload-pre-processing"
Sep 09 13:51:08.179139 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:08.178916    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="30be15c0-e26a-436b-874c-0cdb6b6794a4" containerName="payload-processing"
Sep 09 13:51:08.179139 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:08.178922    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0eed683-b4d8-4415-8604-826429fba8c1" containerName="payload-processing"
Sep 09 13:51:08.179139 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:08.178930    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d7a7a09-1db4-4e34-802b-70754cd75ead" containerName="payload-processing"
Sep 09 13:51:08.179139 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:08.178937    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="36327c8a-9f94-4cb7-ba8b-2e63a8f934b1" containerName="payload-pre-processing"
Sep 09 13:51:08.183376 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:08.183346    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6"
Sep 09 13:51:08.187124 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:08.187100    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-8349bf-openshift-default-dockercfg-x2rzk\""
Sep 09 13:51:08.197472 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:08.197449    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6"]
Sep 09 13:51:08.242640 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:08.242611    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:51:08.271495 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:08.271449    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/556d334c-683a-422f-ad3a-049def5934aa-istiod-ca-cert\") pod \"e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6\" (UID: \"556d334c-683a-422f-ad3a-049def5934aa\") " pod="openshift-ingress/e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6"
Sep 09 13:51:08.271715 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:08.271496    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/556d334c-683a-422f-ad3a-049def5934aa-istio-data\") pod \"e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6\" (UID: \"556d334c-683a-422f-ad3a-049def5934aa\") " pod="openshift-ingress/e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6"
Sep 09 13:51:08.271715 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:08.271527    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbpmv\" (UniqueName: \"kubernetes.io/projected/556d334c-683a-422f-ad3a-049def5934aa-kube-api-access-sbpmv\") pod \"e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6\" (UID: \"556d334c-683a-422f-ad3a-049def5934aa\") " pod="openshift-ingress/e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6"
Sep 09 13:51:08.271715 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:08.271606    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/556d334c-683a-422f-ad3a-049def5934aa-workload-certs\") pod \"e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6\" (UID: \"556d334c-683a-422f-ad3a-049def5934aa\") " pod="openshift-ingress/e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6"
Sep 09 13:51:08.271715 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:08.271659    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/556d334c-683a-422f-ad3a-049def5934aa-credential-socket\") pod \"e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6\" (UID: \"556d334c-683a-422f-ad3a-049def5934aa\") " pod="openshift-ingress/e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6"
Sep 09 13:51:08.271715 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:08.271689    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/556d334c-683a-422f-ad3a-049def5934aa-istio-podinfo\") pod \"e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6\" (UID: \"556d334c-683a-422f-ad3a-049def5934aa\") " pod="openshift-ingress/e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6"
Sep 09 13:51:08.272002 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:08.271740    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/556d334c-683a-422f-ad3a-049def5934aa-istio-envoy\") pod \"e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6\" (UID: \"556d334c-683a-422f-ad3a-049def5934aa\") " pod="openshift-ingress/e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6"
Sep 09 13:51:08.272002 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:08.271953    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/556d334c-683a-422f-ad3a-049def5934aa-workload-socket\") pod \"e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6\" (UID: \"556d334c-683a-422f-ad3a-049def5934aa\") " pod="openshift-ingress/e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6"
Sep 09 13:51:08.272002 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:08.271994    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/556d334c-683a-422f-ad3a-049def5934aa-istio-token\") pod \"e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6\" (UID: \"556d334c-683a-422f-ad3a-049def5934aa\") " pod="openshift-ingress/e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6"
Sep 09 13:51:08.373150 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:08.373118    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/556d334c-683a-422f-ad3a-049def5934aa-istiod-ca-cert\") pod \"e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6\" (UID: \"556d334c-683a-422f-ad3a-049def5934aa\") " pod="openshift-ingress/e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6"
Sep 09 13:51:08.373150 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:08.373154    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/556d334c-683a-422f-ad3a-049def5934aa-istio-data\") pod \"e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6\" (UID: \"556d334c-683a-422f-ad3a-049def5934aa\") " pod="openshift-ingress/e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6"
Sep 09 13:51:08.373424 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:08.373196    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbpmv\" (UniqueName: \"kubernetes.io/projected/556d334c-683a-422f-ad3a-049def5934aa-kube-api-access-sbpmv\") pod \"e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6\" (UID: \"556d334c-683a-422f-ad3a-049def5934aa\") " pod="openshift-ingress/e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6"
Sep 09 13:51:08.373424 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:08.373227    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/556d334c-683a-422f-ad3a-049def5934aa-workload-certs\") pod \"e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6\" (UID: \"556d334c-683a-422f-ad3a-049def5934aa\") " pod="openshift-ingress/e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6"
Sep 09 13:51:08.373424 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:08.373261    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/556d334c-683a-422f-ad3a-049def5934aa-credential-socket\") pod \"e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6\" (UID: \"556d334c-683a-422f-ad3a-049def5934aa\") " pod="openshift-ingress/e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6"
Sep 09 13:51:08.373424 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:08.373283    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/556d334c-683a-422f-ad3a-049def5934aa-istio-podinfo\") pod \"e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6\" (UID: \"556d334c-683a-422f-ad3a-049def5934aa\") " pod="openshift-ingress/e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6"
Sep 09 13:51:08.373424 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:08.373326    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/556d334c-683a-422f-ad3a-049def5934aa-istio-envoy\") pod \"e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6\" (UID: \"556d334c-683a-422f-ad3a-049def5934aa\") " pod="openshift-ingress/e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6"
Sep 09 13:51:08.373725 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:08.373432    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/556d334c-683a-422f-ad3a-049def5934aa-workload-socket\") pod \"e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6\" (UID: \"556d334c-683a-422f-ad3a-049def5934aa\") " pod="openshift-ingress/e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6"
Sep 09 13:51:08.373725 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:08.373462    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/556d334c-683a-422f-ad3a-049def5934aa-istio-token\") pod \"e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6\" (UID: \"556d334c-683a-422f-ad3a-049def5934aa\") " pod="openshift-ingress/e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6"
Sep 09 13:51:08.373725 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:08.373634    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/556d334c-683a-422f-ad3a-049def5934aa-istio-data\") pod \"e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6\" (UID: \"556d334c-683a-422f-ad3a-049def5934aa\") " pod="openshift-ingress/e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6"
Sep 09 13:51:08.373725 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:08.373686    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/556d334c-683a-422f-ad3a-049def5934aa-workload-certs\") pod \"e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6\" (UID: \"556d334c-683a-422f-ad3a-049def5934aa\") " pod="openshift-ingress/e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6"
Sep 09 13:51:08.373949 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:08.373761    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/556d334c-683a-422f-ad3a-049def5934aa-credential-socket\") pod \"e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6\" (UID: \"556d334c-683a-422f-ad3a-049def5934aa\") " pod="openshift-ingress/e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6"
Sep 09 13:51:08.373949 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:08.373791    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/556d334c-683a-422f-ad3a-049def5934aa-workload-socket\") pod \"e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6\" (UID: \"556d334c-683a-422f-ad3a-049def5934aa\") " pod="openshift-ingress/e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6"
Sep 09 13:51:08.373949 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:08.373874    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/556d334c-683a-422f-ad3a-049def5934aa-istiod-ca-cert\") pod \"e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6\" (UID: \"556d334c-683a-422f-ad3a-049def5934aa\") " pod="openshift-ingress/e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6"
Sep 09 13:51:08.375791 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:08.375766    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/556d334c-683a-422f-ad3a-049def5934aa-istio-podinfo\") pod \"e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6\" (UID: \"556d334c-683a-422f-ad3a-049def5934aa\") " pod="openshift-ingress/e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6"
Sep 09 13:51:08.375885 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:08.375863    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/556d334c-683a-422f-ad3a-049def5934aa-istio-envoy\") pod \"e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6\" (UID: \"556d334c-683a-422f-ad3a-049def5934aa\") " pod="openshift-ingress/e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6"
Sep 09 13:51:08.385122 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:08.385096    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbpmv\" (UniqueName: \"kubernetes.io/projected/556d334c-683a-422f-ad3a-049def5934aa-kube-api-access-sbpmv\") pod \"e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6\" (UID: \"556d334c-683a-422f-ad3a-049def5934aa\") " pod="openshift-ingress/e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6"
Sep 09 13:51:08.385795 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:08.385777    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/556d334c-683a-422f-ad3a-049def5934aa-istio-token\") pod \"e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6\" (UID: \"556d334c-683a-422f-ad3a-049def5934aa\") " pod="openshift-ingress/e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6"
Sep 09 13:51:08.436404 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:08.436320    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:51:08.493566 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:08.493531    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6"
Sep 09 13:51:08.768243 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:08.768147    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6"]
Sep 09 13:51:08.771256 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:51:08.771224    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod556d334c_683a_422f_ad3a_049def5934aa.slice/crio-87815df0b2e25b2fee35a453b9ecd94f4823ebef15069f2b1d03a576d058b568 WatchSource:0}: Error finding container 87815df0b2e25b2fee35a453b9ecd94f4823ebef15069f2b1d03a576d058b568: Status 404 returned error can't find the container with id 87815df0b2e25b2fee35a453b9ecd94f4823ebef15069f2b1d03a576d058b568
Sep 09 13:51:08.773392 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:08.773355    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 13:51:08.773499 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:08.773439    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 13:51:08.773499 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:08.773486    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 13:51:09.635095 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:09.635058    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6" event={"ID":"556d334c-683a-422f-ad3a-049def5934aa","Type":"ContainerStarted","Data":"b369bb9ffb5ff3440c1192bc4ee90da956915099c6d4869ca6bd2829bfb7e52f"}
Sep 09 13:51:09.635612 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:09.635124    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6" event={"ID":"556d334c-683a-422f-ad3a-049def5934aa","Type":"ContainerStarted","Data":"87815df0b2e25b2fee35a453b9ecd94f4823ebef15069f2b1d03a576d058b568"}
Sep 09 13:51:09.657350 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:09.657300    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6" podStartSLOduration=1.657284089 podStartE2EDuration="1.657284089s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 13:51:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 13:51:09.656944337 +0000 UTC m=+1481.472468532" watchObservedRunningTime="2026-09-09 13:51:09.657284089 +0000 UTC m=+1481.472808286"
Sep 09 13:51:10.494286 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:10.494253    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6"
Sep 09 13:51:10.499038 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:10.499014    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6"
Sep 09 13:51:10.639759 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:10.639727    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6"
Sep 09 13:51:10.640815 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:10.640798    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6"
Sep 09 13:51:11.559302 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:11.559257    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:51:11.656944 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:11.656916    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:51:12.744408 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:12.744373    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:51:12.843674 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:12.843641    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:51:12.943159 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:12.943126    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:51:13.301620 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:13.301589    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:51:13.396827 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:13.396792    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:51:13.436716 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:13.436680    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-8349bf-64b7856589-tcxc8"]
Sep 09 13:51:13.437110 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:13.437097    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d53099fa-bd97-42bc-9f62-f3484717bf25" containerName="istio-proxy"
Sep 09 13:51:13.440271 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:13.440255    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-8349bf-64b7856589-tcxc8"
Sep 09 13:51:13.443590 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:13.443570    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-8349bf-dockercfg-sz854\""
Sep 09 13:51:13.443708 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:13.443651    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-8349bf\""
Sep 09 13:51:13.455039 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:13.455017    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-8349bf-64b7856589-tcxc8"]
Sep 09 13:51:13.480958 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:13.480929    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-8349bf-5876b4ffc4-p6vjf"]
Sep 09 13:51:13.484370 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:13.484350    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-8349bf-5876b4ffc4-p6vjf"
Sep 09 13:51:13.492796 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:13.492771    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-8349bf-5876b4ffc4-p6vjf"]
Sep 09 13:51:13.622535 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:13.622504    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4a3c12f9-cd77-40b2-a86a-929157320b6b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-8349bf-5876b4ffc4-p6vjf\" (UID: \"4a3c12f9-cd77-40b2-a86a-929157320b6b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-8349bf-5876b4ffc4-p6vjf"
Sep 09 13:51:13.622697 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:13.622576    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3f19149b-6d8c-4c5b-9de1-2fd7c71fd4c4-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-8349bf-64b7856589-tcxc8\" (UID: \"3f19149b-6d8c-4c5b-9de1-2fd7c71fd4c4\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-8349bf-64b7856589-tcxc8"
Sep 09 13:51:13.622697 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:13.622603    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkd6s\" (UniqueName: \"kubernetes.io/projected/3f19149b-6d8c-4c5b-9de1-2fd7c71fd4c4-kube-api-access-rkd6s\") pod \"payload-processing-e2e-ipp-a-8349bf-64b7856589-tcxc8\" (UID: \"3f19149b-6d8c-4c5b-9de1-2fd7c71fd4c4\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-8349bf-64b7856589-tcxc8"
Sep 09 13:51:13.622697 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:13.622635    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cw4pv\" (UniqueName: \"kubernetes.io/projected/4a3c12f9-cd77-40b2-a86a-929157320b6b-kube-api-access-cw4pv\") pod \"payload-pre-processing-e2e-ipp-a-8349bf-5876b4ffc4-p6vjf\" (UID: \"4a3c12f9-cd77-40b2-a86a-929157320b6b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-8349bf-5876b4ffc4-p6vjf"
Sep 09 13:51:13.723394 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:13.723354    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4a3c12f9-cd77-40b2-a86a-929157320b6b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-8349bf-5876b4ffc4-p6vjf\" (UID: \"4a3c12f9-cd77-40b2-a86a-929157320b6b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-8349bf-5876b4ffc4-p6vjf"
Sep 09 13:51:13.723543 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:13.723442    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3f19149b-6d8c-4c5b-9de1-2fd7c71fd4c4-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-8349bf-64b7856589-tcxc8\" (UID: \"3f19149b-6d8c-4c5b-9de1-2fd7c71fd4c4\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-8349bf-64b7856589-tcxc8"
Sep 09 13:51:13.723543 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:13.723468    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkd6s\" (UniqueName: \"kubernetes.io/projected/3f19149b-6d8c-4c5b-9de1-2fd7c71fd4c4-kube-api-access-rkd6s\") pod \"payload-processing-e2e-ipp-a-8349bf-64b7856589-tcxc8\" (UID: \"3f19149b-6d8c-4c5b-9de1-2fd7c71fd4c4\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-8349bf-64b7856589-tcxc8"
Sep 09 13:51:13.723543 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:13.723508    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cw4pv\" (UniqueName: \"kubernetes.io/projected/4a3c12f9-cd77-40b2-a86a-929157320b6b-kube-api-access-cw4pv\") pod \"payload-pre-processing-e2e-ipp-a-8349bf-5876b4ffc4-p6vjf\" (UID: \"4a3c12f9-cd77-40b2-a86a-929157320b6b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-8349bf-5876b4ffc4-p6vjf"
Sep 09 13:51:13.724200 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:13.724158    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4a3c12f9-cd77-40b2-a86a-929157320b6b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-8349bf-5876b4ffc4-p6vjf\" (UID: \"4a3c12f9-cd77-40b2-a86a-929157320b6b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-8349bf-5876b4ffc4-p6vjf"
Sep 09 13:51:13.724261 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:13.724168    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3f19149b-6d8c-4c5b-9de1-2fd7c71fd4c4-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-8349bf-64b7856589-tcxc8\" (UID: \"3f19149b-6d8c-4c5b-9de1-2fd7c71fd4c4\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-8349bf-64b7856589-tcxc8"
Sep 09 13:51:13.735720 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:13.735677    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cw4pv\" (UniqueName: \"kubernetes.io/projected/4a3c12f9-cd77-40b2-a86a-929157320b6b-kube-api-access-cw4pv\") pod \"payload-pre-processing-e2e-ipp-a-8349bf-5876b4ffc4-p6vjf\" (UID: \"4a3c12f9-cd77-40b2-a86a-929157320b6b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-8349bf-5876b4ffc4-p6vjf"
Sep 09 13:51:13.735821 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:13.735677    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkd6s\" (UniqueName: \"kubernetes.io/projected/3f19149b-6d8c-4c5b-9de1-2fd7c71fd4c4-kube-api-access-rkd6s\") pod \"payload-processing-e2e-ipp-a-8349bf-64b7856589-tcxc8\" (UID: \"3f19149b-6d8c-4c5b-9de1-2fd7c71fd4c4\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-8349bf-64b7856589-tcxc8"
Sep 09 13:51:13.750519 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:13.750479    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-8349bf-64b7856589-tcxc8"
Sep 09 13:51:13.795398 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:13.795362    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-8349bf-5876b4ffc4-p6vjf"
Sep 09 13:51:14.027040 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:14.027012    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-8349bf-64b7856589-tcxc8"]
Sep 09 13:51:14.028433 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:51:14.028408    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f19149b_6d8c_4c5b_9de1_2fd7c71fd4c4.slice/crio-56f3617e6c75844a62af86401a3525505e2b267194f9bf7105bcf44256977293 WatchSource:0}: Error finding container 56f3617e6c75844a62af86401a3525505e2b267194f9bf7105bcf44256977293: Status 404 returned error can't find the container with id 56f3617e6c75844a62af86401a3525505e2b267194f9bf7105bcf44256977293
Sep 09 13:51:14.078298 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:14.078269    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-8349bf-5876b4ffc4-p6vjf"]
Sep 09 13:51:14.080756 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:51:14.080725    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a3c12f9_cd77_40b2_a86a_929157320b6b.slice/crio-8ec80e1ecd56fb48f7f4206552d85da96b6318716dbea7df21f31756eae2108c WatchSource:0}: Error finding container 8ec80e1ecd56fb48f7f4206552d85da96b6318716dbea7df21f31756eae2108c: Status 404 returned error can't find the container with id 8ec80e1ecd56fb48f7f4206552d85da96b6318716dbea7df21f31756eae2108c
Sep 09 13:51:14.661632 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:14.661596    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-8349bf-64b7856589-tcxc8" event={"ID":"3f19149b-6d8c-4c5b-9de1-2fd7c71fd4c4","Type":"ContainerStarted","Data":"641f80bd7768f22c00e7db2732a7d2f268964c1446c6a8bbf5fa68ea6bc018b0"}
Sep 09 13:51:14.661804 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:14.661654    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-8349bf-64b7856589-tcxc8" event={"ID":"3f19149b-6d8c-4c5b-9de1-2fd7c71fd4c4","Type":"ContainerStarted","Data":"56f3617e6c75844a62af86401a3525505e2b267194f9bf7105bcf44256977293"}
Sep 09 13:51:14.661804 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:14.661800    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-8349bf-64b7856589-tcxc8"
Sep 09 13:51:14.663114 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:14.663085    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-8349bf-5876b4ffc4-p6vjf" event={"ID":"4a3c12f9-cd77-40b2-a86a-929157320b6b","Type":"ContainerStarted","Data":"203f84215e238de1d648414d426f9db06f876c79908388414adce4a04963de52"}
Sep 09 13:51:14.663254 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:14.663134    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-8349bf-5876b4ffc4-p6vjf" event={"ID":"4a3c12f9-cd77-40b2-a86a-929157320b6b","Type":"ContainerStarted","Data":"8ec80e1ecd56fb48f7f4206552d85da96b6318716dbea7df21f31756eae2108c"}
Sep 09 13:51:14.663254 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:14.663163    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-8349bf-5876b4ffc4-p6vjf"
Sep 09 13:51:14.679466 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:14.679419    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-8349bf-64b7856589-tcxc8" podStartSLOduration=1.6794020120000002 podStartE2EDuration="1.679402012s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 13:51:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 13:51:14.677403886 +0000 UTC m=+1486.492928080" watchObservedRunningTime="2026-09-09 13:51:14.679402012 +0000 UTC m=+1486.494926203"
Sep 09 13:51:14.701764 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:14.701306    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-8349bf-5876b4ffc4-p6vjf" podStartSLOduration=1.701285492 podStartE2EDuration="1.701285492s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 13:51:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 13:51:14.693635009 +0000 UTC m=+1486.509159222" watchObservedRunningTime="2026-09-09 13:51:14.701285492 +0000 UTC m=+1486.516809705"
Sep 09 13:51:16.865678 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:16.865644    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:51:23.082725 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:23.082692    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:51:25.670061 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:25.670027    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-8349bf-64b7856589-tcxc8"
Sep 09 13:51:25.670487 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:25.670095    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-8349bf-5876b4ffc4-p6vjf"
Sep 09 13:51:26.465386 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:26.464306    2578 patch_prober.go:28] interesting pod/e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": read tcp 10.134.0.2:51480->10.134.0.60:15021: read: connection reset by peer" start-of-body=
Sep 09 13:51:26.465386 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:26.464363    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6" podUID="556d334c-683a-422f-ad3a-049def5934aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": read tcp 10.134.0.2:51480->10.134.0.60:15021: read: connection reset by peer"
Sep 09 13:51:26.730695 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:26.730608    2578 generic.go:356] "Generic (PLEG): container finished" podID="556d334c-683a-422f-ad3a-049def5934aa" containerID="b369bb9ffb5ff3440c1192bc4ee90da956915099c6d4869ca6bd2829bfb7e52f" exitCode=0
Sep 09 13:51:26.730695 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:26.730677    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6" event={"ID":"556d334c-683a-422f-ad3a-049def5934aa","Type":"ContainerDied","Data":"b369bb9ffb5ff3440c1192bc4ee90da956915099c6d4869ca6bd2829bfb7e52f"}
Sep 09 13:51:26.731087 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:26.731073    2578 scope.go:117] "RemoveContainer" containerID="b369bb9ffb5ff3440c1192bc4ee90da956915099c6d4869ca6bd2829bfb7e52f"
Sep 09 13:51:26.732259 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:26.732234    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 13:51:26.732316 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:26.732301    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 13:51:26.732357 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:26.732337    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 13:51:27.738102 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:27.738066    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6" event={"ID":"556d334c-683a-422f-ad3a-049def5934aa","Type":"ContainerStarted","Data":"eee40bb9e24decaa80ce0ec49557ad9afcc2f9a31652735acb54ff98e8770500"}
Sep 09 13:51:28.494086 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:28.494040    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6"
Sep 09 13:51:28.494369 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:28.494336    2578 patch_prober.go:28] interesting pod/e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 09 13:51:28.494462 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:28.494407    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6" podUID="556d334c-683a-422f-ad3a-049def5934aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 09 13:51:28.829445 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:28.829365    2578 scope.go:117] "RemoveContainer" containerID="0adbeaedc2b274c14f1e00bcc4f64179513d93ff731e10621757d76e0eee41e3"
Sep 09 13:51:29.494464 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:29.494415    2578 patch_prober.go:28] interesting pod/e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 09 13:51:29.494689 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:29.494490    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6" podUID="556d334c-683a-422f-ad3a-049def5934aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 09 13:51:30.494352 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:30.494303    2578 patch_prober.go:28] interesting pod/e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 09 13:51:30.494962 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:30.494374    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6" podUID="556d334c-683a-422f-ad3a-049def5934aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 09 13:51:31.495064 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:31.495015    2578 patch_prober.go:28] interesting pod/e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 09 13:51:31.495583 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:31.495087    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6" podUID="556d334c-683a-422f-ad3a-049def5934aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 09 13:51:32.494707 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:32.494658    2578 patch_prober.go:28] interesting pod/e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 09 13:51:32.494922 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:32.494747    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6" podUID="556d334c-683a-422f-ad3a-049def5934aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 09 13:51:33.497941 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:33.497905    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6"
Sep 09 13:51:33.498397 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:33.498297    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6"
Sep 09 13:51:33.499096 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:33.499074    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6"
Sep 09 13:51:36.532227 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:36.532189    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:51:37.197277 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:37.197245    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:51:37.517121 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:37.517042    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:51:37.767114 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:37.767079    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:51:38.375447 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:38.375413    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:51:41.203930 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:41.203891    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:51:41.304593 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:41.304559    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:51:42.846386 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:42.846342    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:51:42.945885 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:42.945850    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:51:48.363031 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:51:48.362992    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:52:05.875273 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:52:05.875191    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:52:59.881168 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:52:59.881138    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:53:03.963187 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:03.963143    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:53:05.576218 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:05.576163    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:53:31.556544 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:31.556457    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:53:37.768757 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:37.768728    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-8349bf-64b7856589-tcxc8_3f19149b-6d8c-4c5b-9de1-2fd7c71fd4c4/payload-processing/0.log"
Sep 09 13:53:38.312405 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:38.312363    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:53:38.584295 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:38.584214    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p"]
Sep 09 13:53:38.587797 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:38.587771    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p"
Sep 09 13:53:38.590423 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:38.590401    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-b2555b-openshift-default-dockercfg-cj7pw\""
Sep 09 13:53:38.600776 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:38.600750    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p"]
Sep 09 13:53:38.621919 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:38.621884    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:53:38.691726 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:38.691688    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74d17a49-1d9e-4f3a-9d97-c2a155d0ea24-istio-envoy\") pod \"e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p\" (UID: \"74d17a49-1d9e-4f3a-9d97-c2a155d0ea24\") " pod="openshift-ingress/e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p"
Sep 09 13:53:38.691900 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:38.691740    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74d17a49-1d9e-4f3a-9d97-c2a155d0ea24-istio-data\") pod \"e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p\" (UID: \"74d17a49-1d9e-4f3a-9d97-c2a155d0ea24\") " pod="openshift-ingress/e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p"
Sep 09 13:53:38.691900 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:38.691806    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74d17a49-1d9e-4f3a-9d97-c2a155d0ea24-istio-podinfo\") pod \"e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p\" (UID: \"74d17a49-1d9e-4f3a-9d97-c2a155d0ea24\") " pod="openshift-ingress/e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p"
Sep 09 13:53:38.691900 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:38.691879    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74d17a49-1d9e-4f3a-9d97-c2a155d0ea24-istio-token\") pod \"e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p\" (UID: \"74d17a49-1d9e-4f3a-9d97-c2a155d0ea24\") " pod="openshift-ingress/e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p"
Sep 09 13:53:38.692022 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:38.691903    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74d17a49-1d9e-4f3a-9d97-c2a155d0ea24-workload-certs\") pod \"e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p\" (UID: \"74d17a49-1d9e-4f3a-9d97-c2a155d0ea24\") " pod="openshift-ingress/e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p"
Sep 09 13:53:38.692022 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:38.691920    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbhbm\" (UniqueName: \"kubernetes.io/projected/74d17a49-1d9e-4f3a-9d97-c2a155d0ea24-kube-api-access-nbhbm\") pod \"e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p\" (UID: \"74d17a49-1d9e-4f3a-9d97-c2a155d0ea24\") " pod="openshift-ingress/e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p"
Sep 09 13:53:38.692022 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:38.691952    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74d17a49-1d9e-4f3a-9d97-c2a155d0ea24-credential-socket\") pod \"e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p\" (UID: \"74d17a49-1d9e-4f3a-9d97-c2a155d0ea24\") " pod="openshift-ingress/e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p"
Sep 09 13:53:38.692022 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:38.692002    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74d17a49-1d9e-4f3a-9d97-c2a155d0ea24-workload-socket\") pod \"e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p\" (UID: \"74d17a49-1d9e-4f3a-9d97-c2a155d0ea24\") " pod="openshift-ingress/e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p"
Sep 09 13:53:38.692213 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:38.692030    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74d17a49-1d9e-4f3a-9d97-c2a155d0ea24-istiod-ca-cert\") pod \"e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p\" (UID: \"74d17a49-1d9e-4f3a-9d97-c2a155d0ea24\") " pod="openshift-ingress/e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p"
Sep 09 13:53:38.720582 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:38.720552    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:53:38.792980 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:38.792941    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74d17a49-1d9e-4f3a-9d97-c2a155d0ea24-workload-certs\") pod \"e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p\" (UID: \"74d17a49-1d9e-4f3a-9d97-c2a155d0ea24\") " pod="openshift-ingress/e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p"
Sep 09 13:53:38.792980 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:38.792977    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbhbm\" (UniqueName: \"kubernetes.io/projected/74d17a49-1d9e-4f3a-9d97-c2a155d0ea24-kube-api-access-nbhbm\") pod \"e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p\" (UID: \"74d17a49-1d9e-4f3a-9d97-c2a155d0ea24\") " pod="openshift-ingress/e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p"
Sep 09 13:53:38.793493 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:38.793000    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74d17a49-1d9e-4f3a-9d97-c2a155d0ea24-credential-socket\") pod \"e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p\" (UID: \"74d17a49-1d9e-4f3a-9d97-c2a155d0ea24\") " pod="openshift-ingress/e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p"
Sep 09 13:53:38.793493 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:38.793036    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74d17a49-1d9e-4f3a-9d97-c2a155d0ea24-workload-socket\") pod \"e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p\" (UID: \"74d17a49-1d9e-4f3a-9d97-c2a155d0ea24\") " pod="openshift-ingress/e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p"
Sep 09 13:53:38.793493 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:38.793066    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74d17a49-1d9e-4f3a-9d97-c2a155d0ea24-istiod-ca-cert\") pod \"e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p\" (UID: \"74d17a49-1d9e-4f3a-9d97-c2a155d0ea24\") " pod="openshift-ingress/e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p"
Sep 09 13:53:38.793493 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:38.793091    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74d17a49-1d9e-4f3a-9d97-c2a155d0ea24-istio-envoy\") pod \"e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p\" (UID: \"74d17a49-1d9e-4f3a-9d97-c2a155d0ea24\") " pod="openshift-ingress/e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p"
Sep 09 13:53:38.793493 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:38.793124    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74d17a49-1d9e-4f3a-9d97-c2a155d0ea24-istio-data\") pod \"e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p\" (UID: \"74d17a49-1d9e-4f3a-9d97-c2a155d0ea24\") " pod="openshift-ingress/e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p"
Sep 09 13:53:38.793493 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:38.793170    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74d17a49-1d9e-4f3a-9d97-c2a155d0ea24-istio-podinfo\") pod \"e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p\" (UID: \"74d17a49-1d9e-4f3a-9d97-c2a155d0ea24\") " pod="openshift-ingress/e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p"
Sep 09 13:53:38.793493 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:38.793273    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74d17a49-1d9e-4f3a-9d97-c2a155d0ea24-istio-token\") pod \"e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p\" (UID: \"74d17a49-1d9e-4f3a-9d97-c2a155d0ea24\") " pod="openshift-ingress/e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p"
Sep 09 13:53:38.793493 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:38.793447    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74d17a49-1d9e-4f3a-9d97-c2a155d0ea24-workload-certs\") pod \"e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p\" (UID: \"74d17a49-1d9e-4f3a-9d97-c2a155d0ea24\") " pod="openshift-ingress/e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p"
Sep 09 13:53:38.793809 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:38.793550    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74d17a49-1d9e-4f3a-9d97-c2a155d0ea24-credential-socket\") pod \"e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p\" (UID: \"74d17a49-1d9e-4f3a-9d97-c2a155d0ea24\") " pod="openshift-ingress/e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p"
Sep 09 13:53:38.793809 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:38.793591    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74d17a49-1d9e-4f3a-9d97-c2a155d0ea24-workload-socket\") pod \"e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p\" (UID: \"74d17a49-1d9e-4f3a-9d97-c2a155d0ea24\") " pod="openshift-ingress/e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p"
Sep 09 13:53:38.793809 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:38.793654    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74d17a49-1d9e-4f3a-9d97-c2a155d0ea24-istio-data\") pod \"e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p\" (UID: \"74d17a49-1d9e-4f3a-9d97-c2a155d0ea24\") " pod="openshift-ingress/e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p"
Sep 09 13:53:38.794012 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:38.793992    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74d17a49-1d9e-4f3a-9d97-c2a155d0ea24-istiod-ca-cert\") pod \"e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p\" (UID: \"74d17a49-1d9e-4f3a-9d97-c2a155d0ea24\") " pod="openshift-ingress/e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p"
Sep 09 13:53:38.795491 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:38.795473    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74d17a49-1d9e-4f3a-9d97-c2a155d0ea24-istio-envoy\") pod \"e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p\" (UID: \"74d17a49-1d9e-4f3a-9d97-c2a155d0ea24\") " pod="openshift-ingress/e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p"
Sep 09 13:53:38.795847 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:38.795831    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74d17a49-1d9e-4f3a-9d97-c2a155d0ea24-istio-podinfo\") pod \"e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p\" (UID: \"74d17a49-1d9e-4f3a-9d97-c2a155d0ea24\") " pod="openshift-ingress/e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p"
Sep 09 13:53:38.802548 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:38.802525    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74d17a49-1d9e-4f3a-9d97-c2a155d0ea24-istio-token\") pod \"e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p\" (UID: \"74d17a49-1d9e-4f3a-9d97-c2a155d0ea24\") " pod="openshift-ingress/e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p"
Sep 09 13:53:38.802722 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:38.802699    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbhbm\" (UniqueName: \"kubernetes.io/projected/74d17a49-1d9e-4f3a-9d97-c2a155d0ea24-kube-api-access-nbhbm\") pod \"e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p\" (UID: \"74d17a49-1d9e-4f3a-9d97-c2a155d0ea24\") " pod="openshift-ingress/e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p"
Sep 09 13:53:38.898359 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:38.898327    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p"
Sep 09 13:53:39.173420 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:39.173390    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p"]
Sep 09 13:53:39.175754 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:53:39.175723    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74d17a49_1d9e_4f3a_9d97_c2a155d0ea24.slice/crio-93b96d4bf6e1d75b08680311e1b92f94a874caed184c712fa78c1f02042d30c8 WatchSource:0}: Error finding container 93b96d4bf6e1d75b08680311e1b92f94a874caed184c712fa78c1f02042d30c8: Status 404 returned error can't find the container with id 93b96d4bf6e1d75b08680311e1b92f94a874caed184c712fa78c1f02042d30c8
Sep 09 13:53:39.177952 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:39.177919    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 13:53:39.178044 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:39.177983    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 13:53:39.178044 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:39.178012    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 13:53:39.391967 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:39.391930    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p" event={"ID":"74d17a49-1d9e-4f3a-9d97-c2a155d0ea24","Type":"ContainerStarted","Data":"7cb75a9ca5d5180afad5d676ffc58d1a963b30c0c4dec5bb13f6b0736614147d"}
Sep 09 13:53:39.392166 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:39.391984    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p" event={"ID":"74d17a49-1d9e-4f3a-9d97-c2a155d0ea24","Type":"ContainerStarted","Data":"93b96d4bf6e1d75b08680311e1b92f94a874caed184c712fa78c1f02042d30c8"}
Sep 09 13:53:39.415018 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:39.414950    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p" podStartSLOduration=1.414929015 podStartE2EDuration="1.414929015s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 13:53:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 13:53:39.412430909 +0000 UTC m=+1631.227955104" watchObservedRunningTime="2026-09-09 13:53:39.414929015 +0000 UTC m=+1631.230453226"
Sep 09 13:53:39.899442 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:39.899409    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p"
Sep 09 13:53:40.903866 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:40.903835    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p"
Sep 09 13:53:41.383532 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:41.383491    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:53:41.402707 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:41.402677    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p"
Sep 09 13:53:41.403574 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:41.403555    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p"
Sep 09 13:53:41.481633 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:41.481603    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:53:42.530723 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:42.530695    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:53:42.631099 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:42.631067    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:53:42.842039 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:42.841964    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:53:43.016329 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:43.016294    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:53:43.112621 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:43.112532    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:53:43.201526 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:43.201491    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b2555b-686b59b76b-8k5fl"]
Sep 09 13:53:43.205153 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:43.205135    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b2555b-686b59b76b-8k5fl"
Sep 09 13:53:43.208667 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:43.208648    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-b2555b\""
Sep 09 13:53:43.208779 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:43.208688    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-b2555b-dockercfg-xr2ct\""
Sep 09 13:53:43.217054 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:43.217032    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b2555b-686b59b76b-8k5fl"]
Sep 09 13:53:43.336834 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:43.336799    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sv99\" (UniqueName: \"kubernetes.io/projected/8ad64f8b-1b59-4366-a6bb-a16e40b5fd4c-kube-api-access-2sv99\") pod \"payload-pre-processing-e2e-ipp-cleanup-b2555b-686b59b76b-8k5fl\" (UID: \"8ad64f8b-1b59-4366-a6bb-a16e40b5fd4c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b2555b-686b59b76b-8k5fl"
Sep 09 13:53:43.337006 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:43.336841    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8ad64f8b-1b59-4366-a6bb-a16e40b5fd4c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-b2555b-686b59b76b-8k5fl\" (UID: \"8ad64f8b-1b59-4366-a6bb-a16e40b5fd4c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b2555b-686b59b76b-8k5fl"
Sep 09 13:53:43.437568 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:43.437524    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sv99\" (UniqueName: \"kubernetes.io/projected/8ad64f8b-1b59-4366-a6bb-a16e40b5fd4c-kube-api-access-2sv99\") pod \"payload-pre-processing-e2e-ipp-cleanup-b2555b-686b59b76b-8k5fl\" (UID: \"8ad64f8b-1b59-4366-a6bb-a16e40b5fd4c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b2555b-686b59b76b-8k5fl"
Sep 09 13:53:43.437568 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:43.437571    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8ad64f8b-1b59-4366-a6bb-a16e40b5fd4c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-b2555b-686b59b76b-8k5fl\" (UID: \"8ad64f8b-1b59-4366-a6bb-a16e40b5fd4c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b2555b-686b59b76b-8k5fl"
Sep 09 13:53:43.438249 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:43.438229    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8ad64f8b-1b59-4366-a6bb-a16e40b5fd4c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-b2555b-686b59b76b-8k5fl\" (UID: \"8ad64f8b-1b59-4366-a6bb-a16e40b5fd4c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b2555b-686b59b76b-8k5fl"
Sep 09 13:53:43.445808 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:43.445783    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sv99\" (UniqueName: \"kubernetes.io/projected/8ad64f8b-1b59-4366-a6bb-a16e40b5fd4c-kube-api-access-2sv99\") pod \"payload-pre-processing-e2e-ipp-cleanup-b2555b-686b59b76b-8k5fl\" (UID: \"8ad64f8b-1b59-4366-a6bb-a16e40b5fd4c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b2555b-686b59b76b-8k5fl"
Sep 09 13:53:43.516381 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:43.516340    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b2555b-686b59b76b-8k5fl"
Sep 09 13:53:43.790941 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:43.790870    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b2555b-686b59b76b-8k5fl"]
Sep 09 13:53:43.793791 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:53:43.793764    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ad64f8b_1b59_4366_a6bb_a16e40b5fd4c.slice/crio-4943ce8d6f618bd652b37dd29479c69bc1b65057edd9e2bac18dc1bd3b300ddc WatchSource:0}: Error finding container 4943ce8d6f618bd652b37dd29479c69bc1b65057edd9e2bac18dc1bd3b300ddc: Status 404 returned error can't find the container with id 4943ce8d6f618bd652b37dd29479c69bc1b65057edd9e2bac18dc1bd3b300ddc
Sep 09 13:53:44.421705 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:44.421385    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b2555b-686b59b76b-8k5fl" event={"ID":"8ad64f8b-1b59-4366-a6bb-a16e40b5fd4c","Type":"ContainerStarted","Data":"c7f6c91966133d27217e5dcb2d1411f9dbfc61707d7c176ad8819deeeb46960f"}
Sep 09 13:53:44.421705 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:44.421490    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b2555b-686b59b76b-8k5fl" event={"ID":"8ad64f8b-1b59-4366-a6bb-a16e40b5fd4c","Type":"ContainerStarted","Data":"4943ce8d6f618bd652b37dd29479c69bc1b65057edd9e2bac18dc1bd3b300ddc"}
Sep 09 13:53:44.422299 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:44.422272    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b2555b-686b59b76b-8k5fl"
Sep 09 13:53:44.439717 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:44.439662    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b2555b-686b59b76b-8k5fl" podStartSLOduration=1.439645691 podStartE2EDuration="1.439645691s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 13:53:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 13:53:44.437971028 +0000 UTC m=+1636.253495214" watchObservedRunningTime="2026-09-09 13:53:44.439645691 +0000 UTC m=+1636.255169886"
Sep 09 13:53:51.874859 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:51.874826    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:53:56.433833 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:53:56.433801    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b2555b-686b59b76b-8k5fl"
Sep 09 13:54:02.513484 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:02.513448    2578 generic.go:356] "Generic (PLEG): container finished" podID="74d17a49-1d9e-4f3a-9d97-c2a155d0ea24" containerID="7cb75a9ca5d5180afad5d676ffc58d1a963b30c0c4dec5bb13f6b0736614147d" exitCode=0
Sep 09 13:54:02.514088 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:02.513523    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p" event={"ID":"74d17a49-1d9e-4f3a-9d97-c2a155d0ea24","Type":"ContainerDied","Data":"7cb75a9ca5d5180afad5d676ffc58d1a963b30c0c4dec5bb13f6b0736614147d"}
Sep 09 13:54:02.514088 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:02.513941    2578 scope.go:117] "RemoveContainer" containerID="7cb75a9ca5d5180afad5d676ffc58d1a963b30c0c4dec5bb13f6b0736614147d"
Sep 09 13:54:02.515087 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:02.515060    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 13:54:02.515153 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:02.515124    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 13:54:02.515208 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:02.515166    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 09 13:54:03.520535 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:03.520499    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p" event={"ID":"74d17a49-1d9e-4f3a-9d97-c2a155d0ea24","Type":"ContainerStarted","Data":"c4d372f46164555a8c37808d82f18f49d190f073c17a36dec2274765d34da68e"}
Sep 09 13:54:03.899732 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:03.899681    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p"
Sep 09 13:54:03.899951 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:03.899744    2578 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 09 13:54:03.899951 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:03.899831    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p" podUID="74d17a49-1d9e-4f3a-9d97-c2a155d0ea24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 09 13:54:04.898882 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:04.898840    2578 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 09 13:54:04.899499 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:04.899466    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p" podUID="74d17a49-1d9e-4f3a-9d97-c2a155d0ea24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 09 13:54:05.899642 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:05.899592    2578 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 09 13:54:05.900137 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:05.899665    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p" podUID="74d17a49-1d9e-4f3a-9d97-c2a155d0ea24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 09 13:54:06.350825 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:06.350741    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:54:06.899738 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:06.899676    2578 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 09 13:54:06.900693 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:06.900294    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p" podUID="74d17a49-1d9e-4f3a-9d97-c2a155d0ea24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 09 13:54:07.899700 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:07.899130    2578 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 09 13:54:07.899700 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:07.899225    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p" podUID="74d17a49-1d9e-4f3a-9d97-c2a155d0ea24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 09 13:54:08.903080 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:08.903047    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p"
Sep 09 13:54:08.903572 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:08.903396    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p"
Sep 09 13:54:08.904116 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:08.904098    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p"
Sep 09 13:54:13.117543 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:13.117507    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:54:13.147065 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:13.147032    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b2555b-686b59b76b-8k5fl"]
Sep 09 13:54:13.147331 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:13.147307    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b2555b-686b59b76b-8k5fl" podUID="8ad64f8b-1b59-4366-a6bb-a16e40b5fd4c" containerName="payload-pre-processing" containerID="cri-o://c7f6c91966133d27217e5dcb2d1411f9dbfc61707d7c176ad8819deeeb46960f" gracePeriod=30
Sep 09 13:54:13.218661 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:13.218627    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:54:13.306923 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:13.306894    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:54:13.382200 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:13.382136    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:54:13.403586 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:13.403563    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b2555b-686b59b76b-8k5fl"
Sep 09 13:54:13.437412 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:13.437376    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2sv99\" (UniqueName: \"kubernetes.io/projected/8ad64f8b-1b59-4366-a6bb-a16e40b5fd4c-kube-api-access-2sv99\") pod \"8ad64f8b-1b59-4366-a6bb-a16e40b5fd4c\" (UID: \"8ad64f8b-1b59-4366-a6bb-a16e40b5fd4c\") "
Sep 09 13:54:13.437602 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:13.437425    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8ad64f8b-1b59-4366-a6bb-a16e40b5fd4c-plugins-config-volume\") pod \"8ad64f8b-1b59-4366-a6bb-a16e40b5fd4c\" (UID: \"8ad64f8b-1b59-4366-a6bb-a16e40b5fd4c\") "
Sep 09 13:54:13.437811 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:13.437789    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ad64f8b-1b59-4366-a6bb-a16e40b5fd4c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8ad64f8b-1b59-4366-a6bb-a16e40b5fd4c" (UID: "8ad64f8b-1b59-4366-a6bb-a16e40b5fd4c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 13:54:13.439506 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:13.439481    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ad64f8b-1b59-4366-a6bb-a16e40b5fd4c-kube-api-access-2sv99" (OuterVolumeSpecName: "kube-api-access-2sv99") pod "8ad64f8b-1b59-4366-a6bb-a16e40b5fd4c" (UID: "8ad64f8b-1b59-4366-a6bb-a16e40b5fd4c"). InnerVolumeSpecName "kube-api-access-2sv99". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 13:54:13.539231 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:13.539196    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2sv99\" (UniqueName: \"kubernetes.io/projected/8ad64f8b-1b59-4366-a6bb-a16e40b5fd4c-kube-api-access-2sv99\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:54:13.539231 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:13.539226    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8ad64f8b-1b59-4366-a6bb-a16e40b5fd4c-plugins-config-volume\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:54:13.571591 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:13.571556    2578 generic.go:356] "Generic (PLEG): container finished" podID="8ad64f8b-1b59-4366-a6bb-a16e40b5fd4c" containerID="c7f6c91966133d27217e5dcb2d1411f9dbfc61707d7c176ad8819deeeb46960f" exitCode=0
Sep 09 13:54:13.571792 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:13.571597    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b2555b-686b59b76b-8k5fl"
Sep 09 13:54:13.571792 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:13.571627    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b2555b-686b59b76b-8k5fl" event={"ID":"8ad64f8b-1b59-4366-a6bb-a16e40b5fd4c","Type":"ContainerDied","Data":"c7f6c91966133d27217e5dcb2d1411f9dbfc61707d7c176ad8819deeeb46960f"}
Sep 09 13:54:13.571792 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:13.571675    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b2555b-686b59b76b-8k5fl" event={"ID":"8ad64f8b-1b59-4366-a6bb-a16e40b5fd4c","Type":"ContainerDied","Data":"4943ce8d6f618bd652b37dd29479c69bc1b65057edd9e2bac18dc1bd3b300ddc"}
Sep 09 13:54:13.571792 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:13.571699    2578 scope.go:117] "RemoveContainer" containerID="c7f6c91966133d27217e5dcb2d1411f9dbfc61707d7c176ad8819deeeb46960f"
Sep 09 13:54:13.580651 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:13.580634    2578 scope.go:117] "RemoveContainer" containerID="c7f6c91966133d27217e5dcb2d1411f9dbfc61707d7c176ad8819deeeb46960f"
Sep 09 13:54:13.580908 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:54:13.580891    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7f6c91966133d27217e5dcb2d1411f9dbfc61707d7c176ad8819deeeb46960f\": container with ID starting with c7f6c91966133d27217e5dcb2d1411f9dbfc61707d7c176ad8819deeeb46960f not found: ID does not exist" containerID="c7f6c91966133d27217e5dcb2d1411f9dbfc61707d7c176ad8819deeeb46960f"
Sep 09 13:54:13.580959 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:13.580917    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7f6c91966133d27217e5dcb2d1411f9dbfc61707d7c176ad8819deeeb46960f"} err="failed to get container status \"c7f6c91966133d27217e5dcb2d1411f9dbfc61707d7c176ad8819deeeb46960f\": rpc error: code = NotFound desc = could not find container \"c7f6c91966133d27217e5dcb2d1411f9dbfc61707d7c176ad8819deeeb46960f\": container with ID starting with c7f6c91966133d27217e5dcb2d1411f9dbfc61707d7c176ad8819deeeb46960f not found: ID does not exist"
Sep 09 13:54:13.592381 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:13.592357    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b2555b-686b59b76b-8k5fl"]
Sep 09 13:54:13.596648 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:13.596625    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b2555b-686b59b76b-8k5fl"]
Sep 09 13:54:13.710991 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:13.710904    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:54:14.660301 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:14.660271    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ad64f8b-1b59-4366-a6bb-a16e40b5fd4c" path="/var/lib/kubelet/pods/8ad64f8b-1b59-4366-a6bb-a16e40b5fd4c/volumes"
Sep 09 13:54:17.469603 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:17.469562    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:54:19.417718 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:19.417684    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:54:19.484200 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:19.484146    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:54:19.653341 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:19.653307    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p"]
Sep 09 13:54:19.653654 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:19.653630    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p" podUID="74d17a49-1d9e-4f3a-9d97-c2a155d0ea24" containerName="istio-proxy" containerID="cri-o://c4d372f46164555a8c37808d82f18f49d190f073c17a36dec2274765d34da68e" gracePeriod=30
Sep 09 13:54:19.667489 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:19.667463    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:54:23.470624 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:23.470588    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:54:23.905434 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:23.905400    2578 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 09 13:54:23.905608 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:23.905458    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p" podUID="74d17a49-1d9e-4f3a-9d97-c2a155d0ea24" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 13:54:24.909466 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:24.909442    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p"
Sep 09 13:54:24.949857 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:24.949763    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nbhbm\" (UniqueName: \"kubernetes.io/projected/74d17a49-1d9e-4f3a-9d97-c2a155d0ea24-kube-api-access-nbhbm\") pod \"74d17a49-1d9e-4f3a-9d97-c2a155d0ea24\" (UID: \"74d17a49-1d9e-4f3a-9d97-c2a155d0ea24\") "
Sep 09 13:54:24.949857 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:24.949821    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74d17a49-1d9e-4f3a-9d97-c2a155d0ea24-credential-socket\") pod \"74d17a49-1d9e-4f3a-9d97-c2a155d0ea24\" (UID: \"74d17a49-1d9e-4f3a-9d97-c2a155d0ea24\") "
Sep 09 13:54:24.950084 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:24.949861    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74d17a49-1d9e-4f3a-9d97-c2a155d0ea24-istio-podinfo\") pod \"74d17a49-1d9e-4f3a-9d97-c2a155d0ea24\" (UID: \"74d17a49-1d9e-4f3a-9d97-c2a155d0ea24\") "
Sep 09 13:54:24.950084 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:24.949899    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74d17a49-1d9e-4f3a-9d97-c2a155d0ea24-istio-data\") pod \"74d17a49-1d9e-4f3a-9d97-c2a155d0ea24\" (UID: \"74d17a49-1d9e-4f3a-9d97-c2a155d0ea24\") "
Sep 09 13:54:24.950084 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:24.949944    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74d17a49-1d9e-4f3a-9d97-c2a155d0ea24-workload-socket\") pod \"74d17a49-1d9e-4f3a-9d97-c2a155d0ea24\" (UID: \"74d17a49-1d9e-4f3a-9d97-c2a155d0ea24\") "
Sep 09 13:54:24.950084 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:24.949974    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74d17a49-1d9e-4f3a-9d97-c2a155d0ea24-istio-token\") pod \"74d17a49-1d9e-4f3a-9d97-c2a155d0ea24\" (UID: \"74d17a49-1d9e-4f3a-9d97-c2a155d0ea24\") "
Sep 09 13:54:24.950084 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:24.949999    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74d17a49-1d9e-4f3a-9d97-c2a155d0ea24-istiod-ca-cert\") pod \"74d17a49-1d9e-4f3a-9d97-c2a155d0ea24\" (UID: \"74d17a49-1d9e-4f3a-9d97-c2a155d0ea24\") "
Sep 09 13:54:24.950084 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:24.950070    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74d17a49-1d9e-4f3a-9d97-c2a155d0ea24-workload-certs\") pod \"74d17a49-1d9e-4f3a-9d97-c2a155d0ea24\" (UID: \"74d17a49-1d9e-4f3a-9d97-c2a155d0ea24\") "
Sep 09 13:54:24.950402 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:24.950130    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74d17a49-1d9e-4f3a-9d97-c2a155d0ea24-istio-envoy\") pod \"74d17a49-1d9e-4f3a-9d97-c2a155d0ea24\" (UID: \"74d17a49-1d9e-4f3a-9d97-c2a155d0ea24\") "
Sep 09 13:54:24.950402 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:24.950141    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74d17a49-1d9e-4f3a-9d97-c2a155d0ea24-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "74d17a49-1d9e-4f3a-9d97-c2a155d0ea24" (UID: "74d17a49-1d9e-4f3a-9d97-c2a155d0ea24"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 13:54:24.950402 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:24.950202    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74d17a49-1d9e-4f3a-9d97-c2a155d0ea24-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "74d17a49-1d9e-4f3a-9d97-c2a155d0ea24" (UID: "74d17a49-1d9e-4f3a-9d97-c2a155d0ea24"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 13:54:24.950558 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:24.950483    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74d17a49-1d9e-4f3a-9d97-c2a155d0ea24-credential-socket\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:54:24.950558 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:24.950500    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74d17a49-1d9e-4f3a-9d97-c2a155d0ea24-workload-socket\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:54:24.950558 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:24.950506    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74d17a49-1d9e-4f3a-9d97-c2a155d0ea24-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "74d17a49-1d9e-4f3a-9d97-c2a155d0ea24" (UID: "74d17a49-1d9e-4f3a-9d97-c2a155d0ea24"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 13:54:24.950558 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:24.950527    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74d17a49-1d9e-4f3a-9d97-c2a155d0ea24-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "74d17a49-1d9e-4f3a-9d97-c2a155d0ea24" (UID: "74d17a49-1d9e-4f3a-9d97-c2a155d0ea24"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 13:54:24.950775 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:24.950740    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74d17a49-1d9e-4f3a-9d97-c2a155d0ea24-istio-data" (OuterVolumeSpecName: "istio-data") pod "74d17a49-1d9e-4f3a-9d97-c2a155d0ea24" (UID: "74d17a49-1d9e-4f3a-9d97-c2a155d0ea24"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 13:54:24.952560 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:24.952531    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74d17a49-1d9e-4f3a-9d97-c2a155d0ea24-kube-api-access-nbhbm" (OuterVolumeSpecName: "kube-api-access-nbhbm") pod "74d17a49-1d9e-4f3a-9d97-c2a155d0ea24" (UID: "74d17a49-1d9e-4f3a-9d97-c2a155d0ea24"). InnerVolumeSpecName "kube-api-access-nbhbm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 13:54:24.952792 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:24.952759    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74d17a49-1d9e-4f3a-9d97-c2a155d0ea24-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "74d17a49-1d9e-4f3a-9d97-c2a155d0ea24" (UID: "74d17a49-1d9e-4f3a-9d97-c2a155d0ea24"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 13:54:24.952904 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:24.952808    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/74d17a49-1d9e-4f3a-9d97-c2a155d0ea24-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "74d17a49-1d9e-4f3a-9d97-c2a155d0ea24" (UID: "74d17a49-1d9e-4f3a-9d97-c2a155d0ea24"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 13:54:24.952997 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:24.952981    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74d17a49-1d9e-4f3a-9d97-c2a155d0ea24-istio-token" (OuterVolumeSpecName: "istio-token") pod "74d17a49-1d9e-4f3a-9d97-c2a155d0ea24" (UID: "74d17a49-1d9e-4f3a-9d97-c2a155d0ea24"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 13:54:25.051116 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:25.051062    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74d17a49-1d9e-4f3a-9d97-c2a155d0ea24-istio-token\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:54:25.051116 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:25.051108    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74d17a49-1d9e-4f3a-9d97-c2a155d0ea24-istiod-ca-cert\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:54:25.051116 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:25.051117    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74d17a49-1d9e-4f3a-9d97-c2a155d0ea24-workload-certs\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:54:25.051116 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:25.051125    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74d17a49-1d9e-4f3a-9d97-c2a155d0ea24-istio-envoy\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:54:25.051116 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:25.051134    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nbhbm\" (UniqueName: \"kubernetes.io/projected/74d17a49-1d9e-4f3a-9d97-c2a155d0ea24-kube-api-access-nbhbm\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:54:25.051457 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:25.051143    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74d17a49-1d9e-4f3a-9d97-c2a155d0ea24-istio-podinfo\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:54:25.051457 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:25.051151    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74d17a49-1d9e-4f3a-9d97-c2a155d0ea24-istio-data\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:54:25.633712 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:25.633682    2578 generic.go:356] "Generic (PLEG): container finished" podID="74d17a49-1d9e-4f3a-9d97-c2a155d0ea24" containerID="c4d372f46164555a8c37808d82f18f49d190f073c17a36dec2274765d34da68e" exitCode=0
Sep 09 13:54:25.633868 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:25.633733    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p"
Sep 09 13:54:25.633868 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:25.633772    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p" event={"ID":"74d17a49-1d9e-4f3a-9d97-c2a155d0ea24","Type":"ContainerDied","Data":"c4d372f46164555a8c37808d82f18f49d190f073c17a36dec2274765d34da68e"}
Sep 09 13:54:25.633868 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:25.633827    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p" event={"ID":"74d17a49-1d9e-4f3a-9d97-c2a155d0ea24","Type":"ContainerDied","Data":"93b96d4bf6e1d75b08680311e1b92f94a874caed184c712fa78c1f02042d30c8"}
Sep 09 13:54:25.633868 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:25.633851    2578 scope.go:117] "RemoveContainer" containerID="c4d372f46164555a8c37808d82f18f49d190f073c17a36dec2274765d34da68e"
Sep 09 13:54:25.643678 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:25.643661    2578 scope.go:117] "RemoveContainer" containerID="7cb75a9ca5d5180afad5d676ffc58d1a963b30c0c4dec5bb13f6b0736614147d"
Sep 09 13:54:25.651629 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:25.651608    2578 scope.go:117] "RemoveContainer" containerID="c4d372f46164555a8c37808d82f18f49d190f073c17a36dec2274765d34da68e"
Sep 09 13:54:25.651919 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:54:25.651899    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4d372f46164555a8c37808d82f18f49d190f073c17a36dec2274765d34da68e\": container with ID starting with c4d372f46164555a8c37808d82f18f49d190f073c17a36dec2274765d34da68e not found: ID does not exist" containerID="c4d372f46164555a8c37808d82f18f49d190f073c17a36dec2274765d34da68e"
Sep 09 13:54:25.651991 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:25.651926    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4d372f46164555a8c37808d82f18f49d190f073c17a36dec2274765d34da68e"} err="failed to get container status \"c4d372f46164555a8c37808d82f18f49d190f073c17a36dec2274765d34da68e\": rpc error: code = NotFound desc = could not find container \"c4d372f46164555a8c37808d82f18f49d190f073c17a36dec2274765d34da68e\": container with ID starting with c4d372f46164555a8c37808d82f18f49d190f073c17a36dec2274765d34da68e not found: ID does not exist"
Sep 09 13:54:25.651991 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:25.651943    2578 scope.go:117] "RemoveContainer" containerID="7cb75a9ca5d5180afad5d676ffc58d1a963b30c0c4dec5bb13f6b0736614147d"
Sep 09 13:54:25.652212 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:54:25.652189    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7cb75a9ca5d5180afad5d676ffc58d1a963b30c0c4dec5bb13f6b0736614147d\": container with ID starting with 7cb75a9ca5d5180afad5d676ffc58d1a963b30c0c4dec5bb13f6b0736614147d not found: ID does not exist" containerID="7cb75a9ca5d5180afad5d676ffc58d1a963b30c0c4dec5bb13f6b0736614147d"
Sep 09 13:54:25.652309 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:25.652211    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cb75a9ca5d5180afad5d676ffc58d1a963b30c0c4dec5bb13f6b0736614147d"} err="failed to get container status \"7cb75a9ca5d5180afad5d676ffc58d1a963b30c0c4dec5bb13f6b0736614147d\": rpc error: code = NotFound desc = could not find container \"7cb75a9ca5d5180afad5d676ffc58d1a963b30c0c4dec5bb13f6b0736614147d\": container with ID starting with 7cb75a9ca5d5180afad5d676ffc58d1a963b30c0c4dec5bb13f6b0736614147d not found: ID does not exist"
Sep 09 13:54:25.655504 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:25.655478    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p"]
Sep 09 13:54:25.659623 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:25.659599    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-b2555b-openshift-default-54c995bbb-kmt8p"]
Sep 09 13:54:26.660547 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:26.660519    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74d17a49-1d9e-4f3a-9d97-c2a155d0ea24" path="/var/lib/kubelet/pods/74d17a49-1d9e-4f3a-9d97-c2a155d0ea24/volumes"
Sep 09 13:54:36.266865 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:36.266828    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:54:36.467347 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:36.467292    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:54:38.734094 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:38.734061    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:54:38.763421 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:38.763389    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-8349bf-64b7856589-tcxc8"]
Sep 09 13:54:38.763721 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:38.763687    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-8349bf-64b7856589-tcxc8" podUID="3f19149b-6d8c-4c5b-9de1-2fd7c71fd4c4" containerName="payload-processing" containerID="cri-o://641f80bd7768f22c00e7db2732a7d2f268964c1446c6a8bbf5fa68ea6bc018b0" gracePeriod=30
Sep 09 13:54:38.770412 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:38.770381    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-8349bf-5876b4ffc4-p6vjf"]
Sep 09 13:54:38.770612 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:38.770587    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-8349bf-5876b4ffc4-p6vjf" podUID="4a3c12f9-cd77-40b2-a86a-929157320b6b" containerName="payload-pre-processing" containerID="cri-o://203f84215e238de1d648414d426f9db06f876c79908388414adce4a04963de52" gracePeriod=30
Sep 09 13:54:38.804357 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:38.804321    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:54:38.868669 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:38.868634    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:54:38.935523 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:38.935484    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:54:38.992447 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:38.992340    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:54:39.013405 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:39.013383    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-8349bf-64b7856589-tcxc8"
Sep 09 13:54:39.039598 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:39.039570    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-8349bf-5876b4ffc4-p6vjf"
Sep 09 13:54:39.181463 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:39.181428    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cw4pv\" (UniqueName: \"kubernetes.io/projected/4a3c12f9-cd77-40b2-a86a-929157320b6b-kube-api-access-cw4pv\") pod \"4a3c12f9-cd77-40b2-a86a-929157320b6b\" (UID: \"4a3c12f9-cd77-40b2-a86a-929157320b6b\") "
Sep 09 13:54:39.181659 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:39.181491    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rkd6s\" (UniqueName: \"kubernetes.io/projected/3f19149b-6d8c-4c5b-9de1-2fd7c71fd4c4-kube-api-access-rkd6s\") pod \"3f19149b-6d8c-4c5b-9de1-2fd7c71fd4c4\" (UID: \"3f19149b-6d8c-4c5b-9de1-2fd7c71fd4c4\") "
Sep 09 13:54:39.181659 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:39.181537    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4a3c12f9-cd77-40b2-a86a-929157320b6b-plugins-config-volume\") pod \"4a3c12f9-cd77-40b2-a86a-929157320b6b\" (UID: \"4a3c12f9-cd77-40b2-a86a-929157320b6b\") "
Sep 09 13:54:39.181659 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:39.181561    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3f19149b-6d8c-4c5b-9de1-2fd7c71fd4c4-plugins-config-volume\") pod \"3f19149b-6d8c-4c5b-9de1-2fd7c71fd4c4\" (UID: \"3f19149b-6d8c-4c5b-9de1-2fd7c71fd4c4\") "
Sep 09 13:54:39.181944 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:39.181919    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a3c12f9-cd77-40b2-a86a-929157320b6b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4a3c12f9-cd77-40b2-a86a-929157320b6b" (UID: "4a3c12f9-cd77-40b2-a86a-929157320b6b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 13:54:39.182005 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:39.181951    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f19149b-6d8c-4c5b-9de1-2fd7c71fd4c4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3f19149b-6d8c-4c5b-9de1-2fd7c71fd4c4" (UID: "3f19149b-6d8c-4c5b-9de1-2fd7c71fd4c4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 13:54:39.183656 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:39.183633    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f19149b-6d8c-4c5b-9de1-2fd7c71fd4c4-kube-api-access-rkd6s" (OuterVolumeSpecName: "kube-api-access-rkd6s") pod "3f19149b-6d8c-4c5b-9de1-2fd7c71fd4c4" (UID: "3f19149b-6d8c-4c5b-9de1-2fd7c71fd4c4"). InnerVolumeSpecName "kube-api-access-rkd6s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 13:54:39.183714 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:39.183656    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a3c12f9-cd77-40b2-a86a-929157320b6b-kube-api-access-cw4pv" (OuterVolumeSpecName: "kube-api-access-cw4pv") pod "4a3c12f9-cd77-40b2-a86a-929157320b6b" (UID: "4a3c12f9-cd77-40b2-a86a-929157320b6b"). InnerVolumeSpecName "kube-api-access-cw4pv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 13:54:39.282982 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:39.282882    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cw4pv\" (UniqueName: \"kubernetes.io/projected/4a3c12f9-cd77-40b2-a86a-929157320b6b-kube-api-access-cw4pv\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:54:39.282982 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:39.282925    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rkd6s\" (UniqueName: \"kubernetes.io/projected/3f19149b-6d8c-4c5b-9de1-2fd7c71fd4c4-kube-api-access-rkd6s\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:54:39.282982 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:39.282938    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4a3c12f9-cd77-40b2-a86a-929157320b6b-plugins-config-volume\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:54:39.282982 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:39.282951    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3f19149b-6d8c-4c5b-9de1-2fd7c71fd4c4-plugins-config-volume\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:54:39.297809 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:39.297772    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:54:39.702735 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:39.702702    2578 generic.go:356] "Generic (PLEG): container finished" podID="3f19149b-6d8c-4c5b-9de1-2fd7c71fd4c4" containerID="641f80bd7768f22c00e7db2732a7d2f268964c1446c6a8bbf5fa68ea6bc018b0" exitCode=0
Sep 09 13:54:39.703031 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:39.702742    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-8349bf-64b7856589-tcxc8"
Sep 09 13:54:39.703031 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:39.702792    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-8349bf-64b7856589-tcxc8" event={"ID":"3f19149b-6d8c-4c5b-9de1-2fd7c71fd4c4","Type":"ContainerDied","Data":"641f80bd7768f22c00e7db2732a7d2f268964c1446c6a8bbf5fa68ea6bc018b0"}
Sep 09 13:54:39.703031 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:39.702844    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-8349bf-64b7856589-tcxc8" event={"ID":"3f19149b-6d8c-4c5b-9de1-2fd7c71fd4c4","Type":"ContainerDied","Data":"56f3617e6c75844a62af86401a3525505e2b267194f9bf7105bcf44256977293"}
Sep 09 13:54:39.703031 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:39.702879    2578 scope.go:117] "RemoveContainer" containerID="641f80bd7768f22c00e7db2732a7d2f268964c1446c6a8bbf5fa68ea6bc018b0"
Sep 09 13:54:39.704220 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:39.704199    2578 generic.go:356] "Generic (PLEG): container finished" podID="4a3c12f9-cd77-40b2-a86a-929157320b6b" containerID="203f84215e238de1d648414d426f9db06f876c79908388414adce4a04963de52" exitCode=0
Sep 09 13:54:39.704322 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:39.704230    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-8349bf-5876b4ffc4-p6vjf" event={"ID":"4a3c12f9-cd77-40b2-a86a-929157320b6b","Type":"ContainerDied","Data":"203f84215e238de1d648414d426f9db06f876c79908388414adce4a04963de52"}
Sep 09 13:54:39.704322 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:39.704262    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-8349bf-5876b4ffc4-p6vjf"
Sep 09 13:54:39.704322 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:39.704282    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-8349bf-5876b4ffc4-p6vjf" event={"ID":"4a3c12f9-cd77-40b2-a86a-929157320b6b","Type":"ContainerDied","Data":"8ec80e1ecd56fb48f7f4206552d85da96b6318716dbea7df21f31756eae2108c"}
Sep 09 13:54:39.713206 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:39.713169    2578 scope.go:117] "RemoveContainer" containerID="641f80bd7768f22c00e7db2732a7d2f268964c1446c6a8bbf5fa68ea6bc018b0"
Sep 09 13:54:39.713625 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:54:39.713605    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"641f80bd7768f22c00e7db2732a7d2f268964c1446c6a8bbf5fa68ea6bc018b0\": container with ID starting with 641f80bd7768f22c00e7db2732a7d2f268964c1446c6a8bbf5fa68ea6bc018b0 not found: ID does not exist" containerID="641f80bd7768f22c00e7db2732a7d2f268964c1446c6a8bbf5fa68ea6bc018b0"
Sep 09 13:54:39.713702 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:39.713635    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"641f80bd7768f22c00e7db2732a7d2f268964c1446c6a8bbf5fa68ea6bc018b0"} err="failed to get container status \"641f80bd7768f22c00e7db2732a7d2f268964c1446c6a8bbf5fa68ea6bc018b0\": rpc error: code = NotFound desc = could not find container \"641f80bd7768f22c00e7db2732a7d2f268964c1446c6a8bbf5fa68ea6bc018b0\": container with ID starting with 641f80bd7768f22c00e7db2732a7d2f268964c1446c6a8bbf5fa68ea6bc018b0 not found: ID does not exist"
Sep 09 13:54:39.713702 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:39.713652    2578 scope.go:117] "RemoveContainer" containerID="203f84215e238de1d648414d426f9db06f876c79908388414adce4a04963de52"
Sep 09 13:54:39.721476 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:39.721460    2578 scope.go:117] "RemoveContainer" containerID="203f84215e238de1d648414d426f9db06f876c79908388414adce4a04963de52"
Sep 09 13:54:39.721738 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:54:39.721717    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"203f84215e238de1d648414d426f9db06f876c79908388414adce4a04963de52\": container with ID starting with 203f84215e238de1d648414d426f9db06f876c79908388414adce4a04963de52 not found: ID does not exist" containerID="203f84215e238de1d648414d426f9db06f876c79908388414adce4a04963de52"
Sep 09 13:54:39.721798 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:39.721749    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"203f84215e238de1d648414d426f9db06f876c79908388414adce4a04963de52"} err="failed to get container status \"203f84215e238de1d648414d426f9db06f876c79908388414adce4a04963de52\": rpc error: code = NotFound desc = could not find container \"203f84215e238de1d648414d426f9db06f876c79908388414adce4a04963de52\": container with ID starting with 203f84215e238de1d648414d426f9db06f876c79908388414adce4a04963de52 not found: ID does not exist"
Sep 09 13:54:39.725408 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:39.725382    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-8349bf-64b7856589-tcxc8"]
Sep 09 13:54:39.731498 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:39.731465    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-8349bf-64b7856589-tcxc8"]
Sep 09 13:54:39.741502 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:39.741474    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-8349bf-5876b4ffc4-p6vjf"]
Sep 09 13:54:39.745503 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:39.745479    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-8349bf-5876b4ffc4-p6vjf"]
Sep 09 13:54:40.662838 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:40.662797    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f19149b-6d8c-4c5b-9de1-2fd7c71fd4c4" path="/var/lib/kubelet/pods/3f19149b-6d8c-4c5b-9de1-2fd7c71fd4c4/volumes"
Sep 09 13:54:40.663288 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:40.663269    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a3c12f9-cd77-40b2-a86a-929157320b6b" path="/var/lib/kubelet/pods/4a3c12f9-cd77-40b2-a86a-929157320b6b/volumes"
Sep 09 13:54:44.379196 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:44.379149    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:54:49.460796 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:54:49.460746    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:55:03.952126 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:03.952036    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:55:21.182223 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:21.182185    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:55:21.526872 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:21.526780    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:55:27.100398 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:27.100368    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:55:27.164248 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:27.164216    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:55:27.347369 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:27.347335    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6"]
Sep 09 13:55:27.347625 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:27.347586    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6" podUID="556d334c-683a-422f-ad3a-049def5934aa" containerName="istio-proxy" containerID="cri-o://eee40bb9e24decaa80ce0ec49557ad9afcc2f9a31652735acb54ff98e8770500" gracePeriod=30
Sep 09 13:55:27.364601 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:27.364521    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:55:27.848905 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:27.848848    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:55:32.603977 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:32.603952    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6"
Sep 09 13:55:32.687746 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:32.687708    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/556d334c-683a-422f-ad3a-049def5934aa-istiod-ca-cert\") pod \"556d334c-683a-422f-ad3a-049def5934aa\" (UID: \"556d334c-683a-422f-ad3a-049def5934aa\") "
Sep 09 13:55:32.687915 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:32.687762    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sbpmv\" (UniqueName: \"kubernetes.io/projected/556d334c-683a-422f-ad3a-049def5934aa-kube-api-access-sbpmv\") pod \"556d334c-683a-422f-ad3a-049def5934aa\" (UID: \"556d334c-683a-422f-ad3a-049def5934aa\") "
Sep 09 13:55:32.687915 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:32.687784    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/556d334c-683a-422f-ad3a-049def5934aa-istio-data\") pod \"556d334c-683a-422f-ad3a-049def5934aa\" (UID: \"556d334c-683a-422f-ad3a-049def5934aa\") "
Sep 09 13:55:32.687915 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:32.687828    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/556d334c-683a-422f-ad3a-049def5934aa-istio-envoy\") pod \"556d334c-683a-422f-ad3a-049def5934aa\" (UID: \"556d334c-683a-422f-ad3a-049def5934aa\") "
Sep 09 13:55:32.687915 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:32.687854    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/556d334c-683a-422f-ad3a-049def5934aa-workload-socket\") pod \"556d334c-683a-422f-ad3a-049def5934aa\" (UID: \"556d334c-683a-422f-ad3a-049def5934aa\") "
Sep 09 13:55:32.687915 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:32.687894    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/556d334c-683a-422f-ad3a-049def5934aa-credential-socket\") pod \"556d334c-683a-422f-ad3a-049def5934aa\" (UID: \"556d334c-683a-422f-ad3a-049def5934aa\") "
Sep 09 13:55:32.688169 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:32.687934    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/556d334c-683a-422f-ad3a-049def5934aa-istio-podinfo\") pod \"556d334c-683a-422f-ad3a-049def5934aa\" (UID: \"556d334c-683a-422f-ad3a-049def5934aa\") "
Sep 09 13:55:32.688169 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:32.687960    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/556d334c-683a-422f-ad3a-049def5934aa-istio-token\") pod \"556d334c-683a-422f-ad3a-049def5934aa\" (UID: \"556d334c-683a-422f-ad3a-049def5934aa\") "
Sep 09 13:55:32.688169 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:32.687987    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/556d334c-683a-422f-ad3a-049def5934aa-workload-certs\") pod \"556d334c-683a-422f-ad3a-049def5934aa\" (UID: \"556d334c-683a-422f-ad3a-049def5934aa\") "
Sep 09 13:55:32.688169 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:32.688142    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/556d334c-683a-422f-ad3a-049def5934aa-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "556d334c-683a-422f-ad3a-049def5934aa" (UID: "556d334c-683a-422f-ad3a-049def5934aa"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 13:55:32.688169 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:32.688155    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/556d334c-683a-422f-ad3a-049def5934aa-istio-data" (OuterVolumeSpecName: "istio-data") pod "556d334c-683a-422f-ad3a-049def5934aa" (UID: "556d334c-683a-422f-ad3a-049def5934aa"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 13:55:32.688511 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:32.688453    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/556d334c-683a-422f-ad3a-049def5934aa-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "556d334c-683a-422f-ad3a-049def5934aa" (UID: "556d334c-683a-422f-ad3a-049def5934aa"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 13:55:32.688589 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:32.688531    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/556d334c-683a-422f-ad3a-049def5934aa-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "556d334c-683a-422f-ad3a-049def5934aa" (UID: "556d334c-683a-422f-ad3a-049def5934aa"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 13:55:32.688589 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:32.688544    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/556d334c-683a-422f-ad3a-049def5934aa-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "556d334c-683a-422f-ad3a-049def5934aa" (UID: "556d334c-683a-422f-ad3a-049def5934aa"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 13:55:32.688724 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:32.688708    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/556d334c-683a-422f-ad3a-049def5934aa-istiod-ca-cert\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:55:32.688797 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:32.688730    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/556d334c-683a-422f-ad3a-049def5934aa-istio-data\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:55:32.688797 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:32.688744    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/556d334c-683a-422f-ad3a-049def5934aa-workload-socket\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:55:32.690142 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:32.690119    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/556d334c-683a-422f-ad3a-049def5934aa-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "556d334c-683a-422f-ad3a-049def5934aa" (UID: "556d334c-683a-422f-ad3a-049def5934aa"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 13:55:32.690272 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:32.690252    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/556d334c-683a-422f-ad3a-049def5934aa-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "556d334c-683a-422f-ad3a-049def5934aa" (UID: "556d334c-683a-422f-ad3a-049def5934aa"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 13:55:32.690463 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:32.690446    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/556d334c-683a-422f-ad3a-049def5934aa-kube-api-access-sbpmv" (OuterVolumeSpecName: "kube-api-access-sbpmv") pod "556d334c-683a-422f-ad3a-049def5934aa" (UID: "556d334c-683a-422f-ad3a-049def5934aa"). InnerVolumeSpecName "kube-api-access-sbpmv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 13:55:32.690596 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:32.690582    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/556d334c-683a-422f-ad3a-049def5934aa-istio-token" (OuterVolumeSpecName: "istio-token") pod "556d334c-683a-422f-ad3a-049def5934aa" (UID: "556d334c-683a-422f-ad3a-049def5934aa"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 13:55:32.789590 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:32.789544    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/556d334c-683a-422f-ad3a-049def5934aa-istio-podinfo\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:55:32.789590 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:32.789575    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/556d334c-683a-422f-ad3a-049def5934aa-istio-token\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:55:32.789590 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:32.789585    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/556d334c-683a-422f-ad3a-049def5934aa-workload-certs\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:55:32.789590 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:32.789594    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sbpmv\" (UniqueName: \"kubernetes.io/projected/556d334c-683a-422f-ad3a-049def5934aa-kube-api-access-sbpmv\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:55:32.789866 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:32.789605    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/556d334c-683a-422f-ad3a-049def5934aa-istio-envoy\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:55:32.789866 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:32.789613    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/556d334c-683a-422f-ad3a-049def5934aa-credential-socket\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:55:32.957335 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:32.957245    2578 generic.go:356] "Generic (PLEG): container finished" podID="556d334c-683a-422f-ad3a-049def5934aa" containerID="eee40bb9e24decaa80ce0ec49557ad9afcc2f9a31652735acb54ff98e8770500" exitCode=0
Sep 09 13:55:32.957335 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:32.957289    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6"
Sep 09 13:55:32.957335 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:32.957310    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6" event={"ID":"556d334c-683a-422f-ad3a-049def5934aa","Type":"ContainerDied","Data":"eee40bb9e24decaa80ce0ec49557ad9afcc2f9a31652735acb54ff98e8770500"}
Sep 09 13:55:32.957574 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:32.957355    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6" event={"ID":"556d334c-683a-422f-ad3a-049def5934aa","Type":"ContainerDied","Data":"87815df0b2e25b2fee35a453b9ecd94f4823ebef15069f2b1d03a576d058b568"}
Sep 09 13:55:32.957574 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:32.957375    2578 scope.go:117] "RemoveContainer" containerID="eee40bb9e24decaa80ce0ec49557ad9afcc2f9a31652735acb54ff98e8770500"
Sep 09 13:55:32.966113 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:32.966094    2578 scope.go:117] "RemoveContainer" containerID="b369bb9ffb5ff3440c1192bc4ee90da956915099c6d4869ca6bd2829bfb7e52f"
Sep 09 13:55:32.973859 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:32.973840    2578 scope.go:117] "RemoveContainer" containerID="eee40bb9e24decaa80ce0ec49557ad9afcc2f9a31652735acb54ff98e8770500"
Sep 09 13:55:32.974122 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:55:32.974103    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eee40bb9e24decaa80ce0ec49557ad9afcc2f9a31652735acb54ff98e8770500\": container with ID starting with eee40bb9e24decaa80ce0ec49557ad9afcc2f9a31652735acb54ff98e8770500 not found: ID does not exist" containerID="eee40bb9e24decaa80ce0ec49557ad9afcc2f9a31652735acb54ff98e8770500"
Sep 09 13:55:32.974212 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:32.974131    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eee40bb9e24decaa80ce0ec49557ad9afcc2f9a31652735acb54ff98e8770500"} err="failed to get container status \"eee40bb9e24decaa80ce0ec49557ad9afcc2f9a31652735acb54ff98e8770500\": rpc error: code = NotFound desc = could not find container \"eee40bb9e24decaa80ce0ec49557ad9afcc2f9a31652735acb54ff98e8770500\": container with ID starting with eee40bb9e24decaa80ce0ec49557ad9afcc2f9a31652735acb54ff98e8770500 not found: ID does not exist"
Sep 09 13:55:32.974212 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:32.974149    2578 scope.go:117] "RemoveContainer" containerID="b369bb9ffb5ff3440c1192bc4ee90da956915099c6d4869ca6bd2829bfb7e52f"
Sep 09 13:55:32.974430 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:55:32.974411    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b369bb9ffb5ff3440c1192bc4ee90da956915099c6d4869ca6bd2829bfb7e52f\": container with ID starting with b369bb9ffb5ff3440c1192bc4ee90da956915099c6d4869ca6bd2829bfb7e52f not found: ID does not exist" containerID="b369bb9ffb5ff3440c1192bc4ee90da956915099c6d4869ca6bd2829bfb7e52f"
Sep 09 13:55:32.974483 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:32.974435    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b369bb9ffb5ff3440c1192bc4ee90da956915099c6d4869ca6bd2829bfb7e52f"} err="failed to get container status \"b369bb9ffb5ff3440c1192bc4ee90da956915099c6d4869ca6bd2829bfb7e52f\": rpc error: code = NotFound desc = could not find container \"b369bb9ffb5ff3440c1192bc4ee90da956915099c6d4869ca6bd2829bfb7e52f\": container with ID starting with b369bb9ffb5ff3440c1192bc4ee90da956915099c6d4869ca6bd2829bfb7e52f not found: ID does not exist"
Sep 09 13:55:32.979733 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:32.979709    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6"]
Sep 09 13:55:32.988663 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:32.986405    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-8349bf-openshift-default-86f4cf468b-ktxm6"]
Sep 09 13:55:34.660713 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:34.660676    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="556d334c-683a-422f-ad3a-049def5934aa" path="/var/lib/kubelet/pods/556d334c-683a-422f-ad3a-049def5934aa/volumes"
Sep 09 13:55:38.314965 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:38.314928    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:55:38.394088 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:38.394056    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:55:38.467752 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:38.467719    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:55:38.533012 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:38.532968    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:55:38.903775 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:38.903736    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:55:41.657148 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:41.657109    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:55:44.669484 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:44.669454    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:55:44.734705 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:44.734671    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:55:45.053527 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:45.053443    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:55:45.395631 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:45.395599    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:55:55.649879 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:55.649840    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:55:55.728456 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:55.728420    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8f2df2-8f6bf598-mzhjs"]
Sep 09 13:55:55.728686 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:55.728654    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8f2df2-8f6bf598-mzhjs" podUID="1ec09ff1-8d79-4194-a05d-67f26d0ff1f1" containerName="maas-api" containerID="cri-o://d291a0327002636cf1a60b33ac480195f7bff752f115cb570cb239919ca10d28" gracePeriod=30
Sep 09 13:55:55.761040 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:55.761013    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-8f2df2-29816025-pjm2q"]
Sep 09 13:55:55.763576 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:55.763552    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-8f2df2-29816025-pjm2q"]
Sep 09 13:55:55.764160 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:55.764135    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:55:55.791987 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:55.791958    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8f2df2-7d95599dcd-lnw5d"]
Sep 09 13:55:55.792222 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:55.792201    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8f2df2-7d95599dcd-lnw5d" podUID="8f0d5673-3e94-4ab3-a707-b5c5fe92581f" containerName="payload-pre-processing" containerID="cri-o://303787bd57cab9d584690c0e3ed36e2eb87865b86034dd160ef89a51ea29a74d" gracePeriod=30
Sep 09 13:55:55.863363 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:55.863329    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:55:55.947050 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:55.946984    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:55:56.005891 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:56.005846    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:55:56.048713 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:56.048686    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8f2df2-8f6bf598-mzhjs"
Sep 09 13:55:56.068710 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:56.066611    2578 generic.go:356] "Generic (PLEG): container finished" podID="1ec09ff1-8d79-4194-a05d-67f26d0ff1f1" containerID="d291a0327002636cf1a60b33ac480195f7bff752f115cb570cb239919ca10d28" exitCode=0
Sep 09 13:55:56.068710 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:56.066694    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8f2df2-8f6bf598-mzhjs" event={"ID":"1ec09ff1-8d79-4194-a05d-67f26d0ff1f1","Type":"ContainerDied","Data":"d291a0327002636cf1a60b33ac480195f7bff752f115cb570cb239919ca10d28"}
Sep 09 13:55:56.068710 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:56.066741    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8f2df2-8f6bf598-mzhjs" event={"ID":"1ec09ff1-8d79-4194-a05d-67f26d0ff1f1","Type":"ContainerDied","Data":"a2372a535fc77c50b48e2092ca4151d973426c0f4f459d055ef449d8a7a139bf"}
Sep 09 13:55:56.068710 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:56.066771    2578 scope.go:117] "RemoveContainer" containerID="d291a0327002636cf1a60b33ac480195f7bff752f115cb570cb239919ca10d28"
Sep 09 13:55:56.068710 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:56.066926    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8f2df2-8f6bf598-mzhjs"
Sep 09 13:55:56.070304 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:56.070058    2578 generic.go:356] "Generic (PLEG): container finished" podID="8f0d5673-3e94-4ab3-a707-b5c5fe92581f" containerID="303787bd57cab9d584690c0e3ed36e2eb87865b86034dd160ef89a51ea29a74d" exitCode=0
Sep 09 13:55:56.070304 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:56.070212    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8f2df2-7d95599dcd-lnw5d" event={"ID":"8f0d5673-3e94-4ab3-a707-b5c5fe92581f","Type":"ContainerDied","Data":"303787bd57cab9d584690c0e3ed36e2eb87865b86034dd160ef89a51ea29a74d"}
Sep 09 13:55:56.082010 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:56.081986    2578 scope.go:117] "RemoveContainer" containerID="d291a0327002636cf1a60b33ac480195f7bff752f115cb570cb239919ca10d28"
Sep 09 13:55:56.082385 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:55:56.082362    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d291a0327002636cf1a60b33ac480195f7bff752f115cb570cb239919ca10d28\": container with ID starting with d291a0327002636cf1a60b33ac480195f7bff752f115cb570cb239919ca10d28 not found: ID does not exist" containerID="d291a0327002636cf1a60b33ac480195f7bff752f115cb570cb239919ca10d28"
Sep 09 13:55:56.082483 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:56.082399    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d291a0327002636cf1a60b33ac480195f7bff752f115cb570cb239919ca10d28"} err="failed to get container status \"d291a0327002636cf1a60b33ac480195f7bff752f115cb570cb239919ca10d28\": rpc error: code = NotFound desc = could not find container \"d291a0327002636cf1a60b33ac480195f7bff752f115cb570cb239919ca10d28\": container with ID starting with d291a0327002636cf1a60b33ac480195f7bff752f115cb570cb239919ca10d28 not found: ID does not exist"
Sep 09 13:55:56.086099 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:56.086081    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8f2df2-7d95599dcd-lnw5d"
Sep 09 13:55:56.202197 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:56.202097    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8f0d5673-3e94-4ab3-a707-b5c5fe92581f-plugins-config-volume\") pod \"8f0d5673-3e94-4ab3-a707-b5c5fe92581f\" (UID: \"8f0d5673-3e94-4ab3-a707-b5c5fe92581f\") "
Sep 09 13:55:56.202197 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:56.202140    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fmf4x\" (UniqueName: \"kubernetes.io/projected/8f0d5673-3e94-4ab3-a707-b5c5fe92581f-kube-api-access-fmf4x\") pod \"8f0d5673-3e94-4ab3-a707-b5c5fe92581f\" (UID: \"8f0d5673-3e94-4ab3-a707-b5c5fe92581f\") "
Sep 09 13:55:56.202197 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:56.202157    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ec09ff1-8d79-4194-a05d-67f26d0ff1f1-openshift-service-ca\") pod \"1ec09ff1-8d79-4194-a05d-67f26d0ff1f1\" (UID: \"1ec09ff1-8d79-4194-a05d-67f26d0ff1f1\") "
Sep 09 13:55:56.202490 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:56.202195    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ec09ff1-8d79-4194-a05d-67f26d0ff1f1-maas-api-tls\") pod \"1ec09ff1-8d79-4194-a05d-67f26d0ff1f1\" (UID: \"1ec09ff1-8d79-4194-a05d-67f26d0ff1f1\") "
Sep 09 13:55:56.202490 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:56.202272    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ec09ff1-8d79-4194-a05d-67f26d0ff1f1-metrics-certs\") pod \"1ec09ff1-8d79-4194-a05d-67f26d0ff1f1\" (UID: \"1ec09ff1-8d79-4194-a05d-67f26d0ff1f1\") "
Sep 09 13:55:56.202490 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:56.202301    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pc7xz\" (UniqueName: \"kubernetes.io/projected/1ec09ff1-8d79-4194-a05d-67f26d0ff1f1-kube-api-access-pc7xz\") pod \"1ec09ff1-8d79-4194-a05d-67f26d0ff1f1\" (UID: \"1ec09ff1-8d79-4194-a05d-67f26d0ff1f1\") "
Sep 09 13:55:56.202635 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:56.202526    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ec09ff1-8d79-4194-a05d-67f26d0ff1f1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1ec09ff1-8d79-4194-a05d-67f26d0ff1f1" (UID: "1ec09ff1-8d79-4194-a05d-67f26d0ff1f1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 13:55:56.202920 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:56.202885    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f0d5673-3e94-4ab3-a707-b5c5fe92581f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8f0d5673-3e94-4ab3-a707-b5c5fe92581f" (UID: "8f0d5673-3e94-4ab3-a707-b5c5fe92581f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 13:55:56.203427 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:56.203403    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ec09ff1-8d79-4194-a05d-67f26d0ff1f1-openshift-service-ca\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:55:56.205370 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:56.205319    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f0d5673-3e94-4ab3-a707-b5c5fe92581f-kube-api-access-fmf4x" (OuterVolumeSpecName: "kube-api-access-fmf4x") pod "8f0d5673-3e94-4ab3-a707-b5c5fe92581f" (UID: "8f0d5673-3e94-4ab3-a707-b5c5fe92581f"). InnerVolumeSpecName "kube-api-access-fmf4x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 13:55:56.205474 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:56.205368    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ec09ff1-8d79-4194-a05d-67f26d0ff1f1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1ec09ff1-8d79-4194-a05d-67f26d0ff1f1" (UID: "1ec09ff1-8d79-4194-a05d-67f26d0ff1f1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 13:55:56.206352 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:56.206304    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ec09ff1-8d79-4194-a05d-67f26d0ff1f1-kube-api-access-pc7xz" (OuterVolumeSpecName: "kube-api-access-pc7xz") pod "1ec09ff1-8d79-4194-a05d-67f26d0ff1f1" (UID: "1ec09ff1-8d79-4194-a05d-67f26d0ff1f1"). InnerVolumeSpecName "kube-api-access-pc7xz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 13:55:56.206870 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:56.206838    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ec09ff1-8d79-4194-a05d-67f26d0ff1f1-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "1ec09ff1-8d79-4194-a05d-67f26d0ff1f1" (UID: "1ec09ff1-8d79-4194-a05d-67f26d0ff1f1"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 13:55:56.304210 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:56.304166    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8f0d5673-3e94-4ab3-a707-b5c5fe92581f-plugins-config-volume\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:55:56.304210 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:56.304208    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fmf4x\" (UniqueName: \"kubernetes.io/projected/8f0d5673-3e94-4ab3-a707-b5c5fe92581f-kube-api-access-fmf4x\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:55:56.304210 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:56.304218    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ec09ff1-8d79-4194-a05d-67f26d0ff1f1-maas-api-tls\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:55:56.304438 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:56.304227    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ec09ff1-8d79-4194-a05d-67f26d0ff1f1-metrics-certs\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:55:56.304438 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:56.304235    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pc7xz\" (UniqueName: \"kubernetes.io/projected/1ec09ff1-8d79-4194-a05d-67f26d0ff1f1-kube-api-access-pc7xz\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:55:56.313108 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:56.313068    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:55:56.388303 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:56.388274    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8f2df2-8f6bf598-mzhjs"]
Sep 09 13:55:56.392043 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:56.392014    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8f2df2-8f6bf598-mzhjs"]
Sep 09 13:55:56.661129 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:56.661096    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ec09ff1-8d79-4194-a05d-67f26d0ff1f1" path="/var/lib/kubelet/pods/1ec09ff1-8d79-4194-a05d-67f26d0ff1f1/volumes"
Sep 09 13:55:56.661506 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:56.661402    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c5a538b-6d4b-460f-9109-947d0de43343" path="/var/lib/kubelet/pods/5c5a538b-6d4b-460f-9109-947d0de43343/volumes"
Sep 09 13:55:57.077242 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:57.077151    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8f2df2-7d95599dcd-lnw5d" event={"ID":"8f0d5673-3e94-4ab3-a707-b5c5fe92581f","Type":"ContainerDied","Data":"aaa8d72aefb934308d2ab092845dcdc5c5eda0e0edcaf0fdea3f429a07a915b9"}
Sep 09 13:55:57.077242 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:57.077203    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8f2df2-7d95599dcd-lnw5d"
Sep 09 13:55:57.077242 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:57.077226    2578 scope.go:117] "RemoveContainer" containerID="303787bd57cab9d584690c0e3ed36e2eb87865b86034dd160ef89a51ea29a74d"
Sep 09 13:55:57.092737 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:57.092711    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8f2df2-7d95599dcd-lnw5d"]
Sep 09 13:55:57.096411 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:57.096388    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8f2df2-7d95599dcd-lnw5d"]
Sep 09 13:55:58.660870 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:58.660838    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f0d5673-3e94-4ab3-a707-b5c5fe92581f" path="/var/lib/kubelet/pods/8f0d5673-3e94-4ab3-a707-b5c5fe92581f/volumes"
Sep 09 13:55:58.664963 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:55:58.664938    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:56:02.119021 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:02.118969    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:56:02.177529 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:02.177494    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:56:02.367917 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:02.367873    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9"]
Sep 09 13:56:02.368126 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:02.368102    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9" podUID="e8f28789-061f-4f6e-a274-9c3b3a919cb0" containerName="istio-proxy" containerID="cri-o://af9e0e11aa8a7883530166713255a03a9c62eea4d9725085e01e1a8e951a2dc2" gracePeriod=30
Sep 09 13:56:02.384092 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:02.384062    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:56:02.694304 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:02.694225    2578 patch_prober.go:28] interesting pod/e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 09 13:56:02.694457 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:02.694304    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9" podUID="e8f28789-061f-4f6e-a274-9c3b3a919cb0" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 13:56:02.743367 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:02.743336    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-df48ae-zd67v"]
Sep 09 13:56:02.743668 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:02.743657    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74d17a49-1d9e-4f3a-9d97-c2a155d0ea24" containerName="istio-proxy"
Sep 09 13:56:02.743719 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:02.743670    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="74d17a49-1d9e-4f3a-9d97-c2a155d0ea24" containerName="istio-proxy"
Sep 09 13:56:02.743719 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:02.743683    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ad64f8b-1b59-4366-a6bb-a16e40b5fd4c" containerName="payload-pre-processing"
Sep 09 13:56:02.743719 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:02.743688    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ad64f8b-1b59-4366-a6bb-a16e40b5fd4c" containerName="payload-pre-processing"
Sep 09 13:56:02.743719 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:02.743710    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="556d334c-683a-422f-ad3a-049def5934aa" containerName="istio-proxy"
Sep 09 13:56:02.743719 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:02.743716    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="556d334c-683a-422f-ad3a-049def5934aa" containerName="istio-proxy"
Sep 09 13:56:02.743875 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:02.743726    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="556d334c-683a-422f-ad3a-049def5934aa" containerName="istio-proxy"
Sep 09 13:56:02.743875 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:02.743731    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="556d334c-683a-422f-ad3a-049def5934aa" containerName="istio-proxy"
Sep 09 13:56:02.743875 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:02.743738    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f19149b-6d8c-4c5b-9de1-2fd7c71fd4c4" containerName="payload-processing"
Sep 09 13:56:02.743875 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:02.743744    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f19149b-6d8c-4c5b-9de1-2fd7c71fd4c4" containerName="payload-processing"
Sep 09 13:56:02.743875 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:02.743752    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f0d5673-3e94-4ab3-a707-b5c5fe92581f" containerName="payload-pre-processing"
Sep 09 13:56:02.743875 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:02.743758    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f0d5673-3e94-4ab3-a707-b5c5fe92581f" containerName="payload-pre-processing"
Sep 09 13:56:02.743875 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:02.743766    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a3c12f9-cd77-40b2-a86a-929157320b6b" containerName="payload-pre-processing"
Sep 09 13:56:02.743875 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:02.743770    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a3c12f9-cd77-40b2-a86a-929157320b6b" containerName="payload-pre-processing"
Sep 09 13:56:02.743875 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:02.743778    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ec09ff1-8d79-4194-a05d-67f26d0ff1f1" containerName="maas-api"
Sep 09 13:56:02.743875 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:02.743782    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ec09ff1-8d79-4194-a05d-67f26d0ff1f1" containerName="maas-api"
Sep 09 13:56:02.743875 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:02.743833    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ec09ff1-8d79-4194-a05d-67f26d0ff1f1" containerName="maas-api"
Sep 09 13:56:02.743875 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:02.743841    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="74d17a49-1d9e-4f3a-9d97-c2a155d0ea24" containerName="istio-proxy"
Sep 09 13:56:02.743875 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:02.743847    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="74d17a49-1d9e-4f3a-9d97-c2a155d0ea24" containerName="istio-proxy"
Sep 09 13:56:02.743875 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:02.743855    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ad64f8b-1b59-4366-a6bb-a16e40b5fd4c" containerName="payload-pre-processing"
Sep 09 13:56:02.743875 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:02.743861    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="556d334c-683a-422f-ad3a-049def5934aa" containerName="istio-proxy"
Sep 09 13:56:02.743875 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:02.743866    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f0d5673-3e94-4ab3-a707-b5c5fe92581f" containerName="payload-pre-processing"
Sep 09 13:56:02.743875 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:02.743870    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="556d334c-683a-422f-ad3a-049def5934aa" containerName="istio-proxy"
Sep 09 13:56:02.743875 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:02.743876    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f19149b-6d8c-4c5b-9de1-2fd7c71fd4c4" containerName="payload-processing"
Sep 09 13:56:02.743875 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:02.743880    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a3c12f9-cd77-40b2-a86a-929157320b6b" containerName="payload-pre-processing"
Sep 09 13:56:02.746648 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:02.746632    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-df48ae-zd67v"
Sep 09 13:56:02.749058 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:02.749033    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 09 13:56:02.749231 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:02.749213    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-lh487\""
Sep 09 13:56:02.753815 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:02.753792    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-df48ae-zd67v"]
Sep 09 13:56:02.865111 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:02.865070    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5be5f00-412e-422a-a854-cd25705f9561-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-df48ae-zd67v\" (UID: \"b5be5f00-412e-422a-a854-cd25705f9561\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-df48ae-zd67v"
Sep 09 13:56:02.883337 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:02.883304    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:56:02.966445 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:02.966364    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5be5f00-412e-422a-a854-cd25705f9561-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-df48ae-zd67v\" (UID: \"b5be5f00-412e-422a-a854-cd25705f9561\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-df48ae-zd67v"
Sep 09 13:56:02.966953 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:02.966934    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5be5f00-412e-422a-a854-cd25705f9561-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-df48ae-zd67v\" (UID: \"b5be5f00-412e-422a-a854-cd25705f9561\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-df48ae-zd67v"
Sep 09 13:56:03.058079 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:03.058039    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-df48ae-zd67v"
Sep 09 13:56:03.328357 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:03.328330    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-df48ae-zd67v"]
Sep 09 13:56:03.330527 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:03.330495    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:56:03.330817 ip-10-0-135-192 kubenswrapper[2578]: W0909 13:56:03.330794    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5be5f00_412e_422a_a854_cd25705f9561.slice/crio-f7ce23362508355fe40119a3f3be04f0e3bdfd37b66abe06b501fc4733fca30d WatchSource:0}: Error finding container f7ce23362508355fe40119a3f3be04f0e3bdfd37b66abe06b501fc4733fca30d: Status 404 returned error can't find the container with id f7ce23362508355fe40119a3f3be04f0e3bdfd37b66abe06b501fc4733fca30d
Sep 09 13:56:03.431225 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:03.431194    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:56:04.116118 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:04.116089    2578 generic.go:356] "Generic (PLEG): container finished" podID="b5be5f00-412e-422a-a854-cd25705f9561" containerID="feb623494703de025d88087bf13f9d2ab10755bda5096037e0ac72013ae6feb5" exitCode=0
Sep 09 13:56:04.116317 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:04.116183    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-df48ae-zd67v" event={"ID":"b5be5f00-412e-422a-a854-cd25705f9561","Type":"ContainerDied","Data":"feb623494703de025d88087bf13f9d2ab10755bda5096037e0ac72013ae6feb5"}
Sep 09 13:56:04.116317 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:04.116232    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-df48ae-zd67v" event={"ID":"b5be5f00-412e-422a-a854-cd25705f9561","Type":"ContainerStarted","Data":"f7ce23362508355fe40119a3f3be04f0e3bdfd37b66abe06b501fc4733fca30d"}
Sep 09 13:56:05.248768 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:05.248746    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-df48ae-zd67v"
Sep 09 13:56:05.388493 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:05.388407    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5be5f00-412e-422a-a854-cd25705f9561-maas-api-service-ca\") pod \"b5be5f00-412e-422a-a854-cd25705f9561\" (UID: \"b5be5f00-412e-422a-a854-cd25705f9561\") "
Sep 09 13:56:05.388774 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:05.388752    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5be5f00-412e-422a-a854-cd25705f9561-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b5be5f00-412e-422a-a854-cd25705f9561" (UID: "b5be5f00-412e-422a-a854-cd25705f9561"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 13:56:05.489031 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:05.488997    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5be5f00-412e-422a-a854-cd25705f9561-maas-api-service-ca\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:56:06.131882 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:06.131856    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-df48ae-zd67v"
Sep 09 13:56:06.132045 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:06.131843    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-df48ae-zd67v" event={"ID":"b5be5f00-412e-422a-a854-cd25705f9561","Type":"ContainerDied","Data":"f7ce23362508355fe40119a3f3be04f0e3bdfd37b66abe06b501fc4733fca30d"}
Sep 09 13:56:06.132045 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:06.132004    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f7ce23362508355fe40119a3f3be04f0e3bdfd37b66abe06b501fc4733fca30d"
Sep 09 13:56:07.622314 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:07.622289    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9"
Sep 09 13:56:07.809948 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:07.809913    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8f28789-061f-4f6e-a274-9c3b3a919cb0-workload-socket\") pod \"e8f28789-061f-4f6e-a274-9c3b3a919cb0\" (UID: \"e8f28789-061f-4f6e-a274-9c3b3a919cb0\") "
Sep 09 13:56:07.810094 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:07.809959    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8f28789-061f-4f6e-a274-9c3b3a919cb0-istio-podinfo\") pod \"e8f28789-061f-4f6e-a274-9c3b3a919cb0\" (UID: \"e8f28789-061f-4f6e-a274-9c3b3a919cb0\") "
Sep 09 13:56:07.810094 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:07.809987    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-47jsg\" (UniqueName: \"kubernetes.io/projected/e8f28789-061f-4f6e-a274-9c3b3a919cb0-kube-api-access-47jsg\") pod \"e8f28789-061f-4f6e-a274-9c3b3a919cb0\" (UID: \"e8f28789-061f-4f6e-a274-9c3b3a919cb0\") "
Sep 09 13:56:07.810094 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:07.810011    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8f28789-061f-4f6e-a274-9c3b3a919cb0-istio-data\") pod \"e8f28789-061f-4f6e-a274-9c3b3a919cb0\" (UID: \"e8f28789-061f-4f6e-a274-9c3b3a919cb0\") "
Sep 09 13:56:07.810094 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:07.810089    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8f28789-061f-4f6e-a274-9c3b3a919cb0-istio-token\") pod \"e8f28789-061f-4f6e-a274-9c3b3a919cb0\" (UID: \"e8f28789-061f-4f6e-a274-9c3b3a919cb0\") "
Sep 09 13:56:07.810307 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:07.810163    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8f28789-061f-4f6e-a274-9c3b3a919cb0-istio-envoy\") pod \"e8f28789-061f-4f6e-a274-9c3b3a919cb0\" (UID: \"e8f28789-061f-4f6e-a274-9c3b3a919cb0\") "
Sep 09 13:56:07.810307 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:07.810241    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8f28789-061f-4f6e-a274-9c3b3a919cb0-workload-certs\") pod \"e8f28789-061f-4f6e-a274-9c3b3a919cb0\" (UID: \"e8f28789-061f-4f6e-a274-9c3b3a919cb0\") "
Sep 09 13:56:07.810307 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:07.810268    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8f28789-061f-4f6e-a274-9c3b3a919cb0-istiod-ca-cert\") pod \"e8f28789-061f-4f6e-a274-9c3b3a919cb0\" (UID: \"e8f28789-061f-4f6e-a274-9c3b3a919cb0\") "
Sep 09 13:56:07.810307 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:07.810270    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8f28789-061f-4f6e-a274-9c3b3a919cb0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e8f28789-061f-4f6e-a274-9c3b3a919cb0" (UID: "e8f28789-061f-4f6e-a274-9c3b3a919cb0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 13:56:07.810307 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:07.810294    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8f28789-061f-4f6e-a274-9c3b3a919cb0-credential-socket\") pod \"e8f28789-061f-4f6e-a274-9c3b3a919cb0\" (UID: \"e8f28789-061f-4f6e-a274-9c3b3a919cb0\") "
Sep 09 13:56:07.810556 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:07.810487    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8f28789-061f-4f6e-a274-9c3b3a919cb0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e8f28789-061f-4f6e-a274-9c3b3a919cb0" (UID: "e8f28789-061f-4f6e-a274-9c3b3a919cb0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 13:56:07.810610 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:07.810575    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8f28789-061f-4f6e-a274-9c3b3a919cb0-istio-data" (OuterVolumeSpecName: "istio-data") pod "e8f28789-061f-4f6e-a274-9c3b3a919cb0" (UID: "e8f28789-061f-4f6e-a274-9c3b3a919cb0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 13:56:07.810610 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:07.810596    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8f28789-061f-4f6e-a274-9c3b3a919cb0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e8f28789-061f-4f6e-a274-9c3b3a919cb0" (UID: "e8f28789-061f-4f6e-a274-9c3b3a919cb0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 13:56:07.810756 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:07.810730    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8f28789-061f-4f6e-a274-9c3b3a919cb0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e8f28789-061f-4f6e-a274-9c3b3a919cb0" (UID: "e8f28789-061f-4f6e-a274-9c3b3a919cb0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 13:56:07.810906 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:07.810778    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8f28789-061f-4f6e-a274-9c3b3a919cb0-workload-certs\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:56:07.810906 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:07.810798    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8f28789-061f-4f6e-a274-9c3b3a919cb0-istiod-ca-cert\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:56:07.810906 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:07.810808    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8f28789-061f-4f6e-a274-9c3b3a919cb0-workload-socket\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:56:07.810906 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:07.810816    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8f28789-061f-4f6e-a274-9c3b3a919cb0-istio-data\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:56:07.812340 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:07.812314    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e8f28789-061f-4f6e-a274-9c3b3a919cb0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e8f28789-061f-4f6e-a274-9c3b3a919cb0" (UID: "e8f28789-061f-4f6e-a274-9c3b3a919cb0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 13:56:07.812492 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:07.812470    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8f28789-061f-4f6e-a274-9c3b3a919cb0-kube-api-access-47jsg" (OuterVolumeSpecName: "kube-api-access-47jsg") pod "e8f28789-061f-4f6e-a274-9c3b3a919cb0" (UID: "e8f28789-061f-4f6e-a274-9c3b3a919cb0"). InnerVolumeSpecName "kube-api-access-47jsg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 13:56:07.812681 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:07.812646    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8f28789-061f-4f6e-a274-9c3b3a919cb0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e8f28789-061f-4f6e-a274-9c3b3a919cb0" (UID: "e8f28789-061f-4f6e-a274-9c3b3a919cb0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 13:56:07.812764 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:07.812698    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8f28789-061f-4f6e-a274-9c3b3a919cb0-istio-token" (OuterVolumeSpecName: "istio-token") pod "e8f28789-061f-4f6e-a274-9c3b3a919cb0" (UID: "e8f28789-061f-4f6e-a274-9c3b3a919cb0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 13:56:07.911627 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:07.911549    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8f28789-061f-4f6e-a274-9c3b3a919cb0-credential-socket\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:56:07.911627 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:07.911577    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8f28789-061f-4f6e-a274-9c3b3a919cb0-istio-podinfo\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:56:07.911627 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:07.911587    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-47jsg\" (UniqueName: \"kubernetes.io/projected/e8f28789-061f-4f6e-a274-9c3b3a919cb0-kube-api-access-47jsg\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:56:07.911627 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:07.911595    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8f28789-061f-4f6e-a274-9c3b3a919cb0-istio-token\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:56:07.911627 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:07.911604    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8f28789-061f-4f6e-a274-9c3b3a919cb0-istio-envoy\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:56:08.144131 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:08.144098    2578 generic.go:356] "Generic (PLEG): container finished" podID="e8f28789-061f-4f6e-a274-9c3b3a919cb0" containerID="af9e0e11aa8a7883530166713255a03a9c62eea4d9725085e01e1a8e951a2dc2" exitCode=0
Sep 09 13:56:08.144351 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:08.144147    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9"
Sep 09 13:56:08.144351 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:08.144156    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9" event={"ID":"e8f28789-061f-4f6e-a274-9c3b3a919cb0","Type":"ContainerDied","Data":"af9e0e11aa8a7883530166713255a03a9c62eea4d9725085e01e1a8e951a2dc2"}
Sep 09 13:56:08.144351 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:08.144223    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9" event={"ID":"e8f28789-061f-4f6e-a274-9c3b3a919cb0","Type":"ContainerDied","Data":"ad47417f98ae461d49d7bf92241a54ddf83903051c6089f0ad75aeef39be1392"}
Sep 09 13:56:08.144351 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:08.144245    2578 scope.go:117] "RemoveContainer" containerID="af9e0e11aa8a7883530166713255a03a9c62eea4d9725085e01e1a8e951a2dc2"
Sep 09 13:56:08.153077 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:08.153060    2578 scope.go:117] "RemoveContainer" containerID="e60d979e70819f674828de6c024123388a7cee168e3b0fed0f3a23a92c94eee5"
Sep 09 13:56:08.161062 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:08.161039    2578 scope.go:117] "RemoveContainer" containerID="af9e0e11aa8a7883530166713255a03a9c62eea4d9725085e01e1a8e951a2dc2"
Sep 09 13:56:08.161331 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:56:08.161312    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af9e0e11aa8a7883530166713255a03a9c62eea4d9725085e01e1a8e951a2dc2\": container with ID starting with af9e0e11aa8a7883530166713255a03a9c62eea4d9725085e01e1a8e951a2dc2 not found: ID does not exist" containerID="af9e0e11aa8a7883530166713255a03a9c62eea4d9725085e01e1a8e951a2dc2"
Sep 09 13:56:08.161394 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:08.161338    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af9e0e11aa8a7883530166713255a03a9c62eea4d9725085e01e1a8e951a2dc2"} err="failed to get container status \"af9e0e11aa8a7883530166713255a03a9c62eea4d9725085e01e1a8e951a2dc2\": rpc error: code = NotFound desc = could not find container \"af9e0e11aa8a7883530166713255a03a9c62eea4d9725085e01e1a8e951a2dc2\": container with ID starting with af9e0e11aa8a7883530166713255a03a9c62eea4d9725085e01e1a8e951a2dc2 not found: ID does not exist"
Sep 09 13:56:08.161394 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:08.161354    2578 scope.go:117] "RemoveContainer" containerID="e60d979e70819f674828de6c024123388a7cee168e3b0fed0f3a23a92c94eee5"
Sep 09 13:56:08.161607 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:56:08.161589    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e60d979e70819f674828de6c024123388a7cee168e3b0fed0f3a23a92c94eee5\": container with ID starting with e60d979e70819f674828de6c024123388a7cee168e3b0fed0f3a23a92c94eee5 not found: ID does not exist" containerID="e60d979e70819f674828de6c024123388a7cee168e3b0fed0f3a23a92c94eee5"
Sep 09 13:56:08.161714 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:08.161609    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e60d979e70819f674828de6c024123388a7cee168e3b0fed0f3a23a92c94eee5"} err="failed to get container status \"e60d979e70819f674828de6c024123388a7cee168e3b0fed0f3a23a92c94eee5\": rpc error: code = NotFound desc = could not find container \"e60d979e70819f674828de6c024123388a7cee168e3b0fed0f3a23a92c94eee5\": container with ID starting with e60d979e70819f674828de6c024123388a7cee168e3b0fed0f3a23a92c94eee5 not found: ID does not exist"
Sep 09 13:56:08.166428 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:08.166408    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9"]
Sep 09 13:56:08.169518 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:08.169493    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-8f2df2-openshift-default-57b44cd856-wwwz9"]
Sep 09 13:56:08.662031 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:08.662001    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8f28789-061f-4f6e-a274-9c3b3a919cb0" path="/var/lib/kubelet/pods/e8f28789-061f-4f6e-a274-9c3b3a919cb0/volumes"
Sep 09 13:56:13.305601 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:13.305561    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:56:13.356247 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:13.356211    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-df48ae-7d4cfcd78-qpwqf"]
Sep 09 13:56:13.356513 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:13.356466    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-df48ae-7d4cfcd78-qpwqf" podUID="c55f4880-614b-4be0-bf2a-ec2302571381" containerName="payload-pre-processing" containerID="cri-o://9205609cf2dbb540bafd2e5b0897a9c16146a19069a85bfc3e790e7fbd658478" gracePeriod=30
Sep 09 13:56:13.379375 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:13.379340    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:56:13.446040 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:13.445996    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:56:13.529555 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:13.529528    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-df48ae-zd67v"]
Sep 09 13:56:13.532977 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:13.532956    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-df48ae-zd67v"]
Sep 09 13:56:13.553624 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:13.553593    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:56:13.602057 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:13.602031    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-df48ae-7d4cfcd78-qpwqf"
Sep 09 13:56:13.636483 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:13.636449    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:56:13.762406 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:13.762373    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m5b7r\" (UniqueName: \"kubernetes.io/projected/c55f4880-614b-4be0-bf2a-ec2302571381-kube-api-access-m5b7r\") pod \"c55f4880-614b-4be0-bf2a-ec2302571381\" (UID: \"c55f4880-614b-4be0-bf2a-ec2302571381\") "
Sep 09 13:56:13.762563 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:13.762418    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c55f4880-614b-4be0-bf2a-ec2302571381-plugins-config-volume\") pod \"c55f4880-614b-4be0-bf2a-ec2302571381\" (UID: \"c55f4880-614b-4be0-bf2a-ec2302571381\") "
Sep 09 13:56:13.762812 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:13.762788    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c55f4880-614b-4be0-bf2a-ec2302571381-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c55f4880-614b-4be0-bf2a-ec2302571381" (UID: "c55f4880-614b-4be0-bf2a-ec2302571381"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 13:56:13.764535 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:13.764512    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c55f4880-614b-4be0-bf2a-ec2302571381-kube-api-access-m5b7r" (OuterVolumeSpecName: "kube-api-access-m5b7r") pod "c55f4880-614b-4be0-bf2a-ec2302571381" (UID: "c55f4880-614b-4be0-bf2a-ec2302571381"). InnerVolumeSpecName "kube-api-access-m5b7r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 13:56:13.863715 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:13.863632    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m5b7r\" (UniqueName: \"kubernetes.io/projected/c55f4880-614b-4be0-bf2a-ec2302571381-kube-api-access-m5b7r\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:56:13.863715 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:13.863660    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c55f4880-614b-4be0-bf2a-ec2302571381-plugins-config-volume\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 13:56:13.899718 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:13.899670    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:56:14.174896 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:14.174861    2578 generic.go:356] "Generic (PLEG): container finished" podID="c55f4880-614b-4be0-bf2a-ec2302571381" containerID="9205609cf2dbb540bafd2e5b0897a9c16146a19069a85bfc3e790e7fbd658478" exitCode=0
Sep 09 13:56:14.175069 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:14.174906    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-df48ae-7d4cfcd78-qpwqf"
Sep 09 13:56:14.175069 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:14.174897    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-df48ae-7d4cfcd78-qpwqf" event={"ID":"c55f4880-614b-4be0-bf2a-ec2302571381","Type":"ContainerDied","Data":"9205609cf2dbb540bafd2e5b0897a9c16146a19069a85bfc3e790e7fbd658478"}
Sep 09 13:56:14.175069 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:14.175053    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-df48ae-7d4cfcd78-qpwqf" event={"ID":"c55f4880-614b-4be0-bf2a-ec2302571381","Type":"ContainerDied","Data":"e85497cbf099ffa6bbc81cff47a778f2474cd67d2c5f8a3cc42782317e1bf92e"}
Sep 09 13:56:14.175204 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:14.175090    2578 scope.go:117] "RemoveContainer" containerID="9205609cf2dbb540bafd2e5b0897a9c16146a19069a85bfc3e790e7fbd658478"
Sep 09 13:56:14.184030 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:14.184002    2578 scope.go:117] "RemoveContainer" containerID="9205609cf2dbb540bafd2e5b0897a9c16146a19069a85bfc3e790e7fbd658478"
Sep 09 13:56:14.184362 ip-10-0-135-192 kubenswrapper[2578]: E0909 13:56:14.184345    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9205609cf2dbb540bafd2e5b0897a9c16146a19069a85bfc3e790e7fbd658478\": container with ID starting with 9205609cf2dbb540bafd2e5b0897a9c16146a19069a85bfc3e790e7fbd658478 not found: ID does not exist" containerID="9205609cf2dbb540bafd2e5b0897a9c16146a19069a85bfc3e790e7fbd658478"
Sep 09 13:56:14.184433 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:14.184373    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9205609cf2dbb540bafd2e5b0897a9c16146a19069a85bfc3e790e7fbd658478"} err="failed to get container status \"9205609cf2dbb540bafd2e5b0897a9c16146a19069a85bfc3e790e7fbd658478\": rpc error: code = NotFound desc = could not find container \"9205609cf2dbb540bafd2e5b0897a9c16146a19069a85bfc3e790e7fbd658478\": container with ID starting with 9205609cf2dbb540bafd2e5b0897a9c16146a19069a85bfc3e790e7fbd658478 not found: ID does not exist"
Sep 09 13:56:14.197038 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:14.197014    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-df48ae-7d4cfcd78-qpwqf"]
Sep 09 13:56:14.200571 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:14.200549    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-df48ae-7d4cfcd78-qpwqf"]
Sep 09 13:56:14.661564 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:14.661531    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5be5f00-412e-422a-a854-cd25705f9561" path="/var/lib/kubelet/pods/b5be5f00-412e-422a-a854-cd25705f9561/volumes"
Sep 09 13:56:14.661913 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:14.661880    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c55f4880-614b-4be0-bf2a-ec2302571381" path="/var/lib/kubelet/pods/c55f4880-614b-4be0-bf2a-ec2302571381/volumes"
Sep 09 13:56:16.165923 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:16.165885    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:56:20.117930 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:20.117899    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:56:20.194156 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:20.194109    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:56:20.465456 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:20.465424    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:56:24.261203 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:24.261151    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:56:28.904921 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:28.904888    2578 scope.go:117] "RemoveContainer" containerID="44c5365f85a56418ade64787dcdc81489f5213d1e128cb2b3da827798c6acb26"
Sep 09 13:56:52.622232 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:56:52.622161    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:57:34.115972 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:57:34.115934    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:57:34.222096 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:57:34.222058    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:57:45.169748 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:57:45.169709    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:57:46.073566 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:57:46.073532    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:57:46.920555 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:57:46.920520    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:57:49.518081 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:57:49.518048    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:58:02.217432 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:58:02.217357    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 13:58:11.834339 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:58:11.834303    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:58:19.790086 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:58:19.790046    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:58:27.030057 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:58:27.030020    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:58:35.417590 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:58:35.417552    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:58:47.710649 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:58:47.710612    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:58:54.788089 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:58:54.788048    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:59:02.635151 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:59:02.635116    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 13:59:16.034776 ip-10-0-135-192 kubenswrapper[2578]: I0909 13:59:16.034736    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 14:00:00.219728 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:00:00.219685    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29816040-b9t9q"]
Sep 09 14:00:00.220239 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:00:00.220033    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8f28789-061f-4f6e-a274-9c3b3a919cb0" containerName="istio-proxy"
Sep 09 14:00:00.220239 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:00:00.220045    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8f28789-061f-4f6e-a274-9c3b3a919cb0" containerName="istio-proxy"
Sep 09 14:00:00.220239 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:00:00.220055    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74d17a49-1d9e-4f3a-9d97-c2a155d0ea24" containerName="istio-proxy"
Sep 09 14:00:00.220239 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:00:00.220062    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="74d17a49-1d9e-4f3a-9d97-c2a155d0ea24" containerName="istio-proxy"
Sep 09 14:00:00.220239 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:00:00.220075    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c55f4880-614b-4be0-bf2a-ec2302571381" containerName="payload-pre-processing"
Sep 09 14:00:00.220239 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:00:00.220080    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c55f4880-614b-4be0-bf2a-ec2302571381" containerName="payload-pre-processing"
Sep 09 14:00:00.220239 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:00:00.220093    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5be5f00-412e-422a-a854-cd25705f9561" containerName="revoke-keys"
Sep 09 14:00:00.220239 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:00:00.220098    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5be5f00-412e-422a-a854-cd25705f9561" containerName="revoke-keys"
Sep 09 14:00:00.220239 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:00:00.220151    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8f28789-061f-4f6e-a274-9c3b3a919cb0" containerName="istio-proxy"
Sep 09 14:00:00.220239 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:00:00.220158    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c55f4880-614b-4be0-bf2a-ec2302571381" containerName="payload-pre-processing"
Sep 09 14:00:00.220239 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:00:00.220165    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5be5f00-412e-422a-a854-cd25705f9561" containerName="revoke-keys"
Sep 09 14:00:00.220239 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:00:00.220192    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8f28789-061f-4f6e-a274-9c3b3a919cb0" containerName="istio-proxy"
Sep 09 14:00:00.223107 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:00:00.223088    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816040-b9t9q"
Sep 09 14:00:00.232504 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:00:00.232478    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-lh487\""
Sep 09 14:00:00.233046 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:00:00.233029    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816040-b9t9q"
Sep 09 14:00:00.259985 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:00:00.259924    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29816040-b9t9q"]
Sep 09 14:00:00.551126 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:00:00.551042    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29816040-b9t9q"]
Sep 09 14:00:00.555365 ip-10-0-135-192 kubenswrapper[2578]: W0909 14:00:00.555337    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50363ebf_f025_4694_983b_e79a1729af4b.slice/crio-986609de414daeefe441b76ff7703d6b2838b447bc1dde40a67a6742e61f79c0 WatchSource:0}: Error finding container 986609de414daeefe441b76ff7703d6b2838b447bc1dde40a67a6742e61f79c0: Status 404 returned error can't find the container with id 986609de414daeefe441b76ff7703d6b2838b447bc1dde40a67a6742e61f79c0
Sep 09 14:00:01.176225 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:00:01.176190    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816040-b9t9q" event={"ID":"50363ebf-f025-4694-983b-e79a1729af4b","Type":"ContainerStarted","Data":"2e09ec47456d2def9b2c77e2561ba6c03718006f2a1110a53b4fd736cdea8f2d"}
Sep 09 14:00:01.176410 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:00:01.176267    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816040-b9t9q" event={"ID":"50363ebf-f025-4694-983b-e79a1729af4b","Type":"ContainerStarted","Data":"986609de414daeefe441b76ff7703d6b2838b447bc1dde40a67a6742e61f79c0"}
Sep 09 14:00:01.216663 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:00:01.216610    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816040-b9t9q" podStartSLOduration=1.216595022 podStartE2EDuration="1.216595022s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:00:01.21436274 +0000 UTC m=+2013.029886934" watchObservedRunningTime="2026-09-09 14:00:01.216595022 +0000 UTC m=+2013.032119216"
Sep 09 14:00:02.181980 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:00:02.181944    2578 generic.go:356] "Generic (PLEG): container finished" podID="50363ebf-f025-4694-983b-e79a1729af4b" containerID="2e09ec47456d2def9b2c77e2561ba6c03718006f2a1110a53b4fd736cdea8f2d" exitCode=0
Sep 09 14:00:02.182416 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:00:02.182027    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816040-b9t9q" event={"ID":"50363ebf-f025-4694-983b-e79a1729af4b","Type":"ContainerDied","Data":"2e09ec47456d2def9b2c77e2561ba6c03718006f2a1110a53b4fd736cdea8f2d"}
Sep 09 14:00:03.314952 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:00:03.314922    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816040-b9t9q"
Sep 09 14:00:04.192520 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:00:04.192489    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816040-b9t9q"
Sep 09 14:00:04.192520 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:00:04.192497    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816040-b9t9q" event={"ID":"50363ebf-f025-4694-983b-e79a1729af4b","Type":"ContainerDied","Data":"986609de414daeefe441b76ff7703d6b2838b447bc1dde40a67a6742e61f79c0"}
Sep 09 14:00:04.192741 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:00:04.192547    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="986609de414daeefe441b76ff7703d6b2838b447bc1dde40a67a6742e61f79c0"
Sep 09 14:00:43.681394 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:00:43.681356    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 14:00:52.691016 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:00:52.690933    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 14:00:59.252585 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:00:59.252533    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 14:01:02.119792 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:01:02.119752    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 14:01:26.097360 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:01:26.097328    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 14:01:28.998718 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:01:28.998681    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 14:01:48.670230 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:01:48.670193    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 14:01:50.334888 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:01:50.334855    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 14:01:50.877753 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:01:50.877720    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 14:01:50.936025 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:01:50.935995    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 14:01:58.480540 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:01:58.480507    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 14:02:06.276492 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:06.276460    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 14:02:06.606486 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:06.606390    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6b4b89c5b5-vqtbl"]
Sep 09 14:02:06.606850 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:06.606831    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8f28789-061f-4f6e-a274-9c3b3a919cb0" containerName="istio-proxy"
Sep 09 14:02:06.606939 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:06.606854    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8f28789-061f-4f6e-a274-9c3b3a919cb0" containerName="istio-proxy"
Sep 09 14:02:06.606939 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:06.606894    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50363ebf-f025-4694-983b-e79a1729af4b" containerName="cleanup"
Sep 09 14:02:06.606939 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:06.606904    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="50363ebf-f025-4694-983b-e79a1729af4b" containerName="cleanup"
Sep 09 14:02:06.607089 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:06.606982    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="50363ebf-f025-4694-983b-e79a1729af4b" containerName="cleanup"
Sep 09 14:02:06.610007 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:06.609985    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6b4b89c5b5-vqtbl"
Sep 09 14:02:06.612213 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:06.612186    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-8585bfb869-c5mlq"]
Sep 09 14:02:06.615471 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:06.615453    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-8585bfb869-c5mlq"
Sep 09 14:02:06.619368 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:06.619348    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 09 14:02:06.619621 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:06.619602    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-s8jj8\""
Sep 09 14:02:06.619744 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:06.619611    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 09 14:02:06.619744 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:06.619623    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 09 14:02:06.619866 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:06.619634    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 09 14:02:06.635206 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:06.635157    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6b4b89c5b5-vqtbl"]
Sep 09 14:02:06.636809 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:06.636786    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-8585bfb869-c5mlq"]
Sep 09 14:02:06.653801 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:06.653773    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f475858f-2a5e-4874-9cea-38f4c4833954-openshift-service-ca\") pod \"maas-api-8585bfb869-c5mlq\" (UID: \"f475858f-2a5e-4874-9cea-38f4c4833954\") " pod="odh-ai-gateway-infra/maas-api-8585bfb869-c5mlq"
Sep 09 14:02:06.653970 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:06.653820    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe44fd67-757c-41cf-9a5e-e064d65afef8-metrics-certs\") pod \"maas-api-6b4b89c5b5-vqtbl\" (UID: \"fe44fd67-757c-41cf-9a5e-e064d65afef8\") " pod="odh-ai-gateway-infra/maas-api-6b4b89c5b5-vqtbl"
Sep 09 14:02:06.653970 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:06.653849    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f475858f-2a5e-4874-9cea-38f4c4833954-maas-api-tls\") pod \"maas-api-8585bfb869-c5mlq\" (UID: \"f475858f-2a5e-4874-9cea-38f4c4833954\") " pod="odh-ai-gateway-infra/maas-api-8585bfb869-c5mlq"
Sep 09 14:02:06.653970 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:06.653871    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe44fd67-757c-41cf-9a5e-e064d65afef8-maas-api-tls\") pod \"maas-api-6b4b89c5b5-vqtbl\" (UID: \"fe44fd67-757c-41cf-9a5e-e064d65afef8\") " pod="odh-ai-gateway-infra/maas-api-6b4b89c5b5-vqtbl"
Sep 09 14:02:06.653970 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:06.653896    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe44fd67-757c-41cf-9a5e-e064d65afef8-openshift-service-ca\") pod \"maas-api-6b4b89c5b5-vqtbl\" (UID: \"fe44fd67-757c-41cf-9a5e-e064d65afef8\") " pod="odh-ai-gateway-infra/maas-api-6b4b89c5b5-vqtbl"
Sep 09 14:02:06.653970 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:06.653929    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8gss\" (UniqueName: \"kubernetes.io/projected/fe44fd67-757c-41cf-9a5e-e064d65afef8-kube-api-access-d8gss\") pod \"maas-api-6b4b89c5b5-vqtbl\" (UID: \"fe44fd67-757c-41cf-9a5e-e064d65afef8\") " pod="odh-ai-gateway-infra/maas-api-6b4b89c5b5-vqtbl"
Sep 09 14:02:06.653970 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:06.653949    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f475858f-2a5e-4874-9cea-38f4c4833954-metrics-certs\") pod \"maas-api-8585bfb869-c5mlq\" (UID: \"f475858f-2a5e-4874-9cea-38f4c4833954\") " pod="odh-ai-gateway-infra/maas-api-8585bfb869-c5mlq"
Sep 09 14:02:06.654168 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:06.653981    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxnx2\" (UniqueName: \"kubernetes.io/projected/f475858f-2a5e-4874-9cea-38f4c4833954-kube-api-access-cxnx2\") pod \"maas-api-8585bfb869-c5mlq\" (UID: \"f475858f-2a5e-4874-9cea-38f4c4833954\") " pod="odh-ai-gateway-infra/maas-api-8585bfb869-c5mlq"
Sep 09 14:02:06.755278 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:06.755249    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxnx2\" (UniqueName: \"kubernetes.io/projected/f475858f-2a5e-4874-9cea-38f4c4833954-kube-api-access-cxnx2\") pod \"maas-api-8585bfb869-c5mlq\" (UID: \"f475858f-2a5e-4874-9cea-38f4c4833954\") " pod="odh-ai-gateway-infra/maas-api-8585bfb869-c5mlq"
Sep 09 14:02:06.755491 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:06.755333    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f475858f-2a5e-4874-9cea-38f4c4833954-openshift-service-ca\") pod \"maas-api-8585bfb869-c5mlq\" (UID: \"f475858f-2a5e-4874-9cea-38f4c4833954\") " pod="odh-ai-gateway-infra/maas-api-8585bfb869-c5mlq"
Sep 09 14:02:06.755491 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:06.755412    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe44fd67-757c-41cf-9a5e-e064d65afef8-metrics-certs\") pod \"maas-api-6b4b89c5b5-vqtbl\" (UID: \"fe44fd67-757c-41cf-9a5e-e064d65afef8\") " pod="odh-ai-gateway-infra/maas-api-6b4b89c5b5-vqtbl"
Sep 09 14:02:06.755620 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:06.755535    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f475858f-2a5e-4874-9cea-38f4c4833954-maas-api-tls\") pod \"maas-api-8585bfb869-c5mlq\" (UID: \"f475858f-2a5e-4874-9cea-38f4c4833954\") " pod="odh-ai-gateway-infra/maas-api-8585bfb869-c5mlq"
Sep 09 14:02:06.755620 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:06.755562    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe44fd67-757c-41cf-9a5e-e064d65afef8-maas-api-tls\") pod \"maas-api-6b4b89c5b5-vqtbl\" (UID: \"fe44fd67-757c-41cf-9a5e-e064d65afef8\") " pod="odh-ai-gateway-infra/maas-api-6b4b89c5b5-vqtbl"
Sep 09 14:02:06.755620 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:06.755609    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe44fd67-757c-41cf-9a5e-e064d65afef8-openshift-service-ca\") pod \"maas-api-6b4b89c5b5-vqtbl\" (UID: \"fe44fd67-757c-41cf-9a5e-e064d65afef8\") " pod="odh-ai-gateway-infra/maas-api-6b4b89c5b5-vqtbl"
Sep 09 14:02:06.755881 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:06.755854    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8gss\" (UniqueName: \"kubernetes.io/projected/fe44fd67-757c-41cf-9a5e-e064d65afef8-kube-api-access-d8gss\") pod \"maas-api-6b4b89c5b5-vqtbl\" (UID: \"fe44fd67-757c-41cf-9a5e-e064d65afef8\") " pod="odh-ai-gateway-infra/maas-api-6b4b89c5b5-vqtbl"
Sep 09 14:02:06.755956 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:06.755933    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f475858f-2a5e-4874-9cea-38f4c4833954-metrics-certs\") pod \"maas-api-8585bfb869-c5mlq\" (UID: \"f475858f-2a5e-4874-9cea-38f4c4833954\") " pod="odh-ai-gateway-infra/maas-api-8585bfb869-c5mlq"
Sep 09 14:02:06.756797 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:06.756159    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f475858f-2a5e-4874-9cea-38f4c4833954-openshift-service-ca\") pod \"maas-api-8585bfb869-c5mlq\" (UID: \"f475858f-2a5e-4874-9cea-38f4c4833954\") " pod="odh-ai-gateway-infra/maas-api-8585bfb869-c5mlq"
Sep 09 14:02:06.756797 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:06.756534    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe44fd67-757c-41cf-9a5e-e064d65afef8-openshift-service-ca\") pod \"maas-api-6b4b89c5b5-vqtbl\" (UID: \"fe44fd67-757c-41cf-9a5e-e064d65afef8\") " pod="odh-ai-gateway-infra/maas-api-6b4b89c5b5-vqtbl"
Sep 09 14:02:06.758460 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:06.758428    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe44fd67-757c-41cf-9a5e-e064d65afef8-metrics-certs\") pod \"maas-api-6b4b89c5b5-vqtbl\" (UID: \"fe44fd67-757c-41cf-9a5e-e064d65afef8\") " pod="odh-ai-gateway-infra/maas-api-6b4b89c5b5-vqtbl"
Sep 09 14:02:06.758579 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:06.758560    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f475858f-2a5e-4874-9cea-38f4c4833954-maas-api-tls\") pod \"maas-api-8585bfb869-c5mlq\" (UID: \"f475858f-2a5e-4874-9cea-38f4c4833954\") " pod="odh-ai-gateway-infra/maas-api-8585bfb869-c5mlq"
Sep 09 14:02:06.758620 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:06.758586    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe44fd67-757c-41cf-9a5e-e064d65afef8-maas-api-tls\") pod \"maas-api-6b4b89c5b5-vqtbl\" (UID: \"fe44fd67-757c-41cf-9a5e-e064d65afef8\") " pod="odh-ai-gateway-infra/maas-api-6b4b89c5b5-vqtbl"
Sep 09 14:02:06.758928 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:06.758911    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f475858f-2a5e-4874-9cea-38f4c4833954-metrics-certs\") pod \"maas-api-8585bfb869-c5mlq\" (UID: \"f475858f-2a5e-4874-9cea-38f4c4833954\") " pod="odh-ai-gateway-infra/maas-api-8585bfb869-c5mlq"
Sep 09 14:02:06.765009 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:06.764986    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxnx2\" (UniqueName: \"kubernetes.io/projected/f475858f-2a5e-4874-9cea-38f4c4833954-kube-api-access-cxnx2\") pod \"maas-api-8585bfb869-c5mlq\" (UID: \"f475858f-2a5e-4874-9cea-38f4c4833954\") " pod="odh-ai-gateway-infra/maas-api-8585bfb869-c5mlq"
Sep 09 14:02:06.765094 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:06.765066    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8gss\" (UniqueName: \"kubernetes.io/projected/fe44fd67-757c-41cf-9a5e-e064d65afef8-kube-api-access-d8gss\") pod \"maas-api-6b4b89c5b5-vqtbl\" (UID: \"fe44fd67-757c-41cf-9a5e-e064d65afef8\") " pod="odh-ai-gateway-infra/maas-api-6b4b89c5b5-vqtbl"
Sep 09 14:02:06.922819 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:06.922780    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6b4b89c5b5-vqtbl"
Sep 09 14:02:06.928425 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:06.928400    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-8585bfb869-c5mlq"
Sep 09 14:02:07.209707 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:07.209678    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6b4b89c5b5-vqtbl"]
Sep 09 14:02:07.211473 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:07.211449    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-8585bfb869-c5mlq"]
Sep 09 14:02:07.211632 ip-10-0-135-192 kubenswrapper[2578]: W0909 14:02:07.211608    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe44fd67_757c_41cf_9a5e_e064d65afef8.slice/crio-84d6de807a663a86c981013bacaa49a0d3df2e396f61726de2479e4b1f41bc4b WatchSource:0}: Error finding container 84d6de807a663a86c981013bacaa49a0d3df2e396f61726de2479e4b1f41bc4b: Status 404 returned error can't find the container with id 84d6de807a663a86c981013bacaa49a0d3df2e396f61726de2479e4b1f41bc4b
Sep 09 14:02:07.213313 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:07.213290    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 14:02:07.213429 ip-10-0-135-192 kubenswrapper[2578]: W0909 14:02:07.213383    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf475858f_2a5e_4874_9cea_38f4c4833954.slice/crio-362e56a6012d52cb96c46316f9ade5f6e7b559c9cc1f571089b35e8db028f534 WatchSource:0}: Error finding container 362e56a6012d52cb96c46316f9ade5f6e7b559c9cc1f571089b35e8db028f534: Status 404 returned error can't find the container with id 362e56a6012d52cb96c46316f9ade5f6e7b559c9cc1f571089b35e8db028f534
Sep 09 14:02:07.755254 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:07.755217    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-8585bfb869-c5mlq" event={"ID":"f475858f-2a5e-4874-9cea-38f4c4833954","Type":"ContainerStarted","Data":"362e56a6012d52cb96c46316f9ade5f6e7b559c9cc1f571089b35e8db028f534"}
Sep 09 14:02:07.756394 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:07.756372    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6b4b89c5b5-vqtbl" event={"ID":"fe44fd67-757c-41cf-9a5e-e064d65afef8","Type":"ContainerStarted","Data":"84d6de807a663a86c981013bacaa49a0d3df2e396f61726de2479e4b1f41bc4b"}
Sep 09 14:02:08.762550 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:08.762509    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-8585bfb869-c5mlq" event={"ID":"f475858f-2a5e-4874-9cea-38f4c4833954","Type":"ContainerStarted","Data":"b542ff11e6e3c0b5a04cb2d70083bf0f6fbbac8842623d523e9284e93332840c"}
Sep 09 14:02:08.763007 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:08.762610    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-8585bfb869-c5mlq"
Sep 09 14:02:08.764138 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:08.764117    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6b4b89c5b5-vqtbl" event={"ID":"fe44fd67-757c-41cf-9a5e-e064d65afef8","Type":"ContainerStarted","Data":"566f0af84ad07c4efcc34dc0c36ba3dceb844474dc408ffd60b4e6132cb985ef"}
Sep 09 14:02:08.764221 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:08.764168    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6b4b89c5b5-vqtbl"
Sep 09 14:02:08.787061 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:08.787003    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-8585bfb869-c5mlq" podStartSLOduration=2.284360594 podStartE2EDuration="2.786984108s" totalImagesPullingTime="502.623514ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:02:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:02:08.785644028 +0000 UTC m=+2140.601168221" watchObservedRunningTime="2026-09-09 14:02:08.786984108 +0000 UTC m=+2140.602508301"
Sep 09 14:02:08.820882 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:08.820827    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6b4b89c5b5-vqtbl" podStartSLOduration=2.058279477 podStartE2EDuration="2.820808639s" totalImagesPullingTime="762.529162ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:02:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:02:08.819265915 +0000 UTC m=+2140.634790112" watchObservedRunningTime="2026-09-09 14:02:08.820808639 +0000 UTC m=+2140.636332830"
Sep 09 14:02:14.066769 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:14.066727    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 14:02:14.774113 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:14.774080    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6b4b89c5b5-vqtbl"
Sep 09 14:02:14.774498 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:14.774479    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-8585bfb869-c5mlq"
Sep 09 14:02:14.853630 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:14.853593    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6b4b89c5b5-vqtbl"]
Sep 09 14:02:14.853834 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:14.853786    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-6b4b89c5b5-vqtbl" podUID="fe44fd67-757c-41cf-9a5e-e064d65afef8" containerName="maas-api" containerID="cri-o://566f0af84ad07c4efcc34dc0c36ba3dceb844474dc408ffd60b4e6132cb985ef" gracePeriod=30
Sep 09 14:02:15.098500 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:15.098473    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6b4b89c5b5-vqtbl"
Sep 09 14:02:15.235815 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:15.235773    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe44fd67-757c-41cf-9a5e-e064d65afef8-openshift-service-ca\") pod \"fe44fd67-757c-41cf-9a5e-e064d65afef8\" (UID: \"fe44fd67-757c-41cf-9a5e-e064d65afef8\") "
Sep 09 14:02:15.235986 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:15.235828    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe44fd67-757c-41cf-9a5e-e064d65afef8-metrics-certs\") pod \"fe44fd67-757c-41cf-9a5e-e064d65afef8\" (UID: \"fe44fd67-757c-41cf-9a5e-e064d65afef8\") "
Sep 09 14:02:15.235986 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:15.235921    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe44fd67-757c-41cf-9a5e-e064d65afef8-maas-api-tls\") pod \"fe44fd67-757c-41cf-9a5e-e064d65afef8\" (UID: \"fe44fd67-757c-41cf-9a5e-e064d65afef8\") "
Sep 09 14:02:15.235986 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:15.235945    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d8gss\" (UniqueName: \"kubernetes.io/projected/fe44fd67-757c-41cf-9a5e-e064d65afef8-kube-api-access-d8gss\") pod \"fe44fd67-757c-41cf-9a5e-e064d65afef8\" (UID: \"fe44fd67-757c-41cf-9a5e-e064d65afef8\") "
Sep 09 14:02:15.236236 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:15.236212    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe44fd67-757c-41cf-9a5e-e064d65afef8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fe44fd67-757c-41cf-9a5e-e064d65afef8" (UID: "fe44fd67-757c-41cf-9a5e-e064d65afef8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:02:15.238033 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:15.238003    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe44fd67-757c-41cf-9a5e-e064d65afef8-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "fe44fd67-757c-41cf-9a5e-e064d65afef8" (UID: "fe44fd67-757c-41cf-9a5e-e064d65afef8"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 14:02:15.238135 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:15.238054    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe44fd67-757c-41cf-9a5e-e064d65afef8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fe44fd67-757c-41cf-9a5e-e064d65afef8" (UID: "fe44fd67-757c-41cf-9a5e-e064d65afef8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 14:02:15.238135 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:15.238074    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe44fd67-757c-41cf-9a5e-e064d65afef8-kube-api-access-d8gss" (OuterVolumeSpecName: "kube-api-access-d8gss") pod "fe44fd67-757c-41cf-9a5e-e064d65afef8" (UID: "fe44fd67-757c-41cf-9a5e-e064d65afef8"). InnerVolumeSpecName "kube-api-access-d8gss". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:02:15.336863 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:15.336781    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe44fd67-757c-41cf-9a5e-e064d65afef8-metrics-certs\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 14:02:15.336863 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:15.336811    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe44fd67-757c-41cf-9a5e-e064d65afef8-maas-api-tls\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 14:02:15.336863 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:15.336819    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d8gss\" (UniqueName: \"kubernetes.io/projected/fe44fd67-757c-41cf-9a5e-e064d65afef8-kube-api-access-d8gss\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 14:02:15.336863 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:15.336829    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe44fd67-757c-41cf-9a5e-e064d65afef8-openshift-service-ca\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 09 14:02:15.796720 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:15.796685    2578 generic.go:356] "Generic (PLEG): container finished" podID="fe44fd67-757c-41cf-9a5e-e064d65afef8" containerID="566f0af84ad07c4efcc34dc0c36ba3dceb844474dc408ffd60b4e6132cb985ef" exitCode=0
Sep 09 14:02:15.796890 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:15.796736    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6b4b89c5b5-vqtbl"
Sep 09 14:02:15.796890 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:15.796768    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6b4b89c5b5-vqtbl" event={"ID":"fe44fd67-757c-41cf-9a5e-e064d65afef8","Type":"ContainerDied","Data":"566f0af84ad07c4efcc34dc0c36ba3dceb844474dc408ffd60b4e6132cb985ef"}
Sep 09 14:02:15.796890 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:15.796822    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6b4b89c5b5-vqtbl" event={"ID":"fe44fd67-757c-41cf-9a5e-e064d65afef8","Type":"ContainerDied","Data":"84d6de807a663a86c981013bacaa49a0d3df2e396f61726de2479e4b1f41bc4b"}
Sep 09 14:02:15.796890 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:15.796844    2578 scope.go:117] "RemoveContainer" containerID="566f0af84ad07c4efcc34dc0c36ba3dceb844474dc408ffd60b4e6132cb985ef"
Sep 09 14:02:15.806352 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:15.806336    2578 scope.go:117] "RemoveContainer" containerID="566f0af84ad07c4efcc34dc0c36ba3dceb844474dc408ffd60b4e6132cb985ef"
Sep 09 14:02:15.806613 ip-10-0-135-192 kubenswrapper[2578]: E0909 14:02:15.806594    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"566f0af84ad07c4efcc34dc0c36ba3dceb844474dc408ffd60b4e6132cb985ef\": container with ID starting with 566f0af84ad07c4efcc34dc0c36ba3dceb844474dc408ffd60b4e6132cb985ef not found: ID does not exist" containerID="566f0af84ad07c4efcc34dc0c36ba3dceb844474dc408ffd60b4e6132cb985ef"
Sep 09 14:02:15.806672 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:15.806621    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"566f0af84ad07c4efcc34dc0c36ba3dceb844474dc408ffd60b4e6132cb985ef"} err="failed to get container status \"566f0af84ad07c4efcc34dc0c36ba3dceb844474dc408ffd60b4e6132cb985ef\": rpc error: code = NotFound desc = could not find container \"566f0af84ad07c4efcc34dc0c36ba3dceb844474dc408ffd60b4e6132cb985ef\": container with ID starting with 566f0af84ad07c4efcc34dc0c36ba3dceb844474dc408ffd60b4e6132cb985ef not found: ID does not exist"
Sep 09 14:02:15.820287 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:15.820262    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6b4b89c5b5-vqtbl"]
Sep 09 14:02:15.825858 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:15.825837    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-6b4b89c5b5-vqtbl"]
Sep 09 14:02:16.660498 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:16.660465    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe44fd67-757c-41cf-9a5e-e064d65afef8" path="/var/lib/kubelet/pods/fe44fd67-757c-41cf-9a5e-e064d65afef8/volumes"
Sep 09 14:02:21.070529 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:21.070446    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 14:02:27.274763 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:27.274724    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 14:02:28.970903 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:28.970868    2578 scope.go:117] "RemoveContainer" containerID="feb623494703de025d88087bf13f9d2ab10755bda5096037e0ac72013ae6feb5"
Sep 09 14:02:33.470802 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:33.470763    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-xw4kv"]
Sep 09 14:02:42.476349 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:42.476311    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8469c9486d-6j8ld_9cf8ff24-1a89-4f63-a188-ddccaf2f8720/manager/0.log"
Sep 09 14:02:42.485294 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:42.485271    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8469c9486d-6j8ld_9cf8ff24-1a89-4f63-a188-ddccaf2f8720/copy-manifests/0.log"
Sep 09 14:02:43.153041 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:43.153004    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-8585bfb869-c5mlq_f475858f-2a5e-4874-9cea-38f4c4833954/maas-api/0.log"
Sep 09 14:02:43.480201 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:43.480110    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29816040-b9t9q_50363ebf-f025-4694-983b-e79a1729af4b/cleanup/0.log"
Sep 09 14:02:44.947450 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:44.947421    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-xw4kv_db09cae3-6550-4ea9-ac30-f10ebf24a23b/limitador/0.log"
Sep 09 14:02:45.527260 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:45.527229    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-nd4b5_919b3366-f8a5-48e6-a58e-51a3f5622f79/discovery/0.log"
Sep 09 14:02:46.544867 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:46.544832    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-jprjq_8814be59-4761-45d8-9c50-955f0a3c8256/main/0.log"
Sep 09 14:02:46.998468 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:46.998441    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftq2bj_eb96ae20-f118-47ca-9435-94704ad28a2e/main/0.log"
Sep 09 14:02:47.113980 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:47.113941    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-hh9ps_3587eab6-1c91-4a54-b13c-6c9e8785b847/main/0.log"
Sep 09 14:02:52.560953 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:52.560911    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 14:02:55.523312 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:55.523269    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-zqjnb_4f418699-7dc7-4c31-b9b1-e5612f362ce2/global-pull-secret-syncer/0.log"
Sep 09 14:02:55.580653 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:55.580615    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log"
Sep 09 14:02:55.716810 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:55.716785    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-192.ec2.internal_d1c78154c3f34dfed8a9e280b4b66a37/haproxy/0.log"
Sep 09 14:02:55.742615 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:02:55.742570    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpm7_4d6ead4a-74e5-40e3-a070-c1a9f49c78c8/konnectivity-agent/0.log" limit=1024
Sep 09 14:03:00.507749 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:00.507720    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-xw4kv_db09cae3-6550-4ea9-ac30-f10ebf24a23b/limitador/0.log"
Sep 09 14:03:02.647770 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:02.647743    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ztdz2_451fab74-793e-41e2-8d31-c868d074948c/node-exporter/0.log"
Sep 09 14:03:02.674198 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:02.674152    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ztdz2_451fab74-793e-41e2-8d31-c868d074948c/kube-rbac-proxy/0.log"
Sep 09 14:03:02.693044 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:02.693023    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ztdz2_451fab74-793e-41e2-8d31-c868d074948c/init-textfile/0.log"
Sep 09 14:03:02.743847 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:02.743817    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-ds7jv_f6844652-d3a7-44f7-a095-45291f1ad4aa/kube-rbac-proxy-main/0.log"
Sep 09 14:03:02.767864 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:02.767830    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-ds7jv_f6844652-d3a7-44f7-a095-45291f1ad4aa/kube-rbac-proxy-self/0.log"
Sep 09 14:03:02.790363 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:02.790336    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-ds7jv_f6844652-d3a7-44f7-a095-45291f1ad4aa/openshift-state-metrics/0.log"
Sep 09 14:03:02.844353 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:02.844322    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8a5077e0-163a-4c9e-8d78-e7c0224c5965/prometheus/0.log"
Sep 09 14:03:02.865498 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:02.865419    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8a5077e0-163a-4c9e-8d78-e7c0224c5965/config-reloader/0.log"
Sep 09 14:03:02.893579 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:02.893553    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8a5077e0-163a-4c9e-8d78-e7c0224c5965/thanos-sidecar/0.log"
Sep 09 14:03:02.921457 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:02.921433    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8a5077e0-163a-4c9e-8d78-e7c0224c5965/kube-rbac-proxy-web/0.log"
Sep 09 14:03:02.953629 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:02.953599    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8a5077e0-163a-4c9e-8d78-e7c0224c5965/kube-rbac-proxy/0.log"
Sep 09 14:03:02.990804 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:02.990772    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8a5077e0-163a-4c9e-8d78-e7c0224c5965/kube-rbac-proxy-thanos/0.log"
Sep 09 14:03:03.028787 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:03.028759    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8a5077e0-163a-4c9e-8d78-e7c0224c5965/init-config-reloader/0.log"
Sep 09 14:03:03.142461 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:03.142251    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-78f599db79-xmf56_00914ed8-781a-4ab4-b7d1-f354965e16ef/prometheus-operator-admission-webhook/0.log"
Sep 09 14:03:03.332563 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:03.332530    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5dd99cbf48-hhw7x_928b5550-3225-43a5-8833-acd6039a524a/thanos-query/0.log"
Sep 09 14:03:03.358898 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:03.358862    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5dd99cbf48-hhw7x_928b5550-3225-43a5-8833-acd6039a524a/kube-rbac-proxy-web/0.log"
Sep 09 14:03:03.383370 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:03.383341    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5dd99cbf48-hhw7x_928b5550-3225-43a5-8833-acd6039a524a/kube-rbac-proxy/0.log"
Sep 09 14:03:03.413330 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:03.413251    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5dd99cbf48-hhw7x_928b5550-3225-43a5-8833-acd6039a524a/prom-label-proxy/0.log"
Sep 09 14:03:03.446862 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:03.446838    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5dd99cbf48-hhw7x_928b5550-3225-43a5-8833-acd6039a524a/kube-rbac-proxy-rules/0.log"
Sep 09 14:03:03.472307 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:03.472280    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5dd99cbf48-hhw7x_928b5550-3225-43a5-8833-acd6039a524a/kube-rbac-proxy-metrics/0.log"
Sep 09 14:03:06.105749 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:06.105716    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-xt7qr_b5cd0b68-2d59-4f9c-bca9-521ab995c7cd/download-server/0.log"
Sep 09 14:03:06.130497 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:06.130465    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-nqbm9/perf-node-gather-daemonset-lqgnn"]
Sep 09 14:03:06.130860 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:06.130846    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe44fd67-757c-41cf-9a5e-e064d65afef8" containerName="maas-api"
Sep 09 14:03:06.130860 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:06.130861    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe44fd67-757c-41cf-9a5e-e064d65afef8" containerName="maas-api"
Sep 09 14:03:06.130956 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:06.130946    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe44fd67-757c-41cf-9a5e-e064d65afef8" containerName="maas-api"
Sep 09 14:03:06.133881 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:06.133859    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nqbm9/perf-node-gather-daemonset-lqgnn"
Sep 09 14:03:06.136492 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:06.136470    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nqbm9\"/\"kube-root-ca.crt\""
Sep 09 14:03:06.137345 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:06.137326    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nqbm9\"/\"openshift-service-ca.crt\""
Sep 09 14:03:06.137451 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:06.137344    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-nqbm9\"/\"default-dockercfg-gttcx\""
Sep 09 14:03:06.145479 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:06.145456    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nqbm9/perf-node-gather-daemonset-lqgnn"]
Sep 09 14:03:06.304493 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:06.304455    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/418ec035-c725-42fa-a775-24c0efeb1347-lib-modules\") pod \"perf-node-gather-daemonset-lqgnn\" (UID: \"418ec035-c725-42fa-a775-24c0efeb1347\") " pod="openshift-must-gather-nqbm9/perf-node-gather-daemonset-lqgnn"
Sep 09 14:03:06.304493 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:06.304499    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgqrm\" (UniqueName: \"kubernetes.io/projected/418ec035-c725-42fa-a775-24c0efeb1347-kube-api-access-bgqrm\") pod \"perf-node-gather-daemonset-lqgnn\" (UID: \"418ec035-c725-42fa-a775-24c0efeb1347\") " pod="openshift-must-gather-nqbm9/perf-node-gather-daemonset-lqgnn"
Sep 09 14:03:06.304746 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:06.304600    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/418ec035-c725-42fa-a775-24c0efeb1347-podres\") pod \"perf-node-gather-daemonset-lqgnn\" (UID: \"418ec035-c725-42fa-a775-24c0efeb1347\") " pod="openshift-must-gather-nqbm9/perf-node-gather-daemonset-lqgnn"
Sep 09 14:03:06.304746 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:06.304631    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/418ec035-c725-42fa-a775-24c0efeb1347-sys\") pod \"perf-node-gather-daemonset-lqgnn\" (UID: \"418ec035-c725-42fa-a775-24c0efeb1347\") " pod="openshift-must-gather-nqbm9/perf-node-gather-daemonset-lqgnn"
Sep 09 14:03:06.304746 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:06.304654    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/418ec035-c725-42fa-a775-24c0efeb1347-proc\") pod \"perf-node-gather-daemonset-lqgnn\" (UID: \"418ec035-c725-42fa-a775-24c0efeb1347\") " pod="openshift-must-gather-nqbm9/perf-node-gather-daemonset-lqgnn"
Sep 09 14:03:06.405376 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:06.405338    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/418ec035-c725-42fa-a775-24c0efeb1347-podres\") pod \"perf-node-gather-daemonset-lqgnn\" (UID: \"418ec035-c725-42fa-a775-24c0efeb1347\") " pod="openshift-must-gather-nqbm9/perf-node-gather-daemonset-lqgnn"
Sep 09 14:03:06.405543 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:06.405384    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/418ec035-c725-42fa-a775-24c0efeb1347-sys\") pod \"perf-node-gather-daemonset-lqgnn\" (UID: \"418ec035-c725-42fa-a775-24c0efeb1347\") " pod="openshift-must-gather-nqbm9/perf-node-gather-daemonset-lqgnn"
Sep 09 14:03:06.405543 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:06.405411    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/418ec035-c725-42fa-a775-24c0efeb1347-proc\") pod \"perf-node-gather-daemonset-lqgnn\" (UID: \"418ec035-c725-42fa-a775-24c0efeb1347\") " pod="openshift-must-gather-nqbm9/perf-node-gather-daemonset-lqgnn"
Sep 09 14:03:06.405543 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:06.405485    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/418ec035-c725-42fa-a775-24c0efeb1347-sys\") pod \"perf-node-gather-daemonset-lqgnn\" (UID: \"418ec035-c725-42fa-a775-24c0efeb1347\") " pod="openshift-must-gather-nqbm9/perf-node-gather-daemonset-lqgnn"
Sep 09 14:03:06.405543 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:06.405491    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/418ec035-c725-42fa-a775-24c0efeb1347-lib-modules\") pod \"perf-node-gather-daemonset-lqgnn\" (UID: \"418ec035-c725-42fa-a775-24c0efeb1347\") " pod="openshift-must-gather-nqbm9/perf-node-gather-daemonset-lqgnn"
Sep 09 14:03:06.405543 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:06.405526    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/418ec035-c725-42fa-a775-24c0efeb1347-podres\") pod \"perf-node-gather-daemonset-lqgnn\" (UID: \"418ec035-c725-42fa-a775-24c0efeb1347\") " pod="openshift-must-gather-nqbm9/perf-node-gather-daemonset-lqgnn"
Sep 09 14:03:06.405712 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:06.405533    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/418ec035-c725-42fa-a775-24c0efeb1347-proc\") pod \"perf-node-gather-daemonset-lqgnn\" (UID: \"418ec035-c725-42fa-a775-24c0efeb1347\") " pod="openshift-must-gather-nqbm9/perf-node-gather-daemonset-lqgnn"
Sep 09 14:03:06.405712 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:06.405554    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgqrm\" (UniqueName: \"kubernetes.io/projected/418ec035-c725-42fa-a775-24c0efeb1347-kube-api-access-bgqrm\") pod \"perf-node-gather-daemonset-lqgnn\" (UID: \"418ec035-c725-42fa-a775-24c0efeb1347\") " pod="openshift-must-gather-nqbm9/perf-node-gather-daemonset-lqgnn"
Sep 09 14:03:06.405712 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:06.405569    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/418ec035-c725-42fa-a775-24c0efeb1347-lib-modules\") pod \"perf-node-gather-daemonset-lqgnn\" (UID: \"418ec035-c725-42fa-a775-24c0efeb1347\") " pod="openshift-must-gather-nqbm9/perf-node-gather-daemonset-lqgnn"
Sep 09 14:03:06.429191 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:06.429143    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgqrm\" (UniqueName: \"kubernetes.io/projected/418ec035-c725-42fa-a775-24c0efeb1347-kube-api-access-bgqrm\") pod \"perf-node-gather-daemonset-lqgnn\" (UID: \"418ec035-c725-42fa-a775-24c0efeb1347\") " pod="openshift-must-gather-nqbm9/perf-node-gather-daemonset-lqgnn"
Sep 09 14:03:06.445097 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:06.445067    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nqbm9/perf-node-gather-daemonset-lqgnn"
Sep 09 14:03:06.718028 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:06.718001    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nqbm9/perf-node-gather-daemonset-lqgnn"]
Sep 09 14:03:06.721387 ip-10-0-135-192 kubenswrapper[2578]: W0909 14:03:06.721355    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod418ec035_c725_42fa_a775_24c0efeb1347.slice/crio-faf35b7faf7ad3a2de7652e82b9eb650033bd61ba53f9b0877591e8268f6e2fb WatchSource:0}: Error finding container faf35b7faf7ad3a2de7652e82b9eb650033bd61ba53f9b0877591e8268f6e2fb: Status 404 returned error can't find the container with id faf35b7faf7ad3a2de7652e82b9eb650033bd61ba53f9b0877591e8268f6e2fb
Sep 09 14:03:07.027329 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:07.027233    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nqbm9/perf-node-gather-daemonset-lqgnn" event={"ID":"418ec035-c725-42fa-a775-24c0efeb1347","Type":"ContainerStarted","Data":"1a2bb267af238eb1188f1f55b8448d197ba4be9a90e6288d41289dcec1f24607"}
Sep 09 14:03:07.027329 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:07.027293    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nqbm9/perf-node-gather-daemonset-lqgnn" event={"ID":"418ec035-c725-42fa-a775-24c0efeb1347","Type":"ContainerStarted","Data":"faf35b7faf7ad3a2de7652e82b9eb650033bd61ba53f9b0877591e8268f6e2fb"}
Sep 09 14:03:07.027329 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:07.027318    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-nqbm9/perf-node-gather-daemonset-lqgnn"
Sep 09 14:03:07.045853 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:07.045801    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-nqbm9/perf-node-gather-daemonset-lqgnn" podStartSLOduration=1.045784864 podStartE2EDuration="1.045784864s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 14:03:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:03:07.045332772 +0000 UTC m=+2198.860856967" watchObservedRunningTime="2026-09-09 14:03:07.045784864 +0000 UTC m=+2198.861309057"
Sep 09 14:03:08.135841 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:08.135811    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kflpw_03af7327-8417-4d97-9c3c-cdf5be497be8/dns/0.log"
Sep 09 14:03:08.157076 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:08.157045    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kflpw_03af7327-8417-4d97-9c3c-cdf5be497be8/kube-rbac-proxy/0.log"
Sep 09 14:03:08.181141 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:08.181113    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pg486_dd89162d-80ad-4a5d-9753-a376a17fa59c/dns-node-resolver/0.log"
Sep 09 14:03:08.805812 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:08.805783    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-749b4b959d-cnp69_d1143c2d-590c-4cfc-a2fa-1cf0094ea60a/registry/0.log"
Sep 09 14:03:08.886393 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:08.886363    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-stlfb_1aaceed8-333e-4fde-8412-843a7ea41bf2/node-ca/0.log"
Sep 09 14:03:10.262819 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:10.262788    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-nd4b5_919b3366-f8a5-48e6-a58e-51a3f5622f79/discovery/0.log"
Sep 09 14:03:11.461680 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:11.461649    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mqjtn_7b82458b-86a1-4247-9d77-58bad446ae15/serve-healthcheck-canary/0.log"
Sep 09 14:03:12.065236 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:12.065202    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gnb8t_031e931e-9ee2-4cb0-8a7d-3dba0ce0c96b/kube-rbac-proxy/0.log"
Sep 09 14:03:12.090346 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:12.090319    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gnb8t_031e931e-9ee2-4cb0-8a7d-3dba0ce0c96b/exporter/0.log"
Sep 09 14:03:12.117645 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:12.117616    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gnb8t_031e931e-9ee2-4cb0-8a7d-3dba0ce0c96b/extractor/0.log"
Sep 09 14:03:13.041757 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:13.041731    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-nqbm9/perf-node-gather-daemonset-lqgnn"
Sep 09 14:03:14.897041 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:14.897011    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8469c9486d-6j8ld_9cf8ff24-1a89-4f63-a188-ddccaf2f8720/manager/0.log"
Sep 09 14:03:14.919563 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:14.919537    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8469c9486d-6j8ld_9cf8ff24-1a89-4f63-a188-ddccaf2f8720/copy-manifests/0.log"
Sep 09 14:03:16.422538 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:16.422508    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-68df89f6f5-7v6hd_d85178e3-afa8-48db-bb3c-b424bebb3995/manager/0.log"
Sep 09 14:03:16.481137 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:16.481098    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-nd4b5_919b3366-f8a5-48e6-a58e-51a3f5622f79/discovery/0.log"
Sep 09 14:03:16.486100 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:16.486070    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-cxq54_0b4383ae-e35d-448b-9596-0c563d7f5c9e/openshift-lws-operator/0.log"
Sep 09 14:03:18.547041 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:18.547008    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-nd4b5_919b3366-f8a5-48e6-a58e-51a3f5622f79/discovery/0.log"
Sep 09 14:03:23.212667 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:23.212637    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-52xr2_7832a0f6-3e3a-417d-96df-a284d6eb6429/kube-multus/0.log"
Sep 09 14:03:23.241934 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:23.241902    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6kn8w_47856a84-ddb7-437b-af1a-aa2e9f06bf23/kube-multus-additional-cni-plugins/0.log"
Sep 09 14:03:23.265292 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:23.265261    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6kn8w_47856a84-ddb7-437b-af1a-aa2e9f06bf23/egress-router-binary-copy/0.log"
Sep 09 14:03:23.291167 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:23.291139    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6kn8w_47856a84-ddb7-437b-af1a-aa2e9f06bf23/cni-plugins/0.log"
Sep 09 14:03:23.317369 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:23.317330    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6kn8w_47856a84-ddb7-437b-af1a-aa2e9f06bf23/bond-cni-plugin/0.log"
Sep 09 14:03:23.339708 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:23.339681    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6kn8w_47856a84-ddb7-437b-af1a-aa2e9f06bf23/routeoverride-cni/0.log"
Sep 09 14:03:23.362074 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:23.362048    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6kn8w_47856a84-ddb7-437b-af1a-aa2e9f06bf23/whereabouts-cni-bincopy/0.log"
Sep 09 14:03:23.385841 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:23.385818    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6kn8w_47856a84-ddb7-437b-af1a-aa2e9f06bf23/whereabouts-cni/0.log"
Sep 09 14:03:23.887283 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:23.887250    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-l8p6d_94d06480-f6e0-4f65-9567-c9b9760aeb8a/network-metrics-daemon/0.log"
Sep 09 14:03:23.914027 ip-10-0-135-192 kubenswrapper[2578]: I0909 14:03:23.913996    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-l8p6d_94d06480-f6e0-4f65-9567-c9b9760aeb8a/kube-rbac-proxy/0.log"