Jul 27 20:02:07.082465 ip-10-0-128-149 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 27 20:02:07.082472 ip-10-0-128-149 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 27 20:02:07.082480 ip-10-0-128-149 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 27 20:02:07.082759 ip-10-0-128-149 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 27 20:02:17.110010 ip-10-0-128-149 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 27 20:02:17.110033 ip-10-0-128-149 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot b85b6dcbef284c32bb2f39451c3b7392 --
Jul 27 20:04:10.208172 ip-10-0-128-149 systemd[1]: Starting Kubernetes Kubelet...
Jul 27 20:04:10.551990 ip-10-0-128-149 kubenswrapper[2557]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 20:04:10.551990 ip-10-0-128-149 kubenswrapper[2557]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 27 20:04:10.551990 ip-10-0-128-149 kubenswrapper[2557]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 20:04:10.551990 ip-10-0-128-149 kubenswrapper[2557]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 27 20:04:10.551990 ip-10-0-128-149 kubenswrapper[2557]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 20:04:10.552682 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.552053    2557 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 27 20:04:10.559268 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559238    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 20:04:10.559268 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559258    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 20:04:10.559268 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559263    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 20:04:10.559268 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559266    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 20:04:10.559268 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559269    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 20:04:10.559268 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559274    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 20:04:10.559498 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559280    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 20:04:10.559498 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559283    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 20:04:10.559498 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559287    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 20:04:10.559498 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559289    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 20:04:10.559498 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559292    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 20:04:10.559498 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559295    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 20:04:10.559498 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559298    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 20:04:10.559498 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559300    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 20:04:10.559498 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559303    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 20:04:10.559498 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559305    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 20:04:10.559498 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559308    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 20:04:10.559498 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559310    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 20:04:10.559498 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559313    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 20:04:10.559498 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559315    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 20:04:10.559498 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559318    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 20:04:10.559498 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559320    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 20:04:10.559498 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559323    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 20:04:10.559498 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559325    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 20:04:10.559498 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559328    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 20:04:10.559498 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559330    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 20:04:10.560033 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559333    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 20:04:10.560033 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559335    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 20:04:10.560033 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559338    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 20:04:10.560033 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559340    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 20:04:10.560033 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559344    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 20:04:10.560033 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559346    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 20:04:10.560033 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559349    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 20:04:10.560033 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559351    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 20:04:10.560033 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559354    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 20:04:10.560033 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559356    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 20:04:10.560033 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559360    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 20:04:10.560033 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559363    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 20:04:10.560033 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559366    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 20:04:10.560033 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559369    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 20:04:10.560033 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559371    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 20:04:10.560033 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559374    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 20:04:10.560033 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559377    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 20:04:10.560033 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559379    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 20:04:10.560033 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559382    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 20:04:10.560499 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559385    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 20:04:10.560499 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559387    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 20:04:10.560499 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559390    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 20:04:10.560499 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559392    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 20:04:10.560499 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559395    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 20:04:10.560499 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559399    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 20:04:10.560499 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559402    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 20:04:10.560499 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559405    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 20:04:10.560499 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559407    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 20:04:10.560499 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559411    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 20:04:10.560499 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559413    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 20:04:10.560499 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559416    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 20:04:10.560499 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559418    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 20:04:10.560499 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559421    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 20:04:10.560499 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559423    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 20:04:10.560499 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559426    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 20:04:10.560499 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559428    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 20:04:10.560499 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559431    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 20:04:10.560499 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559434    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 20:04:10.560499 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559437    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 20:04:10.561005 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559440    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 20:04:10.561005 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559444    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 20:04:10.561005 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559447    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 20:04:10.561005 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559451    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 20:04:10.561005 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559454    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 20:04:10.561005 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559457    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 20:04:10.561005 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559460    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 20:04:10.561005 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559463    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 20:04:10.561005 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559466    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 20:04:10.561005 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559469    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 20:04:10.561005 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559471    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 20:04:10.561005 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559474    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 20:04:10.561005 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559476    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 20:04:10.561005 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559480    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 20:04:10.561005 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559483    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 20:04:10.561005 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559485    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 20:04:10.561005 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559487    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 20:04:10.561005 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559490    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 20:04:10.561005 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559493    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 20:04:10.561491 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559496    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 20:04:10.561491 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559498    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 20:04:10.561491 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559501    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 20:04:10.561491 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559503    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 20:04:10.561491 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559508    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 20:04:10.561491 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559512    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 20:04:10.561491 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559515    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 20:04:10.561491 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559518    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 20:04:10.561491 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559521    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 20:04:10.561491 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559524    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 20:04:10.561491 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559526    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 20:04:10.561491 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559529    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 20:04:10.561491 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559532    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 20:04:10.561491 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559534    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 20:04:10.561491 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.559536    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 20:04:10.561491 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560272    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 20:04:10.561491 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560279    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 20:04:10.561491 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560283    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 20:04:10.561491 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560286    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 20:04:10.561491 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560288    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 20:04:10.561991 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560291    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 20:04:10.561991 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560296    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 20:04:10.561991 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560300    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 20:04:10.561991 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560303    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 20:04:10.561991 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560306    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 20:04:10.561991 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560309    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 20:04:10.561991 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560312    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 20:04:10.561991 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560314    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 20:04:10.561991 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560317    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 20:04:10.561991 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560319    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 20:04:10.561991 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560322    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 20:04:10.561991 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560325    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 20:04:10.561991 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560328    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 20:04:10.561991 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560331    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 20:04:10.561991 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560333    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 20:04:10.561991 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560336    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 20:04:10.561991 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560338    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 20:04:10.561991 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560341    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 20:04:10.561991 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560343    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 20:04:10.562465 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560347    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 20:04:10.562465 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560350    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 20:04:10.562465 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560353    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 20:04:10.562465 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560356    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 20:04:10.562465 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560359    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 20:04:10.562465 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560362    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 20:04:10.562465 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560365    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 20:04:10.562465 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560368    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 20:04:10.562465 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560371    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 20:04:10.562465 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560374    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 20:04:10.562465 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560377    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 20:04:10.562465 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560379    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 20:04:10.562465 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560382    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 20:04:10.562465 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560384    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 20:04:10.562465 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560387    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 20:04:10.562465 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560390    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 20:04:10.562465 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560392    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 20:04:10.562465 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560395    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 20:04:10.562465 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560397    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 20:04:10.562465 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560400    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 20:04:10.562974 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560402    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 20:04:10.562974 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560406    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 20:04:10.562974 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560409    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 20:04:10.562974 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560411    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 20:04:10.562974 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560413    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 20:04:10.562974 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560416    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 20:04:10.562974 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560419    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 20:04:10.562974 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560421    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 20:04:10.562974 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560424    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 20:04:10.562974 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560426    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 20:04:10.562974 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560430    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 20:04:10.562974 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560432    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 20:04:10.562974 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560434    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 20:04:10.562974 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560437    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 20:04:10.562974 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560440    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 20:04:10.562974 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560442    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 20:04:10.562974 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560445    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 20:04:10.562974 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560447    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 20:04:10.562974 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560450    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 20:04:10.562974 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560453    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 20:04:10.563469 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560455    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 20:04:10.563469 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560461    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 20:04:10.563469 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560463    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 20:04:10.563469 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560466    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 20:04:10.563469 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560469    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 20:04:10.563469 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560471    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 20:04:10.563469 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560474    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 20:04:10.563469 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560476    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 20:04:10.563469 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560480    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 20:04:10.563469 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560483    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 20:04:10.563469 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560485    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 20:04:10.563469 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560488    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 20:04:10.563469 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560490    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 20:04:10.563469 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560493    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 20:04:10.563469 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560495    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 20:04:10.563469 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560498    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 20:04:10.563469 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560501    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 20:04:10.563469 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560503    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 20:04:10.563469 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560506    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 20:04:10.563469 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560510    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 20:04:10.563976 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560513    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 20:04:10.563976 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560515    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 20:04:10.563976 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560518    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 20:04:10.563976 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560521    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 20:04:10.563976 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560523    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 20:04:10.563976 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560526    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 20:04:10.563976 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560528    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 20:04:10.563976 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560531    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 20:04:10.563976 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560533    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 20:04:10.563976 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560537    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 20:04:10.563976 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560540    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 20:04:10.563976 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560543    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 20:04:10.563976 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560545    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 20:04:10.563976 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560550    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 20:04:10.563976 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560552    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 20:04:10.563976 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560989    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 20:04:10.563976 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560996    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 20:04:10.563976 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.560999    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 20:04:10.563976 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561002    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 20:04:10.563976 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561006    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 20:04:10.564461 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561009    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 20:04:10.564461 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561012    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 20:04:10.564461 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561015    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 20:04:10.564461 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561018    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 20:04:10.564461 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561021    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 20:04:10.564461 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561024    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 20:04:10.564461 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561026    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 20:04:10.564461 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561029    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 20:04:10.564461 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561032    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 20:04:10.564461 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561034    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 20:04:10.564461 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561037    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 20:04:10.564461 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561043    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 20:04:10.564461 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561046    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 20:04:10.564461 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561048    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 20:04:10.564461 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561051    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 20:04:10.564461 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561053    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 20:04:10.564461 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561057    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 20:04:10.564461 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561060    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 20:04:10.564461 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561063    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 20:04:10.564461 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561066    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 20:04:10.565026 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561069    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 20:04:10.565026 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561073    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 20:04:10.565026 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561076    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 20:04:10.565026 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561079    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 20:04:10.565026 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561082    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 20:04:10.565026 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561085    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 20:04:10.565026 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561088    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 20:04:10.565026 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561090    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 20:04:10.565026 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561093    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 20:04:10.565026 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561095    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 20:04:10.565026 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561098    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 20:04:10.565026 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561100    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 20:04:10.565026 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561103    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 20:04:10.565026 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561105    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 20:04:10.565026 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561109    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 20:04:10.565026 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561112    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 20:04:10.565026 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561115    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 20:04:10.565026 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561117    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 20:04:10.565026 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561120    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 20:04:10.565502 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561122    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 20:04:10.565502 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561125    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 20:04:10.565502 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561127    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 20:04:10.565502 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561130    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 20:04:10.565502 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561133    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 20:04:10.565502 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561138    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 20:04:10.565502 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561141    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 20:04:10.565502 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561144    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 20:04:10.565502 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561147    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 20:04:10.565502 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561149    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 20:04:10.565502 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561152    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 20:04:10.565502 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561155    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 20:04:10.565502 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561157    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 20:04:10.565502 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561160    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 20:04:10.565502 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561164    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 20:04:10.565502 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561167    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 20:04:10.565502 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561170    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 20:04:10.565502 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561172    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 20:04:10.565502 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561175    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 20:04:10.565502 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561178    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 20:04:10.566011 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561180    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 20:04:10.566011 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561183    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 20:04:10.566011 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561186    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 20:04:10.566011 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561188    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 20:04:10.566011 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561190    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 20:04:10.566011 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561193    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 20:04:10.566011 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561196    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 20:04:10.566011 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561198    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 20:04:10.566011 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561201    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 20:04:10.566011 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561203    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 20:04:10.566011 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561206    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 20:04:10.566011 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561209    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 20:04:10.566011 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561211    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 20:04:10.566011 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561213    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 20:04:10.566011 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561216    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 20:04:10.566011 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561218    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 20:04:10.566011 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561221    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 20:04:10.566011 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561224    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 20:04:10.566011 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561227    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 20:04:10.566498 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561229    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 20:04:10.566498 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561231    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 20:04:10.566498 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561234    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 20:04:10.566498 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561238    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 20:04:10.566498 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561240    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 20:04:10.566498 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561243    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 20:04:10.566498 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561245    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 20:04:10.566498 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561249    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 20:04:10.566498 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561251    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 20:04:10.566498 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561254    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 20:04:10.566498 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561257    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 20:04:10.566498 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561259    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 20:04:10.566498 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561262    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 20:04:10.566498 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561264    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 20:04:10.566498 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561267    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 20:04:10.566498 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561270    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 20:04:10.566498 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561344    2557 flags.go:64] FLAG: --address="0.0.0.0"
Jul 27 20:04:10.566498 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561351    2557 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 27 20:04:10.566498 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561359    2557 flags.go:64] FLAG: --anonymous-auth="true"
Jul 27 20:04:10.566498 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561364    2557 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 27 20:04:10.566498 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561368    2557 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 27 20:04:10.567022 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561372    2557 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 27 20:04:10.567022 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561376    2557 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 27 20:04:10.567022 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561380    2557 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 27 20:04:10.567022 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561384    2557 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 27 20:04:10.567022 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561387    2557 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 27 20:04:10.567022 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561390    2557 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 27 20:04:10.567022 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561394    2557 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 27 20:04:10.567022 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561397    2557 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 27 20:04:10.567022 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561400    2557 flags.go:64] FLAG: --cgroup-root=""
Jul 27 20:04:10.567022 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561403    2557 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 27 20:04:10.567022 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561406    2557 flags.go:64] FLAG: --client-ca-file=""
Jul 27 20:04:10.567022 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561415    2557 flags.go:64] FLAG: --cloud-provider="external"
Jul 27 20:04:10.567022 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561418    2557 flags.go:64] FLAG: --cluster-dns="[]"
Jul 27 20:04:10.567022 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561422    2557 flags.go:64] FLAG: --cluster-domain=""
Jul 27 20:04:10.567022 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561425    2557 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 27 20:04:10.567022 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561428    2557 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 27 20:04:10.567022 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561431    2557 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 27 20:04:10.567022 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561435    2557 flags.go:64] FLAG: --container-log-max-files="5"
Jul 27 20:04:10.567022 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561440    2557 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 27 20:04:10.567022 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561443    2557 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 27 20:04:10.567022 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561446    2557 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 27 20:04:10.567022 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561449    2557 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 27 20:04:10.567022 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561452    2557 flags.go:64] FLAG: --contention-profiling="false"
Jul 27 20:04:10.567022 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561455    2557 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 27 20:04:10.567609 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561458    2557 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 27 20:04:10.567609 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561461    2557 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 27 20:04:10.567609 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561464    2557 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 27 20:04:10.567609 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561468    2557 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 27 20:04:10.567609 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561471    2557 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 27 20:04:10.567609 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561474    2557 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 27 20:04:10.567609 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561476    2557 flags.go:64] FLAG: --enable-load-reader="false"
Jul 27 20:04:10.567609 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561479    2557 flags.go:64] FLAG: --enable-server="true"
Jul 27 20:04:10.567609 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561482    2557 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 27 20:04:10.567609 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561487    2557 flags.go:64] FLAG: --event-burst="100"
Jul 27 20:04:10.567609 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561490    2557 flags.go:64] FLAG: --event-qps="50"
Jul 27 20:04:10.567609 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561493    2557 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 27 20:04:10.567609 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561496    2557 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 27 20:04:10.567609 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561499    2557 flags.go:64] FLAG: --eviction-hard=""
Jul 27 20:04:10.567609 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561503    2557 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 27 20:04:10.567609 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561506    2557 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 27 20:04:10.567609 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561509    2557 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 27 20:04:10.567609 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561512    2557 flags.go:64] FLAG: --eviction-soft=""
Jul 27 20:04:10.567609 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561515    2557 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 27 20:04:10.567609 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561518    2557 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 27 20:04:10.567609 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561521    2557 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 27 20:04:10.567609 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561524    2557 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 27 20:04:10.567609 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561527    2557 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 27 20:04:10.567609 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561530    2557 flags.go:64] FLAG: --fail-swap-on="true"
Jul 27 20:04:10.567609 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561533    2557 flags.go:64] FLAG: --feature-gates=""
Jul 27 20:04:10.568239 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561537    2557 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 27 20:04:10.568239 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561543    2557 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 27 20:04:10.568239 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561546    2557 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 27 20:04:10.568239 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561549    2557 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 27 20:04:10.568239 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561552    2557 flags.go:64] FLAG: --healthz-port="10248"
Jul 27 20:04:10.568239 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561556    2557 flags.go:64] FLAG: --help="false"
Jul 27 20:04:10.568239 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561559    2557 flags.go:64] FLAG: --hostname-override="ip-10-0-128-149.ec2.internal"
Jul 27 20:04:10.568239 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561562    2557 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 27 20:04:10.568239 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561565    2557 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 27 20:04:10.568239 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561567    2557 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 27 20:04:10.568239 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561571    2557 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 27 20:04:10.568239 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561574    2557 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 27 20:04:10.568239 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561577    2557 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 27 20:04:10.568239 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561580    2557 flags.go:64] FLAG: --image-service-endpoint=""
Jul 27 20:04:10.568239 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561583    2557 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 27 20:04:10.568239 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561586    2557 flags.go:64] FLAG: --kube-api-burst="100"
Jul 27 20:04:10.568239 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561589    2557 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 27 20:04:10.568239 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561592    2557 flags.go:64] FLAG: --kube-api-qps="50"
Jul 27 20:04:10.568239 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561595    2557 flags.go:64] FLAG: --kube-reserved=""
Jul 27 20:04:10.568239 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561598    2557 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 27 20:04:10.568239 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561600    2557 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 27 20:04:10.568239 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561603    2557 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 27 20:04:10.568239 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561606    2557 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 27 20:04:10.568239 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561609    2557 flags.go:64] FLAG: --lock-file=""
Jul 27 20:04:10.568838 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561612    2557 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 27 20:04:10.568838 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561615    2557 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 27 20:04:10.568838 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561618    2557 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 27 20:04:10.568838 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561623    2557 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 27 20:04:10.568838 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561627    2557 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 27 20:04:10.568838 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561629    2557 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 27 20:04:10.568838 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561632    2557 flags.go:64] FLAG: --logging-format="text"
Jul 27 20:04:10.568838 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561635    2557 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 27 20:04:10.568838 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561638    2557 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 27 20:04:10.568838 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561642    2557 flags.go:64] FLAG: --manifest-url=""
Jul 27 20:04:10.568838 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561645    2557 flags.go:64] FLAG: --manifest-url-header=""
Jul 27 20:04:10.568838 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561650    2557 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 27 20:04:10.568838 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561653    2557 flags.go:64] FLAG: --max-open-files="1000000"
Jul 27 20:04:10.568838 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561657    2557 flags.go:64] FLAG: --max-pods="110"
Jul 27 20:04:10.568838 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561660    2557 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 27 20:04:10.568838 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561663    2557 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 27 20:04:10.568838 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561666    2557 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 27 20:04:10.568838 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561669    2557 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 27 20:04:10.568838 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561672    2557 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 27 20:04:10.568838 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561675    2557 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 27 20:04:10.568838 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561678    2557 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 27 20:04:10.568838 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561685    2557 flags.go:64] FLAG: --node-status-max-images="50"
Jul 27 20:04:10.568838 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561688    2557 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 27 20:04:10.568838 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561691    2557 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 27 20:04:10.568838 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561694    2557 flags.go:64] FLAG: --pod-cidr=""
Jul 27 20:04:10.569565 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561697    2557 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 27 20:04:10.569565 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561702    2557 flags.go:64] FLAG: --pod-manifest-path=""
Jul 27 20:04:10.569565 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561706    2557 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 27 20:04:10.569565 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561709    2557 flags.go:64] FLAG: --pods-per-core="0"
Jul 27 20:04:10.569565 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561712    2557 flags.go:64] FLAG: --port="10250"
Jul 27 20:04:10.569565 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561715    2557 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 27 20:04:10.569565 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561717    2557 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06c168b177f5cf6d9"
Jul 27 20:04:10.569565 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561721    2557 flags.go:64] FLAG: --qos-reserved=""
Jul 27 20:04:10.569565 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561724    2557 flags.go:64] FLAG: --read-only-port="10255"
Jul 27 20:04:10.569565 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561727    2557 flags.go:64] FLAG: --register-node="true"
Jul 27 20:04:10.569565 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561729    2557 flags.go:64] FLAG: --register-with-taints=""
Jul 27 20:04:10.569565 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561733    2557 flags.go:64] FLAG: --registry-burst="10"
Jul 27 20:04:10.569565 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561736    2557 flags.go:64] FLAG: --registry-qps="5"
Jul 27 20:04:10.569565 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561739    2557 flags.go:64] FLAG: --reserved-cpus=""
Jul 27 20:04:10.569565 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561742    2557 flags.go:64] FLAG: --reserved-memory=""
Jul 27 20:04:10.569565 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561746    2557 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 27 20:04:10.569565 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561749    2557 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 27 20:04:10.569565 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561753    2557 flags.go:64] FLAG: --rotate-certificates="false"
Jul 27 20:04:10.569565 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561756    2557 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 27 20:04:10.569565 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561759    2557 flags.go:64] FLAG: --runonce="false"
Jul 27 20:04:10.569565 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561762    2557 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 27 20:04:10.569565 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561765    2557 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 27 20:04:10.569565 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561768    2557 flags.go:64] FLAG: --seccomp-default="false"
Jul 27 20:04:10.569565 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561771    2557 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 27 20:04:10.569565 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561774    2557 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 27 20:04:10.570227 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561776    2557 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 27 20:04:10.570227 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561780    2557 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 27 20:04:10.570227 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561783    2557 flags.go:64] FLAG: --storage-driver-password="root"
Jul 27 20:04:10.570227 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561786    2557 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 27 20:04:10.570227 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561789    2557 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 27 20:04:10.570227 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561792    2557 flags.go:64] FLAG: --storage-driver-user="root"
Jul 27 20:04:10.570227 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561794    2557 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 27 20:04:10.570227 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561797    2557 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 27 20:04:10.570227 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561800    2557 flags.go:64] FLAG: --system-cgroups=""
Jul 27 20:04:10.570227 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561803    2557 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 27 20:04:10.570227 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561808    2557 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 27 20:04:10.570227 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561811    2557 flags.go:64] FLAG: --tls-cert-file=""
Jul 27 20:04:10.570227 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561813    2557 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 27 20:04:10.570227 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561817    2557 flags.go:64] FLAG: --tls-min-version=""
Jul 27 20:04:10.570227 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561820    2557 flags.go:64] FLAG: --tls-private-key-file=""
Jul 27 20:04:10.570227 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561823    2557 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 27 20:04:10.570227 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561825    2557 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 27 20:04:10.570227 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561828    2557 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 27 20:04:10.570227 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561831    2557 flags.go:64] FLAG: --v="2"
Jul 27 20:04:10.570227 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561835    2557 flags.go:64] FLAG: --version="false"
Jul 27 20:04:10.570227 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561839    2557 flags.go:64] FLAG: --vmodule=""
Jul 27 20:04:10.570227 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561843    2557 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 27 20:04:10.570227 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.561847    2557 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 27 20:04:10.570227 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.561997    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 20:04:10.570227 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562003    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 20:04:10.570829 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562007    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 20:04:10.570829 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562010    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 20:04:10.570829 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562013    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 20:04:10.570829 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562016    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 20:04:10.570829 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562018    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 20:04:10.570829 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562022    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 20:04:10.570829 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562026    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 20:04:10.570829 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562029    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 20:04:10.570829 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562032    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 20:04:10.570829 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562034    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 20:04:10.570829 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562037    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 20:04:10.570829 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562039    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 20:04:10.570829 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562042    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 20:04:10.570829 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562045    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 20:04:10.570829 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562047    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 20:04:10.570829 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562050    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 20:04:10.570829 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562052    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 20:04:10.570829 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562055    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 20:04:10.570829 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562057    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 20:04:10.570829 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562060    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 20:04:10.571331 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562062    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 20:04:10.571331 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562065    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 20:04:10.571331 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562067    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 20:04:10.571331 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562070    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 20:04:10.571331 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562073    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 20:04:10.571331 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562075    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 20:04:10.571331 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562078    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 20:04:10.571331 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562080    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 20:04:10.571331 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562086    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 20:04:10.571331 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562088    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 20:04:10.571331 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562091    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 20:04:10.571331 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562094    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 20:04:10.571331 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562097    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 20:04:10.571331 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562099    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 20:04:10.571331 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562102    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 20:04:10.571331 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562105    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 20:04:10.571331 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562107    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 20:04:10.571331 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562110    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 20:04:10.571331 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562113    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 20:04:10.571331 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562115    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 20:04:10.571817 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562118    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 20:04:10.571817 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562121    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 20:04:10.571817 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562123    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 20:04:10.571817 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562126    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 20:04:10.571817 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562128    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 20:04:10.571817 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562131    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 20:04:10.571817 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562134    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 20:04:10.571817 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562136    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 20:04:10.571817 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562138    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 20:04:10.571817 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562141    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 20:04:10.571817 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562143    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 20:04:10.571817 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562146    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 20:04:10.571817 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562149    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 20:04:10.571817 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562152    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 20:04:10.571817 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562154    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 20:04:10.571817 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562157    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 20:04:10.571817 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562159    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 20:04:10.571817 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562162    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 20:04:10.571817 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562164    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 20:04:10.571817 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562167    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 20:04:10.572347 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562171    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 20:04:10.572347 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562174    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 20:04:10.572347 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562177    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 20:04:10.572347 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562180    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 20:04:10.572347 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562184    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 20:04:10.572347 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562188    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 20:04:10.572347 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562191    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 20:04:10.572347 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562194    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 20:04:10.572347 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562196    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 20:04:10.572347 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562199    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 20:04:10.572347 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562201    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 20:04:10.572347 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562204    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 20:04:10.572347 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562206    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 20:04:10.572347 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562209    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 20:04:10.572347 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562211    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 20:04:10.572347 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562214    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 20:04:10.572347 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562217    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 20:04:10.572347 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562221    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 20:04:10.572347 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562224    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 20:04:10.572820 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562227    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 20:04:10.572820 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562229    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 20:04:10.572820 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562231    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 20:04:10.572820 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562234    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 20:04:10.572820 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562236    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 20:04:10.572820 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562239    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 20:04:10.572820 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562241    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 20:04:10.572820 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562244    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 20:04:10.572820 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562246    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 20:04:10.572820 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562249    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 20:04:10.572820 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562252    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 20:04:10.572820 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562254    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 20:04:10.572820 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562257    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 20:04:10.572820 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562262    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 20:04:10.572820 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562264    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 20:04:10.572820 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562267    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 20:04:10.572820 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562271    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 20:04:10.572820 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.562274    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 20:04:10.573314 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.562279    2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 20:04:10.573314 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.568947    2557 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 27 20:04:10.573314 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.568964    2557 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 27 20:04:10.573314 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.568984    2557 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 27 20:04:10.573314 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.568991    2557 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 27 20:04:10.573314 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569051    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 20:04:10.573314 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569056    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 20:04:10.573314 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569059    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 20:04:10.573314 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569063    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 20:04:10.573314 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569066    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 20:04:10.573314 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569069    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 20:04:10.573314 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569072    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 20:04:10.573314 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569075    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 20:04:10.573314 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569078    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 20:04:10.573314 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569080    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 20:04:10.573698 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569083    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 20:04:10.573698 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569086    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 20:04:10.573698 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569088    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 20:04:10.573698 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569091    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 20:04:10.573698 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569094    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 20:04:10.573698 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569096    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 20:04:10.573698 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569099    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 20:04:10.573698 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569101    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 20:04:10.573698 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569104    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 20:04:10.573698 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569107    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 20:04:10.573698 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569109    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 20:04:10.573698 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569112    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 20:04:10.573698 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569115    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 20:04:10.573698 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569118    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 20:04:10.573698 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569121    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 20:04:10.573698 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569124    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 20:04:10.573698 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569126    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 20:04:10.573698 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569129    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 20:04:10.573698 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569133    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 20:04:10.574197 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569139    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 20:04:10.574197 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569142    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 20:04:10.574197 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569146    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 20:04:10.574197 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569149    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 20:04:10.574197 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569151    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 20:04:10.574197 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569154    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 20:04:10.574197 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569156    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 20:04:10.574197 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569159    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 20:04:10.574197 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569163    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 20:04:10.574197 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569167    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 20:04:10.574197 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569170    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 20:04:10.574197 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569173    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 20:04:10.574197 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569176    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 20:04:10.574197 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569179    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 20:04:10.574197 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569182    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 20:04:10.574197 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569185    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 20:04:10.574197 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569189    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 20:04:10.574197 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569192    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 20:04:10.574197 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569195    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 20:04:10.574197 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569197    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 20:04:10.574670 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569200    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 20:04:10.574670 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569203    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 20:04:10.574670 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569206    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 20:04:10.574670 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569208    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 20:04:10.574670 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569211    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 20:04:10.574670 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569213    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 20:04:10.574670 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569216    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 20:04:10.574670 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569219    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 20:04:10.574670 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569221    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 20:04:10.574670 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569225    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 20:04:10.574670 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569227    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 20:04:10.574670 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569230    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 20:04:10.574670 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569234    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 20:04:10.574670 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569237    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 20:04:10.574670 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569240    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 20:04:10.574670 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569243    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 20:04:10.574670 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569245    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 20:04:10.574670 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569248    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 20:04:10.574670 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569250    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 20:04:10.574670 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569253    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 20:04:10.575165 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569256    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 20:04:10.575165 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569258    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 20:04:10.575165 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569261    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 20:04:10.575165 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569263    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 20:04:10.575165 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569266    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 20:04:10.575165 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569269    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 20:04:10.575165 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569271    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 20:04:10.575165 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569274    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 20:04:10.575165 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569276    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 20:04:10.575165 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569279    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 20:04:10.575165 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569281    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 20:04:10.575165 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569284    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 20:04:10.575165 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569288    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 20:04:10.575165 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569291    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 20:04:10.575165 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569293    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 20:04:10.575165 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569296    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 20:04:10.575165 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569299    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 20:04:10.575165 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569302    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 20:04:10.575165 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569305    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 20:04:10.575617 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569308    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 20:04:10.575617 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569310    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 20:04:10.575617 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569313    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 20:04:10.575617 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569315    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 20:04:10.575617 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569318    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 20:04:10.575617 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569321    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 20:04:10.575617 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569323    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 20:04:10.575617 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569327    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 20:04:10.575617 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569329    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 20:04:10.575617 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569332    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 20:04:10.575617 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569334    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 20:04:10.575617 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.569340    2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 20:04:10.575617 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569455    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 20:04:10.575617 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569460    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 20:04:10.575617 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569463    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 20:04:10.576010 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569466    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 20:04:10.576010 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569469    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 20:04:10.576010 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569472    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 20:04:10.576010 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569475    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 20:04:10.576010 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569477    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 20:04:10.576010 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569480    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 20:04:10.576010 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569483    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 20:04:10.576010 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569486    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 20:04:10.576010 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569488    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 20:04:10.576010 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569491    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 20:04:10.576010 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569493    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 20:04:10.576010 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569496    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 20:04:10.576010 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569499    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 20:04:10.576010 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569501    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 20:04:10.576010 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569504    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 20:04:10.576010 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569506    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 20:04:10.576010 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569509    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 20:04:10.576010 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569511    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 20:04:10.576010 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569515    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 20:04:10.576010 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569519    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 20:04:10.576493 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569521    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 20:04:10.576493 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569524    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 20:04:10.576493 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569526    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 20:04:10.576493 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569529    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 20:04:10.576493 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569532    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 20:04:10.576493 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569540    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 20:04:10.576493 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569543    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 20:04:10.576493 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569545    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 20:04:10.576493 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569547    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 20:04:10.576493 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569550    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 20:04:10.576493 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569553    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 20:04:10.576493 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569556    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 20:04:10.576493 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569560    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 20:04:10.576493 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569562    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 20:04:10.576493 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569566    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 20:04:10.576493 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569569    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 20:04:10.576493 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569572    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 20:04:10.576493 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569575    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 20:04:10.576493 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569578    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 20:04:10.576493 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569580    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 20:04:10.576998 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569583    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 20:04:10.576998 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569586    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 20:04:10.576998 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569588    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 20:04:10.576998 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569591    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 20:04:10.576998 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569594    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 20:04:10.576998 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569596    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 20:04:10.576998 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569599    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 20:04:10.576998 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569601    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 20:04:10.576998 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569604    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 20:04:10.576998 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569607    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 20:04:10.576998 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569609    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 20:04:10.576998 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569612    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 20:04:10.576998 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569615    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 20:04:10.576998 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569617    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 20:04:10.576998 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569620    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 20:04:10.576998 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569623    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 20:04:10.576998 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569626    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 20:04:10.576998 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569628    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 20:04:10.576998 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569631    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 20:04:10.576998 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569634    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 20:04:10.577714 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569636    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 20:04:10.577714 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569639    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 20:04:10.577714 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569642    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 20:04:10.577714 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569644    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 20:04:10.577714 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569647    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 20:04:10.577714 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569649    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 20:04:10.577714 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569651    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 20:04:10.577714 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569654    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 20:04:10.577714 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569656    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 20:04:10.577714 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569659    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 20:04:10.577714 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569661    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 20:04:10.577714 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569663    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 20:04:10.577714 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569666    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 20:04:10.577714 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569669    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 20:04:10.577714 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569671    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 20:04:10.577714 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569674    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 20:04:10.577714 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569676    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 20:04:10.577714 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569679    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 20:04:10.577714 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569682    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 20:04:10.578309 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569684    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 20:04:10.578309 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569687    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 20:04:10.578309 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569690    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 20:04:10.578309 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569692    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 20:04:10.578309 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569695    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 20:04:10.578309 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569698    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 20:04:10.578309 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569700    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 20:04:10.578309 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569703    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 20:04:10.578309 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569705    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 20:04:10.578309 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569708    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 20:04:10.578309 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569712    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 20:04:10.578309 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569715    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 20:04:10.578309 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569718    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 20:04:10.578309 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569721    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 20:04:10.578309 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569724    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 20:04:10.578309 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569726    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 20:04:10.578309 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:10.569729    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 20:04:10.578717 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.569734    2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 20:04:10.578717 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.569867    2557 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 27 20:04:10.578717 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.571895    2557 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 27 20:04:10.578717 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.573189    2557 server.go:1019] "Starting client certificate rotation"
Jul 27 20:04:10.578717 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.573290    2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 27 20:04:10.578717 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.573909    2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 27 20:04:10.578717 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.576002    2557 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 27 20:04:10.580352 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.580331    2557 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 27 20:04:10.593475 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.593449    2557 log.go:25] "Validated CRI v1 runtime API"
Jul 27 20:04:10.595607 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.595592    2557 log.go:25] "Validated CRI v1 image API"
Jul 27 20:04:10.596569 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.596547    2557 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 27 20:04:10.598688 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.598669    2557 fs.go:135] Filesystem UUIDs: map[2c7386ec-55a3-432a-ad1d-b4bd0d3dd35c:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 d5d9c47a-f087-461f-bc80-b65b1e00d310:/dev/nvme0n1p4]
Jul 27 20:04:10.598733 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.598689    2557 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 27 20:04:10.603119 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.603100    2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 27 20:04:10.603898 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.603766    2557 manager.go:216] Machine: {Timestamp:2026-07-27 20:04:10.602436213 +0000 UTC m=+0.289759539 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3103387 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec23697d32f88c0c18a3a294bfc7db53 SystemUUID:ec23697d-32f8-8c0c-18a3-a294bfc7db53 BootID:b85b6dcb-ef28-4c32-bb2f-39451c3b7392 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e4:94:2d:2d:25 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e4:94:2d:2d:25 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:da:9f:8c:82:c1:0c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 27 20:04:10.603898 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.603894    2557 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 27 20:04:10.604040 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.604028    2557 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 27 20:04:10.606671 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.606643    2557 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 27 20:04:10.606869 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.606673    2557 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-149.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 27 20:04:10.607382 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.607370    2557 topology_manager.go:138] "Creating topology manager with none policy"
Jul 27 20:04:10.607434 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.607387    2557 container_manager_linux.go:309] "Creating device plugin manager"
Jul 27 20:04:10.607434 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.607398    2557 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 27 20:04:10.607986 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.607974    2557 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 27 20:04:10.608870 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.608846    2557 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 27 20:04:10.611639 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.611624    2557 state_mem.go:36] "Initialized new in-memory state store"
Jul 27 20:04:10.611991 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.611978    2557 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 27 20:04:10.612056 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.612018    2557 kubelet.go:486] "Attempting to sync node with API server"
Jul 27 20:04:10.612056 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.612032    2557 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 27 20:04:10.612056 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.612054    2557 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 27 20:04:10.612170 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.612067    2557 kubelet.go:398] "Adding apiserver pod source"
Jul 27 20:04:10.612170 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.612091    2557 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 27 20:04:10.612543 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.612530    2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 27 20:04:10.612622 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.612553    2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 27 20:04:10.614838 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.614821    2557 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 27 20:04:10.618972 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.618952    2557 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 27 20:04:10.619046 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.618996    2557 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 27 20:04:10.620636 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.620622    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 27 20:04:10.620677 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.620641    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 27 20:04:10.620677 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.620648    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 27 20:04:10.620677 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.620654    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 27 20:04:10.620677 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.620662    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 27 20:04:10.620677 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.620668    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 27 20:04:10.620677 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.620677    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 27 20:04:10.620828 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.620682    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 27 20:04:10.620828 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.620690    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 27 20:04:10.620828 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.620696    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 27 20:04:10.620828 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.620704    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 27 20:04:10.620828 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.620709    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 27 20:04:10.620828 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.620732    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 27 20:04:10.620828 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.620738    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 27 20:04:10.623658 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.623637    2557 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-149.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 20:04:10.624198 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.624178    2557 server.go:1268] "Started kubelet"
Jul 27 20:04:10.624198 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:10.624180    2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 27 20:04:10.624198 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:10.624180    2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-149.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 27 20:04:10.624362 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.624249    2557 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 27 20:04:10.624362 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.624307    2557 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 27 20:04:10.624362 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.624360    2557 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 27 20:04:10.625642 ip-10-0-128-149 systemd[1]: Started Kubernetes Kubelet.
Jul 27 20:04:10.626043 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.626022    2557 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 27 20:04:10.626996 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.626978    2557 server.go:310] "Adding debug handlers to kubelet server"
Jul 27 20:04:10.629495 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:10.629477    2557 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 27 20:04:10.633081 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.633061    2557 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 27 20:04:10.633081 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.633068    2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 27 20:04:10.633271 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:10.633150    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-149.ec2.internal\" not found"
Jul 27 20:04:10.633585 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:10.632745    2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-149.ec2.internal.18c63e2995a48dbe  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-149.ec2.internal,UID:ip-10-0-128-149.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-149.ec2.internal,},FirstTimestamp:2026-07-27 20:04:10.624150974 +0000 UTC m=+0.311474303,LastTimestamp:2026-07-27 20:04:10.624150974 +0000 UTC m=+0.311474303,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-149.ec2.internal,}"
Jul 27 20:04:10.633689 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.633629    2557 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 27 20:04:10.633775 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.633762    2557 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 27 20:04:10.633893 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.633720    2557 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 27 20:04:10.633893 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.633884    2557 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 27 20:04:10.634008 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.633900    2557 factory.go:55] Registering systemd factory
Jul 27 20:04:10.634008 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.633909    2557 factory.go:223] Registration of the systemd container factory successfully
Jul 27 20:04:10.634008 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.633887    2557 reconstruct.go:97] "Volume reconstruction finished"
Jul 27 20:04:10.634008 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.633951    2557 reconciler.go:29] "Reconciler: start to sync state"
Jul 27 20:04:10.634175 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.634152    2557 factory.go:153] Registering CRI-O factory
Jul 27 20:04:10.634175 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.634166    2557 factory.go:223] Registration of the crio container factory successfully
Jul 27 20:04:10.634260 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.634191    2557 factory.go:103] Registering Raw factory
Jul 27 20:04:10.634260 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.634202    2557 manager.go:1196] Started watching for new ooms in manager
Jul 27 20:04:10.634612 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.634597    2557 manager.go:349] Starting recovery of all containers
Jul 27 20:04:10.637818 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:10.637796    2557 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 27 20:04:10.637891 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:10.637849    2557 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-149.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 27 20:04:10.639262 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.639239    2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zkrng"
Jul 27 20:04:10.647082 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.646925    2557 manager.go:354] Recovery completed
Jul 27 20:04:10.648335 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:10.648314    2557 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 27 20:04:10.648440 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.648422    2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zkrng"
Jul 27 20:04:10.651618 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.651604    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 20:04:10.654450 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.654430    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-149.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 20:04:10.654537 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.654467    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-149.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 20:04:10.654537 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.654482    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-149.ec2.internal" event="NodeHasSufficientPID"
Jul 27 20:04:10.655057 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.655041    2557 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 27 20:04:10.655057 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.655054    2557 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 27 20:04:10.655185 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.655060    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 20:04:10.655185 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.655074    2557 state_mem.go:36] "Initialized new in-memory state store"
Jul 27 20:04:10.655867 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.655840    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-149.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 20:04:10.655936 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.655886    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-149.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 20:04:10.655936 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.655903    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-149.ec2.internal" event="NodeHasSufficientPID"
Jul 27 20:04:10.656420 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:10.656356    2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-149.ec2.internal.18c63e299772dff9  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-149.ec2.internal,UID:ip-10-0-128-149.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-149.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-149.ec2.internal,},FirstTimestamp:2026-07-27 20:04:10.654449657 +0000 UTC m=+0.341772991,LastTimestamp:2026-07-27 20:04:10.654449657 +0000 UTC m=+0.341772991,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-149.ec2.internal,}"
Jul 27 20:04:10.657605 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.657589    2557 policy_none.go:49] "None policy: Start"
Jul 27 20:04:10.657605 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.657607    2557 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 27 20:04:10.657707 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.657617    2557 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 27 20:04:10.659586 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.659574    2557 policy_none.go:47] "Start"
Jul 27 20:04:10.700447 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.700431    2557 manager.go:337] "Starting Device Plugin manager"
Jul 27 20:04:10.700552 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:10.700465    2557 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 27 20:04:10.700552 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.700477    2557 server.go:87] "Starting device plugin registration server"
Jul 27 20:04:10.700789 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.700776    2557 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 27 20:04:10.700835 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.700802    2557 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 27 20:04:10.700915 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.700898    2557 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 27 20:04:10.701001 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.700984    2557 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 27 20:04:10.701001 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.700997    2557 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 27 20:04:10.701530 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:10.701512    2557 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 27 20:04:10.701610 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:10.701559    2557 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-149.ec2.internal\" not found"
Jul 27 20:04:10.790382 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.790337    2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 27 20:04:10.792600 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.791468    2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 27 20:04:10.792600 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.791504    2557 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 27 20:04:10.792600 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.791526    2557 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 27 20:04:10.792600 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:10.791566    2557 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 27 20:04:10.793919 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.793897    2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 20:04:10.801912 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.801893    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 20:04:10.804304 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.804246    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-149.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 20:04:10.804304 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.804274    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-149.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 20:04:10.804304 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.804286    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-149.ec2.internal" event="NodeHasSufficientPID"
Jul 27 20:04:10.804454 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.804309    2557 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-149.ec2.internal"
Jul 27 20:04:10.812250 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:10.812228    2557 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-149.ec2.internal"
Jul 27 20:04:10.812316 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:10.812254    2557 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-149.ec2.internal\": node \"ip-10-0-128-149.ec2.internal\" not found"
Jul 27 20:04:11.973867 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:11.973841    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-149.ec2.internal\" not found"
Jul 27 20:04:12.005014 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:12.004951    2557 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-149.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-149.ec2.internal"]
Jul 27 20:04:12.005157 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:12.005056    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 20:04:12.006099 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:12.006083    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-149.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 20:04:12.006165 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:12.006117    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-149.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 20:04:12.006165 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:12.006130    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-149.ec2.internal" event="NodeHasSufficientPID"
Jul 27 20:04:12.008468 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:12.008443    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 20:04:12.008563 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:12.008551    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-149.ec2.internal"
Jul 27 20:04:12.008611 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:12.008590    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 20:04:12.009478 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:12.009462    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-149.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 20:04:12.009554 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:12.009484    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-149.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 20:04:12.009554 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:12.009494    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-149.ec2.internal" event="NodeHasSufficientPID"
Jul 27 20:04:12.009554 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:12.009465    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-149.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 20:04:12.009554 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:12.009542    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-149.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 20:04:12.009554 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:12.009554    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-149.ec2.internal" event="NodeHasSufficientPID"
Jul 27 20:04:12.011773 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:12.011758    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-149.ec2.internal"
Jul 27 20:04:12.011814 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:12.011789    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 20:04:12.012556 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:12.012541    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-149.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 20:04:12.012617 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:12.012567    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-149.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 20:04:12.012617 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:12.012577    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-149.ec2.internal" event="NodeHasSufficientPID"
Jul 27 20:04:12.039225 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:12.039198    2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-149.ec2.internal\" not found" node="ip-10-0-128-149.ec2.internal"
Jul 27 20:04:12.043513 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:12.043496    2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-149.ec2.internal\" not found" node="ip-10-0-128-149.ec2.internal"
Jul 27 20:04:12.047924 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:12.047902    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0ff7ebb6ee818f2c2c6896935fdb2199-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-149.ec2.internal\" (UID: \"0ff7ebb6ee818f2c2c6896935fdb2199\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-149.ec2.internal"
Jul 27 20:04:12.048026 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:12.047929    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ff7ebb6ee818f2c2c6896935fdb2199-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-149.ec2.internal\" (UID: \"0ff7ebb6ee818f2c2c6896935fdb2199\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-149.ec2.internal"
Jul 27 20:04:12.048026 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:12.047949    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c1d7f2fc6e91fecc35ff7f75225b4759-config\") pod \"kube-apiserver-proxy-ip-10-0-128-149.ec2.internal\" (UID: \"c1d7f2fc6e91fecc35ff7f75225b4759\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-149.ec2.internal"
Jul 27 20:04:12.074265 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:12.074234    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-149.ec2.internal\" not found"
Jul 27 20:04:12.148808 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:12.148776    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0ff7ebb6ee818f2c2c6896935fdb2199-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-149.ec2.internal\" (UID: \"0ff7ebb6ee818f2c2c6896935fdb2199\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-149.ec2.internal"
Jul 27 20:04:12.148808 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:12.148808    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ff7ebb6ee818f2c2c6896935fdb2199-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-149.ec2.internal\" (UID: \"0ff7ebb6ee818f2c2c6896935fdb2199\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-149.ec2.internal"
Jul 27 20:04:12.148990 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:12.148832    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c1d7f2fc6e91fecc35ff7f75225b4759-config\") pod \"kube-apiserver-proxy-ip-10-0-128-149.ec2.internal\" (UID: \"c1d7f2fc6e91fecc35ff7f75225b4759\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-149.ec2.internal"
Jul 27 20:04:12.148990 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:12.148877    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c1d7f2fc6e91fecc35ff7f75225b4759-config\") pod \"kube-apiserver-proxy-ip-10-0-128-149.ec2.internal\" (UID: \"c1d7f2fc6e91fecc35ff7f75225b4759\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-149.ec2.internal"
Jul 27 20:04:12.148990 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:12.148879    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0ff7ebb6ee818f2c2c6896935fdb2199-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-149.ec2.internal\" (UID: \"0ff7ebb6ee818f2c2c6896935fdb2199\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-149.ec2.internal"
Jul 27 20:04:12.148990 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:12.148887    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ff7ebb6ee818f2c2c6896935fdb2199-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-149.ec2.internal\" (UID: \"0ff7ebb6ee818f2c2c6896935fdb2199\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-149.ec2.internal"
Jul 27 20:04:12.174971 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:12.174905    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-149.ec2.internal\" not found"
Jul 27 20:04:12.275735 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:12.275709    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-149.ec2.internal\" not found"
Jul 27 20:04:12.341875 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:12.341838    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-149.ec2.internal"
Jul 27 20:04:12.347005 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:12.346974    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-149.ec2.internal"
Jul 27 20:04:12.376754 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:12.376709    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-149.ec2.internal\" not found"
Jul 27 20:04:12.477316 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:12.477216    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-149.ec2.internal\" not found"
Jul 27 20:04:12.577733 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:12.577703    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-149.ec2.internal\" not found"
Jul 27 20:04:12.678261 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:12.678223    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-149.ec2.internal\" not found"
Jul 27 20:04:12.685394 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:12.685369    2557 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 27 20:04:12.685577 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:12.685557    2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 27 20:04:12.767517 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:12.767402    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-26 19:59:11 +0000 UTC" deadline="2028-01-08 23:12:39.052571941 +0000 UTC"
Jul 27 20:04:12.767517 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:12.767435    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12723h8m26.285139779s"
Jul 27 20:04:12.778607 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:12.778577    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-149.ec2.internal\" not found"
Jul 27 20:04:12.879228 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:12.879186    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-149.ec2.internal\" not found"
Jul 27 20:04:12.895738 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:12.895706    2557 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 20:04:12.969060 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:12.969027    2557 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 20:04:12.980059 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:12.980030    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-149.ec2.internal\" not found"
Jul 27 20:04:13.058870 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.058796    2557 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 20:04:13.078889 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:13.078845    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ff7ebb6ee818f2c2c6896935fdb2199.slice/crio-1a259c1f3fe9eb0fea4ddef5df9c19db08bb9919b7ab44b2cbefddbf9d53d5dc WatchSource:0}: Error finding container 1a259c1f3fe9eb0fea4ddef5df9c19db08bb9919b7ab44b2cbefddbf9d53d5dc: Status 404 returned error can't find the container with id 1a259c1f3fe9eb0fea4ddef5df9c19db08bb9919b7ab44b2cbefddbf9d53d5dc
Jul 27 20:04:13.079059 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:13.079043    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1d7f2fc6e91fecc35ff7f75225b4759.slice/crio-1c3917dd8762ace9797c842382a82ccc81963582610ac0c1bf403294c9d943b1 WatchSource:0}: Error finding container 1c3917dd8762ace9797c842382a82ccc81963582610ac0c1bf403294c9d943b1: Status 404 returned error can't find the container with id 1c3917dd8762ace9797c842382a82ccc81963582610ac0c1bf403294c9d943b1
Jul 27 20:04:13.083669 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.083652    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 20:04:13.146043 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.146003    2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-149.ec2.internal"
Jul 27 20:04:13.157481 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.157439    2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 27 20:04:13.158474 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.158438    2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-149.ec2.internal"
Jul 27 20:04:13.166654 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.166630    2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 27 20:04:13.590000 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.589975    2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 20:04:13.726100 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.725845    2557 apiserver.go:52] "Watching apiserver"
Jul 27 20:04:13.732763 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.732728    2557 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 27 20:04:13.733288 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.733266    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-49n6x","kube-system/global-pull-secret-syncer-77759","kube-system/konnectivity-agent-lw7mf","kube-system/kube-apiserver-proxy-ip-10-0-128-149.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kskcj","openshift-image-registry/node-ca-4f5vb","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-149.ec2.internal","openshift-multus/multus-m6679","openshift-multus/network-metrics-daemon-ng4cb","openshift-cluster-node-tuning-operator/tuned-lvnfj","openshift-dns/node-resolver-rzzr5","openshift-multus/multus-additional-cni-plugins-zvh24","openshift-network-diagnostics/network-check-target-kxvq5","openshift-network-operator/iptables-alerter-zjmlr"]
Jul 27 20:04:13.736062 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.736041    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lw7mf"
Jul 27 20:04:13.738274 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.738253    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zjmlr"
Jul 27 20:04:13.739048 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.739027    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 27 20:04:13.739139 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.739068    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 27 20:04:13.739139 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.739130    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-ffgf6\""
Jul 27 20:04:13.741189 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.740966    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 27 20:04:13.741281 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.741264    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-89djn\""
Jul 27 20:04:13.741476 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.741446    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 27 20:04:13.744039 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.744017    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 27 20:04:13.744370 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.744353    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ng4cb"
Jul 27 20:04:13.744441 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:13.744420    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ng4cb" podUID="387c729d-a515-4e95-ad05-dbaa75da5b16"
Jul 27 20:04:13.744630 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.744609    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lvnfj"
Jul 27 20:04:13.745667 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.745646    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rzzr5"
Jul 27 20:04:13.745994 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.745976    2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 27 20:04:13.747156 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.747131    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 27 20:04:13.747464 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.747435    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9lpf6\""
Jul 27 20:04:13.747697 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.747677    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 27 20:04:13.747939 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.747921    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 27 20:04:13.748021 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.747942    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 27 20:04:13.748021 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.747955    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zvh24"
Jul 27 20:04:13.748393 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.748377    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-mxzhx\""
Jul 27 20:04:13.750433 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.750412    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxvq5"
Jul 27 20:04:13.750542 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:13.750519    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxvq5" podUID="99be7ce7-1c99-4883-866d-4a67291887ff"
Jul 27 20:04:13.750661 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.750640    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 27 20:04:13.750863 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.750844    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 27 20:04:13.751154 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.751137    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 27 20:04:13.751282 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.751254    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 27 20:04:13.751623 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.751604    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 27 20:04:13.752688 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.752667    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-bkhpj\""
Jul 27 20:04:13.754467 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.754433    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-77759"
Jul 27 20:04:13.755613 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:13.755585    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-77759" podUID="8b80d55b-21c2-41bc-9e47-ec1583240fc2"
Jul 27 20:04:13.757311 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.756592    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4blwt\" (UniqueName: \"kubernetes.io/projected/387c729d-a515-4e95-ad05-dbaa75da5b16-kube-api-access-4blwt\") pod \"network-metrics-daemon-ng4cb\" (UID: \"387c729d-a515-4e95-ad05-dbaa75da5b16\") " pod="openshift-multus/network-metrics-daemon-ng4cb"
Jul 27 20:04:13.757311 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.756626    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce-etc-sysctl-conf\") pod \"tuned-lvnfj\" (UID: \"479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce\") " pod="openshift-cluster-node-tuning-operator/tuned-lvnfj"
Jul 27 20:04:13.757311 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.756650    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/012b0fd7-e3a3-4010-90c1-274a7cfc5f02-system-cni-dir\") pod \"multus-additional-cni-plugins-zvh24\" (UID: \"012b0fd7-e3a3-4010-90c1-274a7cfc5f02\") " pod="openshift-multus/multus-additional-cni-plugins-zvh24"
Jul 27 20:04:13.757311 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.756673    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/012b0fd7-e3a3-4010-90c1-274a7cfc5f02-cni-binary-copy\") pod \"multus-additional-cni-plugins-zvh24\" (UID: \"012b0fd7-e3a3-4010-90c1-274a7cfc5f02\") " pod="openshift-multus/multus-additional-cni-plugins-zvh24"
Jul 27 20:04:13.757311 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.756699    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/012b0fd7-e3a3-4010-90c1-274a7cfc5f02-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zvh24\" (UID: \"012b0fd7-e3a3-4010-90c1-274a7cfc5f02\") " pod="openshift-multus/multus-additional-cni-plugins-zvh24"
Jul 27 20:04:13.757311 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.756724    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/30db2eea-f82c-4108-acd3-dafe3c975665-agent-certs\") pod \"konnectivity-agent-lw7mf\" (UID: \"30db2eea-f82c-4108-acd3-dafe3c975665\") " pod="kube-system/konnectivity-agent-lw7mf"
Jul 27 20:04:13.757311 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.756745    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce-host\") pod \"tuned-lvnfj\" (UID: \"479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce\") " pod="openshift-cluster-node-tuning-operator/tuned-lvnfj"
Jul 27 20:04:13.757311 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.756767    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzs2z\" (UniqueName: \"kubernetes.io/projected/2d6a65ae-132e-4119-8186-23eb80d62c47-kube-api-access-nzs2z\") pod \"iptables-alerter-zjmlr\" (UID: \"2d6a65ae-132e-4119-8186-23eb80d62c47\") " pod="openshift-network-operator/iptables-alerter-zjmlr"
Jul 27 20:04:13.757311 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.756791    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce-etc-kubernetes\") pod \"tuned-lvnfj\" (UID: \"479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce\") " pod="openshift-cluster-node-tuning-operator/tuned-lvnfj"
Jul 27 20:04:13.757311 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.756812    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce-etc-systemd\") pod \"tuned-lvnfj\" (UID: \"479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce\") " pod="openshift-cluster-node-tuning-operator/tuned-lvnfj"
Jul 27 20:04:13.757311 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.756833    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce-sys\") pod \"tuned-lvnfj\" (UID: \"479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce\") " pod="openshift-cluster-node-tuning-operator/tuned-lvnfj"
Jul 27 20:04:13.757311 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.756855    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fg2qm\" (UniqueName: \"kubernetes.io/projected/1b56de62-a601-4cc1-80c9-5b640c1060fe-kube-api-access-fg2qm\") pod \"node-resolver-rzzr5\" (UID: \"1b56de62-a601-4cc1-80c9-5b640c1060fe\") " pod="openshift-dns/node-resolver-rzzr5"
Jul 27 20:04:13.757311 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.756879    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/012b0fd7-e3a3-4010-90c1-274a7cfc5f02-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zvh24\" (UID: \"012b0fd7-e3a3-4010-90c1-274a7cfc5f02\") " pod="openshift-multus/multus-additional-cni-plugins-zvh24"
Jul 27 20:04:13.757311 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.756906    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2d6a65ae-132e-4119-8186-23eb80d62c47-host-slash\") pod \"iptables-alerter-zjmlr\" (UID: \"2d6a65ae-132e-4119-8186-23eb80d62c47\") " pod="openshift-network-operator/iptables-alerter-zjmlr"
Jul 27 20:04:13.757311 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.756926    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce-run\") pod \"tuned-lvnfj\" (UID: \"479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce\") " pod="openshift-cluster-node-tuning-operator/tuned-lvnfj"
Jul 27 20:04:13.757311 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.756947    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce-tmp\") pod \"tuned-lvnfj\" (UID: \"479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce\") " pod="openshift-cluster-node-tuning-operator/tuned-lvnfj"
Jul 27 20:04:13.758147 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.756968    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pwwx\" (UniqueName: \"kubernetes.io/projected/479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce-kube-api-access-5pwwx\") pod \"tuned-lvnfj\" (UID: \"479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce\") " pod="openshift-cluster-node-tuning-operator/tuned-lvnfj"
Jul 27 20:04:13.758147 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.756993    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b56de62-a601-4cc1-80c9-5b640c1060fe-tmp-dir\") pod \"node-resolver-rzzr5\" (UID: \"1b56de62-a601-4cc1-80c9-5b640c1060fe\") " pod="openshift-dns/node-resolver-rzzr5"
Jul 27 20:04:13.758147 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.757017    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/387c729d-a515-4e95-ad05-dbaa75da5b16-metrics-certs\") pod \"network-metrics-daemon-ng4cb\" (UID: \"387c729d-a515-4e95-ad05-dbaa75da5b16\") " pod="openshift-multus/network-metrics-daemon-ng4cb"
Jul 27 20:04:13.758147 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.757041    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce-etc-tuned\") pod \"tuned-lvnfj\" (UID: \"479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce\") " pod="openshift-cluster-node-tuning-operator/tuned-lvnfj"
Jul 27 20:04:13.758147 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.757064    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/012b0fd7-e3a3-4010-90c1-274a7cfc5f02-os-release\") pod \"multus-additional-cni-plugins-zvh24\" (UID: \"012b0fd7-e3a3-4010-90c1-274a7cfc5f02\") " pod="openshift-multus/multus-additional-cni-plugins-zvh24"
Jul 27 20:04:13.758147 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.757088    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glw8v\" (UniqueName: \"kubernetes.io/projected/012b0fd7-e3a3-4010-90c1-274a7cfc5f02-kube-api-access-glw8v\") pod \"multus-additional-cni-plugins-zvh24\" (UID: \"012b0fd7-e3a3-4010-90c1-274a7cfc5f02\") " pod="openshift-multus/multus-additional-cni-plugins-zvh24"
Jul 27 20:04:13.758147 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.757114    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce-etc-modprobe-d\") pod \"tuned-lvnfj\" (UID: \"479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce\") " pod="openshift-cluster-node-tuning-operator/tuned-lvnfj"
Jul 27 20:04:13.758147 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.757156    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce-etc-sysconfig\") pod \"tuned-lvnfj\" (UID: \"479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce\") " pod="openshift-cluster-node-tuning-operator/tuned-lvnfj"
Jul 27 20:04:13.758147 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.757234    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1b56de62-a601-4cc1-80c9-5b640c1060fe-hosts-file\") pod \"node-resolver-rzzr5\" (UID: \"1b56de62-a601-4cc1-80c9-5b640c1060fe\") " pod="openshift-dns/node-resolver-rzzr5"
Jul 27 20:04:13.758147 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.757261    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/012b0fd7-e3a3-4010-90c1-274a7cfc5f02-cnibin\") pod \"multus-additional-cni-plugins-zvh24\" (UID: \"012b0fd7-e3a3-4010-90c1-274a7cfc5f02\") " pod="openshift-multus/multus-additional-cni-plugins-zvh24"
Jul 27 20:04:13.758147 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.757297    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/012b0fd7-e3a3-4010-90c1-274a7cfc5f02-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zvh24\" (UID: \"012b0fd7-e3a3-4010-90c1-274a7cfc5f02\") " pod="openshift-multus/multus-additional-cni-plugins-zvh24"
Jul 27 20:04:13.758147 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.757343    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce-etc-sysctl-d\") pod \"tuned-lvnfj\" (UID: \"479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce\") " pod="openshift-cluster-node-tuning-operator/tuned-lvnfj"
Jul 27 20:04:13.758147 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.757378    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce-lib-modules\") pod \"tuned-lvnfj\" (UID: \"479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce\") " pod="openshift-cluster-node-tuning-operator/tuned-lvnfj"
Jul 27 20:04:13.758147 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.757403    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce-var-lib-kubelet\") pod \"tuned-lvnfj\" (UID: \"479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce\") " pod="openshift-cluster-node-tuning-operator/tuned-lvnfj"
Jul 27 20:04:13.758147 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.757428    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/30db2eea-f82c-4108-acd3-dafe3c975665-konnectivity-ca\") pod \"konnectivity-agent-lw7mf\" (UID: \"30db2eea-f82c-4108-acd3-dafe3c975665\") " pod="kube-system/konnectivity-agent-lw7mf"
Jul 27 20:04:13.758147 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.757481    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2d6a65ae-132e-4119-8186-23eb80d62c47-iptables-alerter-script\") pod \"iptables-alerter-zjmlr\" (UID: \"2d6a65ae-132e-4119-8186-23eb80d62c47\") " pod="openshift-network-operator/iptables-alerter-zjmlr"
Jul 27 20:04:13.759375 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.759290    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-49n6x"
Jul 27 20:04:13.761823 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.761802    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kskcj"
Jul 27 20:04:13.761913 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.761875    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 27 20:04:13.762113 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.761879    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 27 20:04:13.762492 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.762409    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 27 20:04:13.762639 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.762598    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 27 20:04:13.762750 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.762711    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 27 20:04:13.763055 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.763035    2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 27 20:04:13.763259 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.763241    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-8fvm6\""
Jul 27 20:04:13.763380 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.763361    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 27 20:04:13.766583 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.766562    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 27 20:04:13.766676 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.766629    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-qnnjz\""
Jul 27 20:04:13.766890 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.766873    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 27 20:04:13.767042 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.766444    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4f5vb"
Jul 27 20:04:13.767255 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.767235    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 27 20:04:13.769039 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.769018    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-m6679"
Jul 27 20:04:13.771649 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.771596    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 27 20:04:13.771842 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.771801    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 27 20:04:13.772188 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.772166    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-4m4g4\""
Jul 27 20:04:13.772408 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.772390    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 27 20:04:13.772576 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.772441    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 27 20:04:13.772930 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.772910    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-mz4gq\""
Jul 27 20:04:13.781818 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.781703    2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-jvwbh"
Jul 27 20:04:13.790129 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.790078    2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-jvwbh"
Jul 27 20:04:13.848512 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.848434    2557 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 27 20:04:13.858080 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.858049    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce-run\") pod \"tuned-lvnfj\" (UID: \"479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce\") " pod="openshift-cluster-node-tuning-operator/tuned-lvnfj"
Jul 27 20:04:13.858080 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.858081    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce-tmp\") pod \"tuned-lvnfj\" (UID: \"479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce\") " pod="openshift-cluster-node-tuning-operator/tuned-lvnfj"
Jul 27 20:04:13.858300 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.858101    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pwwx\" (UniqueName: \"kubernetes.io/projected/479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce-kube-api-access-5pwwx\") pod \"tuned-lvnfj\" (UID: \"479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce\") " pod="openshift-cluster-node-tuning-operator/tuned-lvnfj"
Jul 27 20:04:13.858300 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.858130    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8b80d55b-21c2-41bc-9e47-ec1583240fc2-original-pull-secret\") pod \"global-pull-secret-syncer-77759\" (UID: \"8b80d55b-21c2-41bc-9e47-ec1583240fc2\") " pod="kube-system/global-pull-secret-syncer-77759"
Jul 27 20:04:13.858300 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.858154    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b49a7aaa-8c6f-4fff-a014-8f20da728376-host-cni-bin\") pod \"ovnkube-node-49n6x\" (UID: \"b49a7aaa-8c6f-4fff-a014-8f20da728376\") " pod="openshift-ovn-kubernetes/ovnkube-node-49n6x"
Jul 27 20:04:13.858300 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.858177    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b9ad3fc-ee74-43ea-be90-3663d26ff6c7-host-var-lib-kubelet\") pod \"multus-m6679\" (UID: \"4b9ad3fc-ee74-43ea-be90-3663d26ff6c7\") " pod="openshift-multus/multus-m6679"
Jul 27 20:04:13.858300 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.858178    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce-run\") pod \"tuned-lvnfj\" (UID: \"479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce\") " pod="openshift-cluster-node-tuning-operator/tuned-lvnfj"
Jul 27 20:04:13.858300 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.858198    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4b9ad3fc-ee74-43ea-be90-3663d26ff6c7-hostroot\") pod \"multus-m6679\" (UID: \"4b9ad3fc-ee74-43ea-be90-3663d26ff6c7\") " pod="openshift-multus/multus-m6679"
Jul 27 20:04:13.858300 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.858238    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/387c729d-a515-4e95-ad05-dbaa75da5b16-metrics-certs\") pod \"network-metrics-daemon-ng4cb\" (UID: \"387c729d-a515-4e95-ad05-dbaa75da5b16\") " pod="openshift-multus/network-metrics-daemon-ng4cb"
Jul 27 20:04:13.858300 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.858263    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glw8v\" (UniqueName: \"kubernetes.io/projected/012b0fd7-e3a3-4010-90c1-274a7cfc5f02-kube-api-access-glw8v\") pod \"multus-additional-cni-plugins-zvh24\" (UID: \"012b0fd7-e3a3-4010-90c1-274a7cfc5f02\") " pod="openshift-multus/multus-additional-cni-plugins-zvh24"
Jul 27 20:04:13.858300 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.858284    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b49a7aaa-8c6f-4fff-a014-8f20da728376-run-systemd\") pod \"ovnkube-node-49n6x\" (UID: \"b49a7aaa-8c6f-4fff-a014-8f20da728376\") " pod="openshift-ovn-kubernetes/ovnkube-node-49n6x"
Jul 27 20:04:13.858803 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.858306    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b49a7aaa-8c6f-4fff-a014-8f20da728376-run-ovn\") pod \"ovnkube-node-49n6x\" (UID: \"b49a7aaa-8c6f-4fff-a014-8f20da728376\") " pod="openshift-ovn-kubernetes/ovnkube-node-49n6x"
Jul 27 20:04:13.858803 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.858326    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4b9ad3fc-ee74-43ea-be90-3663d26ff6c7-multus-cni-dir\") pod \"multus-m6679\" (UID: \"4b9ad3fc-ee74-43ea-be90-3663d26ff6c7\") " pod="openshift-multus/multus-m6679"
Jul 27 20:04:13.858803 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.858350    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4b9ad3fc-ee74-43ea-be90-3663d26ff6c7-multus-daemon-config\") pod \"multus-m6679\" (UID: \"4b9ad3fc-ee74-43ea-be90-3663d26ff6c7\") " pod="openshift-multus/multus-m6679"
Jul 27 20:04:13.858803 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.858376    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce-etc-sysconfig\") pod \"tuned-lvnfj\" (UID: \"479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce\") " pod="openshift-cluster-node-tuning-operator/tuned-lvnfj"
Jul 27 20:04:13.858803 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.858404    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/012b0fd7-e3a3-4010-90c1-274a7cfc5f02-cnibin\") pod \"multus-additional-cni-plugins-zvh24\" (UID: \"012b0fd7-e3a3-4010-90c1-274a7cfc5f02\") " pod="openshift-multus/multus-additional-cni-plugins-zvh24"
Jul 27 20:04:13.858803 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.858430    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jflkw\" (UniqueName: \"kubernetes.io/projected/99be7ce7-1c99-4883-866d-4a67291887ff-kube-api-access-jflkw\") pod \"network-check-target-kxvq5\" (UID: \"99be7ce7-1c99-4883-866d-4a67291887ff\") " pod="openshift-network-diagnostics/network-check-target-kxvq5"
Jul 27 20:04:13.858803 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.858468    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b49a7aaa-8c6f-4fff-a014-8f20da728376-log-socket\") pod \"ovnkube-node-49n6x\" (UID: \"b49a7aaa-8c6f-4fff-a014-8f20da728376\") " pod="openshift-ovn-kubernetes/ovnkube-node-49n6x"
Jul 27 20:04:13.858803 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.858489    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b49a7aaa-8c6f-4fff-a014-8f20da728376-host-run-ovn-kubernetes\") pod \"ovnkube-node-49n6x\" (UID: \"b49a7aaa-8c6f-4fff-a014-8f20da728376\") " pod="openshift-ovn-kubernetes/ovnkube-node-49n6x"
Jul 27 20:04:13.858803 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.858511    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b49a7aaa-8c6f-4fff-a014-8f20da728376-env-overrides\") pod \"ovnkube-node-49n6x\" (UID: \"b49a7aaa-8c6f-4fff-a014-8f20da728376\") " pod="openshift-ovn-kubernetes/ovnkube-node-49n6x"
Jul 27 20:04:13.858803 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.858534    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b49a7aaa-8c6f-4fff-a014-8f20da728376-ovnkube-script-lib\") pod \"ovnkube-node-49n6x\" (UID: \"b49a7aaa-8c6f-4fff-a014-8f20da728376\") " pod="openshift-ovn-kubernetes/ovnkube-node-49n6x"
Jul 27 20:04:13.858803 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.858559    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce-var-lib-kubelet\") pod \"tuned-lvnfj\" (UID: \"479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce\") " pod="openshift-cluster-node-tuning-operator/tuned-lvnfj"
Jul 27 20:04:13.858803 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.858583    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8b80d55b-21c2-41bc-9e47-ec1583240fc2-dbus\") pod \"global-pull-secret-syncer-77759\" (UID: \"8b80d55b-21c2-41bc-9e47-ec1583240fc2\") " pod="kube-system/global-pull-secret-syncer-77759"
Jul 27 20:04:13.858803 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.858604    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b49a7aaa-8c6f-4fff-a014-8f20da728376-etc-openvswitch\") pod \"ovnkube-node-49n6x\" (UID: \"b49a7aaa-8c6f-4fff-a014-8f20da728376\") " pod="openshift-ovn-kubernetes/ovnkube-node-49n6x"
Jul 27 20:04:13.858803 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:13.858614    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:04:13.858803 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.858627    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5eb3269f-73ac-46ec-9ec8-1b188da4b846-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kskcj\" (UID: \"5eb3269f-73ac-46ec-9ec8-1b188da4b846\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kskcj"
Jul 27 20:04:13.858803 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.858651    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4b9ad3fc-ee74-43ea-be90-3663d26ff6c7-host-run-netns\") pod \"multus-m6679\" (UID: \"4b9ad3fc-ee74-43ea-be90-3663d26ff6c7\") " pod="openshift-multus/multus-m6679"
Jul 27 20:04:13.859393 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:13.858706    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/387c729d-a515-4e95-ad05-dbaa75da5b16-metrics-certs podName:387c729d-a515-4e95-ad05-dbaa75da5b16 nodeName:}" failed. No retries permitted until 2026-07-27 20:04:14.358666789 +0000 UTC m=+2.933393156 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/387c729d-a515-4e95-ad05-dbaa75da5b16-metrics-certs") pod "network-metrics-daemon-ng4cb" (UID: "387c729d-a515-4e95-ad05-dbaa75da5b16") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:04:13.859393 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.858715    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/012b0fd7-e3a3-4010-90c1-274a7cfc5f02-cnibin\") pod \"multus-additional-cni-plugins-zvh24\" (UID: \"012b0fd7-e3a3-4010-90c1-274a7cfc5f02\") " pod="openshift-multus/multus-additional-cni-plugins-zvh24"
Jul 27 20:04:13.859393 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.858731    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2d6a65ae-132e-4119-8186-23eb80d62c47-iptables-alerter-script\") pod \"iptables-alerter-zjmlr\" (UID: \"2d6a65ae-132e-4119-8186-23eb80d62c47\") " pod="openshift-network-operator/iptables-alerter-zjmlr"
Jul 27 20:04:13.859393 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.858765    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4blwt\" (UniqueName: \"kubernetes.io/projected/387c729d-a515-4e95-ad05-dbaa75da5b16-kube-api-access-4blwt\") pod \"network-metrics-daemon-ng4cb\" (UID: \"387c729d-a515-4e95-ad05-dbaa75da5b16\") " pod="openshift-multus/network-metrics-daemon-ng4cb"
Jul 27 20:04:13.859393 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.858796    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce-var-lib-kubelet\") pod \"tuned-lvnfj\" (UID: \"479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce\") " pod="openshift-cluster-node-tuning-operator/tuned-lvnfj"
Jul 27 20:04:13.859393 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.858802    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce-etc-sysctl-conf\") pod \"tuned-lvnfj\" (UID: \"479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce\") " pod="openshift-cluster-node-tuning-operator/tuned-lvnfj"
Jul 27 20:04:13.859393 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.858833    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/012b0fd7-e3a3-4010-90c1-274a7cfc5f02-cni-binary-copy\") pod \"multus-additional-cni-plugins-zvh24\" (UID: \"012b0fd7-e3a3-4010-90c1-274a7cfc5f02\") " pod="openshift-multus/multus-additional-cni-plugins-zvh24"
Jul 27 20:04:13.859393 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.858866    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b49a7aaa-8c6f-4fff-a014-8f20da728376-host-slash\") pod \"ovnkube-node-49n6x\" (UID: \"b49a7aaa-8c6f-4fff-a014-8f20da728376\") " pod="openshift-ovn-kubernetes/ovnkube-node-49n6x"
Jul 27 20:04:13.859393 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.858893    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4b9ad3fc-ee74-43ea-be90-3663d26ff6c7-host-run-k8s-cni-cncf-io\") pod \"multus-m6679\" (UID: \"4b9ad3fc-ee74-43ea-be90-3663d26ff6c7\") " pod="openshift-multus/multus-m6679"
Jul 27 20:04:13.859393 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.858900    2557 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 27 20:04:13.859393 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.858916    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/97e4eedc-db60-4e33-96d5-a66a5b35ac80-host\") pod \"node-ca-4f5vb\" (UID: \"97e4eedc-db60-4e33-96d5-a66a5b35ac80\") " pod="openshift-image-registry/node-ca-4f5vb"
Jul 27 20:04:13.859393 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.858939    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b49a7aaa-8c6f-4fff-a014-8f20da728376-ovnkube-config\") pod \"ovnkube-node-49n6x\" (UID: \"b49a7aaa-8c6f-4fff-a014-8f20da728376\") " pod="openshift-ovn-kubernetes/ovnkube-node-49n6x"
Jul 27 20:04:13.859393 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.858963    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5eb3269f-73ac-46ec-9ec8-1b188da4b846-socket-dir\") pod \"aws-ebs-csi-driver-node-kskcj\" (UID: \"5eb3269f-73ac-46ec-9ec8-1b188da4b846\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kskcj"
Jul 27 20:04:13.859393 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.858988    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5eb3269f-73ac-46ec-9ec8-1b188da4b846-etc-selinux\") pod \"aws-ebs-csi-driver-node-kskcj\" (UID: \"5eb3269f-73ac-46ec-9ec8-1b188da4b846\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kskcj"
Jul 27 20:04:13.859393 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.859012    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b9ad3fc-ee74-43ea-be90-3663d26ff6c7-etc-kubernetes\") pod \"multus-m6679\" (UID: \"4b9ad3fc-ee74-43ea-be90-3663d26ff6c7\") " pod="openshift-multus/multus-m6679"
Jul 27 20:04:13.859393 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.859045    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce-host\") pod \"tuned-lvnfj\" (UID: \"479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce\") " pod="openshift-cluster-node-tuning-operator/tuned-lvnfj"
Jul 27 20:04:13.860049 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.859067    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5eb3269f-73ac-46ec-9ec8-1b188da4b846-device-dir\") pod \"aws-ebs-csi-driver-node-kskcj\" (UID: \"5eb3269f-73ac-46ec-9ec8-1b188da4b846\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kskcj"
Jul 27 20:04:13.860049 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.859100    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzs2z\" (UniqueName: \"kubernetes.io/projected/2d6a65ae-132e-4119-8186-23eb80d62c47-kube-api-access-nzs2z\") pod \"iptables-alerter-zjmlr\" (UID: \"2d6a65ae-132e-4119-8186-23eb80d62c47\") " pod="openshift-network-operator/iptables-alerter-zjmlr"
Jul 27 20:04:13.860049 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.859124    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce-etc-systemd\") pod \"tuned-lvnfj\" (UID: \"479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce\") " pod="openshift-cluster-node-tuning-operator/tuned-lvnfj"
Jul 27 20:04:13.860049 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.859149    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/012b0fd7-e3a3-4010-90c1-274a7cfc5f02-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zvh24\" (UID: \"012b0fd7-e3a3-4010-90c1-274a7cfc5f02\") " pod="openshift-multus/multus-additional-cni-plugins-zvh24"
Jul 27 20:04:13.860049 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.859179    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b49a7aaa-8c6f-4fff-a014-8f20da728376-systemd-units\") pod \"ovnkube-node-49n6x\" (UID: \"b49a7aaa-8c6f-4fff-a014-8f20da728376\") " pod="openshift-ovn-kubernetes/ovnkube-node-49n6x"
Jul 27 20:04:13.860049 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.859204    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2d6a65ae-132e-4119-8186-23eb80d62c47-host-slash\") pod \"iptables-alerter-zjmlr\" (UID: \"2d6a65ae-132e-4119-8186-23eb80d62c47\") " pod="openshift-network-operator/iptables-alerter-zjmlr"
Jul 27 20:04:13.860049 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.859263    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2d6a65ae-132e-4119-8186-23eb80d62c47-host-slash\") pod \"iptables-alerter-zjmlr\" (UID: \"2d6a65ae-132e-4119-8186-23eb80d62c47\") " pod="openshift-network-operator/iptables-alerter-zjmlr"
Jul 27 20:04:13.860049 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.859351    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce-host\") pod \"tuned-lvnfj\" (UID: \"479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce\") " pod="openshift-cluster-node-tuning-operator/tuned-lvnfj"
Jul 27 20:04:13.860049 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.859537    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce-etc-sysctl-conf\") pod \"tuned-lvnfj\" (UID: \"479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce\") " pod="openshift-cluster-node-tuning-operator/tuned-lvnfj"
Jul 27 20:04:13.860049 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.858559    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce-etc-sysconfig\") pod \"tuned-lvnfj\" (UID: \"479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce\") " pod="openshift-cluster-node-tuning-operator/tuned-lvnfj"
Jul 27 20:04:13.860049 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.859647    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce-etc-systemd\") pod \"tuned-lvnfj\" (UID: \"479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce\") " pod="openshift-cluster-node-tuning-operator/tuned-lvnfj"
Jul 27 20:04:13.860049 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.859658    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b56de62-a601-4cc1-80c9-5b640c1060fe-tmp-dir\") pod \"node-resolver-rzzr5\" (UID: \"1b56de62-a601-4cc1-80c9-5b640c1060fe\") " pod="openshift-dns/node-resolver-rzzr5"
Jul 27 20:04:13.860049 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.859689    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8b80d55b-21c2-41bc-9e47-ec1583240fc2-kubelet-config\") pod \"global-pull-secret-syncer-77759\" (UID: \"8b80d55b-21c2-41bc-9e47-ec1583240fc2\") " pod="kube-system/global-pull-secret-syncer-77759"
Jul 27 20:04:13.860049 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.859715    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b49a7aaa-8c6f-4fff-a014-8f20da728376-var-lib-openvswitch\") pod \"ovnkube-node-49n6x\" (UID: \"b49a7aaa-8c6f-4fff-a014-8f20da728376\") " pod="openshift-ovn-kubernetes/ovnkube-node-49n6x"
Jul 27 20:04:13.860049 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.859721    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2d6a65ae-132e-4119-8186-23eb80d62c47-iptables-alerter-script\") pod \"iptables-alerter-zjmlr\" (UID: \"2d6a65ae-132e-4119-8186-23eb80d62c47\") " pod="openshift-network-operator/iptables-alerter-zjmlr"
Jul 27 20:04:13.860049 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.859756    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b49a7aaa-8c6f-4fff-a014-8f20da728376-ovn-node-metrics-cert\") pod \"ovnkube-node-49n6x\" (UID: \"b49a7aaa-8c6f-4fff-a014-8f20da728376\") " pod="openshift-ovn-kubernetes/ovnkube-node-49n6x"
Jul 27 20:04:13.860049 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.859779    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4b9ad3fc-ee74-43ea-be90-3663d26ff6c7-system-cni-dir\") pod \"multus-m6679\" (UID: \"4b9ad3fc-ee74-43ea-be90-3663d26ff6c7\") " pod="openshift-multus/multus-m6679"
Jul 27 20:04:13.860828 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.859801    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4b9ad3fc-ee74-43ea-be90-3663d26ff6c7-host-var-lib-cni-bin\") pod \"multus-m6679\" (UID: \"4b9ad3fc-ee74-43ea-be90-3663d26ff6c7\") " pod="openshift-multus/multus-m6679"
Jul 27 20:04:13.860828 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.859828    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce-etc-tuned\") pod \"tuned-lvnfj\" (UID: \"479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce\") " pod="openshift-cluster-node-tuning-operator/tuned-lvnfj"
Jul 27 20:04:13.860828 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.859849    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/012b0fd7-e3a3-4010-90c1-274a7cfc5f02-os-release\") pod \"multus-additional-cni-plugins-zvh24\" (UID: \"012b0fd7-e3a3-4010-90c1-274a7cfc5f02\") " pod="openshift-multus/multus-additional-cni-plugins-zvh24"
Jul 27 20:04:13.860828 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.859872    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b49a7aaa-8c6f-4fff-a014-8f20da728376-node-log\") pod \"ovnkube-node-49n6x\" (UID: \"b49a7aaa-8c6f-4fff-a014-8f20da728376\") " pod="openshift-ovn-kubernetes/ovnkube-node-49n6x"
Jul 27 20:04:13.860828 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.859894    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4b9ad3fc-ee74-43ea-be90-3663d26ff6c7-host-run-multus-certs\") pod \"multus-m6679\" (UID: \"4b9ad3fc-ee74-43ea-be90-3663d26ff6c7\") " pod="openshift-multus/multus-m6679"
Jul 27 20:04:13.860828 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.859918    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcdf9\" (UniqueName: \"kubernetes.io/projected/4b9ad3fc-ee74-43ea-be90-3663d26ff6c7-kube-api-access-wcdf9\") pod \"multus-m6679\" (UID: \"4b9ad3fc-ee74-43ea-be90-3663d26ff6c7\") " pod="openshift-multus/multus-m6679"
Jul 27 20:04:13.860828 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.859942    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce-etc-modprobe-d\") pod \"tuned-lvnfj\" (UID: \"479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce\") " pod="openshift-cluster-node-tuning-operator/tuned-lvnfj"
Jul 27 20:04:13.860828 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.859967    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1b56de62-a601-4cc1-80c9-5b640c1060fe-hosts-file\") pod \"node-resolver-rzzr5\" (UID: \"1b56de62-a601-4cc1-80c9-5b640c1060fe\") " pod="openshift-dns/node-resolver-rzzr5"
Jul 27 20:04:13.860828 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.859993    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/012b0fd7-e3a3-4010-90c1-274a7cfc5f02-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zvh24\" (UID: \"012b0fd7-e3a3-4010-90c1-274a7cfc5f02\") " pod="openshift-multus/multus-additional-cni-plugins-zvh24"
Jul 27 20:04:13.860828 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.860012    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b56de62-a601-4cc1-80c9-5b640c1060fe-tmp-dir\") pod \"node-resolver-rzzr5\" (UID: \"1b56de62-a601-4cc1-80c9-5b640c1060fe\") " pod="openshift-dns/node-resolver-rzzr5"
Jul 27 20:04:13.860828 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.860018    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b49a7aaa-8c6f-4fff-a014-8f20da728376-host-run-netns\") pod \"ovnkube-node-49n6x\" (UID: \"b49a7aaa-8c6f-4fff-a014-8f20da728376\") " pod="openshift-ovn-kubernetes/ovnkube-node-49n6x"
Jul 27 20:04:13.860828 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.860041    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcvbc\" (UniqueName: \"kubernetes.io/projected/b49a7aaa-8c6f-4fff-a014-8f20da728376-kube-api-access-bcvbc\") pod \"ovnkube-node-49n6x\" (UID: \"b49a7aaa-8c6f-4fff-a014-8f20da728376\") " pod="openshift-ovn-kubernetes/ovnkube-node-49n6x"
Jul 27 20:04:13.860828 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.860064    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5eb3269f-73ac-46ec-9ec8-1b188da4b846-registration-dir\") pod \"aws-ebs-csi-driver-node-kskcj\" (UID: \"5eb3269f-73ac-46ec-9ec8-1b188da4b846\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kskcj"
Jul 27 20:04:13.860828 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.860088    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5eb3269f-73ac-46ec-9ec8-1b188da4b846-sys-fs\") pod \"aws-ebs-csi-driver-node-kskcj\" (UID: \"5eb3269f-73ac-46ec-9ec8-1b188da4b846\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kskcj"
Jul 27 20:04:13.860828 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.860109    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4b9ad3fc-ee74-43ea-be90-3663d26ff6c7-cnibin\") pod \"multus-m6679\" (UID: \"4b9ad3fc-ee74-43ea-be90-3663d26ff6c7\") " pod="openshift-multus/multus-m6679"
Jul 27 20:04:13.860828 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.860135    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce-etc-sysctl-d\") pod \"tuned-lvnfj\" (UID: \"479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce\") " pod="openshift-cluster-node-tuning-operator/tuned-lvnfj"
Jul 27 20:04:13.860828 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.860162    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce-lib-modules\") pod \"tuned-lvnfj\" (UID: \"479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce\") " pod="openshift-cluster-node-tuning-operator/tuned-lvnfj"
Jul 27 20:04:13.861603 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.860162    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/012b0fd7-e3a3-4010-90c1-274a7cfc5f02-cni-binary-copy\") pod \"multus-additional-cni-plugins-zvh24\" (UID: \"012b0fd7-e3a3-4010-90c1-274a7cfc5f02\") " pod="openshift-multus/multus-additional-cni-plugins-zvh24"
Jul 27 20:04:13.861603 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.860277    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce-lib-modules\") pod \"tuned-lvnfj\" (UID: \"479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce\") " pod="openshift-cluster-node-tuning-operator/tuned-lvnfj"
Jul 27 20:04:13.861603 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.860308    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rh2zp\" (UniqueName: \"kubernetes.io/projected/97e4eedc-db60-4e33-96d5-a66a5b35ac80-kube-api-access-rh2zp\") pod \"node-ca-4f5vb\" (UID: \"97e4eedc-db60-4e33-96d5-a66a5b35ac80\") " pod="openshift-image-registry/node-ca-4f5vb"
Jul 27 20:04:13.861603 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.860334    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4b9ad3fc-ee74-43ea-be90-3663d26ff6c7-multus-socket-dir-parent\") pod \"multus-m6679\" (UID: \"4b9ad3fc-ee74-43ea-be90-3663d26ff6c7\") " pod="openshift-multus/multus-m6679"
Jul 27 20:04:13.861603 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.860359    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4b9ad3fc-ee74-43ea-be90-3663d26ff6c7-multus-conf-dir\") pod \"multus-m6679\" (UID: \"4b9ad3fc-ee74-43ea-be90-3663d26ff6c7\") " pod="openshift-multus/multus-m6679"
Jul 27 20:04:13.861603 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.860387    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/30db2eea-f82c-4108-acd3-dafe3c975665-konnectivity-ca\") pod \"konnectivity-agent-lw7mf\" (UID: \"30db2eea-f82c-4108-acd3-dafe3c975665\") " pod="kube-system/konnectivity-agent-lw7mf"
Jul 27 20:04:13.861603 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.860428    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/012b0fd7-e3a3-4010-90c1-274a7cfc5f02-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zvh24\" (UID: \"012b0fd7-e3a3-4010-90c1-274a7cfc5f02\") " pod="openshift-multus/multus-additional-cni-plugins-zvh24"
Jul 27 20:04:13.861603 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.860413    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/012b0fd7-e3a3-4010-90c1-274a7cfc5f02-system-cni-dir\") pod \"multus-additional-cni-plugins-zvh24\" (UID: \"012b0fd7-e3a3-4010-90c1-274a7cfc5f02\") " pod="openshift-multus/multus-additional-cni-plugins-zvh24"
Jul 27 20:04:13.861603 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.860487    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4b9ad3fc-ee74-43ea-be90-3663d26ff6c7-host-var-lib-cni-multus\") pod \"multus-m6679\" (UID: \"4b9ad3fc-ee74-43ea-be90-3663d26ff6c7\") " pod="openshift-multus/multus-m6679"
Jul 27 20:04:13.861603 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.860514    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/012b0fd7-e3a3-4010-90c1-274a7cfc5f02-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zvh24\" (UID: \"012b0fd7-e3a3-4010-90c1-274a7cfc5f02\") " pod="openshift-multus/multus-additional-cni-plugins-zvh24"
Jul 27 20:04:13.861603 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.860538    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/97e4eedc-db60-4e33-96d5-a66a5b35ac80-serviceca\") pod \"node-ca-4f5vb\" (UID: \"97e4eedc-db60-4e33-96d5-a66a5b35ac80\") " pod="openshift-image-registry/node-ca-4f5vb"
Jul 27 20:04:13.861603 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.860553    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce-etc-modprobe-d\") pod \"tuned-lvnfj\" (UID: \"479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce\") " pod="openshift-cluster-node-tuning-operator/tuned-lvnfj"
Jul 27 20:04:13.861603 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.860563    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsdsw\" (UniqueName: \"kubernetes.io/projected/5eb3269f-73ac-46ec-9ec8-1b188da4b846-kube-api-access-vsdsw\") pod \"aws-ebs-csi-driver-node-kskcj\" (UID: \"5eb3269f-73ac-46ec-9ec8-1b188da4b846\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kskcj"
Jul 27 20:04:13.861603 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.860591    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/30db2eea-f82c-4108-acd3-dafe3c975665-agent-certs\") pod \"konnectivity-agent-lw7mf\" (UID: \"30db2eea-f82c-4108-acd3-dafe3c975665\") " pod="kube-system/konnectivity-agent-lw7mf"
Jul 27 20:04:13.861603 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.860612    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b49a7aaa-8c6f-4fff-a014-8f20da728376-host-kubelet\") pod \"ovnkube-node-49n6x\" (UID: \"b49a7aaa-8c6f-4fff-a014-8f20da728376\") " pod="openshift-ovn-kubernetes/ovnkube-node-49n6x"
Jul 27 20:04:13.861603 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.860630    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1b56de62-a601-4cc1-80c9-5b640c1060fe-hosts-file\") pod \"node-resolver-rzzr5\" (UID: \"1b56de62-a601-4cc1-80c9-5b640c1060fe\") " pod="openshift-dns/node-resolver-rzzr5"
Jul 27 20:04:13.861603 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.860637    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b49a7aaa-8c6f-4fff-a014-8f20da728376-run-openvswitch\") pod \"ovnkube-node-49n6x\" (UID: \"b49a7aaa-8c6f-4fff-a014-8f20da728376\") " pod="openshift-ovn-kubernetes/ovnkube-node-49n6x"
Jul 27 20:04:13.862525 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.860661    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4b9ad3fc-ee74-43ea-be90-3663d26ff6c7-os-release\") pod \"multus-m6679\" (UID: \"4b9ad3fc-ee74-43ea-be90-3663d26ff6c7\") " pod="openshift-multus/multus-m6679"
Jul 27 20:04:13.862525 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.860684    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce-etc-kubernetes\") pod \"tuned-lvnfj\" (UID: \"479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce\") " pod="openshift-cluster-node-tuning-operator/tuned-lvnfj"
Jul 27 20:04:13.862525 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.860796    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/012b0fd7-e3a3-4010-90c1-274a7cfc5f02-os-release\") pod \"multus-additional-cni-plugins-zvh24\" (UID: \"012b0fd7-e3a3-4010-90c1-274a7cfc5f02\") " pod="openshift-multus/multus-additional-cni-plugins-zvh24"
Jul 27 20:04:13.862525 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.860837    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/012b0fd7-e3a3-4010-90c1-274a7cfc5f02-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zvh24\" (UID: \"012b0fd7-e3a3-4010-90c1-274a7cfc5f02\") " pod="openshift-multus/multus-additional-cni-plugins-zvh24"
Jul 27 20:04:13.862525 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.860885    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce-sys\") pod \"tuned-lvnfj\" (UID: \"479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce\") " pod="openshift-cluster-node-tuning-operator/tuned-lvnfj"
Jul 27 20:04:13.862525 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.860911    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fg2qm\" (UniqueName: \"kubernetes.io/projected/1b56de62-a601-4cc1-80c9-5b640c1060fe-kube-api-access-fg2qm\") pod \"node-resolver-rzzr5\" (UID: \"1b56de62-a601-4cc1-80c9-5b640c1060fe\") " pod="openshift-dns/node-resolver-rzzr5"
Jul 27 20:04:13.862525 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.860938    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b49a7aaa-8c6f-4fff-a014-8f20da728376-host-cni-netd\") pod \"ovnkube-node-49n6x\" (UID: \"b49a7aaa-8c6f-4fff-a014-8f20da728376\") " pod="openshift-ovn-kubernetes/ovnkube-node-49n6x"
Jul 27 20:04:13.862525 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.860965    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b49a7aaa-8c6f-4fff-a014-8f20da728376-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-49n6x\" (UID: \"b49a7aaa-8c6f-4fff-a014-8f20da728376\") " pod="openshift-ovn-kubernetes/ovnkube-node-49n6x"
Jul 27 20:04:13.862525 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.860993    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4b9ad3fc-ee74-43ea-be90-3663d26ff6c7-cni-binary-copy\") pod \"multus-m6679\" (UID: \"4b9ad3fc-ee74-43ea-be90-3663d26ff6c7\") " pod="openshift-multus/multus-m6679"
Jul 27 20:04:13.862525 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.861128    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce-etc-sysctl-d\") pod \"tuned-lvnfj\" (UID: \"479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce\") " pod="openshift-cluster-node-tuning-operator/tuned-lvnfj"
Jul 27 20:04:13.862525 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.861190    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce-etc-kubernetes\") pod \"tuned-lvnfj\" (UID: \"479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce\") " pod="openshift-cluster-node-tuning-operator/tuned-lvnfj"
Jul 27 20:04:13.862525 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.861203    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/012b0fd7-e3a3-4010-90c1-274a7cfc5f02-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zvh24\" (UID: \"012b0fd7-e3a3-4010-90c1-274a7cfc5f02\") " pod="openshift-multus/multus-additional-cni-plugins-zvh24"
Jul 27 20:04:13.862525 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.861236    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce-sys\") pod \"tuned-lvnfj\" (UID: \"479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce\") " pod="openshift-cluster-node-tuning-operator/tuned-lvnfj"
Jul 27 20:04:13.865349 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.863980    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce-etc-tuned\") pod \"tuned-lvnfj\" (UID: \"479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce\") " pod="openshift-cluster-node-tuning-operator/tuned-lvnfj"
Jul 27 20:04:13.865349 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.864124    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce-tmp\") pod \"tuned-lvnfj\" (UID: \"479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce\") " pod="openshift-cluster-node-tuning-operator/tuned-lvnfj"
Jul 27 20:04:13.865349 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.864156    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/30db2eea-f82c-4108-acd3-dafe3c975665-konnectivity-ca\") pod \"konnectivity-agent-lw7mf\" (UID: \"30db2eea-f82c-4108-acd3-dafe3c975665\") " pod="kube-system/konnectivity-agent-lw7mf"
Jul 27 20:04:13.865349 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.864209    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/012b0fd7-e3a3-4010-90c1-274a7cfc5f02-system-cni-dir\") pod \"multus-additional-cni-plugins-zvh24\" (UID: \"012b0fd7-e3a3-4010-90c1-274a7cfc5f02\") " pod="openshift-multus/multus-additional-cni-plugins-zvh24"
Jul 27 20:04:13.867033 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.867006    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pwwx\" (UniqueName: \"kubernetes.io/projected/479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce-kube-api-access-5pwwx\") pod \"tuned-lvnfj\" (UID: \"479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce\") " pod="openshift-cluster-node-tuning-operator/tuned-lvnfj"
Jul 27 20:04:13.868281 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.868256    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/30db2eea-f82c-4108-acd3-dafe3c975665-agent-certs\") pod \"konnectivity-agent-lw7mf\" (UID: \"30db2eea-f82c-4108-acd3-dafe3c975665\") " pod="kube-system/konnectivity-agent-lw7mf"
Jul 27 20:04:13.869473 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.869434    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-glw8v\" (UniqueName: \"kubernetes.io/projected/012b0fd7-e3a3-4010-90c1-274a7cfc5f02-kube-api-access-glw8v\") pod \"multus-additional-cni-plugins-zvh24\" (UID: \"012b0fd7-e3a3-4010-90c1-274a7cfc5f02\") " pod="openshift-multus/multus-additional-cni-plugins-zvh24"
Jul 27 20:04:13.870205 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.870181    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4blwt\" (UniqueName: \"kubernetes.io/projected/387c729d-a515-4e95-ad05-dbaa75da5b16-kube-api-access-4blwt\") pod \"network-metrics-daemon-ng4cb\" (UID: \"387c729d-a515-4e95-ad05-dbaa75da5b16\") " pod="openshift-multus/network-metrics-daemon-ng4cb"
Jul 27 20:04:13.870533 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.870509    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzs2z\" (UniqueName: \"kubernetes.io/projected/2d6a65ae-132e-4119-8186-23eb80d62c47-kube-api-access-nzs2z\") pod \"iptables-alerter-zjmlr\" (UID: \"2d6a65ae-132e-4119-8186-23eb80d62c47\") " pod="openshift-network-operator/iptables-alerter-zjmlr"
Jul 27 20:04:13.872335 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.872312    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fg2qm\" (UniqueName: \"kubernetes.io/projected/1b56de62-a601-4cc1-80c9-5b640c1060fe-kube-api-access-fg2qm\") pod \"node-resolver-rzzr5\" (UID: \"1b56de62-a601-4cc1-80c9-5b640c1060fe\") " pod="openshift-dns/node-resolver-rzzr5"
Jul 27 20:04:13.912496 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.912369    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-149.ec2.internal" event={"ID":"0ff7ebb6ee818f2c2c6896935fdb2199","Type":"ContainerStarted","Data":"1a259c1f3fe9eb0fea4ddef5df9c19db08bb9919b7ab44b2cbefddbf9d53d5dc"}
Jul 27 20:04:13.914783 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.914613    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-149.ec2.internal" event={"ID":"c1d7f2fc6e91fecc35ff7f75225b4759","Type":"ContainerStarted","Data":"1c3917dd8762ace9797c842382a82ccc81963582610ac0c1bf403294c9d943b1"}
Jul 27 20:04:13.962249 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.962214    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b9ad3fc-ee74-43ea-be90-3663d26ff6c7-etc-kubernetes\") pod \"multus-m6679\" (UID: \"4b9ad3fc-ee74-43ea-be90-3663d26ff6c7\") " pod="openshift-multus/multus-m6679"
Jul 27 20:04:13.962249 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.962258    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5eb3269f-73ac-46ec-9ec8-1b188da4b846-device-dir\") pod \"aws-ebs-csi-driver-node-kskcj\" (UID: \"5eb3269f-73ac-46ec-9ec8-1b188da4b846\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kskcj"
Jul 27 20:04:13.963589 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.962287    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b49a7aaa-8c6f-4fff-a014-8f20da728376-systemd-units\") pod \"ovnkube-node-49n6x\" (UID: \"b49a7aaa-8c6f-4fff-a014-8f20da728376\") " pod="openshift-ovn-kubernetes/ovnkube-node-49n6x"
Jul 27 20:04:13.963589 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.962311    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8b80d55b-21c2-41bc-9e47-ec1583240fc2-kubelet-config\") pod \"global-pull-secret-syncer-77759\" (UID: \"8b80d55b-21c2-41bc-9e47-ec1583240fc2\") " pod="kube-system/global-pull-secret-syncer-77759"
Jul 27 20:04:13.963589 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.962331    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b49a7aaa-8c6f-4fff-a014-8f20da728376-var-lib-openvswitch\") pod \"ovnkube-node-49n6x\" (UID: \"b49a7aaa-8c6f-4fff-a014-8f20da728376\") " pod="openshift-ovn-kubernetes/ovnkube-node-49n6x"
Jul 27 20:04:13.963589 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.962356    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b49a7aaa-8c6f-4fff-a014-8f20da728376-ovn-node-metrics-cert\") pod \"ovnkube-node-49n6x\" (UID: \"b49a7aaa-8c6f-4fff-a014-8f20da728376\") " pod="openshift-ovn-kubernetes/ovnkube-node-49n6x"
Jul 27 20:04:13.963589 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.962379    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4b9ad3fc-ee74-43ea-be90-3663d26ff6c7-system-cni-dir\") pod \"multus-m6679\" (UID: \"4b9ad3fc-ee74-43ea-be90-3663d26ff6c7\") " pod="openshift-multus/multus-m6679"
Jul 27 20:04:13.963589 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.962400    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4b9ad3fc-ee74-43ea-be90-3663d26ff6c7-host-var-lib-cni-bin\") pod \"multus-m6679\" (UID: \"4b9ad3fc-ee74-43ea-be90-3663d26ff6c7\") " pod="openshift-multus/multus-m6679"
Jul 27 20:04:13.963589 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.962423    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b49a7aaa-8c6f-4fff-a014-8f20da728376-node-log\") pod \"ovnkube-node-49n6x\" (UID: \"b49a7aaa-8c6f-4fff-a014-8f20da728376\") " pod="openshift-ovn-kubernetes/ovnkube-node-49n6x"
Jul 27 20:04:13.963589 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.962466    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4b9ad3fc-ee74-43ea-be90-3663d26ff6c7-host-run-multus-certs\") pod \"multus-m6679\" (UID: \"4b9ad3fc-ee74-43ea-be90-3663d26ff6c7\") " pod="openshift-multus/multus-m6679"
Jul 27 20:04:13.963589 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.962491    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcdf9\" (UniqueName: \"kubernetes.io/projected/4b9ad3fc-ee74-43ea-be90-3663d26ff6c7-kube-api-access-wcdf9\") pod \"multus-m6679\" (UID: \"4b9ad3fc-ee74-43ea-be90-3663d26ff6c7\") " pod="openshift-multus/multus-m6679"
Jul 27 20:04:13.963589 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.962516    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b49a7aaa-8c6f-4fff-a014-8f20da728376-host-run-netns\") pod \"ovnkube-node-49n6x\" (UID: \"b49a7aaa-8c6f-4fff-a014-8f20da728376\") " pod="openshift-ovn-kubernetes/ovnkube-node-49n6x"
Jul 27 20:04:13.963589 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.962540    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcvbc\" (UniqueName: \"kubernetes.io/projected/b49a7aaa-8c6f-4fff-a014-8f20da728376-kube-api-access-bcvbc\") pod \"ovnkube-node-49n6x\" (UID: \"b49a7aaa-8c6f-4fff-a014-8f20da728376\") " pod="openshift-ovn-kubernetes/ovnkube-node-49n6x"
Jul 27 20:04:13.963589 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.962540    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b49a7aaa-8c6f-4fff-a014-8f20da728376-var-lib-openvswitch\") pod \"ovnkube-node-49n6x\" (UID: \"b49a7aaa-8c6f-4fff-a014-8f20da728376\") " pod="openshift-ovn-kubernetes/ovnkube-node-49n6x"
Jul 27 20:04:13.963589 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.962566    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5eb3269f-73ac-46ec-9ec8-1b188da4b846-registration-dir\") pod \"aws-ebs-csi-driver-node-kskcj\" (UID: \"5eb3269f-73ac-46ec-9ec8-1b188da4b846\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kskcj"
Jul 27 20:04:13.963589 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.962574    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4b9ad3fc-ee74-43ea-be90-3663d26ff6c7-host-var-lib-cni-bin\") pod \"multus-m6679\" (UID: \"4b9ad3fc-ee74-43ea-be90-3663d26ff6c7\") " pod="openshift-multus/multus-m6679"
Jul 27 20:04:13.963589 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.962590    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5eb3269f-73ac-46ec-9ec8-1b188da4b846-sys-fs\") pod \"aws-ebs-csi-driver-node-kskcj\" (UID: \"5eb3269f-73ac-46ec-9ec8-1b188da4b846\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kskcj"
Jul 27 20:04:13.963589 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.962601    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b49a7aaa-8c6f-4fff-a014-8f20da728376-systemd-units\") pod \"ovnkube-node-49n6x\" (UID: \"b49a7aaa-8c6f-4fff-a014-8f20da728376\") " pod="openshift-ovn-kubernetes/ovnkube-node-49n6x"
Jul 27 20:04:13.963589 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.962616    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5eb3269f-73ac-46ec-9ec8-1b188da4b846-device-dir\") pod \"aws-ebs-csi-driver-node-kskcj\" (UID: \"5eb3269f-73ac-46ec-9ec8-1b188da4b846\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kskcj"
Jul 27 20:04:13.964422 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.962623    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4b9ad3fc-ee74-43ea-be90-3663d26ff6c7-cnibin\") pod \"multus-m6679\" (UID: \"4b9ad3fc-ee74-43ea-be90-3663d26ff6c7\") " pod="openshift-multus/multus-m6679"
Jul 27 20:04:13.964422 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.962654    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5eb3269f-73ac-46ec-9ec8-1b188da4b846-sys-fs\") pod \"aws-ebs-csi-driver-node-kskcj\" (UID: \"5eb3269f-73ac-46ec-9ec8-1b188da4b846\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kskcj"
Jul 27 20:04:13.964422 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.962574    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4b9ad3fc-ee74-43ea-be90-3663d26ff6c7-system-cni-dir\") pod \"multus-m6679\" (UID: \"4b9ad3fc-ee74-43ea-be90-3663d26ff6c7\") " pod="openshift-multus/multus-m6679"
Jul 27 20:04:13.964422 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.962655    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8b80d55b-21c2-41bc-9e47-ec1583240fc2-kubelet-config\") pod \"global-pull-secret-syncer-77759\" (UID: \"8b80d55b-21c2-41bc-9e47-ec1583240fc2\") " pod="kube-system/global-pull-secret-syncer-77759"
Jul 27 20:04:13.964422 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.962663    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rh2zp\" (UniqueName: \"kubernetes.io/projected/97e4eedc-db60-4e33-96d5-a66a5b35ac80-kube-api-access-rh2zp\") pod \"node-ca-4f5vb\" (UID: \"97e4eedc-db60-4e33-96d5-a66a5b35ac80\") " pod="openshift-image-registry/node-ca-4f5vb"
Jul 27 20:04:13.964422 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.962691    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b49a7aaa-8c6f-4fff-a014-8f20da728376-host-run-netns\") pod \"ovnkube-node-49n6x\" (UID: \"b49a7aaa-8c6f-4fff-a014-8f20da728376\") " pod="openshift-ovn-kubernetes/ovnkube-node-49n6x"
Jul 27 20:04:13.964422 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.962719    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4b9ad3fc-ee74-43ea-be90-3663d26ff6c7-multus-socket-dir-parent\") pod \"multus-m6679\" (UID: \"4b9ad3fc-ee74-43ea-be90-3663d26ff6c7\") " pod="openshift-multus/multus-m6679"
Jul 27 20:04:13.964422 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.962739    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4b9ad3fc-ee74-43ea-be90-3663d26ff6c7-cnibin\") pod \"multus-m6679\" (UID: \"4b9ad3fc-ee74-43ea-be90-3663d26ff6c7\") " pod="openshift-multus/multus-m6679"
Jul 27 20:04:13.964422 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.962750    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4b9ad3fc-ee74-43ea-be90-3663d26ff6c7-multus-conf-dir\") pod \"multus-m6679\" (UID: \"4b9ad3fc-ee74-43ea-be90-3663d26ff6c7\") " pod="openshift-multus/multus-m6679"
Jul 27 20:04:13.964422 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.962776    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4b9ad3fc-ee74-43ea-be90-3663d26ff6c7-host-var-lib-cni-multus\") pod \"multus-m6679\" (UID: \"4b9ad3fc-ee74-43ea-be90-3663d26ff6c7\") " pod="openshift-multus/multus-m6679"
Jul 27 20:04:13.964422 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.962782    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5eb3269f-73ac-46ec-9ec8-1b188da4b846-registration-dir\") pod \"aws-ebs-csi-driver-node-kskcj\" (UID: \"5eb3269f-73ac-46ec-9ec8-1b188da4b846\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kskcj"
Jul 27 20:04:13.964422 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.962801    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/97e4eedc-db60-4e33-96d5-a66a5b35ac80-serviceca\") pod \"node-ca-4f5vb\" (UID: \"97e4eedc-db60-4e33-96d5-a66a5b35ac80\") " pod="openshift-image-registry/node-ca-4f5vb"
Jul 27 20:04:13.964422 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.962826    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsdsw\" (UniqueName: \"kubernetes.io/projected/5eb3269f-73ac-46ec-9ec8-1b188da4b846-kube-api-access-vsdsw\") pod \"aws-ebs-csi-driver-node-kskcj\" (UID: \"5eb3269f-73ac-46ec-9ec8-1b188da4b846\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kskcj"
Jul 27 20:04:13.964422 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.962849    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b49a7aaa-8c6f-4fff-a014-8f20da728376-host-kubelet\") pod \"ovnkube-node-49n6x\" (UID: \"b49a7aaa-8c6f-4fff-a014-8f20da728376\") " pod="openshift-ovn-kubernetes/ovnkube-node-49n6x"
Jul 27 20:04:13.964422 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.962853    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b49a7aaa-8c6f-4fff-a014-8f20da728376-node-log\") pod \"ovnkube-node-49n6x\" (UID: \"b49a7aaa-8c6f-4fff-a014-8f20da728376\") " pod="openshift-ovn-kubernetes/ovnkube-node-49n6x"
Jul 27 20:04:13.964422 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.962870    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b49a7aaa-8c6f-4fff-a014-8f20da728376-run-openvswitch\") pod \"ovnkube-node-49n6x\" (UID: \"b49a7aaa-8c6f-4fff-a014-8f20da728376\") " pod="openshift-ovn-kubernetes/ovnkube-node-49n6x"
Jul 27 20:04:13.964422 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.962891    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4b9ad3fc-ee74-43ea-be90-3663d26ff6c7-os-release\") pod \"multus-m6679\" (UID: \"4b9ad3fc-ee74-43ea-be90-3663d26ff6c7\") " pod="openshift-multus/multus-m6679"
Jul 27 20:04:13.964422 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.962896    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4b9ad3fc-ee74-43ea-be90-3663d26ff6c7-host-run-multus-certs\") pod \"multus-m6679\" (UID: \"4b9ad3fc-ee74-43ea-be90-3663d26ff6c7\") " pod="openshift-multus/multus-m6679"
Jul 27 20:04:13.965175 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.962926    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b49a7aaa-8c6f-4fff-a014-8f20da728376-host-cni-netd\") pod \"ovnkube-node-49n6x\" (UID: \"b49a7aaa-8c6f-4fff-a014-8f20da728376\") " pod="openshift-ovn-kubernetes/ovnkube-node-49n6x"
Jul 27 20:04:13.965175 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.962964    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b49a7aaa-8c6f-4fff-a014-8f20da728376-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-49n6x\" (UID: \"b49a7aaa-8c6f-4fff-a014-8f20da728376\") " pod="openshift-ovn-kubernetes/ovnkube-node-49n6x"
Jul 27 20:04:13.965175 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.962944    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b9ad3fc-ee74-43ea-be90-3663d26ff6c7-etc-kubernetes\") pod \"multus-m6679\" (UID: \"4b9ad3fc-ee74-43ea-be90-3663d26ff6c7\") " pod="openshift-multus/multus-m6679"
Jul 27 20:04:13.965175 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.963018    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4b9ad3fc-ee74-43ea-be90-3663d26ff6c7-multus-socket-dir-parent\") pod \"multus-m6679\" (UID: \"4b9ad3fc-ee74-43ea-be90-3663d26ff6c7\") " pod="openshift-multus/multus-m6679"
Jul 27 20:04:13.965175 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.963061    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4b9ad3fc-ee74-43ea-be90-3663d26ff6c7-multus-conf-dir\") pod \"multus-m6679\" (UID: \"4b9ad3fc-ee74-43ea-be90-3663d26ff6c7\") " pod="openshift-multus/multus-m6679"
Jul 27 20:04:13.965175 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.962989    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4b9ad3fc-ee74-43ea-be90-3663d26ff6c7-cni-binary-copy\") pod \"multus-m6679\" (UID: \"4b9ad3fc-ee74-43ea-be90-3663d26ff6c7\") " pod="openshift-multus/multus-m6679"
Jul 27 20:04:13.965175 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.963101    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8b80d55b-21c2-41bc-9e47-ec1583240fc2-original-pull-secret\") pod \"global-pull-secret-syncer-77759\" (UID: \"8b80d55b-21c2-41bc-9e47-ec1583240fc2\") " pod="kube-system/global-pull-secret-syncer-77759"
Jul 27 20:04:13.965175 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.963127    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b49a7aaa-8c6f-4fff-a014-8f20da728376-host-cni-bin\") pod \"ovnkube-node-49n6x\" (UID: \"b49a7aaa-8c6f-4fff-a014-8f20da728376\") " pod="openshift-ovn-kubernetes/ovnkube-node-49n6x"
Jul 27 20:04:13.965175 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.963150    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b9ad3fc-ee74-43ea-be90-3663d26ff6c7-host-var-lib-kubelet\") pod \"multus-m6679\" (UID: \"4b9ad3fc-ee74-43ea-be90-3663d26ff6c7\") " pod="openshift-multus/multus-m6679"
Jul 27 20:04:13.965175 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.963173    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4b9ad3fc-ee74-43ea-be90-3663d26ff6c7-hostroot\") pod \"multus-m6679\" (UID: \"4b9ad3fc-ee74-43ea-be90-3663d26ff6c7\") " pod="openshift-multus/multus-m6679"
Jul 27 20:04:13.965175 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.963192    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b49a7aaa-8c6f-4fff-a014-8f20da728376-host-kubelet\") pod \"ovnkube-node-49n6x\" (UID: \"b49a7aaa-8c6f-4fff-a014-8f20da728376\") " pod="openshift-ovn-kubernetes/ovnkube-node-49n6x"
Jul 27 20:04:13.965175 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.963229    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4b9ad3fc-ee74-43ea-be90-3663d26ff6c7-hostroot\") pod \"multus-m6679\" (UID: \"4b9ad3fc-ee74-43ea-be90-3663d26ff6c7\") " pod="openshift-multus/multus-m6679"
Jul 27 20:04:13.965175 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:13.963260    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 20:04:13.965175 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.963264    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b49a7aaa-8c6f-4fff-a014-8f20da728376-run-openvswitch\") pod \"ovnkube-node-49n6x\" (UID: \"b49a7aaa-8c6f-4fff-a014-8f20da728376\") " pod="openshift-ovn-kubernetes/ovnkube-node-49n6x"
Jul 27 20:04:13.965175 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:13.963314    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b80d55b-21c2-41bc-9e47-ec1583240fc2-original-pull-secret podName:8b80d55b-21c2-41bc-9e47-ec1583240fc2 nodeName:}" failed. No retries permitted until 2026-07-27 20:04:14.46329583 +0000 UTC m=+3.038022196 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8b80d55b-21c2-41bc-9e47-ec1583240fc2-original-pull-secret") pod "global-pull-secret-syncer-77759" (UID: "8b80d55b-21c2-41bc-9e47-ec1583240fc2") : object "kube-system"/"original-pull-secret" not registered
Jul 27 20:04:13.965175 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.963322    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4b9ad3fc-ee74-43ea-be90-3663d26ff6c7-os-release\") pod \"multus-m6679\" (UID: \"4b9ad3fc-ee74-43ea-be90-3663d26ff6c7\") " pod="openshift-multus/multus-m6679"
Jul 27 20:04:13.965175 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.963330    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/97e4eedc-db60-4e33-96d5-a66a5b35ac80-serviceca\") pod \"node-ca-4f5vb\" (UID: \"97e4eedc-db60-4e33-96d5-a66a5b35ac80\") " pod="openshift-image-registry/node-ca-4f5vb"
Jul 27 20:04:13.965175 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.963357    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b49a7aaa-8c6f-4fff-a014-8f20da728376-host-cni-netd\") pod \"ovnkube-node-49n6x\" (UID: \"b49a7aaa-8c6f-4fff-a014-8f20da728376\") " pod="openshift-ovn-kubernetes/ovnkube-node-49n6x"
Jul 27 20:04:13.965937 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.963386    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4b9ad3fc-ee74-43ea-be90-3663d26ff6c7-host-var-lib-cni-multus\") pod \"multus-m6679\" (UID: \"4b9ad3fc-ee74-43ea-be90-3663d26ff6c7\") " pod="openshift-multus/multus-m6679"
Jul 27 20:04:13.965937 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.963424    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b49a7aaa-8c6f-4fff-a014-8f20da728376-run-systemd\") pod \"ovnkube-node-49n6x\" (UID: \"b49a7aaa-8c6f-4fff-a014-8f20da728376\") " pod="openshift-ovn-kubernetes/ovnkube-node-49n6x"
Jul 27 20:04:13.965937 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.963427    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b49a7aaa-8c6f-4fff-a014-8f20da728376-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-49n6x\" (UID: \"b49a7aaa-8c6f-4fff-a014-8f20da728376\") " pod="openshift-ovn-kubernetes/ovnkube-node-49n6x"
Jul 27 20:04:13.965937 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.963473    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b49a7aaa-8c6f-4fff-a014-8f20da728376-run-ovn\") pod \"ovnkube-node-49n6x\" (UID: \"b49a7aaa-8c6f-4fff-a014-8f20da728376\") " pod="openshift-ovn-kubernetes/ovnkube-node-49n6x"
Jul 27 20:04:13.965937 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.963487    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b9ad3fc-ee74-43ea-be90-3663d26ff6c7-host-var-lib-kubelet\") pod \"multus-m6679\" (UID: \"4b9ad3fc-ee74-43ea-be90-3663d26ff6c7\") " pod="openshift-multus/multus-m6679"
Jul 27 20:04:13.965937 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.963496    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b49a7aaa-8c6f-4fff-a014-8f20da728376-run-systemd\") pod \"ovnkube-node-49n6x\" (UID: \"b49a7aaa-8c6f-4fff-a014-8f20da728376\") " pod="openshift-ovn-kubernetes/ovnkube-node-49n6x"
Jul 27 20:04:13.965937 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.963500    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4b9ad3fc-ee74-43ea-be90-3663d26ff6c7-multus-cni-dir\") pod \"multus-m6679\" (UID: \"4b9ad3fc-ee74-43ea-be90-3663d26ff6c7\") " pod="openshift-multus/multus-m6679"
Jul 27 20:04:13.965937 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.963523    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4b9ad3fc-ee74-43ea-be90-3663d26ff6c7-cni-binary-copy\") pod \"multus-m6679\" (UID: \"4b9ad3fc-ee74-43ea-be90-3663d26ff6c7\") " pod="openshift-multus/multus-m6679"
Jul 27 20:04:13.965937 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.963535    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b49a7aaa-8c6f-4fff-a014-8f20da728376-run-ovn\") pod \"ovnkube-node-49n6x\" (UID: \"b49a7aaa-8c6f-4fff-a014-8f20da728376\") " pod="openshift-ovn-kubernetes/ovnkube-node-49n6x"
Jul 27 20:04:13.965937 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.963528    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4b9ad3fc-ee74-43ea-be90-3663d26ff6c7-multus-daemon-config\") pod \"multus-m6679\" (UID: \"4b9ad3fc-ee74-43ea-be90-3663d26ff6c7\") " pod="openshift-multus/multus-m6679"
Jul 27 20:04:13.965937 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.963568    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jflkw\" (UniqueName: \"kubernetes.io/projected/99be7ce7-1c99-4883-866d-4a67291887ff-kube-api-access-jflkw\") pod \"network-check-target-kxvq5\" (UID: \"99be7ce7-1c99-4883-866d-4a67291887ff\") " pod="openshift-network-diagnostics/network-check-target-kxvq5"
Jul 27 20:04:13.965937 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.963576    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4b9ad3fc-ee74-43ea-be90-3663d26ff6c7-multus-cni-dir\") pod \"multus-m6679\" (UID: \"4b9ad3fc-ee74-43ea-be90-3663d26ff6c7\") " pod="openshift-multus/multus-m6679"
Jul 27 20:04:13.965937 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.963527    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b49a7aaa-8c6f-4fff-a014-8f20da728376-host-cni-bin\") pod \"ovnkube-node-49n6x\" (UID: \"b49a7aaa-8c6f-4fff-a014-8f20da728376\") " pod="openshift-ovn-kubernetes/ovnkube-node-49n6x"
Jul 27 20:04:13.965937 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.963591    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b49a7aaa-8c6f-4fff-a014-8f20da728376-log-socket\") pod \"ovnkube-node-49n6x\" (UID: \"b49a7aaa-8c6f-4fff-a014-8f20da728376\") " pod="openshift-ovn-kubernetes/ovnkube-node-49n6x"
Jul 27 20:04:13.965937 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.963638    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b49a7aaa-8c6f-4fff-a014-8f20da728376-log-socket\") pod \"ovnkube-node-49n6x\" (UID: \"b49a7aaa-8c6f-4fff-a014-8f20da728376\") " pod="openshift-ovn-kubernetes/ovnkube-node-49n6x"
Jul 27 20:04:13.965937 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.963667    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b49a7aaa-8c6f-4fff-a014-8f20da728376-host-run-ovn-kubernetes\") pod \"ovnkube-node-49n6x\" (UID: \"b49a7aaa-8c6f-4fff-a014-8f20da728376\") " pod="openshift-ovn-kubernetes/ovnkube-node-49n6x"
Jul 27 20:04:13.965937 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.963723    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b49a7aaa-8c6f-4fff-a014-8f20da728376-env-overrides\") pod \"ovnkube-node-49n6x\" (UID: \"b49a7aaa-8c6f-4fff-a014-8f20da728376\") " pod="openshift-ovn-kubernetes/ovnkube-node-49n6x"
Jul 27 20:04:13.965937 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.963753    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b49a7aaa-8c6f-4fff-a014-8f20da728376-ovnkube-script-lib\") pod \"ovnkube-node-49n6x\" (UID: \"b49a7aaa-8c6f-4fff-a014-8f20da728376\") " pod="openshift-ovn-kubernetes/ovnkube-node-49n6x"
Jul 27 20:04:13.966710 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.963785    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8b80d55b-21c2-41bc-9e47-ec1583240fc2-dbus\") pod \"global-pull-secret-syncer-77759\" (UID: \"8b80d55b-21c2-41bc-9e47-ec1583240fc2\") " pod="kube-system/global-pull-secret-syncer-77759"
Jul 27 20:04:13.966710 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.963807    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b49a7aaa-8c6f-4fff-a014-8f20da728376-etc-openvswitch\") pod \"ovnkube-node-49n6x\" (UID: \"b49a7aaa-8c6f-4fff-a014-8f20da728376\") " pod="openshift-ovn-kubernetes/ovnkube-node-49n6x"
Jul 27 20:04:13.966710 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.963853    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5eb3269f-73ac-46ec-9ec8-1b188da4b846-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kskcj\" (UID: \"5eb3269f-73ac-46ec-9ec8-1b188da4b846\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kskcj"
Jul 27 20:04:13.966710 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.963880    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4b9ad3fc-ee74-43ea-be90-3663d26ff6c7-host-run-netns\") pod \"multus-m6679\" (UID: \"4b9ad3fc-ee74-43ea-be90-3663d26ff6c7\") " pod="openshift-multus/multus-m6679"
Jul 27 20:04:13.966710 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.963909    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b49a7aaa-8c6f-4fff-a014-8f20da728376-host-slash\") pod \"ovnkube-node-49n6x\" (UID: \"b49a7aaa-8c6f-4fff-a014-8f20da728376\") " pod="openshift-ovn-kubernetes/ovnkube-node-49n6x"
Jul 27 20:04:13.966710 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.963935    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4b9ad3fc-ee74-43ea-be90-3663d26ff6c7-host-run-k8s-cni-cncf-io\") pod \"multus-m6679\" (UID: \"4b9ad3fc-ee74-43ea-be90-3663d26ff6c7\") " pod="openshift-multus/multus-m6679"
Jul 27 20:04:13.966710 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.963958    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/97e4eedc-db60-4e33-96d5-a66a5b35ac80-host\") pod \"node-ca-4f5vb\" (UID: \"97e4eedc-db60-4e33-96d5-a66a5b35ac80\") " pod="openshift-image-registry/node-ca-4f5vb"
Jul 27 20:04:13.966710 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.963997    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b49a7aaa-8c6f-4fff-a014-8f20da728376-ovnkube-config\") pod \"ovnkube-node-49n6x\" (UID: \"b49a7aaa-8c6f-4fff-a014-8f20da728376\") " pod="openshift-ovn-kubernetes/ovnkube-node-49n6x"
Jul 27 20:04:13.966710 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.964012    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8b80d55b-21c2-41bc-9e47-ec1583240fc2-dbus\") pod \"global-pull-secret-syncer-77759\" (UID: \"8b80d55b-21c2-41bc-9e47-ec1583240fc2\") " pod="kube-system/global-pull-secret-syncer-77759"
Jul 27 20:04:13.966710 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.964021    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5eb3269f-73ac-46ec-9ec8-1b188da4b846-socket-dir\") pod \"aws-ebs-csi-driver-node-kskcj\" (UID: \"5eb3269f-73ac-46ec-9ec8-1b188da4b846\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kskcj"
Jul 27 20:04:13.966710 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.964073    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b49a7aaa-8c6f-4fff-a014-8f20da728376-etc-openvswitch\") pod \"ovnkube-node-49n6x\" (UID: \"b49a7aaa-8c6f-4fff-a014-8f20da728376\") " pod="openshift-ovn-kubernetes/ovnkube-node-49n6x"
Jul 27 20:04:13.966710 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.964092    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4b9ad3fc-ee74-43ea-be90-3663d26ff6c7-host-run-k8s-cni-cncf-io\") pod \"multus-m6679\" (UID: \"4b9ad3fc-ee74-43ea-be90-3663d26ff6c7\") " pod="openshift-multus/multus-m6679"
Jul 27 20:04:13.966710 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.964144    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b49a7aaa-8c6f-4fff-a014-8f20da728376-host-slash\") pod \"ovnkube-node-49n6x\" (UID: \"b49a7aaa-8c6f-4fff-a014-8f20da728376\") " pod="openshift-ovn-kubernetes/ovnkube-node-49n6x"
Jul 27 20:04:13.966710 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.964176    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4b9ad3fc-ee74-43ea-be90-3663d26ff6c7-host-run-netns\") pod \"multus-m6679\" (UID: \"4b9ad3fc-ee74-43ea-be90-3663d26ff6c7\") " pod="openshift-multus/multus-m6679"
Jul 27 20:04:13.966710 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.964197    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5eb3269f-73ac-46ec-9ec8-1b188da4b846-etc-selinux\") pod \"aws-ebs-csi-driver-node-kskcj\" (UID: \"5eb3269f-73ac-46ec-9ec8-1b188da4b846\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kskcj"
Jul 27 20:04:13.966710 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.964202    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5eb3269f-73ac-46ec-9ec8-1b188da4b846-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kskcj\" (UID: \"5eb3269f-73ac-46ec-9ec8-1b188da4b846\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kskcj"
Jul 27 20:04:13.966710 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.964149    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5eb3269f-73ac-46ec-9ec8-1b188da4b846-socket-dir\") pod \"aws-ebs-csi-driver-node-kskcj\" (UID: \"5eb3269f-73ac-46ec-9ec8-1b188da4b846\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kskcj"
Jul 27 20:04:13.967446 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.963751    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b49a7aaa-8c6f-4fff-a014-8f20da728376-host-run-ovn-kubernetes\") pod \"ovnkube-node-49n6x\" (UID: \"b49a7aaa-8c6f-4fff-a014-8f20da728376\") " pod="openshift-ovn-kubernetes/ovnkube-node-49n6x"
Jul 27 20:04:13.967446 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.964015    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4b9ad3fc-ee74-43ea-be90-3663d26ff6c7-multus-daemon-config\") pod \"multus-m6679\" (UID: \"4b9ad3fc-ee74-43ea-be90-3663d26ff6c7\") " pod="openshift-multus/multus-m6679"
Jul 27 20:04:13.967446 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.964251    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/97e4eedc-db60-4e33-96d5-a66a5b35ac80-host\") pod \"node-ca-4f5vb\" (UID: \"97e4eedc-db60-4e33-96d5-a66a5b35ac80\") " pod="openshift-image-registry/node-ca-4f5vb"
Jul 27 20:04:13.967446 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.964325    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5eb3269f-73ac-46ec-9ec8-1b188da4b846-etc-selinux\") pod \"aws-ebs-csi-driver-node-kskcj\" (UID: \"5eb3269f-73ac-46ec-9ec8-1b188da4b846\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kskcj"
Jul 27 20:04:13.967446 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.964923    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b49a7aaa-8c6f-4fff-a014-8f20da728376-env-overrides\") pod \"ovnkube-node-49n6x\" (UID: \"b49a7aaa-8c6f-4fff-a014-8f20da728376\") " pod="openshift-ovn-kubernetes/ovnkube-node-49n6x"
Jul 27 20:04:13.967446 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.965150    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b49a7aaa-8c6f-4fff-a014-8f20da728376-ovnkube-script-lib\") pod \"ovnkube-node-49n6x\" (UID: \"b49a7aaa-8c6f-4fff-a014-8f20da728376\") " pod="openshift-ovn-kubernetes/ovnkube-node-49n6x"
Jul 27 20:04:13.967446 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.965198    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b49a7aaa-8c6f-4fff-a014-8f20da728376-ovnkube-config\") pod \"ovnkube-node-49n6x\" (UID: \"b49a7aaa-8c6f-4fff-a014-8f20da728376\") " pod="openshift-ovn-kubernetes/ovnkube-node-49n6x"
Jul 27 20:04:13.967446 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.965936    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b49a7aaa-8c6f-4fff-a014-8f20da728376-ovn-node-metrics-cert\") pod \"ovnkube-node-49n6x\" (UID: \"b49a7aaa-8c6f-4fff-a014-8f20da728376\") " pod="openshift-ovn-kubernetes/ovnkube-node-49n6x"
Jul 27 20:04:13.971124 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:13.970772    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 20:04:13.971124 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:13.970796    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 20:04:13.971124 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:13.970810    2557 projected.go:196] Error preparing data for projected volume kube-api-access-jflkw for pod openshift-network-diagnostics/network-check-target-kxvq5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:04:13.971124 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:13.970872    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/99be7ce7-1c99-4883-866d-4a67291887ff-kube-api-access-jflkw podName:99be7ce7-1c99-4883-866d-4a67291887ff nodeName:}" failed. No retries permitted until 2026-07-27 20:04:14.47085491 +0000 UTC m=+3.045581298 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jflkw" (UniqueName: "kubernetes.io/projected/99be7ce7-1c99-4883-866d-4a67291887ff-kube-api-access-jflkw") pod "network-check-target-kxvq5" (UID: "99be7ce7-1c99-4883-866d-4a67291887ff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:04:13.973907 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.973421    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcdf9\" (UniqueName: \"kubernetes.io/projected/4b9ad3fc-ee74-43ea-be90-3663d26ff6c7-kube-api-access-wcdf9\") pod \"multus-m6679\" (UID: \"4b9ad3fc-ee74-43ea-be90-3663d26ff6c7\") " pod="openshift-multus/multus-m6679"
Jul 27 20:04:13.974125 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.973985    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rh2zp\" (UniqueName: \"kubernetes.io/projected/97e4eedc-db60-4e33-96d5-a66a5b35ac80-kube-api-access-rh2zp\") pod \"node-ca-4f5vb\" (UID: \"97e4eedc-db60-4e33-96d5-a66a5b35ac80\") " pod="openshift-image-registry/node-ca-4f5vb"
Jul 27 20:04:13.974379 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.974298    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsdsw\" (UniqueName: \"kubernetes.io/projected/5eb3269f-73ac-46ec-9ec8-1b188da4b846-kube-api-access-vsdsw\") pod \"aws-ebs-csi-driver-node-kskcj\" (UID: \"5eb3269f-73ac-46ec-9ec8-1b188da4b846\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kskcj"
Jul 27 20:04:13.974988 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:13.974926    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcvbc\" (UniqueName: \"kubernetes.io/projected/b49a7aaa-8c6f-4fff-a014-8f20da728376-kube-api-access-bcvbc\") pod \"ovnkube-node-49n6x\" (UID: \"b49a7aaa-8c6f-4fff-a014-8f20da728376\") " pod="openshift-ovn-kubernetes/ovnkube-node-49n6x"
Jul 27 20:04:14.054241 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:14.054202    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lw7mf"
Jul 27 20:04:14.064039 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:14.064018    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zjmlr"
Jul 27 20:04:14.074862 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:14.074842    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lvnfj"
Jul 27 20:04:14.081607 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:14.081584    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rzzr5"
Jul 27 20:04:14.090193 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:14.090165    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zvh24"
Jul 27 20:04:14.098919 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:14.098857    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-49n6x"
Jul 27 20:04:14.106703 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:14.106683    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kskcj"
Jul 27 20:04:14.115443 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:14.115424    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4f5vb"
Jul 27 20:04:14.122113 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:14.122087    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-m6679"
Jul 27 20:04:14.367516 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:14.367425    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/387c729d-a515-4e95-ad05-dbaa75da5b16-metrics-certs\") pod \"network-metrics-daemon-ng4cb\" (UID: \"387c729d-a515-4e95-ad05-dbaa75da5b16\") " pod="openshift-multus/network-metrics-daemon-ng4cb"
Jul 27 20:04:14.367658 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:14.367566    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:04:14.367658 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:14.367632    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/387c729d-a515-4e95-ad05-dbaa75da5b16-metrics-certs podName:387c729d-a515-4e95-ad05-dbaa75da5b16 nodeName:}" failed. No retries permitted until 2026-07-27 20:04:15.367616951 +0000 UTC m=+3.942343321 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/387c729d-a515-4e95-ad05-dbaa75da5b16-metrics-certs") pod "network-metrics-daemon-ng4cb" (UID: "387c729d-a515-4e95-ad05-dbaa75da5b16") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:04:14.468366 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:14.468290    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8b80d55b-21c2-41bc-9e47-ec1583240fc2-original-pull-secret\") pod \"global-pull-secret-syncer-77759\" (UID: \"8b80d55b-21c2-41bc-9e47-ec1583240fc2\") " pod="kube-system/global-pull-secret-syncer-77759"
Jul 27 20:04:14.468575 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:14.468489    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 20:04:14.468575 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:14.468564    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b80d55b-21c2-41bc-9e47-ec1583240fc2-original-pull-secret podName:8b80d55b-21c2-41bc-9e47-ec1583240fc2 nodeName:}" failed. No retries permitted until 2026-07-27 20:04:15.468541244 +0000 UTC m=+4.043267615 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8b80d55b-21c2-41bc-9e47-ec1583240fc2-original-pull-secret") pod "global-pull-secret-syncer-77759" (UID: "8b80d55b-21c2-41bc-9e47-ec1583240fc2") : object "kube-system"/"original-pull-secret" not registered
Jul 27 20:04:14.568969 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:14.568895    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jflkw\" (UniqueName: \"kubernetes.io/projected/99be7ce7-1c99-4883-866d-4a67291887ff-kube-api-access-jflkw\") pod \"network-check-target-kxvq5\" (UID: \"99be7ce7-1c99-4883-866d-4a67291887ff\") " pod="openshift-network-diagnostics/network-check-target-kxvq5"
Jul 27 20:04:14.569169 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:14.569091    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 20:04:14.569169 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:14.569123    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 20:04:14.569169 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:14.569138    2557 projected.go:196] Error preparing data for projected volume kube-api-access-jflkw for pod openshift-network-diagnostics/network-check-target-kxvq5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:04:14.569312 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:14.569217    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/99be7ce7-1c99-4883-866d-4a67291887ff-kube-api-access-jflkw podName:99be7ce7-1c99-4883-866d-4a67291887ff nodeName:}" failed. No retries permitted until 2026-07-27 20:04:15.569195531 +0000 UTC m=+4.143921915 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jflkw" (UniqueName: "kubernetes.io/projected/99be7ce7-1c99-4883-866d-4a67291887ff-kube-api-access-jflkw") pod "network-check-target-kxvq5" (UID: "99be7ce7-1c99-4883-866d-4a67291887ff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:04:14.794577 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:14.794493    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 19:59:13 +0000 UTC" deadline="2028-02-04 15:24:09.797410674 +0000 UTC"
Jul 27 20:04:14.794577 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:14.794528    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13363h19m55.002886266s"
Jul 27 20:04:14.905373 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:14.905337    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-77759"
Jul 27 20:04:14.905565 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:14.905493    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-77759" podUID="8b80d55b-21c2-41bc-9e47-ec1583240fc2"
Jul 27 20:04:14.905565 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:14.905563    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ng4cb"
Jul 27 20:04:14.905698 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:14.905663    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ng4cb" podUID="387c729d-a515-4e95-ad05-dbaa75da5b16"
Jul 27 20:04:15.020762 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:15.020732    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b9ad3fc_ee74_43ea_be90_3663d26ff6c7.slice/crio-57b0e2c7c67a6163e253da9870751db9067b68299143ed07dc4bc41647dcb2b9 WatchSource:0}: Error finding container 57b0e2c7c67a6163e253da9870751db9067b68299143ed07dc4bc41647dcb2b9: Status 404 returned error can't find the container with id 57b0e2c7c67a6163e253da9870751db9067b68299143ed07dc4bc41647dcb2b9
Jul 27 20:04:15.025716 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:15.025681    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d6a65ae_132e_4119_8186_23eb80d62c47.slice/crio-02a686807a59bacce2e1ac42fab10283eb8697f37f4444276551e5f1b4071bb3 WatchSource:0}: Error finding container 02a686807a59bacce2e1ac42fab10283eb8697f37f4444276551e5f1b4071bb3: Status 404 returned error can't find the container with id 02a686807a59bacce2e1ac42fab10283eb8697f37f4444276551e5f1b4071bb3
Jul 27 20:04:15.026390 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:15.026336    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97e4eedc_db60_4e33_96d5_a66a5b35ac80.slice/crio-49525c8696955aff182cc5e62fd13e0a945dfa08573437e09cec4b0d7d42fbfb WatchSource:0}: Error finding container 49525c8696955aff182cc5e62fd13e0a945dfa08573437e09cec4b0d7d42fbfb: Status 404 returned error can't find the container with id 49525c8696955aff182cc5e62fd13e0a945dfa08573437e09cec4b0d7d42fbfb
Jul 27 20:04:15.026899 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:15.026875    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b56de62_a601_4cc1_80c9_5b640c1060fe.slice/crio-87f1fae6524247c6c05a65e3b954a30ade6934112fbabdf0ef629b7965944fec WatchSource:0}: Error finding container 87f1fae6524247c6c05a65e3b954a30ade6934112fbabdf0ef629b7965944fec: Status 404 returned error can't find the container with id 87f1fae6524247c6c05a65e3b954a30ade6934112fbabdf0ef629b7965944fec
Jul 27 20:04:15.028261 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:15.028235    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod479cbe00_3a6f_4e7f_a58c_d8e4c4c564ce.slice/crio-5202c0c219618bfd6c3520229c8c07430277e3b4c21e26971e20851bcfbe0f2a WatchSource:0}: Error finding container 5202c0c219618bfd6c3520229c8c07430277e3b4c21e26971e20851bcfbe0f2a: Status 404 returned error can't find the container with id 5202c0c219618bfd6c3520229c8c07430277e3b4c21e26971e20851bcfbe0f2a
Jul 27 20:04:15.050933 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:15.050512    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb49a7aaa_8c6f_4fff_a014_8f20da728376.slice/crio-554df59cb15a502622c2ec167e01fb3734c19bbba52780e1152e51b5cedbdac9 WatchSource:0}: Error finding container 554df59cb15a502622c2ec167e01fb3734c19bbba52780e1152e51b5cedbdac9: Status 404 returned error can't find the container with id 554df59cb15a502622c2ec167e01fb3734c19bbba52780e1152e51b5cedbdac9
Jul 27 20:04:15.051150 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:15.051122    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30db2eea_f82c_4108_acd3_dafe3c975665.slice/crio-67dcb79934302f43b538220479ae29f9f61831d6fa6aa6c77f437cc43459a16d WatchSource:0}: Error finding container 67dcb79934302f43b538220479ae29f9f61831d6fa6aa6c77f437cc43459a16d: Status 404 returned error can't find the container with id 67dcb79934302f43b538220479ae29f9f61831d6fa6aa6c77f437cc43459a16d
Jul 27 20:04:15.052436 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:15.052415    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod012b0fd7_e3a3_4010_90c1_274a7cfc5f02.slice/crio-c700b3b2f0a22de34d54b3110604bb4f534e9e499c208ef68bca039f1277373b WatchSource:0}: Error finding container c700b3b2f0a22de34d54b3110604bb4f534e9e499c208ef68bca039f1277373b: Status 404 returned error can't find the container with id c700b3b2f0a22de34d54b3110604bb4f534e9e499c208ef68bca039f1277373b
Jul 27 20:04:15.053191 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:15.053018    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5eb3269f_73ac_46ec_9ec8_1b188da4b846.slice/crio-9ed7d3af5e5deab3e338c84b83046bfbde3559a9f746fe08ab64036646c966f2 WatchSource:0}: Error finding container 9ed7d3af5e5deab3e338c84b83046bfbde3559a9f746fe08ab64036646c966f2: Status 404 returned error can't find the container with id 9ed7d3af5e5deab3e338c84b83046bfbde3559a9f746fe08ab64036646c966f2
Jul 27 20:04:15.376649 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:15.376382    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/387c729d-a515-4e95-ad05-dbaa75da5b16-metrics-certs\") pod \"network-metrics-daemon-ng4cb\" (UID: \"387c729d-a515-4e95-ad05-dbaa75da5b16\") " pod="openshift-multus/network-metrics-daemon-ng4cb"
Jul 27 20:04:15.376649 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:15.376555    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:04:15.376819 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:15.376681    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/387c729d-a515-4e95-ad05-dbaa75da5b16-metrics-certs podName:387c729d-a515-4e95-ad05-dbaa75da5b16 nodeName:}" failed. No retries permitted until 2026-07-27 20:04:17.376666924 +0000 UTC m=+5.951393290 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/387c729d-a515-4e95-ad05-dbaa75da5b16-metrics-certs") pod "network-metrics-daemon-ng4cb" (UID: "387c729d-a515-4e95-ad05-dbaa75da5b16") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:04:15.477750 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:15.477708    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8b80d55b-21c2-41bc-9e47-ec1583240fc2-original-pull-secret\") pod \"global-pull-secret-syncer-77759\" (UID: \"8b80d55b-21c2-41bc-9e47-ec1583240fc2\") " pod="kube-system/global-pull-secret-syncer-77759"
Jul 27 20:04:15.477933 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:15.477872    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 20:04:15.477995 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:15.477955    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b80d55b-21c2-41bc-9e47-ec1583240fc2-original-pull-secret podName:8b80d55b-21c2-41bc-9e47-ec1583240fc2 nodeName:}" failed. No retries permitted until 2026-07-27 20:04:17.477934746 +0000 UTC m=+6.052661114 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8b80d55b-21c2-41bc-9e47-ec1583240fc2-original-pull-secret") pod "global-pull-secret-syncer-77759" (UID: "8b80d55b-21c2-41bc-9e47-ec1583240fc2") : object "kube-system"/"original-pull-secret" not registered
Jul 27 20:04:15.578846 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:15.578807    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jflkw\" (UniqueName: \"kubernetes.io/projected/99be7ce7-1c99-4883-866d-4a67291887ff-kube-api-access-jflkw\") pod \"network-check-target-kxvq5\" (UID: \"99be7ce7-1c99-4883-866d-4a67291887ff\") " pod="openshift-network-diagnostics/network-check-target-kxvq5"
Jul 27 20:04:15.579090 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:15.579005    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 20:04:15.579090 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:15.579030    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 20:04:15.579090 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:15.579044    2557 projected.go:196] Error preparing data for projected volume kube-api-access-jflkw for pod openshift-network-diagnostics/network-check-target-kxvq5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:04:15.579276 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:15.579107    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/99be7ce7-1c99-4883-866d-4a67291887ff-kube-api-access-jflkw podName:99be7ce7-1c99-4883-866d-4a67291887ff nodeName:}" failed. No retries permitted until 2026-07-27 20:04:17.579086417 +0000 UTC m=+6.153812789 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jflkw" (UniqueName: "kubernetes.io/projected/99be7ce7-1c99-4883-866d-4a67291887ff-kube-api-access-jflkw") pod "network-check-target-kxvq5" (UID: "99be7ce7-1c99-4883-866d-4a67291887ff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:04:15.795774 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:15.795572    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 19:59:13 +0000 UTC" deadline="2028-02-02 13:20:33.983893557 +0000 UTC"
Jul 27 20:04:15.795774 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:15.795635    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13313h16m18.188262391s"
Jul 27 20:04:15.906623 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:15.906591    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxvq5"
Jul 27 20:04:15.906802 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:15.906728    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxvq5" podUID="99be7ce7-1c99-4883-866d-4a67291887ff"
Jul 27 20:04:15.924954 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:15.924792    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zvh24" event={"ID":"012b0fd7-e3a3-4010-90c1-274a7cfc5f02","Type":"ContainerStarted","Data":"c700b3b2f0a22de34d54b3110604bb4f534e9e499c208ef68bca039f1277373b"}
Jul 27 20:04:15.926703 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:15.926637    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lw7mf" event={"ID":"30db2eea-f82c-4108-acd3-dafe3c975665","Type":"ContainerStarted","Data":"67dcb79934302f43b538220479ae29f9f61831d6fa6aa6c77f437cc43459a16d"}
Jul 27 20:04:15.933233 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:15.933148    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zjmlr" event={"ID":"2d6a65ae-132e-4119-8186-23eb80d62c47","Type":"ContainerStarted","Data":"02a686807a59bacce2e1ac42fab10283eb8697f37f4444276551e5f1b4071bb3"}
Jul 27 20:04:15.946761 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:15.946679    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-m6679" event={"ID":"4b9ad3fc-ee74-43ea-be90-3663d26ff6c7","Type":"ContainerStarted","Data":"57b0e2c7c67a6163e253da9870751db9067b68299143ed07dc4bc41647dcb2b9"}
Jul 27 20:04:15.961228 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:15.961193    2557 generic.go:356] "Generic (PLEG): container finished" podID="0ff7ebb6ee818f2c2c6896935fdb2199" containerID="138719a9879d402702a301ee8a3ddb46ab34ca2a7cf66ce22b7bbb50bd18a9c6" exitCode=0
Jul 27 20:04:15.961401 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:15.961322    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-149.ec2.internal" event={"ID":"0ff7ebb6ee818f2c2c6896935fdb2199","Type":"ContainerDied","Data":"138719a9879d402702a301ee8a3ddb46ab34ca2a7cf66ce22b7bbb50bd18a9c6"}
Jul 27 20:04:15.967288 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:15.967259    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-149.ec2.internal" event={"ID":"c1d7f2fc6e91fecc35ff7f75225b4759","Type":"ContainerStarted","Data":"c4a17d09d3bc18a485d1a2238348e2becd98323dffc75732b2f780b6527c1d0c"}
Jul 27 20:04:15.984731 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:15.984705    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-49n6x" event={"ID":"b49a7aaa-8c6f-4fff-a014-8f20da728376","Type":"ContainerStarted","Data":"554df59cb15a502622c2ec167e01fb3734c19bbba52780e1152e51b5cedbdac9"}
Jul 27 20:04:16.000086 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:15.999500    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lvnfj" event={"ID":"479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce","Type":"ContainerStarted","Data":"5202c0c219618bfd6c3520229c8c07430277e3b4c21e26971e20851bcfbe0f2a"}
Jul 27 20:04:16.012548 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:16.012506    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rzzr5" event={"ID":"1b56de62-a601-4cc1-80c9-5b640c1060fe","Type":"ContainerStarted","Data":"87f1fae6524247c6c05a65e3b954a30ade6934112fbabdf0ef629b7965944fec"}
Jul 27 20:04:16.021607 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:16.021574    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4f5vb" event={"ID":"97e4eedc-db60-4e33-96d5-a66a5b35ac80","Type":"ContainerStarted","Data":"49525c8696955aff182cc5e62fd13e0a945dfa08573437e09cec4b0d7d42fbfb"}
Jul 27 20:04:16.027351 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:16.027266    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kskcj" event={"ID":"5eb3269f-73ac-46ec-9ec8-1b188da4b846","Type":"ContainerStarted","Data":"9ed7d3af5e5deab3e338c84b83046bfbde3559a9f746fe08ab64036646c966f2"}
Jul 27 20:04:16.904780 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:16.904751    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ng4cb"
Jul 27 20:04:16.905259 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:16.904761    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-77759"
Jul 27 20:04:16.905259 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:16.904900    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ng4cb" podUID="387c729d-a515-4e95-ad05-dbaa75da5b16"
Jul 27 20:04:16.905259 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:16.905069    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-77759" podUID="8b80d55b-21c2-41bc-9e47-ec1583240fc2"
Jul 27 20:04:17.044674 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:17.044625    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-149.ec2.internal" event={"ID":"0ff7ebb6ee818f2c2c6896935fdb2199","Type":"ContainerStarted","Data":"f2fef7e9ebdda8361abe8c0f939ce2acbf41caeaece16579d77408b57f04bcbf"}
Jul 27 20:04:17.061002 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:17.060850    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-149.ec2.internal" podStartSLOduration=4.060831175 podStartE2EDuration="4.060831175s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:04:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:04:15.998956115 +0000 UTC m=+4.573682504" watchObservedRunningTime="2026-07-27 20:04:17.060831175 +0000 UTC m=+5.635557564"
Jul 27 20:04:17.397846 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:17.397755    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/387c729d-a515-4e95-ad05-dbaa75da5b16-metrics-certs\") pod \"network-metrics-daemon-ng4cb\" (UID: \"387c729d-a515-4e95-ad05-dbaa75da5b16\") " pod="openshift-multus/network-metrics-daemon-ng4cb"
Jul 27 20:04:17.398008 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:17.397942    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:04:17.398008 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:17.398006    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/387c729d-a515-4e95-ad05-dbaa75da5b16-metrics-certs podName:387c729d-a515-4e95-ad05-dbaa75da5b16 nodeName:}" failed. No retries permitted until 2026-07-27 20:04:21.397987678 +0000 UTC m=+9.972714047 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/387c729d-a515-4e95-ad05-dbaa75da5b16-metrics-certs") pod "network-metrics-daemon-ng4cb" (UID: "387c729d-a515-4e95-ad05-dbaa75da5b16") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:04:17.498296 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:17.498256    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8b80d55b-21c2-41bc-9e47-ec1583240fc2-original-pull-secret\") pod \"global-pull-secret-syncer-77759\" (UID: \"8b80d55b-21c2-41bc-9e47-ec1583240fc2\") " pod="kube-system/global-pull-secret-syncer-77759"
Jul 27 20:04:17.498514 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:17.498436    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 20:04:17.499328 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:17.498744    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b80d55b-21c2-41bc-9e47-ec1583240fc2-original-pull-secret podName:8b80d55b-21c2-41bc-9e47-ec1583240fc2 nodeName:}" failed. No retries permitted until 2026-07-27 20:04:21.498611318 +0000 UTC m=+10.073337688 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8b80d55b-21c2-41bc-9e47-ec1583240fc2-original-pull-secret") pod "global-pull-secret-syncer-77759" (UID: "8b80d55b-21c2-41bc-9e47-ec1583240fc2") : object "kube-system"/"original-pull-secret" not registered
Jul 27 20:04:17.598809 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:17.598767    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jflkw\" (UniqueName: \"kubernetes.io/projected/99be7ce7-1c99-4883-866d-4a67291887ff-kube-api-access-jflkw\") pod \"network-check-target-kxvq5\" (UID: \"99be7ce7-1c99-4883-866d-4a67291887ff\") " pod="openshift-network-diagnostics/network-check-target-kxvq5"
Jul 27 20:04:17.599072 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:17.598951    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 20:04:17.599072 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:17.598970    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 20:04:17.599072 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:17.598982    2557 projected.go:196] Error preparing data for projected volume kube-api-access-jflkw for pod openshift-network-diagnostics/network-check-target-kxvq5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:04:17.599072 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:17.599043    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/99be7ce7-1c99-4883-866d-4a67291887ff-kube-api-access-jflkw podName:99be7ce7-1c99-4883-866d-4a67291887ff nodeName:}" failed. No retries permitted until 2026-07-27 20:04:21.599023307 +0000 UTC m=+10.173749674 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jflkw" (UniqueName: "kubernetes.io/projected/99be7ce7-1c99-4883-866d-4a67291887ff-kube-api-access-jflkw") pod "network-check-target-kxvq5" (UID: "99be7ce7-1c99-4883-866d-4a67291887ff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:04:17.909482 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:17.909180    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxvq5"
Jul 27 20:04:17.909482 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:17.909306    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxvq5" podUID="99be7ce7-1c99-4883-866d-4a67291887ff"
Jul 27 20:04:18.905000 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:18.904945    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-77759"
Jul 27 20:04:18.905254 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:18.905101    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-77759" podUID="8b80d55b-21c2-41bc-9e47-ec1583240fc2"
Jul 27 20:04:18.905526 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:18.905506    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ng4cb"
Jul 27 20:04:18.905638 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:18.905616    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ng4cb" podUID="387c729d-a515-4e95-ad05-dbaa75da5b16"
Jul 27 20:04:19.905238 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:19.905088    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxvq5"
Jul 27 20:04:19.905731 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:19.905239    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxvq5" podUID="99be7ce7-1c99-4883-866d-4a67291887ff"
Jul 27 20:04:20.904636 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:20.904595    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-77759"
Jul 27 20:04:20.904826 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:20.904717    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-77759" podUID="8b80d55b-21c2-41bc-9e47-ec1583240fc2"
Jul 27 20:04:20.905040 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:20.904595    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ng4cb"
Jul 27 20:04:20.905168 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:20.905147    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ng4cb" podUID="387c729d-a515-4e95-ad05-dbaa75da5b16"
Jul 27 20:04:21.435231 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:21.434689    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/387c729d-a515-4e95-ad05-dbaa75da5b16-metrics-certs\") pod \"network-metrics-daemon-ng4cb\" (UID: \"387c729d-a515-4e95-ad05-dbaa75da5b16\") " pod="openshift-multus/network-metrics-daemon-ng4cb"
Jul 27 20:04:21.435231 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:21.434843    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:04:21.435231 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:21.434904    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/387c729d-a515-4e95-ad05-dbaa75da5b16-metrics-certs podName:387c729d-a515-4e95-ad05-dbaa75da5b16 nodeName:}" failed. No retries permitted until 2026-07-27 20:04:29.434885712 +0000 UTC m=+18.009612080 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/387c729d-a515-4e95-ad05-dbaa75da5b16-metrics-certs") pod "network-metrics-daemon-ng4cb" (UID: "387c729d-a515-4e95-ad05-dbaa75da5b16") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:04:21.536112 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:21.536072    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8b80d55b-21c2-41bc-9e47-ec1583240fc2-original-pull-secret\") pod \"global-pull-secret-syncer-77759\" (UID: \"8b80d55b-21c2-41bc-9e47-ec1583240fc2\") " pod="kube-system/global-pull-secret-syncer-77759"
Jul 27 20:04:21.536347 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:21.536311    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 20:04:21.536906 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:21.536432    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b80d55b-21c2-41bc-9e47-ec1583240fc2-original-pull-secret podName:8b80d55b-21c2-41bc-9e47-ec1583240fc2 nodeName:}" failed. No retries permitted until 2026-07-27 20:04:29.536408181 +0000 UTC m=+18.111134570 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8b80d55b-21c2-41bc-9e47-ec1583240fc2-original-pull-secret") pod "global-pull-secret-syncer-77759" (UID: "8b80d55b-21c2-41bc-9e47-ec1583240fc2") : object "kube-system"/"original-pull-secret" not registered
Jul 27 20:04:21.637330 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:21.637293    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jflkw\" (UniqueName: \"kubernetes.io/projected/99be7ce7-1c99-4883-866d-4a67291887ff-kube-api-access-jflkw\") pod \"network-check-target-kxvq5\" (UID: \"99be7ce7-1c99-4883-866d-4a67291887ff\") " pod="openshift-network-diagnostics/network-check-target-kxvq5"
Jul 27 20:04:21.637555 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:21.637487    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 20:04:21.637555 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:21.637514    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 20:04:21.637555 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:21.637526    2557 projected.go:196] Error preparing data for projected volume kube-api-access-jflkw for pod openshift-network-diagnostics/network-check-target-kxvq5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:04:21.637712 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:21.637589    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/99be7ce7-1c99-4883-866d-4a67291887ff-kube-api-access-jflkw podName:99be7ce7-1c99-4883-866d-4a67291887ff nodeName:}" failed. No retries permitted until 2026-07-27 20:04:29.637568367 +0000 UTC m=+18.212294752 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jflkw" (UniqueName: "kubernetes.io/projected/99be7ce7-1c99-4883-866d-4a67291887ff-kube-api-access-jflkw") pod "network-check-target-kxvq5" (UID: "99be7ce7-1c99-4883-866d-4a67291887ff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:04:21.907333 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:21.907082    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxvq5"
Jul 27 20:04:21.907333 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:21.907214    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxvq5" podUID="99be7ce7-1c99-4883-866d-4a67291887ff"
Jul 27 20:04:22.905544 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:22.905225    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ng4cb"
Jul 27 20:04:22.905544 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:22.905365    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ng4cb" podUID="387c729d-a515-4e95-ad05-dbaa75da5b16"
Jul 27 20:04:22.905544 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:22.905399    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-77759"
Jul 27 20:04:22.905544 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:22.905503    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-77759" podUID="8b80d55b-21c2-41bc-9e47-ec1583240fc2"
Jul 27 20:04:23.906699 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:23.906663    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxvq5"
Jul 27 20:04:23.907144 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:23.906799    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxvq5" podUID="99be7ce7-1c99-4883-866d-4a67291887ff"
Jul 27 20:04:24.904396 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:24.904351    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-77759"
Jul 27 20:04:24.904589 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:24.904351    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ng4cb"
Jul 27 20:04:24.904589 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:24.904518    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-77759" podUID="8b80d55b-21c2-41bc-9e47-ec1583240fc2"
Jul 27 20:04:24.904589 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:24.904571    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ng4cb" podUID="387c729d-a515-4e95-ad05-dbaa75da5b16"
Jul 27 20:04:25.904663 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:25.904629    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxvq5"
Jul 27 20:04:25.905038 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:25.904750    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxvq5" podUID="99be7ce7-1c99-4883-866d-4a67291887ff"
Jul 27 20:04:26.904721 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:26.904677    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-77759"
Jul 27 20:04:26.904721 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:26.904715    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ng4cb"
Jul 27 20:04:26.905160 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:26.904828    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-77759" podUID="8b80d55b-21c2-41bc-9e47-ec1583240fc2"
Jul 27 20:04:26.905160 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:26.904962    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ng4cb" podUID="387c729d-a515-4e95-ad05-dbaa75da5b16"
Jul 27 20:04:27.905201 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:27.905164    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxvq5"
Jul 27 20:04:27.905599 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:27.905296    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxvq5" podUID="99be7ce7-1c99-4883-866d-4a67291887ff"
Jul 27 20:04:28.905334 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:28.905297    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ng4cb"
Jul 27 20:04:28.905848 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:28.905294    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-77759"
Jul 27 20:04:28.905848 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:28.905444    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ng4cb" podUID="387c729d-a515-4e95-ad05-dbaa75da5b16"
Jul 27 20:04:28.905848 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:28.905531    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-77759" podUID="8b80d55b-21c2-41bc-9e47-ec1583240fc2"
Jul 27 20:04:29.499082 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:29.499050    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/387c729d-a515-4e95-ad05-dbaa75da5b16-metrics-certs\") pod \"network-metrics-daemon-ng4cb\" (UID: \"387c729d-a515-4e95-ad05-dbaa75da5b16\") " pod="openshift-multus/network-metrics-daemon-ng4cb"
Jul 27 20:04:29.499258 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:29.499226    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:04:29.499303 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:29.499295    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/387c729d-a515-4e95-ad05-dbaa75da5b16-metrics-certs podName:387c729d-a515-4e95-ad05-dbaa75da5b16 nodeName:}" failed. No retries permitted until 2026-07-27 20:04:45.499279036 +0000 UTC m=+34.074005401 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/387c729d-a515-4e95-ad05-dbaa75da5b16-metrics-certs") pod "network-metrics-daemon-ng4cb" (UID: "387c729d-a515-4e95-ad05-dbaa75da5b16") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:04:29.600290 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:29.600238    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8b80d55b-21c2-41bc-9e47-ec1583240fc2-original-pull-secret\") pod \"global-pull-secret-syncer-77759\" (UID: \"8b80d55b-21c2-41bc-9e47-ec1583240fc2\") " pod="kube-system/global-pull-secret-syncer-77759"
Jul 27 20:04:29.600435 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:29.600401    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 20:04:29.600510 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:29.600480    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b80d55b-21c2-41bc-9e47-ec1583240fc2-original-pull-secret podName:8b80d55b-21c2-41bc-9e47-ec1583240fc2 nodeName:}" failed. No retries permitted until 2026-07-27 20:04:45.600461372 +0000 UTC m=+34.175187750 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8b80d55b-21c2-41bc-9e47-ec1583240fc2-original-pull-secret") pod "global-pull-secret-syncer-77759" (UID: "8b80d55b-21c2-41bc-9e47-ec1583240fc2") : object "kube-system"/"original-pull-secret" not registered
Jul 27 20:04:29.700771 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:29.700730    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jflkw\" (UniqueName: \"kubernetes.io/projected/99be7ce7-1c99-4883-866d-4a67291887ff-kube-api-access-jflkw\") pod \"network-check-target-kxvq5\" (UID: \"99be7ce7-1c99-4883-866d-4a67291887ff\") " pod="openshift-network-diagnostics/network-check-target-kxvq5"
Jul 27 20:04:29.700934 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:29.700883    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 20:04:29.700934 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:29.700902    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 20:04:29.700934 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:29.700913    2557 projected.go:196] Error preparing data for projected volume kube-api-access-jflkw for pod openshift-network-diagnostics/network-check-target-kxvq5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:04:29.701100 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:29.700976    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/99be7ce7-1c99-4883-866d-4a67291887ff-kube-api-access-jflkw podName:99be7ce7-1c99-4883-866d-4a67291887ff nodeName:}" failed. No retries permitted until 2026-07-27 20:04:45.700956886 +0000 UTC m=+34.275683269 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jflkw" (UniqueName: "kubernetes.io/projected/99be7ce7-1c99-4883-866d-4a67291887ff-kube-api-access-jflkw") pod "network-check-target-kxvq5" (UID: "99be7ce7-1c99-4883-866d-4a67291887ff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:04:29.904569 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:29.904502    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxvq5"
Jul 27 20:04:29.904704 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:29.904600    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxvq5" podUID="99be7ce7-1c99-4883-866d-4a67291887ff"
Jul 27 20:04:30.904854 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:30.904814    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ng4cb"
Jul 27 20:04:30.905262 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:30.904814    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-77759"
Jul 27 20:04:30.905262 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:30.904964    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ng4cb" podUID="387c729d-a515-4e95-ad05-dbaa75da5b16"
Jul 27 20:04:30.905262 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:30.904999    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-77759" podUID="8b80d55b-21c2-41bc-9e47-ec1583240fc2"
Jul 27 20:04:31.905798 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:31.905751    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxvq5"
Jul 27 20:04:31.906258 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:31.905865    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxvq5" podUID="99be7ce7-1c99-4883-866d-4a67291887ff"
Jul 27 20:04:32.905361 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:32.905321    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ng4cb"
Jul 27 20:04:32.905563 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:32.905328    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-77759"
Jul 27 20:04:32.905563 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:32.905483    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ng4cb" podUID="387c729d-a515-4e95-ad05-dbaa75da5b16"
Jul 27 20:04:32.905694 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:32.905554    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-77759" podUID="8b80d55b-21c2-41bc-9e47-ec1583240fc2"
Jul 27 20:04:33.904802 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:33.904780    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxvq5"
Jul 27 20:04:33.905108 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:33.904900    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxvq5" podUID="99be7ce7-1c99-4883-866d-4a67291887ff"
Jul 27 20:04:34.091076 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:34.090382    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lvnfj" event={"ID":"479cbe00-3a6f-4e7f-a58c-d8e4c4c564ce","Type":"ContainerStarted","Data":"64e6df41e141264128456eaac8fde6d0b2686b1a29476b9b46488ad4d71c8bbe"}
Jul 27 20:04:34.092990 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:34.092574    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lw7mf" event={"ID":"30db2eea-f82c-4108-acd3-dafe3c975665","Type":"ContainerStarted","Data":"d30aaaa8c42b2186068aff924d5b5e6f4f38a36e37aa1b26cdfb21d2c27dfaca"}
Jul 27 20:04:34.113418 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:34.113368    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-lvnfj" podStartSLOduration=4.241220845 podStartE2EDuration="23.113348921s" totalImagesPullingTime="18.872128076s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:04:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:04:34.113110507 +0000 UTC m=+22.687836886" watchObservedRunningTime="2026-07-27 20:04:34.113348921 +0000 UTC m=+22.688075310"
Jul 27 20:04:34.115363 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:34.114618    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-149.ec2.internal" podStartSLOduration=21.114601543 podStartE2EDuration="21.114601543s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:04:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:04:17.069466815 +0000 UTC m=+5.644193201" watchObservedRunningTime="2026-07-27 20:04:34.114601543 +0000 UTC m=+22.689327931"
Jul 27 20:04:34.157846 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:34.157784    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-lw7mf" podStartSLOduration=4.293216879 podStartE2EDuration="23.157762078s" totalImagesPullingTime="18.864545199s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:04:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:04:34.157323412 +0000 UTC m=+22.732049801" watchObservedRunningTime="2026-07-27 20:04:34.157762078 +0000 UTC m=+22.732488550"
Jul 27 20:04:34.208228 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:34.207919    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:04:34.297323 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:34.297295    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:04:34.904732 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:34.904701    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ng4cb"
Jul 27 20:04:34.904957 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:34.904827    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ng4cb" podUID="387c729d-a515-4e95-ad05-dbaa75da5b16"
Jul 27 20:04:34.904957 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:34.904879    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-77759"
Jul 27 20:04:34.905692 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:34.904979    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-77759" podUID="8b80d55b-21c2-41bc-9e47-ec1583240fc2"
Jul 27 20:04:35.095817 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:35.095727    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-m6679" event={"ID":"4b9ad3fc-ee74-43ea-be90-3663d26ff6c7","Type":"ContainerStarted","Data":"28277edf17fc34d67d734b3295c88e082de95aab5f05af8d24a0179f11a12812"}
Jul 27 20:04:35.098610 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:35.098586    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-49n6x" event={"ID":"b49a7aaa-8c6f-4fff-a014-8f20da728376","Type":"ContainerStarted","Data":"e92e7b6bd90990437fa6b100acf3b6b21e9d599394ba71c6e80b6894a357205b"}
Jul 27 20:04:35.098747 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:35.098649    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-49n6x" event={"ID":"b49a7aaa-8c6f-4fff-a014-8f20da728376","Type":"ContainerStarted","Data":"a9a6b8296f9f49cb5f22dd1d94d2d5a6f4402be9ad630e7e2242988c986cd7b1"}
Jul 27 20:04:35.098747 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:35.098681    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-49n6x" event={"ID":"b49a7aaa-8c6f-4fff-a014-8f20da728376","Type":"ContainerStarted","Data":"1f043a840ae5af1ea9600598c3ff15fe7489a651e462bede9ff06437cd2c7fde"}
Jul 27 20:04:35.098747 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:35.098717    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-49n6x" event={"ID":"b49a7aaa-8c6f-4fff-a014-8f20da728376","Type":"ContainerStarted","Data":"cbf72be0c89b4dd8d5619dafc5b70b431fdb865a6c2fff9b35f5ff55e44d5cae"}
Jul 27 20:04:35.098747 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:35.098747    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-49n6x" event={"ID":"b49a7aaa-8c6f-4fff-a014-8f20da728376","Type":"ContainerStarted","Data":"b32a0bd0ef08796a9ea47846f67a00f421f719d1d1464c7b141b9f235bcba14c"}
Jul 27 20:04:35.098912 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:35.098782    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-49n6x" event={"ID":"b49a7aaa-8c6f-4fff-a014-8f20da728376","Type":"ContainerStarted","Data":"18a8723436314251b8aa6cf8f68e98f283f03ae7be7cb5f460039b55c0934d73"}
Jul 27 20:04:35.099836 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:35.099814    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rzzr5" event={"ID":"1b56de62-a601-4cc1-80c9-5b640c1060fe","Type":"ContainerStarted","Data":"ab4c3117011dc3507e286bcf4765d4dd9182574fc7a33a3001dc8ddc7c5c532f"}
Jul 27 20:04:35.101196 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:35.101166    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4f5vb" event={"ID":"97e4eedc-db60-4e33-96d5-a66a5b35ac80","Type":"ContainerStarted","Data":"98eb9b69a51b65080365fc67e5a83eb89eebf9c2d7ac4cd239646e11d6d23c85"}
Jul 27 20:04:35.102510 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:35.102490    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kskcj" event={"ID":"5eb3269f-73ac-46ec-9ec8-1b188da4b846","Type":"ContainerStarted","Data":"b5569f0ea4f23b9eb3b909b19131c4b7ecf842ed72558fd7cdb838eac9b10c09"}
Jul 27 20:04:35.103750 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:35.103727    2557 generic.go:356] "Generic (PLEG): container finished" podID="012b0fd7-e3a3-4010-90c1-274a7cfc5f02" containerID="0dbcd08ba3ba473c68b9878e1c072a21687d894e5315356c258e6a16aa89341b" exitCode=0
Jul 27 20:04:35.103837 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:35.103757    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zvh24" event={"ID":"012b0fd7-e3a3-4010-90c1-274a7cfc5f02","Type":"ContainerDied","Data":"0dbcd08ba3ba473c68b9878e1c072a21687d894e5315356c258e6a16aa89341b"}
Jul 27 20:04:35.116374 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:35.116330    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-m6679" podStartSLOduration=4.149304716 podStartE2EDuration="23.116313638s" totalImagesPullingTime="18.967008922s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:04:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:04:35.11606221 +0000 UTC m=+23.690788597" watchObservedRunningTime="2026-07-27 20:04:35.116313638 +0000 UTC m=+23.691040026"
Jul 27 20:04:35.145307 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:35.145256    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-4f5vb" podStartSLOduration=4.263228084 podStartE2EDuration="23.145240985s" totalImagesPullingTime="18.882012901s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:04:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:04:35.131376393 +0000 UTC m=+23.706102782" watchObservedRunningTime="2026-07-27 20:04:35.145240985 +0000 UTC m=+23.719967373"
Jul 27 20:04:35.145523 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:35.145502    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-rzzr5" podStartSLOduration=5.264259237 podStartE2EDuration="24.145496746s" totalImagesPullingTime="18.881237509s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:04:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:04:35.144725725 +0000 UTC m=+23.719452112" watchObservedRunningTime="2026-07-27 20:04:35.145496746 +0000 UTC m=+23.720223134"
Jul 27 20:04:35.208303 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:35.208258    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:04:35.308651 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:35.308615    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:04:35.410293 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:35.410254    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:04:35.547161 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:35.547136    2557 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 27 20:04:35.827891 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:35.827734    2557 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-27T20:04:35.547154963Z","UUID":"1c11417d-6c37-497c-a865-5db35160868c","Handler":null,"Name":"","Endpoint":""}
Jul 27 20:04:35.829490 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:35.829466    2557 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 27 20:04:35.829639 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:35.829508    2557 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 27 20:04:35.901164 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:35.901125    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-lw7mf"
Jul 27 20:04:35.902015 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:35.901995    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-lw7mf"
Jul 27 20:04:35.905307 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:35.905280    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxvq5"
Jul 27 20:04:35.905707 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:35.905412    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxvq5" podUID="99be7ce7-1c99-4883-866d-4a67291887ff"
Jul 27 20:04:36.109297 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:36.109136    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kskcj" event={"ID":"5eb3269f-73ac-46ec-9ec8-1b188da4b846","Type":"ContainerStarted","Data":"3cade7645aed38d108d0c98bc829678bac94e8eefd79a0ce71b6a000941b2d60"}
Jul 27 20:04:36.110917 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:36.110887    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zjmlr" event={"ID":"2d6a65ae-132e-4119-8186-23eb80d62c47","Type":"ContainerStarted","Data":"f4d8a1ff44ab7ce12ecfad91ef0823945aa9ee234bd9a226ed1b5f7259a203bb"}
Jul 27 20:04:36.111577 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:36.111557    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-lw7mf"
Jul 27 20:04:36.112034 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:36.112016    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-lw7mf"
Jul 27 20:04:36.127846 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:36.127795    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-zjmlr" podStartSLOduration=6.220309352 podStartE2EDuration="25.127779936s" totalImagesPullingTime="18.907470584s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:04:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:04:36.127488011 +0000 UTC m=+24.702214399" watchObservedRunningTime="2026-07-27 20:04:36.127779936 +0000 UTC m=+24.702506375"
Jul 27 20:04:36.247759 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:36.247537    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:04:36.348045 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:36.348005    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:04:36.905148 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:36.905062    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ng4cb"
Jul 27 20:04:36.905345 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:36.905069    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-77759"
Jul 27 20:04:36.905345 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:36.905213    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ng4cb" podUID="387c729d-a515-4e95-ad05-dbaa75da5b16"
Jul 27 20:04:36.905345 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:36.905267    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-77759" podUID="8b80d55b-21c2-41bc-9e47-ec1583240fc2"
Jul 27 20:04:36.953516 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:36.953474    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:04:37.025078 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:37.025030    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:04:37.115682 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:37.115639    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kskcj" event={"ID":"5eb3269f-73ac-46ec-9ec8-1b188da4b846","Type":"ContainerStarted","Data":"e9d7519d781a13919589d514f548bf1d2aa584b9e62ae05ee47846cd4a3ba95a"}
Jul 27 20:04:37.119941 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:37.119903    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-49n6x" event={"ID":"b49a7aaa-8c6f-4fff-a014-8f20da728376","Type":"ContainerStarted","Data":"8cd5ef37d6fae54e26fa9b967a790b2dcec427b2af094dd87c3a5c3f3d4ff3a2"}
Jul 27 20:04:37.138329 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:37.138277    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kskcj" podStartSLOduration=3.897582081 podStartE2EDuration="25.138261313s" totalImagesPullingTime="21.240679232s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:04:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:04:37.137599948 +0000 UTC m=+25.712326348" watchObservedRunningTime="2026-07-27 20:04:37.138261313 +0000 UTC m=+25.712987702"
Jul 27 20:04:37.905118 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:37.905068    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxvq5"
Jul 27 20:04:37.905316 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:37.905218    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxvq5" podUID="99be7ce7-1c99-4883-866d-4a67291887ff"
Jul 27 20:04:38.904889 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:38.904855    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ng4cb"
Jul 27 20:04:38.905482 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:38.904981    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ng4cb" podUID="387c729d-a515-4e95-ad05-dbaa75da5b16"
Jul 27 20:04:38.905482 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:38.905039    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-77759"
Jul 27 20:04:38.905482 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:38.905178    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-77759" podUID="8b80d55b-21c2-41bc-9e47-ec1583240fc2"
Jul 27 20:04:39.905051 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:39.904875    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxvq5"
Jul 27 20:04:39.905644 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:39.905142    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxvq5" podUID="99be7ce7-1c99-4883-866d-4a67291887ff"
Jul 27 20:04:40.128601 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:40.128522    2557 generic.go:356] "Generic (PLEG): container finished" podID="012b0fd7-e3a3-4010-90c1-274a7cfc5f02" containerID="2784a939a9e9cdcad72593d366e68142ad72e71ae248009f03f3ea60021cfc36" exitCode=0
Jul 27 20:04:40.128765 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:40.128614    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zvh24" event={"ID":"012b0fd7-e3a3-4010-90c1-274a7cfc5f02","Type":"ContainerDied","Data":"2784a939a9e9cdcad72593d366e68142ad72e71ae248009f03f3ea60021cfc36"}
Jul 27 20:04:40.132399 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:40.132373    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-49n6x" event={"ID":"b49a7aaa-8c6f-4fff-a014-8f20da728376","Type":"ContainerStarted","Data":"5fc9ecf2ad92a9586b964a4ed6cb2eb64bb524a7c83e1914fbe6333a359d130d"}
Jul 27 20:04:40.132658 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:40.132643    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-49n6x"
Jul 27 20:04:40.132743 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:40.132706    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-49n6x"
Jul 27 20:04:40.148703 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:40.148673    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-49n6x"
Jul 27 20:04:40.179240 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:40.179189    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-49n6x" podStartSLOduration=9.241526253 podStartE2EDuration="28.179172933s" totalImagesPullingTime="18.93764668s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:04:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:04:40.179075364 +0000 UTC m=+28.753801764" watchObservedRunningTime="2026-07-27 20:04:40.179172933 +0000 UTC m=+28.753899321"
Jul 27 20:04:40.904958 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:40.904930    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ng4cb"
Jul 27 20:04:40.905130 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:40.904971    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-77759"
Jul 27 20:04:40.905130 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:40.905070    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ng4cb" podUID="387c729d-a515-4e95-ad05-dbaa75da5b16"
Jul 27 20:04:40.905589 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:40.905488    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-77759" podUID="8b80d55b-21c2-41bc-9e47-ec1583240fc2"
Jul 27 20:04:41.137334 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:41.137303    2557 generic.go:356] "Generic (PLEG): container finished" podID="012b0fd7-e3a3-4010-90c1-274a7cfc5f02" containerID="a43c65c569b55258f103bd52c545900b4f1ca6c208cbed8d90bec7bbaa27be9f" exitCode=0
Jul 27 20:04:41.137519 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:41.137383    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zvh24" event={"ID":"012b0fd7-e3a3-4010-90c1-274a7cfc5f02","Type":"ContainerDied","Data":"a43c65c569b55258f103bd52c545900b4f1ca6c208cbed8d90bec7bbaa27be9f"}
Jul 27 20:04:41.137882 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:41.137854    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-49n6x"
Jul 27 20:04:41.153078 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:41.153055    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-49n6x"
Jul 27 20:04:41.343604 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:41.343525    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kxvq5"]
Jul 27 20:04:41.343738 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:41.343683    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxvq5"
Jul 27 20:04:41.343791 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:41.343772    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxvq5" podUID="99be7ce7-1c99-4883-866d-4a67291887ff"
Jul 27 20:04:41.346883 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:41.346843    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-77759"]
Jul 27 20:04:41.347015 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:41.346959    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-77759"
Jul 27 20:04:41.347068 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:41.347045    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-77759" podUID="8b80d55b-21c2-41bc-9e47-ec1583240fc2"
Jul 27 20:04:41.347578 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:41.347557    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ng4cb"]
Jul 27 20:04:41.347693 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:41.347658    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ng4cb"
Jul 27 20:04:41.347784 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:41.347766    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ng4cb" podUID="387c729d-a515-4e95-ad05-dbaa75da5b16"
Jul 27 20:04:42.142645 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:42.142556    2557 generic.go:356] "Generic (PLEG): container finished" podID="012b0fd7-e3a3-4010-90c1-274a7cfc5f02" containerID="5a2e34cccd05f32421bb1c25bb3528ac763ef1ebb37ee6193628b0542fb156f9" exitCode=0
Jul 27 20:04:42.142645 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:42.142628    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zvh24" event={"ID":"012b0fd7-e3a3-4010-90c1-274a7cfc5f02","Type":"ContainerDied","Data":"5a2e34cccd05f32421bb1c25bb3528ac763ef1ebb37ee6193628b0542fb156f9"}
Jul 27 20:04:42.905423 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:42.905378    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ng4cb"
Jul 27 20:04:42.905614 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:42.905385    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxvq5"
Jul 27 20:04:42.905614 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:42.905535    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ng4cb" podUID="387c729d-a515-4e95-ad05-dbaa75da5b16"
Jul 27 20:04:42.905614 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:42.905395    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-77759"
Jul 27 20:04:42.905614 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:42.905601    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxvq5" podUID="99be7ce7-1c99-4883-866d-4a67291887ff"
Jul 27 20:04:42.905806 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:42.905667    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-77759" podUID="8b80d55b-21c2-41bc-9e47-ec1583240fc2"
Jul 27 20:04:44.904910 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:44.904876    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ng4cb"
Jul 27 20:04:44.904910 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:44.904907    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-77759"
Jul 27 20:04:44.905654 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:44.904876    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxvq5"
Jul 27 20:04:44.905654 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:44.905068    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ng4cb" podUID="387c729d-a515-4e95-ad05-dbaa75da5b16"
Jul 27 20:04:44.905654 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:44.905216    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-77759" podUID="8b80d55b-21c2-41bc-9e47-ec1583240fc2"
Jul 27 20:04:44.905654 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:44.905296    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxvq5" podUID="99be7ce7-1c99-4883-866d-4a67291887ff"
Jul 27 20:04:45.517881 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:45.517728    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/387c729d-a515-4e95-ad05-dbaa75da5b16-metrics-certs\") pod \"network-metrics-daemon-ng4cb\" (UID: \"387c729d-a515-4e95-ad05-dbaa75da5b16\") " pod="openshift-multus/network-metrics-daemon-ng4cb"
Jul 27 20:04:45.518136 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:45.517909    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:04:45.518136 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:45.517998    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/387c729d-a515-4e95-ad05-dbaa75da5b16-metrics-certs podName:387c729d-a515-4e95-ad05-dbaa75da5b16 nodeName:}" failed. No retries permitted until 2026-07-27 20:05:17.517973705 +0000 UTC m=+66.092700073 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/387c729d-a515-4e95-ad05-dbaa75da5b16-metrics-certs") pod "network-metrics-daemon-ng4cb" (UID: "387c729d-a515-4e95-ad05-dbaa75da5b16") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:04:45.618724 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:45.618689    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8b80d55b-21c2-41bc-9e47-ec1583240fc2-original-pull-secret\") pod \"global-pull-secret-syncer-77759\" (UID: \"8b80d55b-21c2-41bc-9e47-ec1583240fc2\") " pod="kube-system/global-pull-secret-syncer-77759"
Jul 27 20:04:45.618894 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:45.618858    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 20:04:45.618946 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:45.618929    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b80d55b-21c2-41bc-9e47-ec1583240fc2-original-pull-secret podName:8b80d55b-21c2-41bc-9e47-ec1583240fc2 nodeName:}" failed. No retries permitted until 2026-07-27 20:05:17.618911896 +0000 UTC m=+66.193638267 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8b80d55b-21c2-41bc-9e47-ec1583240fc2-original-pull-secret") pod "global-pull-secret-syncer-77759" (UID: "8b80d55b-21c2-41bc-9e47-ec1583240fc2") : object "kube-system"/"original-pull-secret" not registered
Jul 27 20:04:45.719723 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:45.719687    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jflkw\" (UniqueName: \"kubernetes.io/projected/99be7ce7-1c99-4883-866d-4a67291887ff-kube-api-access-jflkw\") pod \"network-check-target-kxvq5\" (UID: \"99be7ce7-1c99-4883-866d-4a67291887ff\") " pod="openshift-network-diagnostics/network-check-target-kxvq5"
Jul 27 20:04:45.719918 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:45.719885    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 20:04:45.719918 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:45.719913    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 20:04:45.720029 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:45.719923    2557 projected.go:196] Error preparing data for projected volume kube-api-access-jflkw for pod openshift-network-diagnostics/network-check-target-kxvq5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:04:45.720029 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:45.719987    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/99be7ce7-1c99-4883-866d-4a67291887ff-kube-api-access-jflkw podName:99be7ce7-1c99-4883-866d-4a67291887ff nodeName:}" failed. No retries permitted until 2026-07-27 20:05:17.719969797 +0000 UTC m=+66.294696166 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jflkw" (UniqueName: "kubernetes.io/projected/99be7ce7-1c99-4883-866d-4a67291887ff-kube-api-access-jflkw") pod "network-check-target-kxvq5" (UID: "99be7ce7-1c99-4883-866d-4a67291887ff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:04:46.776294 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:46.776263    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-149.ec2.internal" event="NodeReady"
Jul 27 20:04:46.776761 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:46.776389    2557 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 27 20:04:46.823826 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:46.823792    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-cfftn"]
Jul 27 20:04:46.839864 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:46.839834    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-cgn8m"]
Jul 27 20:04:46.840024 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:46.839961    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cfftn"
Jul 27 20:04:46.842011 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:46.841978    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 27 20:04:46.842560 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:46.842078    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2k4bq\""
Jul 27 20:04:46.842560 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:46.842207    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 27 20:04:46.853309 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:46.853287    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cfftn"]
Jul 27 20:04:46.853416 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:46.853321    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cgn8m"]
Jul 27 20:04:46.853416 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:46.853400    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cgn8m"
Jul 27 20:04:46.855664 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:46.855638    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 27 20:04:46.855792 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:46.855669    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-dk9cc\""
Jul 27 20:04:46.855792 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:46.855638    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 27 20:04:46.855792 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:46.855747    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 27 20:04:46.905386 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:46.905347    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-77759"
Jul 27 20:04:46.905386 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:46.905368    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ng4cb"
Jul 27 20:04:46.905616 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:46.905347    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxvq5"
Jul 27 20:04:46.907701 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:46.907680    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 27 20:04:46.907875 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:46.907738    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 27 20:04:46.908038 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:46.908019    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nkj9h\""
Jul 27 20:04:46.908142 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:46.908069    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 27 20:04:46.908142 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:46.908088    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 27 20:04:46.908142 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:46.908087    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5hkrg\""
Jul 27 20:04:46.930749 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:46.930697    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94m6q\" (UniqueName: \"kubernetes.io/projected/16dce8d0-44a1-48a6-9626-ca84454d9680-kube-api-access-94m6q\") pod \"dns-default-cfftn\" (UID: \"16dce8d0-44a1-48a6-9626-ca84454d9680\") " pod="openshift-dns/dns-default-cfftn"
Jul 27 20:04:46.930749 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:46.930733    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16dce8d0-44a1-48a6-9626-ca84454d9680-tmp-dir\") pod \"dns-default-cfftn\" (UID: \"16dce8d0-44a1-48a6-9626-ca84454d9680\") " pod="openshift-dns/dns-default-cfftn"
Jul 27 20:04:46.930873 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:46.930751    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fd837541-b858-4d93-8260-bf7c6b040358-cert\") pod \"ingress-canary-cgn8m\" (UID: \"fd837541-b858-4d93-8260-bf7c6b040358\") " pod="openshift-ingress-canary/ingress-canary-cgn8m"
Jul 27 20:04:46.930873 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:46.930799    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pjrk\" (UniqueName: \"kubernetes.io/projected/fd837541-b858-4d93-8260-bf7c6b040358-kube-api-access-2pjrk\") pod \"ingress-canary-cgn8m\" (UID: \"fd837541-b858-4d93-8260-bf7c6b040358\") " pod="openshift-ingress-canary/ingress-canary-cgn8m"
Jul 27 20:04:46.930873 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:46.930845    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/16dce8d0-44a1-48a6-9626-ca84454d9680-config-volume\") pod \"dns-default-cfftn\" (UID: \"16dce8d0-44a1-48a6-9626-ca84454d9680\") " pod="openshift-dns/dns-default-cfftn"
Jul 27 20:04:46.930873 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:46.930864    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16dce8d0-44a1-48a6-9626-ca84454d9680-metrics-tls\") pod \"dns-default-cfftn\" (UID: \"16dce8d0-44a1-48a6-9626-ca84454d9680\") " pod="openshift-dns/dns-default-cfftn"
Jul 27 20:04:46.942776 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:46.942755    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:04:47.004031 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:47.003992    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:04:47.032051 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:47.032020    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/16dce8d0-44a1-48a6-9626-ca84454d9680-config-volume\") pod \"dns-default-cfftn\" (UID: \"16dce8d0-44a1-48a6-9626-ca84454d9680\") " pod="openshift-dns/dns-default-cfftn"
Jul 27 20:04:47.032165 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:47.032057    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16dce8d0-44a1-48a6-9626-ca84454d9680-metrics-tls\") pod \"dns-default-cfftn\" (UID: \"16dce8d0-44a1-48a6-9626-ca84454d9680\") " pod="openshift-dns/dns-default-cfftn"
Jul 27 20:04:47.032232 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:47.032207    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94m6q\" (UniqueName: \"kubernetes.io/projected/16dce8d0-44a1-48a6-9626-ca84454d9680-kube-api-access-94m6q\") pod \"dns-default-cfftn\" (UID: \"16dce8d0-44a1-48a6-9626-ca84454d9680\") " pod="openshift-dns/dns-default-cfftn"
Jul 27 20:04:47.032318 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:47.032304    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 20:04:47.032377 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:47.032360    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16dce8d0-44a1-48a6-9626-ca84454d9680-tmp-dir\") pod \"dns-default-cfftn\" (UID: \"16dce8d0-44a1-48a6-9626-ca84454d9680\") " pod="openshift-dns/dns-default-cfftn"
Jul 27 20:04:47.032377 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:47.032375    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16dce8d0-44a1-48a6-9626-ca84454d9680-metrics-tls podName:16dce8d0-44a1-48a6-9626-ca84454d9680 nodeName:}" failed. No retries permitted until 2026-07-27 20:04:47.532354896 +0000 UTC m=+36.107081280 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/16dce8d0-44a1-48a6-9626-ca84454d9680-metrics-tls") pod "dns-default-cfftn" (UID: "16dce8d0-44a1-48a6-9626-ca84454d9680") : secret "dns-default-metrics-tls" not found
Jul 27 20:04:47.032519 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:47.032404    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fd837541-b858-4d93-8260-bf7c6b040358-cert\") pod \"ingress-canary-cgn8m\" (UID: \"fd837541-b858-4d93-8260-bf7c6b040358\") " pod="openshift-ingress-canary/ingress-canary-cgn8m"
Jul 27 20:04:47.032519 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:47.032434    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pjrk\" (UniqueName: \"kubernetes.io/projected/fd837541-b858-4d93-8260-bf7c6b040358-kube-api-access-2pjrk\") pod \"ingress-canary-cgn8m\" (UID: \"fd837541-b858-4d93-8260-bf7c6b040358\") " pod="openshift-ingress-canary/ingress-canary-cgn8m"
Jul 27 20:04:47.032686 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:47.032666    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16dce8d0-44a1-48a6-9626-ca84454d9680-tmp-dir\") pod \"dns-default-cfftn\" (UID: \"16dce8d0-44a1-48a6-9626-ca84454d9680\") " pod="openshift-dns/dns-default-cfftn"
Jul 27 20:04:47.032739 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:47.032697    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/16dce8d0-44a1-48a6-9626-ca84454d9680-config-volume\") pod \"dns-default-cfftn\" (UID: \"16dce8d0-44a1-48a6-9626-ca84454d9680\") " pod="openshift-dns/dns-default-cfftn"
Jul 27 20:04:47.036520 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:47.036504    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fd837541-b858-4d93-8260-bf7c6b040358-cert\") pod \"ingress-canary-cgn8m\" (UID: \"fd837541-b858-4d93-8260-bf7c6b040358\") " pod="openshift-ingress-canary/ingress-canary-cgn8m"
Jul 27 20:04:47.041548 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:47.041386    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94m6q\" (UniqueName: \"kubernetes.io/projected/16dce8d0-44a1-48a6-9626-ca84454d9680-kube-api-access-94m6q\") pod \"dns-default-cfftn\" (UID: \"16dce8d0-44a1-48a6-9626-ca84454d9680\") " pod="openshift-dns/dns-default-cfftn"
Jul 27 20:04:47.041683 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:47.041441    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pjrk\" (UniqueName: \"kubernetes.io/projected/fd837541-b858-4d93-8260-bf7c6b040358-kube-api-access-2pjrk\") pod \"ingress-canary-cgn8m\" (UID: \"fd837541-b858-4d93-8260-bf7c6b040358\") " pod="openshift-ingress-canary/ingress-canary-cgn8m"
Jul 27 20:04:47.159242 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:47.159210    2557 generic.go:356] "Generic (PLEG): container finished" podID="012b0fd7-e3a3-4010-90c1-274a7cfc5f02" containerID="2e995eac317f905a24ec946d8403a49c5911a3ef0f4093f803ec7c798f406528" exitCode=0
Jul 27 20:04:47.159411 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:47.159267    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zvh24" event={"ID":"012b0fd7-e3a3-4010-90c1-274a7cfc5f02","Type":"ContainerDied","Data":"2e995eac317f905a24ec946d8403a49c5911a3ef0f4093f803ec7c798f406528"}
Jul 27 20:04:47.161516 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:47.161495    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cgn8m"
Jul 27 20:04:47.349823 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:47.349793    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cgn8m"]
Jul 27 20:04:47.387380 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:04:47.387338    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd837541_b858_4d93_8260_bf7c6b040358.slice/crio-a964438950e105dc02dca695ba6e313ca15804869126dc223392ceaf04a0189c WatchSource:0}: Error finding container a964438950e105dc02dca695ba6e313ca15804869126dc223392ceaf04a0189c: Status 404 returned error can't find the container with id a964438950e105dc02dca695ba6e313ca15804869126dc223392ceaf04a0189c
Jul 27 20:04:47.536665 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:47.536626    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16dce8d0-44a1-48a6-9626-ca84454d9680-metrics-tls\") pod \"dns-default-cfftn\" (UID: \"16dce8d0-44a1-48a6-9626-ca84454d9680\") " pod="openshift-dns/dns-default-cfftn"
Jul 27 20:04:47.536838 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:47.536785    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 20:04:47.536888 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:47.536852    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16dce8d0-44a1-48a6-9626-ca84454d9680-metrics-tls podName:16dce8d0-44a1-48a6-9626-ca84454d9680 nodeName:}" failed. No retries permitted until 2026-07-27 20:04:48.536834605 +0000 UTC m=+37.111560970 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/16dce8d0-44a1-48a6-9626-ca84454d9680-metrics-tls") pod "dns-default-cfftn" (UID: "16dce8d0-44a1-48a6-9626-ca84454d9680") : secret "dns-default-metrics-tls" not found
Jul 27 20:04:48.162648 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:48.162585    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cgn8m" event={"ID":"fd837541-b858-4d93-8260-bf7c6b040358","Type":"ContainerStarted","Data":"a964438950e105dc02dca695ba6e313ca15804869126dc223392ceaf04a0189c"}
Jul 27 20:04:48.165623 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:48.165586    2557 generic.go:356] "Generic (PLEG): container finished" podID="012b0fd7-e3a3-4010-90c1-274a7cfc5f02" containerID="ec16142a6d6662f44e0dcd8dd011340e066e0ff2b0fed1daaf0a6fa5de71c82a" exitCode=0
Jul 27 20:04:48.165738 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:48.165629    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zvh24" event={"ID":"012b0fd7-e3a3-4010-90c1-274a7cfc5f02","Type":"ContainerDied","Data":"ec16142a6d6662f44e0dcd8dd011340e066e0ff2b0fed1daaf0a6fa5de71c82a"}
Jul 27 20:04:48.545008 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:48.544805    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16dce8d0-44a1-48a6-9626-ca84454d9680-metrics-tls\") pod \"dns-default-cfftn\" (UID: \"16dce8d0-44a1-48a6-9626-ca84454d9680\") " pod="openshift-dns/dns-default-cfftn"
Jul 27 20:04:48.545192 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:48.544942    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 20:04:48.545192 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:48.545149    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16dce8d0-44a1-48a6-9626-ca84454d9680-metrics-tls podName:16dce8d0-44a1-48a6-9626-ca84454d9680 nodeName:}" failed. No retries permitted until 2026-07-27 20:04:50.545126242 +0000 UTC m=+39.119852621 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/16dce8d0-44a1-48a6-9626-ca84454d9680-metrics-tls") pod "dns-default-cfftn" (UID: "16dce8d0-44a1-48a6-9626-ca84454d9680") : secret "dns-default-metrics-tls" not found
Jul 27 20:04:49.173033 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:49.173000    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zvh24" event={"ID":"012b0fd7-e3a3-4010-90c1-274a7cfc5f02","Type":"ContainerStarted","Data":"44c4d104147a0bed265b9ec4aa766ef9b5fd5672cad3be9a94d296ef61b51517"}
Jul 27 20:04:49.198149 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:49.198099    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-zvh24" podStartSLOduration=9.15794362 podStartE2EDuration="38.198082174s" totalImagesPullingTime="29.040138554s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:04:11 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:04:49.196642335 +0000 UTC m=+37.771368736" watchObservedRunningTime="2026-07-27 20:04:49.198082174 +0000 UTC m=+37.772808561"
Jul 27 20:04:49.363895 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:49.363858    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:04:49.432773 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:49.432688    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:04:49.819179 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:49.819077    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:04:49.918992 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:49.918949    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:04:50.561634 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:50.561596    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16dce8d0-44a1-48a6-9626-ca84454d9680-metrics-tls\") pod \"dns-default-cfftn\" (UID: \"16dce8d0-44a1-48a6-9626-ca84454d9680\") " pod="openshift-dns/dns-default-cfftn"
Jul 27 20:04:50.562185 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:50.561741    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 20:04:50.562185 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:50.561807    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16dce8d0-44a1-48a6-9626-ca84454d9680-metrics-tls podName:16dce8d0-44a1-48a6-9626-ca84454d9680 nodeName:}" failed. No retries permitted until 2026-07-27 20:04:54.561788393 +0000 UTC m=+43.136514759 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/16dce8d0-44a1-48a6-9626-ca84454d9680-metrics-tls") pod "dns-default-cfftn" (UID: "16dce8d0-44a1-48a6-9626-ca84454d9680") : secret "dns-default-metrics-tls" not found
Jul 27 20:04:51.179676 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:51.179581    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cgn8m" event={"ID":"fd837541-b858-4d93-8260-bf7c6b040358","Type":"ContainerStarted","Data":"e8e0b3484ab430598c5fc5b4b4dc1f72350739fbc63c289ba4b838765d0a46d8"}
Jul 27 20:04:51.197917 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:51.197860    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-cgn8m" podStartSLOduration=2.385451904 podStartE2EDuration="5.197845755s" totalImagesPullingTime="2.812393851s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:04:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:04:51.196583706 +0000 UTC m=+39.771310095" watchObservedRunningTime="2026-07-27 20:04:51.197845755 +0000 UTC m=+39.772572142"
Jul 27 20:04:51.985382 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:51.985337    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:04:54.587886 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:54.587849    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16dce8d0-44a1-48a6-9626-ca84454d9680-metrics-tls\") pod \"dns-default-cfftn\" (UID: \"16dce8d0-44a1-48a6-9626-ca84454d9680\") " pod="openshift-dns/dns-default-cfftn"
Jul 27 20:04:54.588271 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:54.587970    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 20:04:54.588271 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:04:54.588023    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16dce8d0-44a1-48a6-9626-ca84454d9680-metrics-tls podName:16dce8d0-44a1-48a6-9626-ca84454d9680 nodeName:}" failed. No retries permitted until 2026-07-27 20:05:02.588009832 +0000 UTC m=+51.162736197 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/16dce8d0-44a1-48a6-9626-ca84454d9680-metrics-tls") pod "dns-default-cfftn" (UID: "16dce8d0-44a1-48a6-9626-ca84454d9680") : secret "dns-default-metrics-tls" not found
Jul 27 20:04:54.776712 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:54.776672    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:04:54.857713 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:04:54.857630    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:05:02.643340 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:02.643297    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16dce8d0-44a1-48a6-9626-ca84454d9680-metrics-tls\") pod \"dns-default-cfftn\" (UID: \"16dce8d0-44a1-48a6-9626-ca84454d9680\") " pod="openshift-dns/dns-default-cfftn"
Jul 27 20:05:02.643819 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:05:02.643423    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 20:05:02.643819 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:05:02.643513    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16dce8d0-44a1-48a6-9626-ca84454d9680-metrics-tls podName:16dce8d0-44a1-48a6-9626-ca84454d9680 nodeName:}" failed. No retries permitted until 2026-07-27 20:05:18.643497648 +0000 UTC m=+67.218224014 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/16dce8d0-44a1-48a6-9626-ca84454d9680-metrics-tls") pod "dns-default-cfftn" (UID: "16dce8d0-44a1-48a6-9626-ca84454d9680") : secret "dns-default-metrics-tls" not found
Jul 27 20:05:13.156677 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:13.156645    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-49n6x"
Jul 27 20:05:13.286760 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:13.286723    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:05:13.343834 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:13.343806    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:05:16.549137 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:16.549099    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:05:16.601827 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:16.601791    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:05:17.553421 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:17.553385    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/387c729d-a515-4e95-ad05-dbaa75da5b16-metrics-certs\") pod \"network-metrics-daemon-ng4cb\" (UID: \"387c729d-a515-4e95-ad05-dbaa75da5b16\") " pod="openshift-multus/network-metrics-daemon-ng4cb"
Jul 27 20:05:17.556234 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:17.556212    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 27 20:05:17.564498 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:05:17.564475    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 27 20:05:17.564565 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:05:17.564551    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/387c729d-a515-4e95-ad05-dbaa75da5b16-metrics-certs podName:387c729d-a515-4e95-ad05-dbaa75da5b16 nodeName:}" failed. No retries permitted until 2026-07-27 20:06:21.564527134 +0000 UTC m=+130.139253500 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/387c729d-a515-4e95-ad05-dbaa75da5b16-metrics-certs") pod "network-metrics-daemon-ng4cb" (UID: "387c729d-a515-4e95-ad05-dbaa75da5b16") : secret "metrics-daemon-secret" not found
Jul 27 20:05:17.654104 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:17.654064    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8b80d55b-21c2-41bc-9e47-ec1583240fc2-original-pull-secret\") pod \"global-pull-secret-syncer-77759\" (UID: \"8b80d55b-21c2-41bc-9e47-ec1583240fc2\") " pod="kube-system/global-pull-secret-syncer-77759"
Jul 27 20:05:17.656665 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:17.656640    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 27 20:05:17.668316 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:17.668290    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8b80d55b-21c2-41bc-9e47-ec1583240fc2-original-pull-secret\") pod \"global-pull-secret-syncer-77759\" (UID: \"8b80d55b-21c2-41bc-9e47-ec1583240fc2\") " pod="kube-system/global-pull-secret-syncer-77759"
Jul 27 20:05:17.755389 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:17.755351    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jflkw\" (UniqueName: \"kubernetes.io/projected/99be7ce7-1c99-4883-866d-4a67291887ff-kube-api-access-jflkw\") pod \"network-check-target-kxvq5\" (UID: \"99be7ce7-1c99-4883-866d-4a67291887ff\") " pod="openshift-network-diagnostics/network-check-target-kxvq5"
Jul 27 20:05:17.758048 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:17.758030    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 27 20:05:17.768240 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:17.768216    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 27 20:05:17.778527 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:17.778505    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jflkw\" (UniqueName: \"kubernetes.io/projected/99be7ce7-1c99-4883-866d-4a67291887ff-kube-api-access-jflkw\") pod \"network-check-target-kxvq5\" (UID: \"99be7ce7-1c99-4883-866d-4a67291887ff\") " pod="openshift-network-diagnostics/network-check-target-kxvq5"
Jul 27 20:05:17.815433 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:17.815337    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-77759"
Jul 27 20:05:17.822898 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:17.822878    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nkj9h\""
Jul 27 20:05:17.831035 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:17.830992    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxvq5"
Jul 27 20:05:17.979299 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:17.979271    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-77759"]
Jul 27 20:05:17.982495 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:05:17.982442    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b80d55b_21c2_41bc_9e47_ec1583240fc2.slice/crio-d2ff27740080fe9954f432f48df675d7dcbc146a589cddf149e4b0c187527b6f WatchSource:0}: Error finding container d2ff27740080fe9954f432f48df675d7dcbc146a589cddf149e4b0c187527b6f: Status 404 returned error can't find the container with id d2ff27740080fe9954f432f48df675d7dcbc146a589cddf149e4b0c187527b6f
Jul 27 20:05:17.993723 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:17.993700    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kxvq5"]
Jul 27 20:05:17.996551 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:05:17.996526    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99be7ce7_1c99_4883_866d_4a67291887ff.slice/crio-37c3dba342f6d217b4c7aec755d59a065c0bc117b6376bdec867f8e3c693ff20 WatchSource:0}: Error finding container 37c3dba342f6d217b4c7aec755d59a065c0bc117b6376bdec867f8e3c693ff20: Status 404 returned error can't find the container with id 37c3dba342f6d217b4c7aec755d59a065c0bc117b6376bdec867f8e3c693ff20
Jul 27 20:05:18.246011 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:18.245974    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-77759" event={"ID":"8b80d55b-21c2-41bc-9e47-ec1583240fc2","Type":"ContainerStarted","Data":"d2ff27740080fe9954f432f48df675d7dcbc146a589cddf149e4b0c187527b6f"}
Jul 27 20:05:18.247045 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:18.247024    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kxvq5" event={"ID":"99be7ce7-1c99-4883-866d-4a67291887ff","Type":"ContainerStarted","Data":"37c3dba342f6d217b4c7aec755d59a065c0bc117b6376bdec867f8e3c693ff20"}
Jul 27 20:05:18.662081 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:18.661989    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16dce8d0-44a1-48a6-9626-ca84454d9680-metrics-tls\") pod \"dns-default-cfftn\" (UID: \"16dce8d0-44a1-48a6-9626-ca84454d9680\") " pod="openshift-dns/dns-default-cfftn"
Jul 27 20:05:18.662532 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:05:18.662129    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 20:05:18.662532 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:05:18.662195    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16dce8d0-44a1-48a6-9626-ca84454d9680-metrics-tls podName:16dce8d0-44a1-48a6-9626-ca84454d9680 nodeName:}" failed. No retries permitted until 2026-07-27 20:05:50.662177662 +0000 UTC m=+99.236904028 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/16dce8d0-44a1-48a6-9626-ca84454d9680-metrics-tls") pod "dns-default-cfftn" (UID: "16dce8d0-44a1-48a6-9626-ca84454d9680") : secret "dns-default-metrics-tls" not found
Jul 27 20:05:23.261660 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:23.261616    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kxvq5" event={"ID":"99be7ce7-1c99-4883-866d-4a67291887ff","Type":"ContainerStarted","Data":"b13f86813a40771ef107e5a8e3e08d89ab44dfe1a25e0a08fd779d2650b6dfba"}
Jul 27 20:05:23.262127 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:23.261684    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-kxvq5"
Jul 27 20:05:23.263144 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:23.263122    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-77759" event={"ID":"8b80d55b-21c2-41bc-9e47-ec1583240fc2","Type":"ContainerStarted","Data":"fae07c6b967a430e5d7804728de1750f8b4006f5fdbfccd51b1d5798e3f8241b"}
Jul 27 20:05:23.292906 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:23.292852    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-kxvq5" podStartSLOduration=66.364123437 podStartE2EDuration="1m11.292833737s" totalImagesPullingTime="4.9287103s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:04:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:05:23.276757573 +0000 UTC m=+71.851483961" watchObservedRunningTime="2026-07-27 20:05:23.292833737 +0000 UTC m=+71.867560125"
Jul 27 20:05:23.293071 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:23.293033    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-77759" podStartSLOduration=66.344572275 podStartE2EDuration="1m11.293025237s" totalImagesPullingTime="4.948452962s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:04:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:05:23.291928449 +0000 UTC m=+71.866654837" watchObservedRunningTime="2026-07-27 20:05:23.293025237 +0000 UTC m=+71.867751624"
Jul 27 20:05:33.210262 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:33.210226    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-qf7sz"]
Jul 27 20:05:33.212988 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:33.212971    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-qf7sz"
Jul 27 20:05:33.215383 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:33.215365    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 27 20:05:33.215581 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:33.215568    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 27 20:05:33.215669 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:33.215617    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 27 20:05:33.215901 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:33.215882    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 27 20:05:33.216359 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:33.216342    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-dxj9x\""
Jul 27 20:05:33.225419 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:33.225399    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-qf7sz"]
Jul 27 20:05:33.258678 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:33.258649    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3a7e2235-bcb7-46dd-9ac1-cd7fa374c19a-config\") pod \"service-ca-operator-5d6c75f84f-qf7sz\" (UID: \"3a7e2235-bcb7-46dd-9ac1-cd7fa374c19a\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-qf7sz"
Jul 27 20:05:33.258832 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:33.258686    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdvhr\" (UniqueName: \"kubernetes.io/projected/3a7e2235-bcb7-46dd-9ac1-cd7fa374c19a-kube-api-access-rdvhr\") pod \"service-ca-operator-5d6c75f84f-qf7sz\" (UID: \"3a7e2235-bcb7-46dd-9ac1-cd7fa374c19a\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-qf7sz"
Jul 27 20:05:33.258832 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:33.258718    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3a7e2235-bcb7-46dd-9ac1-cd7fa374c19a-serving-cert\") pod \"service-ca-operator-5d6c75f84f-qf7sz\" (UID: \"3a7e2235-bcb7-46dd-9ac1-cd7fa374c19a\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-qf7sz"
Jul 27 20:05:33.316200 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:33.316172    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-rcn59"]
Jul 27 20:05:33.319022 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:33.318994    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-rcn59"
Jul 27 20:05:33.321552 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:33.321524    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 27 20:05:33.321888 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:33.321872    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 27 20:05:33.322181 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:33.322165    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-7fjgk\""
Jul 27 20:05:33.329212 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:33.329191    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-rcn59"]
Jul 27 20:05:33.359188 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:33.359156    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3a7e2235-bcb7-46dd-9ac1-cd7fa374c19a-config\") pod \"service-ca-operator-5d6c75f84f-qf7sz\" (UID: \"3a7e2235-bcb7-46dd-9ac1-cd7fa374c19a\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-qf7sz"
Jul 27 20:05:33.359188 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:33.359193    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdvhr\" (UniqueName: \"kubernetes.io/projected/3a7e2235-bcb7-46dd-9ac1-cd7fa374c19a-kube-api-access-rdvhr\") pod \"service-ca-operator-5d6c75f84f-qf7sz\" (UID: \"3a7e2235-bcb7-46dd-9ac1-cd7fa374c19a\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-qf7sz"
Jul 27 20:05:33.359402 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:33.359218    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gk8n\" (UniqueName: \"kubernetes.io/projected/cd3da7a1-e90c-492f-bb7d-d00f4236e20d-kube-api-access-7gk8n\") pod \"volume-data-source-validator-549c6d54cf-rcn59\" (UID: \"cd3da7a1-e90c-492f-bb7d-d00f4236e20d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-rcn59"
Jul 27 20:05:33.359402 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:33.359319    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3a7e2235-bcb7-46dd-9ac1-cd7fa374c19a-serving-cert\") pod \"service-ca-operator-5d6c75f84f-qf7sz\" (UID: \"3a7e2235-bcb7-46dd-9ac1-cd7fa374c19a\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-qf7sz"
Jul 27 20:05:33.359735 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:33.359716    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3a7e2235-bcb7-46dd-9ac1-cd7fa374c19a-config\") pod \"service-ca-operator-5d6c75f84f-qf7sz\" (UID: \"3a7e2235-bcb7-46dd-9ac1-cd7fa374c19a\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-qf7sz"
Jul 27 20:05:33.361530 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:33.361509    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3a7e2235-bcb7-46dd-9ac1-cd7fa374c19a-serving-cert\") pod \"service-ca-operator-5d6c75f84f-qf7sz\" (UID: \"3a7e2235-bcb7-46dd-9ac1-cd7fa374c19a\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-qf7sz"
Jul 27 20:05:33.366516 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:33.366493    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdvhr\" (UniqueName: \"kubernetes.io/projected/3a7e2235-bcb7-46dd-9ac1-cd7fa374c19a-kube-api-access-rdvhr\") pod \"service-ca-operator-5d6c75f84f-qf7sz\" (UID: \"3a7e2235-bcb7-46dd-9ac1-cd7fa374c19a\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-qf7sz"
Jul 27 20:05:33.415946 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:33.415913    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-ttmct"]
Jul 27 20:05:33.418995 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:33.418972    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-ttmct"
Jul 27 20:05:33.419112 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:33.419047    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-74566c475c-7w525"]
Jul 27 20:05:33.421158 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:33.421131    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 27 20:05:33.421371 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:33.421357    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 27 20:05:33.421485 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:33.421465    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 27 20:05:33.421749 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:33.421735    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-74566c475c-7w525"
Jul 27 20:05:33.421827 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:33.421805    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-mx9v7\""
Jul 27 20:05:33.423610 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:33.423594    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 27 20:05:33.423708 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:33.423676    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 27 20:05:33.423788 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:33.423773    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 27 20:05:33.423845 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:33.423802    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 27 20:05:33.424144 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:33.424128    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 27 20:05:33.424220 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:33.424157    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 27 20:05:33.424220 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:33.424188    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-hxpcl\""
Jul 27 20:05:33.429511 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:33.429491    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-ttmct"]
Jul 27 20:05:33.436662 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:33.436639    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-74566c475c-7w525"]
Jul 27 20:05:33.459827 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:33.459797    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gk8n\" (UniqueName: \"kubernetes.io/projected/cd3da7a1-e90c-492f-bb7d-d00f4236e20d-kube-api-access-7gk8n\") pod \"volume-data-source-validator-549c6d54cf-rcn59\" (UID: \"cd3da7a1-e90c-492f-bb7d-d00f4236e20d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-rcn59"
Jul 27 20:05:33.459827 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:33.459830    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/966563a5-3031-4e3f-ab52-31e43de5dd1f-service-ca-bundle\") pod \"router-default-74566c475c-7w525\" (UID: \"966563a5-3031-4e3f-ab52-31e43de5dd1f\") " pod="openshift-ingress/router-default-74566c475c-7w525"
Jul 27 20:05:33.460003 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:33.459847    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67x57\" (UniqueName: \"kubernetes.io/projected/966563a5-3031-4e3f-ab52-31e43de5dd1f-kube-api-access-67x57\") pod \"router-default-74566c475c-7w525\" (UID: \"966563a5-3031-4e3f-ab52-31e43de5dd1f\") " pod="openshift-ingress/router-default-74566c475c-7w525"
Jul 27 20:05:33.460003 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:33.459870    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1584e08c-de11-42ba-ab68-1424e16b8b37-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-ttmct\" (UID: \"1584e08c-de11-42ba-ab68-1424e16b8b37\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-ttmct"
Jul 27 20:05:33.460003 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:33.459898    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6pwn\" (UniqueName: \"kubernetes.io/projected/1584e08c-de11-42ba-ab68-1424e16b8b37-kube-api-access-v6pwn\") pod \"cluster-samples-operator-6748489656-ttmct\" (UID: \"1584e08c-de11-42ba-ab68-1424e16b8b37\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-ttmct"
Jul 27 20:05:33.460003 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:33.459954    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/966563a5-3031-4e3f-ab52-31e43de5dd1f-default-certificate\") pod \"router-default-74566c475c-7w525\" (UID: \"966563a5-3031-4e3f-ab52-31e43de5dd1f\") " pod="openshift-ingress/router-default-74566c475c-7w525"
Jul 27 20:05:33.460003 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:33.459983    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/966563a5-3031-4e3f-ab52-31e43de5dd1f-metrics-certs\") pod \"router-default-74566c475c-7w525\" (UID: \"966563a5-3031-4e3f-ab52-31e43de5dd1f\") " pod="openshift-ingress/router-default-74566c475c-7w525"
Jul 27 20:05:33.460158 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:33.460035    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/966563a5-3031-4e3f-ab52-31e43de5dd1f-stats-auth\") pod \"router-default-74566c475c-7w525\" (UID: \"966563a5-3031-4e3f-ab52-31e43de5dd1f\") " pod="openshift-ingress/router-default-74566c475c-7w525"
Jul 27 20:05:33.470529 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:33.470443    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gk8n\" (UniqueName: \"kubernetes.io/projected/cd3da7a1-e90c-492f-bb7d-d00f4236e20d-kube-api-access-7gk8n\") pod \"volume-data-source-validator-549c6d54cf-rcn59\" (UID: \"cd3da7a1-e90c-492f-bb7d-d00f4236e20d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-rcn59"
Jul 27 20:05:33.522332 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:33.522203    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-qf7sz"
Jul 27 20:05:33.544184 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:33.544148    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:05:33.561270 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:33.561239    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/966563a5-3031-4e3f-ab52-31e43de5dd1f-service-ca-bundle\") pod \"router-default-74566c475c-7w525\" (UID: \"966563a5-3031-4e3f-ab52-31e43de5dd1f\") " pod="openshift-ingress/router-default-74566c475c-7w525"
Jul 27 20:05:33.561426 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:33.561280    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67x57\" (UniqueName: \"kubernetes.io/projected/966563a5-3031-4e3f-ab52-31e43de5dd1f-kube-api-access-67x57\") pod \"router-default-74566c475c-7w525\" (UID: \"966563a5-3031-4e3f-ab52-31e43de5dd1f\") " pod="openshift-ingress/router-default-74566c475c-7w525"
Jul 27 20:05:33.561426 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:33.561400    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1584e08c-de11-42ba-ab68-1424e16b8b37-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-ttmct\" (UID: \"1584e08c-de11-42ba-ab68-1424e16b8b37\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-ttmct"
Jul 27 20:05:33.561551 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:05:33.561428    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/966563a5-3031-4e3f-ab52-31e43de5dd1f-service-ca-bundle podName:966563a5-3031-4e3f-ab52-31e43de5dd1f nodeName:}" failed. No retries permitted until 2026-07-27 20:05:34.061409481 +0000 UTC m=+82.636135848 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/966563a5-3031-4e3f-ab52-31e43de5dd1f-service-ca-bundle") pod "router-default-74566c475c-7w525" (UID: "966563a5-3031-4e3f-ab52-31e43de5dd1f") : configmap references non-existent config key: service-ca.crt
Jul 27 20:05:33.561551 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:33.561494    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6pwn\" (UniqueName: \"kubernetes.io/projected/1584e08c-de11-42ba-ab68-1424e16b8b37-kube-api-access-v6pwn\") pod \"cluster-samples-operator-6748489656-ttmct\" (UID: \"1584e08c-de11-42ba-ab68-1424e16b8b37\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-ttmct"
Jul 27 20:05:33.561551 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:05:33.561516    2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 27 20:05:33.561551 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:33.561535    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/966563a5-3031-4e3f-ab52-31e43de5dd1f-default-certificate\") pod \"router-default-74566c475c-7w525\" (UID: \"966563a5-3031-4e3f-ab52-31e43de5dd1f\") " pod="openshift-ingress/router-default-74566c475c-7w525"
Jul 27 20:05:33.561737 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:05:33.561568    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1584e08c-de11-42ba-ab68-1424e16b8b37-samples-operator-tls podName:1584e08c-de11-42ba-ab68-1424e16b8b37 nodeName:}" failed. No retries permitted until 2026-07-27 20:05:34.061550624 +0000 UTC m=+82.636276992 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1584e08c-de11-42ba-ab68-1424e16b8b37-samples-operator-tls") pod "cluster-samples-operator-6748489656-ttmct" (UID: "1584e08c-de11-42ba-ab68-1424e16b8b37") : secret "samples-operator-tls" not found
Jul 27 20:05:33.561737 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:33.561606    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/966563a5-3031-4e3f-ab52-31e43de5dd1f-metrics-certs\") pod \"router-default-74566c475c-7w525\" (UID: \"966563a5-3031-4e3f-ab52-31e43de5dd1f\") " pod="openshift-ingress/router-default-74566c475c-7w525"
Jul 27 20:05:33.561737 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:33.561634    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/966563a5-3031-4e3f-ab52-31e43de5dd1f-stats-auth\") pod \"router-default-74566c475c-7w525\" (UID: \"966563a5-3031-4e3f-ab52-31e43de5dd1f\") " pod="openshift-ingress/router-default-74566c475c-7w525"
Jul 27 20:05:33.561737 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:05:33.561686    2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 27 20:05:33.561737 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:05:33.561738    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/966563a5-3031-4e3f-ab52-31e43de5dd1f-metrics-certs podName:966563a5-3031-4e3f-ab52-31e43de5dd1f nodeName:}" failed. No retries permitted until 2026-07-27 20:05:34.061723956 +0000 UTC m=+82.636450332 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/966563a5-3031-4e3f-ab52-31e43de5dd1f-metrics-certs") pod "router-default-74566c475c-7w525" (UID: "966563a5-3031-4e3f-ab52-31e43de5dd1f") : secret "router-metrics-certs-default" not found
Jul 27 20:05:33.563969 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:33.563944    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/966563a5-3031-4e3f-ab52-31e43de5dd1f-stats-auth\") pod \"router-default-74566c475c-7w525\" (UID: \"966563a5-3031-4e3f-ab52-31e43de5dd1f\") " pod="openshift-ingress/router-default-74566c475c-7w525"
Jul 27 20:05:33.564071 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:33.564021    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/966563a5-3031-4e3f-ab52-31e43de5dd1f-default-certificate\") pod \"router-default-74566c475c-7w525\" (UID: \"966563a5-3031-4e3f-ab52-31e43de5dd1f\") " pod="openshift-ingress/router-default-74566c475c-7w525"
Jul 27 20:05:33.573914 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:33.573889    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6pwn\" (UniqueName: \"kubernetes.io/projected/1584e08c-de11-42ba-ab68-1424e16b8b37-kube-api-access-v6pwn\") pod \"cluster-samples-operator-6748489656-ttmct\" (UID: \"1584e08c-de11-42ba-ab68-1424e16b8b37\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-ttmct"
Jul 27 20:05:33.574149 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:33.574131    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67x57\" (UniqueName: \"kubernetes.io/projected/966563a5-3031-4e3f-ab52-31e43de5dd1f-kube-api-access-67x57\") pod \"router-default-74566c475c-7w525\" (UID: \"966563a5-3031-4e3f-ab52-31e43de5dd1f\") " pod="openshift-ingress/router-default-74566c475c-7w525"
Jul 27 20:05:33.627770 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:33.627722    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-rcn59"
Jul 27 20:05:33.648830 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:33.648803    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-qf7sz"]
Jul 27 20:05:33.651503 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:05:33.651474    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a7e2235_bcb7_46dd_9ac1_cd7fa374c19a.slice/crio-f8694222d64e25041583c7110ac0553e64a91e7d0a2dff36fabef9aad8a44df5 WatchSource:0}: Error finding container f8694222d64e25041583c7110ac0553e64a91e7d0a2dff36fabef9aad8a44df5: Status 404 returned error can't find the container with id f8694222d64e25041583c7110ac0553e64a91e7d0a2dff36fabef9aad8a44df5
Jul 27 20:05:33.753290 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:33.753260    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-rcn59"]
Jul 27 20:05:33.756311 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:05:33.756286    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd3da7a1_e90c_492f_bb7d_d00f4236e20d.slice/crio-d336a74afbba1b8e54fbbf769b376181c90d347dc04ecfe334f5e3ffe8abcb79 WatchSource:0}: Error finding container d336a74afbba1b8e54fbbf769b376181c90d347dc04ecfe334f5e3ffe8abcb79: Status 404 returned error can't find the container with id d336a74afbba1b8e54fbbf769b376181c90d347dc04ecfe334f5e3ffe8abcb79
Jul 27 20:05:34.064862 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:34.064779    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/966563a5-3031-4e3f-ab52-31e43de5dd1f-service-ca-bundle\") pod \"router-default-74566c475c-7w525\" (UID: \"966563a5-3031-4e3f-ab52-31e43de5dd1f\") " pod="openshift-ingress/router-default-74566c475c-7w525"
Jul 27 20:05:34.064862 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:34.064824    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1584e08c-de11-42ba-ab68-1424e16b8b37-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-ttmct\" (UID: \"1584e08c-de11-42ba-ab68-1424e16b8b37\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-ttmct"
Jul 27 20:05:34.065066 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:05:34.064921    2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 27 20:05:34.065066 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:05:34.064969    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1584e08c-de11-42ba-ab68-1424e16b8b37-samples-operator-tls podName:1584e08c-de11-42ba-ab68-1424e16b8b37 nodeName:}" failed. No retries permitted until 2026-07-27 20:05:35.064955507 +0000 UTC m=+83.639681874 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1584e08c-de11-42ba-ab68-1424e16b8b37-samples-operator-tls") pod "cluster-samples-operator-6748489656-ttmct" (UID: "1584e08c-de11-42ba-ab68-1424e16b8b37") : secret "samples-operator-tls" not found
Jul 27 20:05:34.065066 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:05:34.064983    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/966563a5-3031-4e3f-ab52-31e43de5dd1f-service-ca-bundle podName:966563a5-3031-4e3f-ab52-31e43de5dd1f nodeName:}" failed. No retries permitted until 2026-07-27 20:05:35.06497679 +0000 UTC m=+83.639703156 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/966563a5-3031-4e3f-ab52-31e43de5dd1f-service-ca-bundle") pod "router-default-74566c475c-7w525" (UID: "966563a5-3031-4e3f-ab52-31e43de5dd1f") : configmap references non-existent config key: service-ca.crt
Jul 27 20:05:34.065066 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:34.064964    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/966563a5-3031-4e3f-ab52-31e43de5dd1f-metrics-certs\") pod \"router-default-74566c475c-7w525\" (UID: \"966563a5-3031-4e3f-ab52-31e43de5dd1f\") " pod="openshift-ingress/router-default-74566c475c-7w525"
Jul 27 20:05:34.065066 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:05:34.065040    2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 27 20:05:34.065240 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:05:34.065104    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/966563a5-3031-4e3f-ab52-31e43de5dd1f-metrics-certs podName:966563a5-3031-4e3f-ab52-31e43de5dd1f nodeName:}" failed. No retries permitted until 2026-07-27 20:05:35.065088868 +0000 UTC m=+83.639815242 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/966563a5-3031-4e3f-ab52-31e43de5dd1f-metrics-certs") pod "router-default-74566c475c-7w525" (UID: "966563a5-3031-4e3f-ab52-31e43de5dd1f") : secret "router-metrics-certs-default" not found
Jul 27 20:05:34.294845 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:34.294807    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-qf7sz" event={"ID":"3a7e2235-bcb7-46dd-9ac1-cd7fa374c19a","Type":"ContainerStarted","Data":"f8694222d64e25041583c7110ac0553e64a91e7d0a2dff36fabef9aad8a44df5"}
Jul 27 20:05:34.295876 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:34.295854    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-rcn59" event={"ID":"cd3da7a1-e90c-492f-bb7d-d00f4236e20d","Type":"ContainerStarted","Data":"d336a74afbba1b8e54fbbf769b376181c90d347dc04ecfe334f5e3ffe8abcb79"}
Jul 27 20:05:35.074665 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:35.074620    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/966563a5-3031-4e3f-ab52-31e43de5dd1f-metrics-certs\") pod \"router-default-74566c475c-7w525\" (UID: \"966563a5-3031-4e3f-ab52-31e43de5dd1f\") " pod="openshift-ingress/router-default-74566c475c-7w525"
Jul 27 20:05:35.074856 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:35.074723    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/966563a5-3031-4e3f-ab52-31e43de5dd1f-service-ca-bundle\") pod \"router-default-74566c475c-7w525\" (UID: \"966563a5-3031-4e3f-ab52-31e43de5dd1f\") " pod="openshift-ingress/router-default-74566c475c-7w525"
Jul 27 20:05:35.074856 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:35.074755    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1584e08c-de11-42ba-ab68-1424e16b8b37-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-ttmct\" (UID: \"1584e08c-de11-42ba-ab68-1424e16b8b37\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-ttmct"
Jul 27 20:05:35.074975 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:05:35.074892    2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 27 20:05:35.075029 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:05:35.074975    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1584e08c-de11-42ba-ab68-1424e16b8b37-samples-operator-tls podName:1584e08c-de11-42ba-ab68-1424e16b8b37 nodeName:}" failed. No retries permitted until 2026-07-27 20:05:37.074945941 +0000 UTC m=+85.649672309 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1584e08c-de11-42ba-ab68-1424e16b8b37-samples-operator-tls") pod "cluster-samples-operator-6748489656-ttmct" (UID: "1584e08c-de11-42ba-ab68-1424e16b8b37") : secret "samples-operator-tls" not found
Jul 27 20:05:35.075564 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:05:35.075390    2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 27 20:05:35.075564 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:05:35.075442    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/966563a5-3031-4e3f-ab52-31e43de5dd1f-metrics-certs podName:966563a5-3031-4e3f-ab52-31e43de5dd1f nodeName:}" failed. No retries permitted until 2026-07-27 20:05:37.075426216 +0000 UTC m=+85.650152586 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/966563a5-3031-4e3f-ab52-31e43de5dd1f-metrics-certs") pod "router-default-74566c475c-7w525" (UID: "966563a5-3031-4e3f-ab52-31e43de5dd1f") : secret "router-metrics-certs-default" not found
Jul 27 20:05:35.075564 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:05:35.075526    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/966563a5-3031-4e3f-ab52-31e43de5dd1f-service-ca-bundle podName:966563a5-3031-4e3f-ab52-31e43de5dd1f nodeName:}" failed. No retries permitted until 2026-07-27 20:05:37.075515267 +0000 UTC m=+85.650241640 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/966563a5-3031-4e3f-ab52-31e43de5dd1f-service-ca-bundle") pod "router-default-74566c475c-7w525" (UID: "966563a5-3031-4e3f-ab52-31e43de5dd1f") : configmap references non-existent config key: service-ca.crt
Jul 27 20:05:35.972187 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:35.972142    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:05:36.303263 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:36.303233    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-rcn59" event={"ID":"cd3da7a1-e90c-492f-bb7d-d00f4236e20d","Type":"ContainerStarted","Data":"0401eb2234a8aa74f7941b64d1ad536ea67a2e658ef92f3c8792caddcb61aec4"}
Jul 27 20:05:36.304939 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:36.304900    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-qf7sz" event={"ID":"3a7e2235-bcb7-46dd-9ac1-cd7fa374c19a","Type":"ContainerStarted","Data":"fb961a923484f66cc3d07f8c0cf737e28831502ba8806f1478465cfee69224da"}
Jul 27 20:05:36.319438 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:36.319386    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-rcn59" podStartSLOduration=0.860748863 podStartE2EDuration="3.319371863s" totalImagesPullingTime="2.458623s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:05:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:05:36.318969307 +0000 UTC m=+84.893695695" watchObservedRunningTime="2026-07-27 20:05:36.319371863 +0000 UTC m=+84.894098250"
Jul 27 20:05:36.335087 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:36.335030    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-qf7sz" podStartSLOduration=0.770789256 podStartE2EDuration="3.335010444s" totalImagesPullingTime="2.564221188s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:05:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:05:36.334044195 +0000 UTC m=+84.908770586" watchObservedRunningTime="2026-07-27 20:05:36.335010444 +0000 UTC m=+84.909736833"
Jul 27 20:05:36.426609 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:36.426572    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:05:36.483089 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:36.483059    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:05:37.091809 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:37.091762    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/966563a5-3031-4e3f-ab52-31e43de5dd1f-service-ca-bundle\") pod \"router-default-74566c475c-7w525\" (UID: \"966563a5-3031-4e3f-ab52-31e43de5dd1f\") " pod="openshift-ingress/router-default-74566c475c-7w525"
Jul 27 20:05:37.092193 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:37.091821    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1584e08c-de11-42ba-ab68-1424e16b8b37-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-ttmct\" (UID: \"1584e08c-de11-42ba-ab68-1424e16b8b37\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-ttmct"
Jul 27 20:05:37.092193 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:37.091875    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/966563a5-3031-4e3f-ab52-31e43de5dd1f-metrics-certs\") pod \"router-default-74566c475c-7w525\" (UID: \"966563a5-3031-4e3f-ab52-31e43de5dd1f\") " pod="openshift-ingress/router-default-74566c475c-7w525"
Jul 27 20:05:37.092193 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:05:37.091935    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/966563a5-3031-4e3f-ab52-31e43de5dd1f-service-ca-bundle podName:966563a5-3031-4e3f-ab52-31e43de5dd1f nodeName:}" failed. No retries permitted until 2026-07-27 20:05:41.091916295 +0000 UTC m=+89.666642661 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/966563a5-3031-4e3f-ab52-31e43de5dd1f-service-ca-bundle") pod "router-default-74566c475c-7w525" (UID: "966563a5-3031-4e3f-ab52-31e43de5dd1f") : configmap references non-existent config key: service-ca.crt
Jul 27 20:05:37.092193 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:05:37.091992    2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 27 20:05:37.092193 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:05:37.091997    2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 27 20:05:37.092193 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:05:37.092047    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/966563a5-3031-4e3f-ab52-31e43de5dd1f-metrics-certs podName:966563a5-3031-4e3f-ab52-31e43de5dd1f nodeName:}" failed. No retries permitted until 2026-07-27 20:05:41.092032182 +0000 UTC m=+89.666758552 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/966563a5-3031-4e3f-ab52-31e43de5dd1f-metrics-certs") pod "router-default-74566c475c-7w525" (UID: "966563a5-3031-4e3f-ab52-31e43de5dd1f") : secret "router-metrics-certs-default" not found
Jul 27 20:05:37.092193 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:05:37.092065    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1584e08c-de11-42ba-ab68-1424e16b8b37-samples-operator-tls podName:1584e08c-de11-42ba-ab68-1424e16b8b37 nodeName:}" failed. No retries permitted until 2026-07-27 20:05:41.092054591 +0000 UTC m=+89.666780964 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1584e08c-de11-42ba-ab68-1424e16b8b37-samples-operator-tls") pod "cluster-samples-operator-6748489656-ttmct" (UID: "1584e08c-de11-42ba-ab68-1424e16b8b37") : secret "samples-operator-tls" not found
Jul 27 20:05:37.699111 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:37.699075    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:05:37.754499 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:37.754467    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:05:38.126059 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:38.126024    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:05:38.392535 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:38.392441    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:05:38.494250 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:38.494213    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:05:38.733508 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:38.733478    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-kbtmz"]
Jul 27 20:05:38.736439 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:38.736421    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kbtmz"
Jul 27 20:05:38.739814 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:38.739794    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 27 20:05:38.739915 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:38.739794    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 27 20:05:38.740792 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:38.740774    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2fdzc\""
Jul 27 20:05:38.740792 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:38.740781    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 27 20:05:38.740937 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:38.740819    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 27 20:05:38.759238 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:38.757542    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kbtmz"]
Jul 27 20:05:38.803569 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:38.803535    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68-data-volume\") pod \"insights-runtime-extractor-kbtmz\" (UID: \"be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68\") " pod="openshift-insights/insights-runtime-extractor-kbtmz"
Jul 27 20:05:38.803569 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:38.803575    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrl9n\" (UniqueName: \"kubernetes.io/projected/be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68-kube-api-access-lrl9n\") pod \"insights-runtime-extractor-kbtmz\" (UID: \"be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68\") " pod="openshift-insights/insights-runtime-extractor-kbtmz"
Jul 27 20:05:38.803787 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:38.803699    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kbtmz\" (UID: \"be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68\") " pod="openshift-insights/insights-runtime-extractor-kbtmz"
Jul 27 20:05:38.803787 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:38.803731    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68-crio-socket\") pod \"insights-runtime-extractor-kbtmz\" (UID: \"be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68\") " pod="openshift-insights/insights-runtime-extractor-kbtmz"
Jul 27 20:05:38.803851 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:38.803789    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kbtmz\" (UID: \"be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68\") " pod="openshift-insights/insights-runtime-extractor-kbtmz"
Jul 27 20:05:38.904330 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:38.904284    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kbtmz\" (UID: \"be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68\") " pod="openshift-insights/insights-runtime-extractor-kbtmz"
Jul 27 20:05:38.904330 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:38.904337    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68-data-volume\") pod \"insights-runtime-extractor-kbtmz\" (UID: \"be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68\") " pod="openshift-insights/insights-runtime-extractor-kbtmz"
Jul 27 20:05:38.904583 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:38.904357    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrl9n\" (UniqueName: \"kubernetes.io/projected/be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68-kube-api-access-lrl9n\") pod \"insights-runtime-extractor-kbtmz\" (UID: \"be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68\") " pod="openshift-insights/insights-runtime-extractor-kbtmz"
Jul 27 20:05:38.904583 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:05:38.904393    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 20:05:38.904583 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:38.904411    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kbtmz\" (UID: \"be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68\") " pod="openshift-insights/insights-runtime-extractor-kbtmz"
Jul 27 20:05:38.904583 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:38.904429    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68-crio-socket\") pod \"insights-runtime-extractor-kbtmz\" (UID: \"be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68\") " pod="openshift-insights/insights-runtime-extractor-kbtmz"
Jul 27 20:05:38.904583 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:05:38.904485    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68-insights-runtime-extractor-tls podName:be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68 nodeName:}" failed. No retries permitted until 2026-07-27 20:05:39.404442625 +0000 UTC m=+87.979169006 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kbtmz" (UID: "be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68") : secret "insights-runtime-extractor-tls" not found
Jul 27 20:05:38.904583 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:38.904528    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68-crio-socket\") pod \"insights-runtime-extractor-kbtmz\" (UID: \"be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68\") " pod="openshift-insights/insights-runtime-extractor-kbtmz"
Jul 27 20:05:38.904583 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:05:38.904543    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 20:05:38.904851 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:05:38.904622    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68-kube-rbac-proxy-cm podName:be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68 nodeName:}" failed. No retries permitted until 2026-07-27 20:05:39.404603192 +0000 UTC m=+87.979329558 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kbtmz" (UID: "be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68") : configmap "kube-rbac-proxy" not found
Jul 27 20:05:38.904892 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:38.904879    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68-data-volume\") pod \"insights-runtime-extractor-kbtmz\" (UID: \"be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68\") " pod="openshift-insights/insights-runtime-extractor-kbtmz"
Jul 27 20:05:38.912930 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:38.912899    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrl9n\" (UniqueName: \"kubernetes.io/projected/be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68-kube-api-access-lrl9n\") pod \"insights-runtime-extractor-kbtmz\" (UID: \"be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68\") " pod="openshift-insights/insights-runtime-extractor-kbtmz"
Jul 27 20:05:39.045158 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:39.045053    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:05:39.145610 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:39.145575    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:05:39.408806 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:39.408711    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kbtmz\" (UID: \"be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68\") " pod="openshift-insights/insights-runtime-extractor-kbtmz"
Jul 27 20:05:39.408806 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:39.408781    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kbtmz\" (UID: \"be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68\") " pod="openshift-insights/insights-runtime-extractor-kbtmz"
Jul 27 20:05:39.409003 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:05:39.408837    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 20:05:39.409003 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:05:39.408892    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 20:05:39.409003 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:05:39.408913    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68-kube-rbac-proxy-cm podName:be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68 nodeName:}" failed. No retries permitted until 2026-07-27 20:05:40.408896876 +0000 UTC m=+88.983623248 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kbtmz" (UID: "be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68") : configmap "kube-rbac-proxy" not found
Jul 27 20:05:39.409003 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:05:39.408969    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68-insights-runtime-extractor-tls podName:be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68 nodeName:}" failed. No retries permitted until 2026-07-27 20:05:40.408952906 +0000 UTC m=+88.983679287 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kbtmz" (UID: "be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68") : secret "insights-runtime-extractor-tls" not found
Jul 27 20:05:39.414118 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:39.414087    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:05:39.823118 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:39.823087    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:05:40.026830 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:40.026799    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:05:40.087926 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:40.087844    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:05:40.418524 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:40.418427    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kbtmz\" (UID: \"be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68\") " pod="openshift-insights/insights-runtime-extractor-kbtmz"
Jul 27 20:05:40.418913 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:05:40.418555    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 20:05:40.418913 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:40.418587    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kbtmz\" (UID: \"be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68\") " pod="openshift-insights/insights-runtime-extractor-kbtmz"
Jul 27 20:05:40.418913 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:05:40.418634    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68-kube-rbac-proxy-cm podName:be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68 nodeName:}" failed. No retries permitted until 2026-07-27 20:05:42.418618139 +0000 UTC m=+90.993344505 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kbtmz" (UID: "be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68") : configmap "kube-rbac-proxy" not found
Jul 27 20:05:40.418913 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:05:40.418679    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 20:05:40.418913 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:05:40.418724    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68-insights-runtime-extractor-tls podName:be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68 nodeName:}" failed. No retries permitted until 2026-07-27 20:05:42.418711533 +0000 UTC m=+90.993437899 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kbtmz" (UID: "be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68") : secret "insights-runtime-extractor-tls" not found
Jul 27 20:05:40.465565 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:40.465523    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:05:40.642598 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:40.642558    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:05:40.919232 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:40.919203    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rzzr5_1b56de62-a601-4cc1-80c9-5b640c1060fe/dns-node-resolver/0.log"
Jul 27 20:05:40.996192 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:40.996140    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:05:41.123982 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:41.123947    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/966563a5-3031-4e3f-ab52-31e43de5dd1f-service-ca-bundle\") pod \"router-default-74566c475c-7w525\" (UID: \"966563a5-3031-4e3f-ab52-31e43de5dd1f\") " pod="openshift-ingress/router-default-74566c475c-7w525"
Jul 27 20:05:41.123982 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:41.123987    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1584e08c-de11-42ba-ab68-1424e16b8b37-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-ttmct\" (UID: \"1584e08c-de11-42ba-ab68-1424e16b8b37\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-ttmct"
Jul 27 20:05:41.124199 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:41.124037    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/966563a5-3031-4e3f-ab52-31e43de5dd1f-metrics-certs\") pod \"router-default-74566c475c-7w525\" (UID: \"966563a5-3031-4e3f-ab52-31e43de5dd1f\") " pod="openshift-ingress/router-default-74566c475c-7w525"
Jul 27 20:05:41.124199 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:05:41.124135    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/966563a5-3031-4e3f-ab52-31e43de5dd1f-service-ca-bundle podName:966563a5-3031-4e3f-ab52-31e43de5dd1f nodeName:}" failed. No retries permitted until 2026-07-27 20:05:49.124111207 +0000 UTC m=+97.698837573 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/966563a5-3031-4e3f-ab52-31e43de5dd1f-service-ca-bundle") pod "router-default-74566c475c-7w525" (UID: "966563a5-3031-4e3f-ab52-31e43de5dd1f") : configmap references non-existent config key: service-ca.crt
Jul 27 20:05:41.124199 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:05:41.124154    2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 27 20:05:41.124199 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:05:41.124200    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/966563a5-3031-4e3f-ab52-31e43de5dd1f-metrics-certs podName:966563a5-3031-4e3f-ab52-31e43de5dd1f nodeName:}" failed. No retries permitted until 2026-07-27 20:05:49.124188718 +0000 UTC m=+97.698915083 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/966563a5-3031-4e3f-ab52-31e43de5dd1f-metrics-certs") pod "router-default-74566c475c-7w525" (UID: "966563a5-3031-4e3f-ab52-31e43de5dd1f") : secret "router-metrics-certs-default" not found
Jul 27 20:05:41.124331 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:05:41.124158    2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 27 20:05:41.124331 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:05:41.124232    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1584e08c-de11-42ba-ab68-1424e16b8b37-samples-operator-tls podName:1584e08c-de11-42ba-ab68-1424e16b8b37 nodeName:}" failed. No retries permitted until 2026-07-27 20:05:49.124221782 +0000 UTC m=+97.698948149 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1584e08c-de11-42ba-ab68-1424e16b8b37-samples-operator-tls") pod "cluster-samples-operator-6748489656-ttmct" (UID: "1584e08c-de11-42ba-ab68-1424e16b8b37") : secret "samples-operator-tls" not found
Jul 27 20:05:41.319152 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:41.319120    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4f5vb_97e4eedc-db60-4e33-96d5-a66a5b35ac80/node-ca/0.log"
Jul 27 20:05:42.119252 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:42.119222    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cgn8m_fd837541-b858-4d93-8260-bf7c6b040358/serve-healthcheck-canary/0.log"
Jul 27 20:05:42.435508 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:42.435379    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kbtmz\" (UID: \"be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68\") " pod="openshift-insights/insights-runtime-extractor-kbtmz"
Jul 27 20:05:42.435508 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:42.435437    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kbtmz\" (UID: \"be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68\") " pod="openshift-insights/insights-runtime-extractor-kbtmz"
Jul 27 20:05:42.435709 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:05:42.435512    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 20:05:42.435709 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:05:42.435555    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 20:05:42.435709 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:05:42.435579    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68-kube-rbac-proxy-cm podName:be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68 nodeName:}" failed. No retries permitted until 2026-07-27 20:05:46.435562455 +0000 UTC m=+95.010288821 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kbtmz" (UID: "be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68") : configmap "kube-rbac-proxy" not found
Jul 27 20:05:42.435709 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:05:42.435600    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68-insights-runtime-extractor-tls podName:be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68 nodeName:}" failed. No retries permitted until 2026-07-27 20:05:46.435588597 +0000 UTC m=+95.010314963 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kbtmz" (UID: "be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68") : secret "insights-runtime-extractor-tls" not found
Jul 27 20:05:43.281803 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:43.281762    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:05:43.525959 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:43.525923    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:05:43.663066 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:43.660608    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:05:43.759547 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:43.759507    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:05:43.877172 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:43.877121    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:05:43.978719 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:43.978682    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:05:44.978989 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:44.978950    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:05:45.177311 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:45.177274    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:05:45.375969 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:45.375881    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:05:45.777557 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:45.777527    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:05:46.466019 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:46.465965    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kbtmz\" (UID: \"be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68\") " pod="openshift-insights/insights-runtime-extractor-kbtmz"
Jul 27 20:05:46.466417 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:46.466100    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kbtmz\" (UID: \"be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68\") " pod="openshift-insights/insights-runtime-extractor-kbtmz"
Jul 27 20:05:46.466417 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:05:46.466140    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 20:05:46.466417 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:05:46.466170    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 20:05:46.466417 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:05:46.466229    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68-insights-runtime-extractor-tls podName:be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68 nodeName:}" failed. No retries permitted until 2026-07-27 20:05:54.466208873 +0000 UTC m=+103.040935246 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kbtmz" (UID: "be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68") : secret "insights-runtime-extractor-tls" not found
Jul 27 20:05:46.466417 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:05:46.466246    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68-kube-rbac-proxy-cm podName:be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68 nodeName:}" failed. No retries permitted until 2026-07-27 20:05:54.466237629 +0000 UTC m=+103.040963995 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kbtmz" (UID: "be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68") : configmap "kube-rbac-proxy" not found
Jul 27 20:05:46.742376 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:46.742340    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:05:46.893497 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:46.893441    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:05:46.994933 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:46.994851    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:05:47.174887 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:47.174852    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:05:47.247932 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:47.247854    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:05:47.387463 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:47.387427    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:05:47.593499 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:47.593405    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:05:47.660891 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:47.660859    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:05:48.615051 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:48.615016    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:05:48.978413 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:48.978372    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:05:49.176173 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:49.176139    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:05:49.188598 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:49.188574    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/966563a5-3031-4e3f-ab52-31e43de5dd1f-service-ca-bundle\") pod \"router-default-74566c475c-7w525\" (UID: \"966563a5-3031-4e3f-ab52-31e43de5dd1f\") " pod="openshift-ingress/router-default-74566c475c-7w525"
Jul 27 20:05:49.188678 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:49.188613    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1584e08c-de11-42ba-ab68-1424e16b8b37-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-ttmct\" (UID: \"1584e08c-de11-42ba-ab68-1424e16b8b37\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-ttmct"
Jul 27 20:05:49.188678 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:49.188658    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/966563a5-3031-4e3f-ab52-31e43de5dd1f-metrics-certs\") pod \"router-default-74566c475c-7w525\" (UID: \"966563a5-3031-4e3f-ab52-31e43de5dd1f\") " pod="openshift-ingress/router-default-74566c475c-7w525"
Jul 27 20:05:49.188757 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:05:49.188742    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/966563a5-3031-4e3f-ab52-31e43de5dd1f-service-ca-bundle podName:966563a5-3031-4e3f-ab52-31e43de5dd1f nodeName:}" failed. No retries permitted until 2026-07-27 20:06:05.188720255 +0000 UTC m=+113.763446620 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/966563a5-3031-4e3f-ab52-31e43de5dd1f-service-ca-bundle") pod "router-default-74566c475c-7w525" (UID: "966563a5-3031-4e3f-ab52-31e43de5dd1f") : configmap references non-existent config key: service-ca.crt
Jul 27 20:05:49.191060 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:49.191037    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1584e08c-de11-42ba-ab68-1424e16b8b37-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-ttmct\" (UID: \"1584e08c-de11-42ba-ab68-1424e16b8b37\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-ttmct"
Jul 27 20:05:49.191060 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:49.191056    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/966563a5-3031-4e3f-ab52-31e43de5dd1f-metrics-certs\") pod \"router-default-74566c475c-7w525\" (UID: \"966563a5-3031-4e3f-ab52-31e43de5dd1f\") " pod="openshift-ingress/router-default-74566c475c-7w525"
Jul 27 20:05:49.328987 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:49.328899    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-ttmct"
Jul 27 20:05:49.417757 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:49.417723    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:05:49.456047 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:49.456022    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-ttmct"]
Jul 27 20:05:49.579620 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:49.579522    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:05:49.729424 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:49.729391    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:05:50.343760 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:50.343718    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-ttmct" event={"ID":"1584e08c-de11-42ba-ab68-1424e16b8b37","Type":"ContainerStarted","Data":"1bb833edf8c5129f8a80f7899ea4d7aa37404fb000d7e552be1d60df58ed22c8"}
Jul 27 20:05:50.701030 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:50.700921    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16dce8d0-44a1-48a6-9626-ca84454d9680-metrics-tls\") pod \"dns-default-cfftn\" (UID: \"16dce8d0-44a1-48a6-9626-ca84454d9680\") " pod="openshift-dns/dns-default-cfftn"
Jul 27 20:05:50.703220 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:50.703185    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16dce8d0-44a1-48a6-9626-ca84454d9680-metrics-tls\") pod \"dns-default-cfftn\" (UID: \"16dce8d0-44a1-48a6-9626-ca84454d9680\") " pod="openshift-dns/dns-default-cfftn"
Jul 27 20:05:50.751657 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:50.751624    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2k4bq\""
Jul 27 20:05:50.759557 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:50.759529    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cfftn"
Jul 27 20:05:50.776201 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:50.776177    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:05:50.893610 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:50.893581    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cfftn"]
Jul 27 20:05:50.986715 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:50.986677    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:05:51.180371 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:51.180330    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:05:51.275238 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:05:51.275170    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16dce8d0_44a1_48a6_9626_ca84454d9680.slice/crio-012a1ab8885d0d5b8bc3f9c336007ca9ac4d690cae4a76f512237359135d7ae6 WatchSource:0}: Error finding container 012a1ab8885d0d5b8bc3f9c336007ca9ac4d690cae4a76f512237359135d7ae6: Status 404 returned error can't find the container with id 012a1ab8885d0d5b8bc3f9c336007ca9ac4d690cae4a76f512237359135d7ae6
Jul 27 20:05:51.323120 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:51.323061    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:05:51.346893 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:51.346866    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cfftn" event={"ID":"16dce8d0-44a1-48a6-9626-ca84454d9680","Type":"ContainerStarted","Data":"012a1ab8885d0d5b8bc3f9c336007ca9ac4d690cae4a76f512237359135d7ae6"}
Jul 27 20:05:51.424152 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:51.424119    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:05:51.624399 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:51.624316    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:05:51.944325 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:51.944233    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:05:52.002636 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:52.002591    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:05:52.351240 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:52.351201    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-ttmct" event={"ID":"1584e08c-de11-42ba-ab68-1424e16b8b37","Type":"ContainerStarted","Data":"ef7df3e8c7c08523434c94df280fba6aaa0b4ffcd9a9e57479f9a80864dedc9a"}
Jul 27 20:05:52.351391 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:52.351261    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-ttmct" event={"ID":"1584e08c-de11-42ba-ab68-1424e16b8b37","Type":"ContainerStarted","Data":"dda6c322fd6affb9dacd75a3532810d65436f4498e0601d3a8ad89166f2dd328"}
Jul 27 20:05:52.368897 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:52.368835    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-ttmct" podStartSLOduration=17.546344556 podStartE2EDuration="19.368811277s" totalImagesPullingTime="1.822466721s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:05:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:05:52.36807465 +0000 UTC m=+100.942801062" watchObservedRunningTime="2026-07-27 20:05:52.368811277 +0000 UTC m=+100.943537667"
Jul 27 20:05:52.614281 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:52.614190    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:05:52.977132 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:52.977092    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:05:53.181893 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:53.181861    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:05:53.356765 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:53.356678    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cfftn" event={"ID":"16dce8d0-44a1-48a6-9626-ca84454d9680","Type":"ContainerStarted","Data":"bcabd338789bb0aec7b79aa1d96c5ce5defdafdcf70a02b26ef0ad35b277d20b"}
Jul 27 20:05:53.356916 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:53.356772    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cfftn" event={"ID":"16dce8d0-44a1-48a6-9626-ca84454d9680","Type":"ContainerStarted","Data":"6539451b3dc33573e6ac74ca42bc0e1c5be3f6151b2a89155c6a11b51c9a7137"}
Jul 27 20:05:53.374879 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:53.374825    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-cfftn" podStartSLOduration=65.641443487 podStartE2EDuration="1m7.37480774s" totalImagesPullingTime="1.733364253s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:04:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:05:53.373341752 +0000 UTC m=+101.948068140" watchObservedRunningTime="2026-07-27 20:05:53.37480774 +0000 UTC m=+101.949534128"
Jul 27 20:05:53.398993 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:53.398960    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:05:53.787094 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:53.787060    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:05:53.989568 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:53.989534    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:05:54.268780 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:54.268752    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-kxvq5"
Jul 27 20:05:54.360197 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:54.360158    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-cfftn"
Jul 27 20:05:54.532309 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:54.532216    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kbtmz\" (UID: \"be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68\") " pod="openshift-insights/insights-runtime-extractor-kbtmz"
Jul 27 20:05:54.532309 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:54.532291    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kbtmz\" (UID: \"be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68\") " pod="openshift-insights/insights-runtime-extractor-kbtmz"
Jul 27 20:05:54.532784 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:54.532761    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kbtmz\" (UID: \"be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68\") " pod="openshift-insights/insights-runtime-extractor-kbtmz"
Jul 27 20:05:54.534655 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:54.534635    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kbtmz\" (UID: \"be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68\") " pod="openshift-insights/insights-runtime-extractor-kbtmz"
Jul 27 20:05:54.645560 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:54.645525    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kbtmz"
Jul 27 20:05:54.787531 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:54.787437    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kbtmz"]
Jul 27 20:05:54.790885 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:05:54.790858    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe3ddbcc_b81d_4f72_a3e0_969fc4c6ec68.slice/crio-d1204a44181dcec43d4e17fb55fe2e03604d42f11e0222bd2ca0eb5aa44dcdb5 WatchSource:0}: Error finding container d1204a44181dcec43d4e17fb55fe2e03604d42f11e0222bd2ca0eb5aa44dcdb5: Status 404 returned error can't find the container with id d1204a44181dcec43d4e17fb55fe2e03604d42f11e0222bd2ca0eb5aa44dcdb5
Jul 27 20:05:55.367137 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:55.367042    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kbtmz" event={"ID":"be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68","Type":"ContainerStarted","Data":"d1204a44181dcec43d4e17fb55fe2e03604d42f11e0222bd2ca0eb5aa44dcdb5"}
Jul 27 20:05:57.716783 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:57.716747    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:05:57.821595 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:57.821555    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:05:57.997306 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:57.997274    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:05:58.357467 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:58.357365    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:05:58.440070 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:58.440035    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:05:58.771375 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:58.771259    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:05:58.862126 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:58.862091    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:05:59.163944 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:59.163847    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:05:59.264399 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:59.264362    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:05:59.376132 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:05:59.376099    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:00.003769 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:00.003740    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:00.079273 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:00.079197    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:00.272393 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:00.272359    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-2ddz5"]
Jul 27 20:06:00.275339 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:00.275322    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-2ddz5"
Jul 27 20:06:00.278128 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:00.278105    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-phqdx"]
Jul 27 20:06:00.279486 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:00.279438    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 27 20:06:00.280260 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:00.280243    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 27 20:06:00.280359 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:00.280286    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-f9lml\""
Jul 27 20:06:00.280977 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:00.280960    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-phqdx"
Jul 27 20:06:00.282921 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:00.282901    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-pmcwj\""
Jul 27 20:06:00.289055 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:00.289016    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-2ddz5"]
Jul 27 20:06:00.293995 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:00.293971    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-phqdx"]
Jul 27 20:06:00.380437 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:00.380354    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f5411457-3ec1-47a1-a64f-4111eb7d2610-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-2ddz5\" (UID: \"f5411457-3ec1-47a1-a64f-4111eb7d2610\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-2ddz5"
Jul 27 20:06:00.380437 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:00.380403    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f5411457-3ec1-47a1-a64f-4111eb7d2610-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-2ddz5\" (UID: \"f5411457-3ec1-47a1-a64f-4111eb7d2610\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-2ddz5"
Jul 27 20:06:00.380437 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:00.380431    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmlmp\" (UniqueName: \"kubernetes.io/projected/28f34417-67fc-43a9-8c88-d43012308434-kube-api-access-qmlmp\") pod \"network-check-source-7d88cb55d8-phqdx\" (UID: \"28f34417-67fc-43a9-8c88-d43012308434\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-phqdx"
Jul 27 20:06:00.386638 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:00.386610    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kbtmz" event={"ID":"be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68","Type":"ContainerStarted","Data":"7516de7b58686d9306d2bd36705e1f08d55805882f728641f41e6850ca530c12"}
Jul 27 20:06:00.398279 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:00.398248    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-h5wdd"]
Jul 27 20:06:00.401318 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:00.401284    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-65fc577b8b-lxzch"]
Jul 27 20:06:00.401446 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:00.401429    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-h5wdd"
Jul 27 20:06:00.404294 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:00.404270    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65fc577b8b-lxzch"
Jul 27 20:06:00.405406 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:00.405385    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 27 20:06:00.406707 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:00.406686    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 27 20:06:00.406798 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:00.406771    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-rh76t\""
Jul 27 20:06:00.411438 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:00.411201    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bsfqh\""
Jul 27 20:06:00.411438 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:00.411288    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 27 20:06:00.411666 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:00.411610    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 27 20:06:00.412374 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:00.412357    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 27 20:06:00.416920 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:00.416895    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 27 20:06:00.428130 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:00.427935    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-65fc577b8b-lxzch"]
Jul 27 20:06:00.429600 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:00.429576    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-h5wdd"]
Jul 27 20:06:00.439067 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:00.438934    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-65fc577b8b-lxzch"]
Jul 27 20:06:00.439202 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:06:00.439151    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[bound-sa-token ca-trust-extracted image-registry-private-configuration installation-pull-secrets kube-api-access-jksgw registry-certificates registry-tls trusted-ca], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-65fc577b8b-lxzch" podUID="a6e1127a-fa95-49bc-9fc3-711a287c99c5"
Jul 27 20:06:00.459284 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:00.459252    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:00.481700 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:00.481661    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a6e1127a-fa95-49bc-9fc3-711a287c99c5-registry-tls\") pod \"image-registry-65fc577b8b-lxzch\" (UID: \"a6e1127a-fa95-49bc-9fc3-711a287c99c5\") " pod="openshift-image-registry/image-registry-65fc577b8b-lxzch"
Jul 27 20:06:00.481860 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:00.481723    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f5411457-3ec1-47a1-a64f-4111eb7d2610-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-2ddz5\" (UID: \"f5411457-3ec1-47a1-a64f-4111eb7d2610\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-2ddz5"
Jul 27 20:06:00.481860 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:00.481764    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a6e1127a-fa95-49bc-9fc3-711a287c99c5-image-registry-private-configuration\") pod \"image-registry-65fc577b8b-lxzch\" (UID: \"a6e1127a-fa95-49bc-9fc3-711a287c99c5\") " pod="openshift-image-registry/image-registry-65fc577b8b-lxzch"
Jul 27 20:06:00.482415 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:00.482201    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a6e1127a-fa95-49bc-9fc3-711a287c99c5-trusted-ca\") pod \"image-registry-65fc577b8b-lxzch\" (UID: \"a6e1127a-fa95-49bc-9fc3-711a287c99c5\") " pod="openshift-image-registry/image-registry-65fc577b8b-lxzch"
Jul 27 20:06:00.482564 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:00.482262    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jksgw\" (UniqueName: \"kubernetes.io/projected/a6e1127a-fa95-49bc-9fc3-711a287c99c5-kube-api-access-jksgw\") pod \"image-registry-65fc577b8b-lxzch\" (UID: \"a6e1127a-fa95-49bc-9fc3-711a287c99c5\") " pod="openshift-image-registry/image-registry-65fc577b8b-lxzch"
Jul 27 20:06:00.482564 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:00.482533    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a6e1127a-fa95-49bc-9fc3-711a287c99c5-registry-certificates\") pod \"image-registry-65fc577b8b-lxzch\" (UID: \"a6e1127a-fa95-49bc-9fc3-711a287c99c5\") " pod="openshift-image-registry/image-registry-65fc577b8b-lxzch"
Jul 27 20:06:00.482683 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:00.482574    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a6e1127a-fa95-49bc-9fc3-711a287c99c5-bound-sa-token\") pod \"image-registry-65fc577b8b-lxzch\" (UID: \"a6e1127a-fa95-49bc-9fc3-711a287c99c5\") " pod="openshift-image-registry/image-registry-65fc577b8b-lxzch"
Jul 27 20:06:00.482683 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:00.482651    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqttc\" (UniqueName: \"kubernetes.io/projected/649d3ae6-5b22-422b-9e2b-2ae5a29ee8dc-kube-api-access-qqttc\") pod \"downloads-7c97dc4555-h5wdd\" (UID: \"649d3ae6-5b22-422b-9e2b-2ae5a29ee8dc\") " pod="openshift-console/downloads-7c97dc4555-h5wdd"
Jul 27 20:06:00.482783 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:00.482741    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmlmp\" (UniqueName: \"kubernetes.io/projected/28f34417-67fc-43a9-8c88-d43012308434-kube-api-access-qmlmp\") pod \"network-check-source-7d88cb55d8-phqdx\" (UID: \"28f34417-67fc-43a9-8c88-d43012308434\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-phqdx"
Jul 27 20:06:00.482831 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:00.482789    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f5411457-3ec1-47a1-a64f-4111eb7d2610-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-2ddz5\" (UID: \"f5411457-3ec1-47a1-a64f-4111eb7d2610\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-2ddz5"
Jul 27 20:06:00.483079 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:00.483052    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a6e1127a-fa95-49bc-9fc3-711a287c99c5-ca-trust-extracted\") pod \"image-registry-65fc577b8b-lxzch\" (UID: \"a6e1127a-fa95-49bc-9fc3-711a287c99c5\") " pod="openshift-image-registry/image-registry-65fc577b8b-lxzch"
Jul 27 20:06:00.483211 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:00.483110    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a6e1127a-fa95-49bc-9fc3-711a287c99c5-installation-pull-secrets\") pod \"image-registry-65fc577b8b-lxzch\" (UID: \"a6e1127a-fa95-49bc-9fc3-711a287c99c5\") " pod="openshift-image-registry/image-registry-65fc577b8b-lxzch"
Jul 27 20:06:00.486733 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:00.485266    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f5411457-3ec1-47a1-a64f-4111eb7d2610-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-2ddz5\" (UID: \"f5411457-3ec1-47a1-a64f-4111eb7d2610\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-2ddz5"
Jul 27 20:06:00.486733 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:00.485660    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f5411457-3ec1-47a1-a64f-4111eb7d2610-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-2ddz5\" (UID: \"f5411457-3ec1-47a1-a64f-4111eb7d2610\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-2ddz5"
Jul 27 20:06:00.510109 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:00.510080    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmlmp\" (UniqueName: \"kubernetes.io/projected/28f34417-67fc-43a9-8c88-d43012308434-kube-api-access-qmlmp\") pod \"network-check-source-7d88cb55d8-phqdx\" (UID: \"28f34417-67fc-43a9-8c88-d43012308434\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-phqdx"
Jul 27 20:06:00.584182 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:00.584142    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a6e1127a-fa95-49bc-9fc3-711a287c99c5-registry-certificates\") pod \"image-registry-65fc577b8b-lxzch\" (UID: \"a6e1127a-fa95-49bc-9fc3-711a287c99c5\") " pod="openshift-image-registry/image-registry-65fc577b8b-lxzch"
Jul 27 20:06:00.584376 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:00.584203    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a6e1127a-fa95-49bc-9fc3-711a287c99c5-bound-sa-token\") pod \"image-registry-65fc577b8b-lxzch\" (UID: \"a6e1127a-fa95-49bc-9fc3-711a287c99c5\") " pod="openshift-image-registry/image-registry-65fc577b8b-lxzch"
Jul 27 20:06:00.584376 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:00.584240    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqttc\" (UniqueName: \"kubernetes.io/projected/649d3ae6-5b22-422b-9e2b-2ae5a29ee8dc-kube-api-access-qqttc\") pod \"downloads-7c97dc4555-h5wdd\" (UID: \"649d3ae6-5b22-422b-9e2b-2ae5a29ee8dc\") " pod="openshift-console/downloads-7c97dc4555-h5wdd"
Jul 27 20:06:00.584376 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:00.584311    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a6e1127a-fa95-49bc-9fc3-711a287c99c5-ca-trust-extracted\") pod \"image-registry-65fc577b8b-lxzch\" (UID: \"a6e1127a-fa95-49bc-9fc3-711a287c99c5\") " pod="openshift-image-registry/image-registry-65fc577b8b-lxzch"
Jul 27 20:06:00.584376 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:00.584344    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a6e1127a-fa95-49bc-9fc3-711a287c99c5-installation-pull-secrets\") pod \"image-registry-65fc577b8b-lxzch\" (UID: \"a6e1127a-fa95-49bc-9fc3-711a287c99c5\") " pod="openshift-image-registry/image-registry-65fc577b8b-lxzch"
Jul 27 20:06:00.584642 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:00.584384    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a6e1127a-fa95-49bc-9fc3-711a287c99c5-registry-tls\") pod \"image-registry-65fc577b8b-lxzch\" (UID: \"a6e1127a-fa95-49bc-9fc3-711a287c99c5\") " pod="openshift-image-registry/image-registry-65fc577b8b-lxzch"
Jul 27 20:06:00.584642 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:00.584430    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a6e1127a-fa95-49bc-9fc3-711a287c99c5-image-registry-private-configuration\") pod \"image-registry-65fc577b8b-lxzch\" (UID: \"a6e1127a-fa95-49bc-9fc3-711a287c99c5\") " pod="openshift-image-registry/image-registry-65fc577b8b-lxzch"
Jul 27 20:06:00.584642 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:00.584482    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a6e1127a-fa95-49bc-9fc3-711a287c99c5-trusted-ca\") pod \"image-registry-65fc577b8b-lxzch\" (UID: \"a6e1127a-fa95-49bc-9fc3-711a287c99c5\") " pod="openshift-image-registry/image-registry-65fc577b8b-lxzch"
Jul 27 20:06:00.584642 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:00.584513    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jksgw\" (UniqueName: \"kubernetes.io/projected/a6e1127a-fa95-49bc-9fc3-711a287c99c5-kube-api-access-jksgw\") pod \"image-registry-65fc577b8b-lxzch\" (UID: \"a6e1127a-fa95-49bc-9fc3-711a287c99c5\") " pod="openshift-image-registry/image-registry-65fc577b8b-lxzch"
Jul 27 20:06:00.585114 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:00.585088    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a6e1127a-fa95-49bc-9fc3-711a287c99c5-registry-certificates\") pod \"image-registry-65fc577b8b-lxzch\" (UID: \"a6e1127a-fa95-49bc-9fc3-711a287c99c5\") " pod="openshift-image-registry/image-registry-65fc577b8b-lxzch"
Jul 27 20:06:00.586343 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:00.585787    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a6e1127a-fa95-49bc-9fc3-711a287c99c5-ca-trust-extracted\") pod \"image-registry-65fc577b8b-lxzch\" (UID: \"a6e1127a-fa95-49bc-9fc3-711a287c99c5\") " pod="openshift-image-registry/image-registry-65fc577b8b-lxzch"
Jul 27 20:06:00.586343 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:00.586116    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a6e1127a-fa95-49bc-9fc3-711a287c99c5-trusted-ca\") pod \"image-registry-65fc577b8b-lxzch\" (UID: \"a6e1127a-fa95-49bc-9fc3-711a287c99c5\") " pod="openshift-image-registry/image-registry-65fc577b8b-lxzch"
Jul 27 20:06:00.586343 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:00.586145    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-2ddz5"
Jul 27 20:06:00.587892 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:00.587863    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a6e1127a-fa95-49bc-9fc3-711a287c99c5-image-registry-private-configuration\") pod \"image-registry-65fc577b8b-lxzch\" (UID: \"a6e1127a-fa95-49bc-9fc3-711a287c99c5\") " pod="openshift-image-registry/image-registry-65fc577b8b-lxzch"
Jul 27 20:06:00.588701 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:00.588677    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a6e1127a-fa95-49bc-9fc3-711a287c99c5-installation-pull-secrets\") pod \"image-registry-65fc577b8b-lxzch\" (UID: \"a6e1127a-fa95-49bc-9fc3-711a287c99c5\") " pod="openshift-image-registry/image-registry-65fc577b8b-lxzch"
Jul 27 20:06:00.589843 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:00.589818    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a6e1127a-fa95-49bc-9fc3-711a287c99c5-registry-tls\") pod \"image-registry-65fc577b8b-lxzch\" (UID: \"a6e1127a-fa95-49bc-9fc3-711a287c99c5\") " pod="openshift-image-registry/image-registry-65fc577b8b-lxzch"
Jul 27 20:06:00.591333 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:00.591137    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-phqdx"
Jul 27 20:06:00.609573 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:00.609549    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a6e1127a-fa95-49bc-9fc3-711a287c99c5-bound-sa-token\") pod \"image-registry-65fc577b8b-lxzch\" (UID: \"a6e1127a-fa95-49bc-9fc3-711a287c99c5\") " pod="openshift-image-registry/image-registry-65fc577b8b-lxzch"
Jul 27 20:06:00.610635 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:00.610596    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jksgw\" (UniqueName: \"kubernetes.io/projected/a6e1127a-fa95-49bc-9fc3-711a287c99c5-kube-api-access-jksgw\") pod \"image-registry-65fc577b8b-lxzch\" (UID: \"a6e1127a-fa95-49bc-9fc3-711a287c99c5\") " pod="openshift-image-registry/image-registry-65fc577b8b-lxzch"
Jul 27 20:06:00.617535 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:00.617486    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqttc\" (UniqueName: \"kubernetes.io/projected/649d3ae6-5b22-422b-9e2b-2ae5a29ee8dc-kube-api-access-qqttc\") pod \"downloads-7c97dc4555-h5wdd\" (UID: \"649d3ae6-5b22-422b-9e2b-2ae5a29ee8dc\") " pod="openshift-console/downloads-7c97dc4555-h5wdd"
Jul 27 20:06:00.623250 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:00.623223    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:00.714989 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:00.714926    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-h5wdd"
Jul 27 20:06:00.780342 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:00.779819    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-2ddz5"]
Jul 27 20:06:00.802748 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:00.802670    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-phqdx"]
Jul 27 20:06:00.807601 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:06:00.807573    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28f34417_67fc_43a9_8c88_d43012308434.slice/crio-1c8e6eaddb8aa1310bff77cf9c8d9d21299412d15a298325acb1445332eb1bdb WatchSource:0}: Error finding container 1c8e6eaddb8aa1310bff77cf9c8d9d21299412d15a298325acb1445332eb1bdb: Status 404 returned error can't find the container with id 1c8e6eaddb8aa1310bff77cf9c8d9d21299412d15a298325acb1445332eb1bdb
Jul 27 20:06:00.885704 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:00.885675    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-h5wdd"]
Jul 27 20:06:00.892010 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:06:00.891981    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod649d3ae6_5b22_422b_9e2b_2ae5a29ee8dc.slice/crio-b0dbd37b407b9fa9714f065858cf6e08a2861d37650a8f2111c12132c95d72b9 WatchSource:0}: Error finding container b0dbd37b407b9fa9714f065858cf6e08a2861d37650a8f2111c12132c95d72b9: Status 404 returned error can't find the container with id b0dbd37b407b9fa9714f065858cf6e08a2861d37650a8f2111c12132c95d72b9
Jul 27 20:06:01.392880 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:01.392621    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-phqdx" event={"ID":"28f34417-67fc-43a9-8c88-d43012308434","Type":"ContainerStarted","Data":"c0979ff2b1d50150d44b2ff44db4e462c9bc0f0bbe6e27aca90fb8da7757b7e3"}
Jul 27 20:06:01.392880 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:01.392683    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-phqdx" event={"ID":"28f34417-67fc-43a9-8c88-d43012308434","Type":"ContainerStarted","Data":"1c8e6eaddb8aa1310bff77cf9c8d9d21299412d15a298325acb1445332eb1bdb"}
Jul 27 20:06:01.393840 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:01.393813    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-h5wdd" event={"ID":"649d3ae6-5b22-422b-9e2b-2ae5a29ee8dc","Type":"ContainerStarted","Data":"b0dbd37b407b9fa9714f065858cf6e08a2861d37650a8f2111c12132c95d72b9"}
Jul 27 20:06:01.395141 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:01.395115    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-2ddz5" event={"ID":"f5411457-3ec1-47a1-a64f-4111eb7d2610","Type":"ContainerStarted","Data":"f3804fb8b4dcc55af030805a578046b0398fde7aef85d955188f19062d4016ff"}
Jul 27 20:06:01.395230 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:01.395120    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65fc577b8b-lxzch"
Jul 27 20:06:01.402888 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:01.402869    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65fc577b8b-lxzch"
Jul 27 20:06:01.417894 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:01.417847    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-phqdx" podStartSLOduration=1.417827049 podStartE2EDuration="1.417827049s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:06:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:06:01.417326937 +0000 UTC m=+109.992053326" watchObservedRunningTime="2026-07-27 20:06:01.417827049 +0000 UTC m=+109.992553437"
Jul 27 20:06:01.491779 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:01.491739    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a6e1127a-fa95-49bc-9fc3-711a287c99c5-bound-sa-token\") pod \"a6e1127a-fa95-49bc-9fc3-711a287c99c5\" (UID: \"a6e1127a-fa95-49bc-9fc3-711a287c99c5\") "
Jul 27 20:06:01.491954 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:01.491787    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a6e1127a-fa95-49bc-9fc3-711a287c99c5-registry-tls\") pod \"a6e1127a-fa95-49bc-9fc3-711a287c99c5\" (UID: \"a6e1127a-fa95-49bc-9fc3-711a287c99c5\") "
Jul 27 20:06:01.491954 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:01.491817    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a6e1127a-fa95-49bc-9fc3-711a287c99c5-trusted-ca\") pod \"a6e1127a-fa95-49bc-9fc3-711a287c99c5\" (UID: \"a6e1127a-fa95-49bc-9fc3-711a287c99c5\") "
Jul 27 20:06:01.491954 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:01.491862    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a6e1127a-fa95-49bc-9fc3-711a287c99c5-image-registry-private-configuration\") pod \"a6e1127a-fa95-49bc-9fc3-711a287c99c5\" (UID: \"a6e1127a-fa95-49bc-9fc3-711a287c99c5\") "
Jul 27 20:06:01.491954 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:01.491897    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a6e1127a-fa95-49bc-9fc3-711a287c99c5-registry-certificates\") pod \"a6e1127a-fa95-49bc-9fc3-711a287c99c5\" (UID: \"a6e1127a-fa95-49bc-9fc3-711a287c99c5\") "
Jul 27 20:06:01.491954 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:01.491932    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a6e1127a-fa95-49bc-9fc3-711a287c99c5-ca-trust-extracted\") pod \"a6e1127a-fa95-49bc-9fc3-711a287c99c5\" (UID: \"a6e1127a-fa95-49bc-9fc3-711a287c99c5\") "
Jul 27 20:06:01.492235 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:01.491970    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a6e1127a-fa95-49bc-9fc3-711a287c99c5-installation-pull-secrets\") pod \"a6e1127a-fa95-49bc-9fc3-711a287c99c5\" (UID: \"a6e1127a-fa95-49bc-9fc3-711a287c99c5\") "
Jul 27 20:06:01.492235 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:01.492032    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jksgw\" (UniqueName: \"kubernetes.io/projected/a6e1127a-fa95-49bc-9fc3-711a287c99c5-kube-api-access-jksgw\") pod \"a6e1127a-fa95-49bc-9fc3-711a287c99c5\" (UID: \"a6e1127a-fa95-49bc-9fc3-711a287c99c5\") "
Jul 27 20:06:01.492718 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:01.492512    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6e1127a-fa95-49bc-9fc3-711a287c99c5-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "a6e1127a-fa95-49bc-9fc3-711a287c99c5" (UID: "a6e1127a-fa95-49bc-9fc3-711a287c99c5"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:06:01.492718 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:01.492625    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6e1127a-fa95-49bc-9fc3-711a287c99c5-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "a6e1127a-fa95-49bc-9fc3-711a287c99c5" (UID: "a6e1127a-fa95-49bc-9fc3-711a287c99c5"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:06:01.493202 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:01.493168    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6e1127a-fa95-49bc-9fc3-711a287c99c5-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "a6e1127a-fa95-49bc-9fc3-711a287c99c5" (UID: "a6e1127a-fa95-49bc-9fc3-711a287c99c5"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:06:01.495569 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:01.495538    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6e1127a-fa95-49bc-9fc3-711a287c99c5-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "a6e1127a-fa95-49bc-9fc3-711a287c99c5" (UID: "a6e1127a-fa95-49bc-9fc3-711a287c99c5"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:06:01.495687 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:01.495583    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6e1127a-fa95-49bc-9fc3-711a287c99c5-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a6e1127a-fa95-49bc-9fc3-711a287c99c5" (UID: "a6e1127a-fa95-49bc-9fc3-711a287c99c5"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:06:01.495687 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:01.495660    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6e1127a-fa95-49bc-9fc3-711a287c99c5-kube-api-access-jksgw" (OuterVolumeSpecName: "kube-api-access-jksgw") pod "a6e1127a-fa95-49bc-9fc3-711a287c99c5" (UID: "a6e1127a-fa95-49bc-9fc3-711a287c99c5"). InnerVolumeSpecName "kube-api-access-jksgw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:06:01.496341 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:01.496321    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6e1127a-fa95-49bc-9fc3-711a287c99c5-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "a6e1127a-fa95-49bc-9fc3-711a287c99c5" (UID: "a6e1127a-fa95-49bc-9fc3-711a287c99c5"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:06:01.496908 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:01.496872    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6e1127a-fa95-49bc-9fc3-711a287c99c5-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "a6e1127a-fa95-49bc-9fc3-711a287c99c5" (UID: "a6e1127a-fa95-49bc-9fc3-711a287c99c5"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:06:01.593684 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:01.593645    2557 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a6e1127a-fa95-49bc-9fc3-711a287c99c5-bound-sa-token\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:06:01.593684 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:01.593683    2557 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a6e1127a-fa95-49bc-9fc3-711a287c99c5-registry-tls\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:06:01.593906 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:01.593697    2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a6e1127a-fa95-49bc-9fc3-711a287c99c5-trusted-ca\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:06:01.593906 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:01.593715    2557 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a6e1127a-fa95-49bc-9fc3-711a287c99c5-image-registry-private-configuration\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:06:01.593906 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:01.593738    2557 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a6e1127a-fa95-49bc-9fc3-711a287c99c5-registry-certificates\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:06:01.593906 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:01.593759    2557 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a6e1127a-fa95-49bc-9fc3-711a287c99c5-ca-trust-extracted\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:06:01.593906 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:01.593779    2557 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a6e1127a-fa95-49bc-9fc3-711a287c99c5-installation-pull-secrets\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:06:01.593906 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:01.593800    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jksgw\" (UniqueName: \"kubernetes.io/projected/a6e1127a-fa95-49bc-9fc3-711a287c99c5-kube-api-access-jksgw\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:06:01.634909 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:01.634868    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:01.990301 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:01.990250    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:02.078100 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:02.078022    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:02.399357 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:02.399272    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65fc577b8b-lxzch"
Jul 27 20:06:02.446937 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:02.446900    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-65fc577b8b-lxzch"]
Jul 27 20:06:02.451082 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:02.451054    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-65fc577b8b-lxzch"]
Jul 27 20:06:03.909591 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:03.909517    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6e1127a-fa95-49bc-9fc3-711a287c99c5" path="/var/lib/kubelet/pods/a6e1127a-fa95-49bc-9fc3-711a287c99c5/volumes"
Jul 27 20:06:04.369732 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:04.369701    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-cfftn"
Jul 27 20:06:05.229026 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:05.228976    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/966563a5-3031-4e3f-ab52-31e43de5dd1f-service-ca-bundle\") pod \"router-default-74566c475c-7w525\" (UID: \"966563a5-3031-4e3f-ab52-31e43de5dd1f\") " pod="openshift-ingress/router-default-74566c475c-7w525"
Jul 27 20:06:05.229876 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:05.229846    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/966563a5-3031-4e3f-ab52-31e43de5dd1f-service-ca-bundle\") pod \"router-default-74566c475c-7w525\" (UID: \"966563a5-3031-4e3f-ab52-31e43de5dd1f\") " pod="openshift-ingress/router-default-74566c475c-7w525"
Jul 27 20:06:05.234957 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:05.234931    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-74566c475c-7w525"
Jul 27 20:06:05.413851 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:05.413635    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-2ddz5" event={"ID":"f5411457-3ec1-47a1-a64f-4111eb7d2610","Type":"ContainerStarted","Data":"afd2b96f458b9e5b2516fd28213743c90705df604445c4a0e4875827b32371dd"}
Jul 27 20:06:05.415775 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:05.415749    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kbtmz" event={"ID":"be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68","Type":"ContainerStarted","Data":"6df30cf7322bd52f10275e584e969fb8a88e2c7050e421e69d7b84b66d457f17"}
Jul 27 20:06:05.418061 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:05.418035    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-74566c475c-7w525"]
Jul 27 20:06:05.422499 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:06:05.422471    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod966563a5_3031_4e3f_ab52_31e43de5dd1f.slice/crio-0558ae9220e186104464b4ba00f6c31b4645101b8a737befd6d8a9d18dc3b79d WatchSource:0}: Error finding container 0558ae9220e186104464b4ba00f6c31b4645101b8a737befd6d8a9d18dc3b79d: Status 404 returned error can't find the container with id 0558ae9220e186104464b4ba00f6c31b4645101b8a737befd6d8a9d18dc3b79d
Jul 27 20:06:05.437999 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:05.437950    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-2ddz5" podStartSLOduration=1.8104250149999999 podStartE2EDuration="5.437934694s" totalImagesPullingTime="3.627509679s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:06:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:06:05.437698421 +0000 UTC m=+114.012424809" watchObservedRunningTime="2026-07-27 20:06:05.437934694 +0000 UTC m=+114.012661082"
Jul 27 20:06:05.557819 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:05.557761    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:05.707820 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:05.707760    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:06.422649 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:06.422617    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-74566c475c-7w525" event={"ID":"966563a5-3031-4e3f-ab52-31e43de5dd1f","Type":"ContainerStarted","Data":"565d7ae2ff7194c6bc95c78fb277ba1243d1fc625b8cf3c4046a00e1b71641b2"}
Jul 27 20:06:06.423108 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:06.422673    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-74566c475c-7w525" event={"ID":"966563a5-3031-4e3f-ab52-31e43de5dd1f","Type":"ContainerStarted","Data":"0558ae9220e186104464b4ba00f6c31b4645101b8a737befd6d8a9d18dc3b79d"}
Jul 27 20:06:07.235906 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:07.235870    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-74566c475c-7w525"
Jul 27 20:06:07.239068 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:07.239040    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-74566c475c-7w525"
Jul 27 20:06:07.261664 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:07.261607    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-74566c475c-7w525" podStartSLOduration=34.261585047 podStartE2EDuration="34.261585047s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:05:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:06:06.456811562 +0000 UTC m=+115.031537950" watchObservedRunningTime="2026-07-27 20:06:07.261585047 +0000 UTC m=+115.836311435"
Jul 27 20:06:07.425491 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:07.425443    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-74566c475c-7w525"
Jul 27 20:06:07.427029 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:07.427007    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-74566c475c-7w525"
Jul 27 20:06:08.049942 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:08.049851    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:08.145358 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:08.145266    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:09.435546 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:09.435501    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kbtmz" event={"ID":"be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68","Type":"ContainerStarted","Data":"8584eb5376166e47338f43afaec926a3be2752f087d65769da0530fe32319a76"}
Jul 27 20:06:09.466861 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:09.466802    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-kbtmz" podStartSLOduration=17.719542438 podStartE2EDuration="31.466787604s" totalImagesPullingTime="13.747245166s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:05:38 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:06:09.466614996 +0000 UTC m=+118.041341384" watchObservedRunningTime="2026-07-27 20:06:09.466787604 +0000 UTC m=+118.041513991"
Jul 27 20:06:10.673027 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:10.672975    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:10.773252 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:10.773203    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:10.859414 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:10.859381    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-bgwnm"]
Jul 27 20:06:10.864081 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:10.864051    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-bgwnm"
Jul 27 20:06:10.864081 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:10.864061    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:10.866613 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:10.866584    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-rkjs2\""
Jul 27 20:06:10.866758 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:10.866712    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 27 20:06:10.872398 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:10.872373    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-bgwnm"]
Jul 27 20:06:10.975535 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:10.975498    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/641a3438-ba1c-4ca3-a8a1-82b033dcafbc-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-bgwnm\" (UID: \"641a3438-ba1c-4ca3-a8a1-82b033dcafbc\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-bgwnm"
Jul 27 20:06:11.076904 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:11.076869    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/641a3438-ba1c-4ca3-a8a1-82b033dcafbc-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-bgwnm\" (UID: \"641a3438-ba1c-4ca3-a8a1-82b033dcafbc\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-bgwnm"
Jul 27 20:06:11.077092 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:06:11.077017    2557 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 27 20:06:11.077167 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:06:11.077095    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/641a3438-ba1c-4ca3-a8a1-82b033dcafbc-tls-certificates podName:641a3438-ba1c-4ca3-a8a1-82b033dcafbc nodeName:}" failed. No retries permitted until 2026-07-27 20:06:11.577074027 +0000 UTC m=+120.151800395 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/641a3438-ba1c-4ca3-a8a1-82b033dcafbc-tls-certificates") pod "prometheus-operator-admission-webhook-7f8d78f54b-bgwnm" (UID: "641a3438-ba1c-4ca3-a8a1-82b033dcafbc") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 27 20:06:11.297444 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:11.297352    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:11.580781 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:11.580682    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/641a3438-ba1c-4ca3-a8a1-82b033dcafbc-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-bgwnm\" (UID: \"641a3438-ba1c-4ca3-a8a1-82b033dcafbc\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-bgwnm"
Jul 27 20:06:11.583431 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:11.583401    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/641a3438-ba1c-4ca3-a8a1-82b033dcafbc-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-bgwnm\" (UID: \"641a3438-ba1c-4ca3-a8a1-82b033dcafbc\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-bgwnm"
Jul 27 20:06:11.594778 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:11.594749    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:11.703855 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:11.703814    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:11.778190 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:11.778161    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-rkjs2\""
Jul 27 20:06:11.785715 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:11.785683    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-bgwnm"
Jul 27 20:06:13.206466 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:13.206421    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-57794dfc97-dfk9c"]
Jul 27 20:06:13.209913 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:13.209890    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57794dfc97-dfk9c"
Jul 27 20:06:13.212529 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:13.212507    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 27 20:06:13.212529 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:13.212518    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 27 20:06:13.213309 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:13.213284    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 27 20:06:13.213407 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:13.213323    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 27 20:06:13.213407 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:13.213385    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-k7t6n\""
Jul 27 20:06:13.213407 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:13.213292    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 27 20:06:13.222707 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:13.222680    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57794dfc97-dfk9c"]
Jul 27 20:06:13.295280 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:13.295242    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7-console-config\") pod \"console-57794dfc97-dfk9c\" (UID: \"a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7\") " pod="openshift-console/console-57794dfc97-dfk9c"
Jul 27 20:06:13.295280 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:13.295292    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7-console-oauth-config\") pod \"console-57794dfc97-dfk9c\" (UID: \"a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7\") " pod="openshift-console/console-57794dfc97-dfk9c"
Jul 27 20:06:13.295567 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:13.295330    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7-console-serving-cert\") pod \"console-57794dfc97-dfk9c\" (UID: \"a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7\") " pod="openshift-console/console-57794dfc97-dfk9c"
Jul 27 20:06:13.295567 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:13.295363    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7-oauth-serving-cert\") pod \"console-57794dfc97-dfk9c\" (UID: \"a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7\") " pod="openshift-console/console-57794dfc97-dfk9c"
Jul 27 20:06:13.295567 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:13.295409    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7-service-ca\") pod \"console-57794dfc97-dfk9c\" (UID: \"a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7\") " pod="openshift-console/console-57794dfc97-dfk9c"
Jul 27 20:06:13.295567 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:13.295434    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pt29r\" (UniqueName: \"kubernetes.io/projected/a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7-kube-api-access-pt29r\") pod \"console-57794dfc97-dfk9c\" (UID: \"a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7\") " pod="openshift-console/console-57794dfc97-dfk9c"
Jul 27 20:06:13.395978 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:13.395939    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7-console-config\") pod \"console-57794dfc97-dfk9c\" (UID: \"a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7\") " pod="openshift-console/console-57794dfc97-dfk9c"
Jul 27 20:06:13.395978 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:13.395983    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7-console-oauth-config\") pod \"console-57794dfc97-dfk9c\" (UID: \"a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7\") " pod="openshift-console/console-57794dfc97-dfk9c"
Jul 27 20:06:13.395978 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:13.396000    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7-console-serving-cert\") pod \"console-57794dfc97-dfk9c\" (UID: \"a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7\") " pod="openshift-console/console-57794dfc97-dfk9c"
Jul 27 20:06:13.396299 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:13.396029    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7-oauth-serving-cert\") pod \"console-57794dfc97-dfk9c\" (UID: \"a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7\") " pod="openshift-console/console-57794dfc97-dfk9c"
Jul 27 20:06:13.396299 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:13.396077    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7-service-ca\") pod \"console-57794dfc97-dfk9c\" (UID: \"a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7\") " pod="openshift-console/console-57794dfc97-dfk9c"
Jul 27 20:06:13.396299 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:13.396101    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pt29r\" (UniqueName: \"kubernetes.io/projected/a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7-kube-api-access-pt29r\") pod \"console-57794dfc97-dfk9c\" (UID: \"a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7\") " pod="openshift-console/console-57794dfc97-dfk9c"
Jul 27 20:06:13.396940 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:13.396868    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7-console-config\") pod \"console-57794dfc97-dfk9c\" (UID: \"a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7\") " pod="openshift-console/console-57794dfc97-dfk9c"
Jul 27 20:06:13.396940 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:13.396868    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7-oauth-serving-cert\") pod \"console-57794dfc97-dfk9c\" (UID: \"a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7\") " pod="openshift-console/console-57794dfc97-dfk9c"
Jul 27 20:06:13.397148 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:13.396956    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7-service-ca\") pod \"console-57794dfc97-dfk9c\" (UID: \"a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7\") " pod="openshift-console/console-57794dfc97-dfk9c"
Jul 27 20:06:13.398746 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:13.398725    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7-console-oauth-config\") pod \"console-57794dfc97-dfk9c\" (UID: \"a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7\") " pod="openshift-console/console-57794dfc97-dfk9c"
Jul 27 20:06:13.398903 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:13.398884    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7-console-serving-cert\") pod \"console-57794dfc97-dfk9c\" (UID: \"a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7\") " pod="openshift-console/console-57794dfc97-dfk9c"
Jul 27 20:06:13.404073 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:13.404049    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pt29r\" (UniqueName: \"kubernetes.io/projected/a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7-kube-api-access-pt29r\") pod \"console-57794dfc97-dfk9c\" (UID: \"a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7\") " pod="openshift-console/console-57794dfc97-dfk9c"
Jul 27 20:06:13.521079 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:13.521038    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57794dfc97-dfk9c"
Jul 27 20:06:13.526924 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:13.526888    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:13.631828 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:13.631797    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:14.879895 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:14.879855    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:14.979612 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:14.979569    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:18.187037 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:18.187003    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8468f468dd-4bmjq"]
Jul 27 20:06:18.195848 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:18.195823    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8468f468dd-4bmjq"
Jul 27 20:06:18.200605 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:18.200530    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8468f468dd-4bmjq"]
Jul 27 20:06:18.207330 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:18.207307    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 27 20:06:18.337638 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:18.337603    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4kqz\" (UniqueName: \"kubernetes.io/projected/19c97936-7d69-495c-94eb-884bcf3e80d1-kube-api-access-m4kqz\") pod \"console-8468f468dd-4bmjq\" (UID: \"19c97936-7d69-495c-94eb-884bcf3e80d1\") " pod="openshift-console/console-8468f468dd-4bmjq"
Jul 27 20:06:18.337638 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:18.337646    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/19c97936-7d69-495c-94eb-884bcf3e80d1-console-config\") pod \"console-8468f468dd-4bmjq\" (UID: \"19c97936-7d69-495c-94eb-884bcf3e80d1\") " pod="openshift-console/console-8468f468dd-4bmjq"
Jul 27 20:06:18.337839 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:18.337667    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/19c97936-7d69-495c-94eb-884bcf3e80d1-oauth-serving-cert\") pod \"console-8468f468dd-4bmjq\" (UID: \"19c97936-7d69-495c-94eb-884bcf3e80d1\") " pod="openshift-console/console-8468f468dd-4bmjq"
Jul 27 20:06:18.337839 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:18.337731    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/19c97936-7d69-495c-94eb-884bcf3e80d1-console-oauth-config\") pod \"console-8468f468dd-4bmjq\" (UID: \"19c97936-7d69-495c-94eb-884bcf3e80d1\") " pod="openshift-console/console-8468f468dd-4bmjq"
Jul 27 20:06:18.337839 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:18.337769    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/19c97936-7d69-495c-94eb-884bcf3e80d1-console-serving-cert\") pod \"console-8468f468dd-4bmjq\" (UID: \"19c97936-7d69-495c-94eb-884bcf3e80d1\") " pod="openshift-console/console-8468f468dd-4bmjq"
Jul 27 20:06:18.337839 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:18.337796    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19c97936-7d69-495c-94eb-884bcf3e80d1-trusted-ca-bundle\") pod \"console-8468f468dd-4bmjq\" (UID: \"19c97936-7d69-495c-94eb-884bcf3e80d1\") " pod="openshift-console/console-8468f468dd-4bmjq"
Jul 27 20:06:18.337839 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:18.337818    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/19c97936-7d69-495c-94eb-884bcf3e80d1-service-ca\") pod \"console-8468f468dd-4bmjq\" (UID: \"19c97936-7d69-495c-94eb-884bcf3e80d1\") " pod="openshift-console/console-8468f468dd-4bmjq"
Jul 27 20:06:18.362548 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:18.362518    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-bgwnm"]
Jul 27 20:06:18.369575 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:06:18.369541    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod641a3438_ba1c_4ca3_a8a1_82b033dcafbc.slice/crio-85aa3ba5ed1811aef4d9b31fac2e8e73cbd011e9b587b5f606024159e0be3838 WatchSource:0}: Error finding container 85aa3ba5ed1811aef4d9b31fac2e8e73cbd011e9b587b5f606024159e0be3838: Status 404 returned error can't find the container with id 85aa3ba5ed1811aef4d9b31fac2e8e73cbd011e9b587b5f606024159e0be3838
Jul 27 20:06:18.373629 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:18.373604    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57794dfc97-dfk9c"]
Jul 27 20:06:18.377255 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:06:18.377233    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda09eb9e4_a5ed_43c5_8fdb_6eef8f65cbd7.slice/crio-e75486b80838ffd439bb08ad0c95407a8ca070a5ad61cad15b268f8f329475ef WatchSource:0}: Error finding container e75486b80838ffd439bb08ad0c95407a8ca070a5ad61cad15b268f8f329475ef: Status 404 returned error can't find the container with id e75486b80838ffd439bb08ad0c95407a8ca070a5ad61cad15b268f8f329475ef
Jul 27 20:06:18.438422 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:18.438357    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4kqz\" (UniqueName: \"kubernetes.io/projected/19c97936-7d69-495c-94eb-884bcf3e80d1-kube-api-access-m4kqz\") pod \"console-8468f468dd-4bmjq\" (UID: \"19c97936-7d69-495c-94eb-884bcf3e80d1\") " pod="openshift-console/console-8468f468dd-4bmjq"
Jul 27 20:06:18.438422 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:18.438390    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/19c97936-7d69-495c-94eb-884bcf3e80d1-console-config\") pod \"console-8468f468dd-4bmjq\" (UID: \"19c97936-7d69-495c-94eb-884bcf3e80d1\") " pod="openshift-console/console-8468f468dd-4bmjq"
Jul 27 20:06:18.438422 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:18.438407    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/19c97936-7d69-495c-94eb-884bcf3e80d1-oauth-serving-cert\") pod \"console-8468f468dd-4bmjq\" (UID: \"19c97936-7d69-495c-94eb-884bcf3e80d1\") " pod="openshift-console/console-8468f468dd-4bmjq"
Jul 27 20:06:18.438687 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:18.438440    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/19c97936-7d69-495c-94eb-884bcf3e80d1-console-oauth-config\") pod \"console-8468f468dd-4bmjq\" (UID: \"19c97936-7d69-495c-94eb-884bcf3e80d1\") " pod="openshift-console/console-8468f468dd-4bmjq"
Jul 27 20:06:18.438687 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:18.438583    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/19c97936-7d69-495c-94eb-884bcf3e80d1-console-serving-cert\") pod \"console-8468f468dd-4bmjq\" (UID: \"19c97936-7d69-495c-94eb-884bcf3e80d1\") " pod="openshift-console/console-8468f468dd-4bmjq"
Jul 27 20:06:18.438687 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:18.438621    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19c97936-7d69-495c-94eb-884bcf3e80d1-trusted-ca-bundle\") pod \"console-8468f468dd-4bmjq\" (UID: \"19c97936-7d69-495c-94eb-884bcf3e80d1\") " pod="openshift-console/console-8468f468dd-4bmjq"
Jul 27 20:06:18.438687 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:18.438657    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/19c97936-7d69-495c-94eb-884bcf3e80d1-service-ca\") pod \"console-8468f468dd-4bmjq\" (UID: \"19c97936-7d69-495c-94eb-884bcf3e80d1\") " pod="openshift-console/console-8468f468dd-4bmjq"
Jul 27 20:06:18.439104 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:18.439072    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/19c97936-7d69-495c-94eb-884bcf3e80d1-oauth-serving-cert\") pod \"console-8468f468dd-4bmjq\" (UID: \"19c97936-7d69-495c-94eb-884bcf3e80d1\") " pod="openshift-console/console-8468f468dd-4bmjq"
Jul 27 20:06:18.439202 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:18.439152    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/19c97936-7d69-495c-94eb-884bcf3e80d1-console-config\") pod \"console-8468f468dd-4bmjq\" (UID: \"19c97936-7d69-495c-94eb-884bcf3e80d1\") " pod="openshift-console/console-8468f468dd-4bmjq"
Jul 27 20:06:18.439320 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:18.439298    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/19c97936-7d69-495c-94eb-884bcf3e80d1-service-ca\") pod \"console-8468f468dd-4bmjq\" (UID: \"19c97936-7d69-495c-94eb-884bcf3e80d1\") " pod="openshift-console/console-8468f468dd-4bmjq"
Jul 27 20:06:18.439607 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:18.439590    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19c97936-7d69-495c-94eb-884bcf3e80d1-trusted-ca-bundle\") pod \"console-8468f468dd-4bmjq\" (UID: \"19c97936-7d69-495c-94eb-884bcf3e80d1\") " pod="openshift-console/console-8468f468dd-4bmjq"
Jul 27 20:06:18.440958 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:18.440937    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/19c97936-7d69-495c-94eb-884bcf3e80d1-console-serving-cert\") pod \"console-8468f468dd-4bmjq\" (UID: \"19c97936-7d69-495c-94eb-884bcf3e80d1\") " pod="openshift-console/console-8468f468dd-4bmjq"
Jul 27 20:06:18.441055 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:18.440994    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/19c97936-7d69-495c-94eb-884bcf3e80d1-console-oauth-config\") pod \"console-8468f468dd-4bmjq\" (UID: \"19c97936-7d69-495c-94eb-884bcf3e80d1\") " pod="openshift-console/console-8468f468dd-4bmjq"
Jul 27 20:06:18.448750 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:18.448732    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4kqz\" (UniqueName: \"kubernetes.io/projected/19c97936-7d69-495c-94eb-884bcf3e80d1-kube-api-access-m4kqz\") pod \"console-8468f468dd-4bmjq\" (UID: \"19c97936-7d69-495c-94eb-884bcf3e80d1\") " pod="openshift-console/console-8468f468dd-4bmjq"
Jul 27 20:06:18.467445 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:18.467417    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57794dfc97-dfk9c" event={"ID":"a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7","Type":"ContainerStarted","Data":"e75486b80838ffd439bb08ad0c95407a8ca070a5ad61cad15b268f8f329475ef"}
Jul 27 20:06:18.468696 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:18.468675    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-bgwnm" event={"ID":"641a3438-ba1c-4ca3-a8a1-82b033dcafbc","Type":"ContainerStarted","Data":"85aa3ba5ed1811aef4d9b31fac2e8e73cbd011e9b587b5f606024159e0be3838"}
Jul 27 20:06:18.516347 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:18.516319    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8468f468dd-4bmjq"
Jul 27 20:06:18.675163 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:18.675091    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8468f468dd-4bmjq"]
Jul 27 20:06:18.678850 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:06:18.678824    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19c97936_7d69_495c_94eb_884bcf3e80d1.slice/crio-07b9b9e7f15d16eeb928888d830e4e563ad216a07358ab7459370d38a44f3ffb WatchSource:0}: Error finding container 07b9b9e7f15d16eeb928888d830e4e563ad216a07358ab7459370d38a44f3ffb: Status 404 returned error can't find the container with id 07b9b9e7f15d16eeb928888d830e4e563ad216a07358ab7459370d38a44f3ffb
Jul 27 20:06:19.415495 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:19.415418    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:19.478478 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:19.478018    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-h5wdd" event={"ID":"649d3ae6-5b22-422b-9e2b-2ae5a29ee8dc","Type":"ContainerStarted","Data":"8517323a92ce97613b723034242d1e74252e3515a139436ad94288dbd19c8b94"}
Jul 27 20:06:19.479262 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:19.479200    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-h5wdd"
Jul 27 20:06:19.480697 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:19.480638    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8468f468dd-4bmjq" event={"ID":"19c97936-7d69-495c-94eb-884bcf3e80d1","Type":"ContainerStarted","Data":"07b9b9e7f15d16eeb928888d830e4e563ad216a07358ab7459370d38a44f3ffb"}
Jul 27 20:06:19.492246 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:19.492191    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-h5wdd"
Jul 27 20:06:19.503037 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:19.502107    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-h5wdd" podStartSLOduration=1.98402176 podStartE2EDuration="19.502088177s" totalImagesPullingTime="17.518066417s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:06:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:06:19.497729854 +0000 UTC m=+128.072456242" watchObservedRunningTime="2026-07-27 20:06:19.502088177 +0000 UTC m=+128.076814570"
Jul 27 20:06:19.510686 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:19.510643    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:21.492058 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:21.492018    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-bgwnm" event={"ID":"641a3438-ba1c-4ca3-a8a1-82b033dcafbc","Type":"ContainerStarted","Data":"b32ae0b8c880592dcd36e2a9bc8f1a6b093dc8b1de1371829b767d32d240f2eb"}
Jul 27 20:06:21.492570 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:21.492145    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-bgwnm"
Jul 27 20:06:21.497709 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:21.497679    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-bgwnm"
Jul 27 20:06:21.514046 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:21.513995    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-bgwnm" podStartSLOduration=9.367854569 podStartE2EDuration="11.513981058s" totalImagesPullingTime="2.146126489s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:06:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:06:21.512626005 +0000 UTC m=+130.087352398" watchObservedRunningTime="2026-07-27 20:06:21.513981058 +0000 UTC m=+130.088707447"
Jul 27 20:06:21.573889 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:21.573854    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/387c729d-a515-4e95-ad05-dbaa75da5b16-metrics-certs\") pod \"network-metrics-daemon-ng4cb\" (UID: \"387c729d-a515-4e95-ad05-dbaa75da5b16\") " pod="openshift-multus/network-metrics-daemon-ng4cb"
Jul 27 20:06:21.577069 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:21.577023    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/387c729d-a515-4e95-ad05-dbaa75da5b16-metrics-certs\") pod \"network-metrics-daemon-ng4cb\" (UID: \"387c729d-a515-4e95-ad05-dbaa75da5b16\") " pod="openshift-multus/network-metrics-daemon-ng4cb"
Jul 27 20:06:21.728130 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:21.728094    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5hkrg\""
Jul 27 20:06:21.735806 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:21.735778    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ng4cb"
Jul 27 20:06:21.878731 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:21.878632    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:21.920484 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:21.920427    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-5hdzn"]
Jul 27 20:06:21.946218 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:21.946188    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-5hdzn"]
Jul 27 20:06:21.946500 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:21.946475    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-5hdzn"
Jul 27 20:06:21.950200 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:21.949884    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 27 20:06:21.950200 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:21.950117    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 27 20:06:21.950604 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:21.950341    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 27 20:06:21.950604 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:21.950562    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 27 20:06:21.950962 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:21.950940    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-bqplw\""
Jul 27 20:06:21.951168 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:21.951149    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 27 20:06:21.968900 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:21.968866    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:22.078889 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:22.078682    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmttz\" (UniqueName: \"kubernetes.io/projected/d2311eaa-592a-4a2d-90ec-81ea40058b3e-kube-api-access-nmttz\") pod \"prometheus-operator-84d69f794d-5hdzn\" (UID: \"d2311eaa-592a-4a2d-90ec-81ea40058b3e\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-5hdzn"
Jul 27 20:06:22.078889 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:22.078734    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d2311eaa-592a-4a2d-90ec-81ea40058b3e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-5hdzn\" (UID: \"d2311eaa-592a-4a2d-90ec-81ea40058b3e\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-5hdzn"
Jul 27 20:06:22.079177 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:22.079147    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2311eaa-592a-4a2d-90ec-81ea40058b3e-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-5hdzn\" (UID: \"d2311eaa-592a-4a2d-90ec-81ea40058b3e\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-5hdzn"
Jul 27 20:06:22.079419 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:22.079216    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d2311eaa-592a-4a2d-90ec-81ea40058b3e-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-5hdzn\" (UID: \"d2311eaa-592a-4a2d-90ec-81ea40058b3e\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-5hdzn"
Jul 27 20:06:22.179856 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:22.179821    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmttz\" (UniqueName: \"kubernetes.io/projected/d2311eaa-592a-4a2d-90ec-81ea40058b3e-kube-api-access-nmttz\") pod \"prometheus-operator-84d69f794d-5hdzn\" (UID: \"d2311eaa-592a-4a2d-90ec-81ea40058b3e\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-5hdzn"
Jul 27 20:06:22.180068 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:22.179867    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d2311eaa-592a-4a2d-90ec-81ea40058b3e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-5hdzn\" (UID: \"d2311eaa-592a-4a2d-90ec-81ea40058b3e\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-5hdzn"
Jul 27 20:06:22.180068 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:22.179914    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2311eaa-592a-4a2d-90ec-81ea40058b3e-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-5hdzn\" (UID: \"d2311eaa-592a-4a2d-90ec-81ea40058b3e\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-5hdzn"
Jul 27 20:06:22.180068 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:22.179960    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d2311eaa-592a-4a2d-90ec-81ea40058b3e-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-5hdzn\" (UID: \"d2311eaa-592a-4a2d-90ec-81ea40058b3e\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-5hdzn"
Jul 27 20:06:22.180228 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:06:22.180092    2557 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 27 20:06:22.180228 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:06:22.180149    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2311eaa-592a-4a2d-90ec-81ea40058b3e-prometheus-operator-tls podName:d2311eaa-592a-4a2d-90ec-81ea40058b3e nodeName:}" failed. No retries permitted until 2026-07-27 20:06:22.680128042 +0000 UTC m=+131.254854429 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/d2311eaa-592a-4a2d-90ec-81ea40058b3e-prometheus-operator-tls") pod "prometheus-operator-84d69f794d-5hdzn" (UID: "d2311eaa-592a-4a2d-90ec-81ea40058b3e") : secret "prometheus-operator-tls" not found
Jul 27 20:06:22.180924 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:22.180891    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2311eaa-592a-4a2d-90ec-81ea40058b3e-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-5hdzn\" (UID: \"d2311eaa-592a-4a2d-90ec-81ea40058b3e\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-5hdzn"
Jul 27 20:06:22.187148 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:22.187123    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d2311eaa-592a-4a2d-90ec-81ea40058b3e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-5hdzn\" (UID: \"d2311eaa-592a-4a2d-90ec-81ea40058b3e\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-5hdzn"
Jul 27 20:06:22.192404 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:22.192359    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmttz\" (UniqueName: \"kubernetes.io/projected/d2311eaa-592a-4a2d-90ec-81ea40058b3e-kube-api-access-nmttz\") pod \"prometheus-operator-84d69f794d-5hdzn\" (UID: \"d2311eaa-592a-4a2d-90ec-81ea40058b3e\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-5hdzn"
Jul 27 20:06:22.508217 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:22.508181    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:22.684976 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:22.684802    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d2311eaa-592a-4a2d-90ec-81ea40058b3e-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-5hdzn\" (UID: \"d2311eaa-592a-4a2d-90ec-81ea40058b3e\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-5hdzn"
Jul 27 20:06:22.695965 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:22.695909    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d2311eaa-592a-4a2d-90ec-81ea40058b3e-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-5hdzn\" (UID: \"d2311eaa-592a-4a2d-90ec-81ea40058b3e\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-5hdzn"
Jul 27 20:06:22.862630 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:22.862558    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-5hdzn"
Jul 27 20:06:23.039666 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:23.039631    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ng4cb"]
Jul 27 20:06:23.043104 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:06:23.043070    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod387c729d_a515_4e95_ad05_dbaa75da5b16.slice/crio-30bedf9a1f92fad67e694e7e710ef78ca6d1e15eede6fa9ccb5d2c15cfa89f5a WatchSource:0}: Error finding container 30bedf9a1f92fad67e694e7e710ef78ca6d1e15eede6fa9ccb5d2c15cfa89f5a: Status 404 returned error can't find the container with id 30bedf9a1f92fad67e694e7e710ef78ca6d1e15eede6fa9ccb5d2c15cfa89f5a
Jul 27 20:06:23.062560 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:23.062483    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-5hdzn"]
Jul 27 20:06:23.066865 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:23.066836    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:23.145019 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:23.144924    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:23.221012 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:06:23.220970    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2311eaa_592a_4a2d_90ec_81ea40058b3e.slice/crio-faba29b5919eba0079fccf3beeabc47c2f4b6b15f6ad629533c510a923411d9d WatchSource:0}: Error finding container faba29b5919eba0079fccf3beeabc47c2f4b6b15f6ad629533c510a923411d9d: Status 404 returned error can't find the container with id faba29b5919eba0079fccf3beeabc47c2f4b6b15f6ad629533c510a923411d9d
Jul 27 20:06:23.516253 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:23.516211    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57794dfc97-dfk9c" event={"ID":"a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7","Type":"ContainerStarted","Data":"0628938f83ad6dec82b2a53fd5f1de80cd57a02e58942708d7904d42d458df74"}
Jul 27 20:06:23.518407 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:23.518354    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8468f468dd-4bmjq" event={"ID":"19c97936-7d69-495c-94eb-884bcf3e80d1","Type":"ContainerStarted","Data":"f592b53aea352f071c0e1f154715a2536167f5453b5669a72bf802bb77a39448"}
Jul 27 20:06:23.520019 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:23.519964    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-5hdzn" event={"ID":"d2311eaa-592a-4a2d-90ec-81ea40058b3e","Type":"ContainerStarted","Data":"faba29b5919eba0079fccf3beeabc47c2f4b6b15f6ad629533c510a923411d9d"}
Jul 27 20:06:23.521564 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:23.521544    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-57794dfc97-dfk9c"
Jul 27 20:06:23.521666 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:23.521605    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-57794dfc97-dfk9c"
Jul 27 20:06:23.522753 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:23.522725    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ng4cb" event={"ID":"387c729d-a515-4e95-ad05-dbaa75da5b16","Type":"ContainerStarted","Data":"30bedf9a1f92fad67e694e7e710ef78ca6d1e15eede6fa9ccb5d2c15cfa89f5a"}
Jul 27 20:06:23.522852 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:23.522822    2557 patch_prober.go:28] interesting pod/console-57794dfc97-dfk9c container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.18:8443/health\": dial tcp 10.134.0.18:8443: connect: connection refused" start-of-body=
Jul 27 20:06:23.522915 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:23.522866    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-57794dfc97-dfk9c" podUID="a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7" containerName="console" probeResult="failure" output="Get \"https://10.134.0.18:8443/health\": dial tcp 10.134.0.18:8443: connect: connection refused"
Jul 27 20:06:23.537284 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:23.537065    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-57794dfc97-dfk9c" podStartSLOduration=5.594314506 podStartE2EDuration="10.537048154s" totalImagesPullingTime="4.942733648s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:06:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:06:23.535722681 +0000 UTC m=+132.110449094" watchObservedRunningTime="2026-07-27 20:06:23.537048154 +0000 UTC m=+132.111774541"
Jul 27 20:06:23.558177 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:23.558123    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8468f468dd-4bmjq" podStartSLOduration=0.924240226 podStartE2EDuration="5.558104985s" totalImagesPullingTime="4.633864759s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:06:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:06:23.556819348 +0000 UTC m=+132.131545761" watchObservedRunningTime="2026-07-27 20:06:23.558104985 +0000 UTC m=+132.132831388"
Jul 27 20:06:23.926723 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:23.926674    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:24.029862 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:24.029701    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:24.373767 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:24.373728    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:24.438511 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:24.438441    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:25.533808 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:25.533774    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-5hdzn" event={"ID":"d2311eaa-592a-4a2d-90ec-81ea40058b3e","Type":"ContainerStarted","Data":"671ccbf58a946f6509be6195e57711923ae93bb75bf046c635e1639e8dd425b6"}
Jul 27 20:06:25.535583 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:25.535510    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ng4cb" event={"ID":"387c729d-a515-4e95-ad05-dbaa75da5b16","Type":"ContainerStarted","Data":"44b7307ce8c24d6e76e7432be7d2d76b5f0294578453d245b7a0f30d372e9f54"}
Jul 27 20:06:25.762387 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:25.762347    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:26.541830 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:26.541793    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-5hdzn" event={"ID":"d2311eaa-592a-4a2d-90ec-81ea40058b3e","Type":"ContainerStarted","Data":"9810d67758520b198e2402fb8dd435461576ca5037824f9e7096ac74eb684456"}
Jul 27 20:06:26.543959 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:26.543931    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ng4cb" event={"ID":"387c729d-a515-4e95-ad05-dbaa75da5b16","Type":"ContainerStarted","Data":"dda41a1a681c54891cbb5097e3df85d2e1e8ba3b5aa8b7d35d400e451b7637d3"}
Jul 27 20:06:26.562165 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:26.562098    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-5hdzn" podStartSLOduration=3.40469092 podStartE2EDuration="5.56207601s" totalImagesPullingTime="2.15738509s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:06:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:06:26.560536525 +0000 UTC m=+135.135262925" watchObservedRunningTime="2026-07-27 20:06:26.56207601 +0000 UTC m=+135.136802400"
Jul 27 20:06:26.578827 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:26.578692    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-ng4cb" podStartSLOduration=133.237835059 podStartE2EDuration="2m15.578670052s" totalImagesPullingTime="2.340834993s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:04:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:06:26.577721808 +0000 UTC m=+135.152448225" watchObservedRunningTime="2026-07-27 20:06:26.578670052 +0000 UTC m=+135.153396441"
Jul 27 20:06:26.688878 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:26.688838    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:26.761558 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:26.761518    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:28.040183 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:28.040142    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:28.288002 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:28.287962    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:28.378047 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:28.377969    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-pxl99"]
Jul 27 20:06:28.383815 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:28.383780    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:28.418624 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:28.418592    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pxl99"
Jul 27 20:06:28.421549 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:28.421524    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 27 20:06:28.421699 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:28.421680    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 27 20:06:28.421771 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:28.421756    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-gvc48\""
Jul 27 20:06:28.422086 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:28.422066    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 27 20:06:28.433233 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:28.433201    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1b22393f-e566-4822-a999-3927f0ab9455-sys\") pod \"node-exporter-pxl99\" (UID: \"1b22393f-e566-4822-a999-3927f0ab9455\") " pod="openshift-monitoring/node-exporter-pxl99"
Jul 27 20:06:28.433345 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:28.433274    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1b22393f-e566-4822-a999-3927f0ab9455-root\") pod \"node-exporter-pxl99\" (UID: \"1b22393f-e566-4822-a999-3927f0ab9455\") " pod="openshift-monitoring/node-exporter-pxl99"
Jul 27 20:06:28.433345 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:28.433304    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1b22393f-e566-4822-a999-3927f0ab9455-node-exporter-textfile\") pod \"node-exporter-pxl99\" (UID: \"1b22393f-e566-4822-a999-3927f0ab9455\") " pod="openshift-monitoring/node-exporter-pxl99"
Jul 27 20:06:28.433345 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:28.433339    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1b22393f-e566-4822-a999-3927f0ab9455-node-exporter-tls\") pod \"node-exporter-pxl99\" (UID: \"1b22393f-e566-4822-a999-3927f0ab9455\") " pod="openshift-monitoring/node-exporter-pxl99"
Jul 27 20:06:28.433531 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:28.433368    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1b22393f-e566-4822-a999-3927f0ab9455-node-exporter-wtmp\") pod \"node-exporter-pxl99\" (UID: \"1b22393f-e566-4822-a999-3927f0ab9455\") " pod="openshift-monitoring/node-exporter-pxl99"
Jul 27 20:06:28.433531 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:28.433402    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1b22393f-e566-4822-a999-3927f0ab9455-node-exporter-accelerators-collector-config\") pod \"node-exporter-pxl99\" (UID: \"1b22393f-e566-4822-a999-3927f0ab9455\") " pod="openshift-monitoring/node-exporter-pxl99"
Jul 27 20:06:28.433531 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:28.433430    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2m58j\" (UniqueName: \"kubernetes.io/projected/1b22393f-e566-4822-a999-3927f0ab9455-kube-api-access-2m58j\") pod \"node-exporter-pxl99\" (UID: \"1b22393f-e566-4822-a999-3927f0ab9455\") " pod="openshift-monitoring/node-exporter-pxl99"
Jul 27 20:06:28.433531 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:28.433480    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b22393f-e566-4822-a999-3927f0ab9455-metrics-client-ca\") pod \"node-exporter-pxl99\" (UID: \"1b22393f-e566-4822-a999-3927f0ab9455\") " pod="openshift-monitoring/node-exporter-pxl99"
Jul 27 20:06:28.433531 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:28.433507    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1b22393f-e566-4822-a999-3927f0ab9455-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pxl99\" (UID: \"1b22393f-e566-4822-a999-3927f0ab9455\") " pod="openshift-monitoring/node-exporter-pxl99"
Jul 27 20:06:28.516803 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:28.516756    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8468f468dd-4bmjq"
Jul 27 20:06:28.516971 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:28.516832    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8468f468dd-4bmjq"
Jul 27 20:06:28.521661 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:28.521632    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8468f468dd-4bmjq"
Jul 27 20:06:28.527796 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:28.527774    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:28.534411 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:28.534392    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1b22393f-e566-4822-a999-3927f0ab9455-sys\") pod \"node-exporter-pxl99\" (UID: \"1b22393f-e566-4822-a999-3927f0ab9455\") " pod="openshift-monitoring/node-exporter-pxl99"
Jul 27 20:06:28.534518 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:28.534501    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1b22393f-e566-4822-a999-3927f0ab9455-root\") pod \"node-exporter-pxl99\" (UID: \"1b22393f-e566-4822-a999-3927f0ab9455\") " pod="openshift-monitoring/node-exporter-pxl99"
Jul 27 20:06:28.534518 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:28.534509    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1b22393f-e566-4822-a999-3927f0ab9455-sys\") pod \"node-exporter-pxl99\" (UID: \"1b22393f-e566-4822-a999-3927f0ab9455\") " pod="openshift-monitoring/node-exporter-pxl99"
Jul 27 20:06:28.534629 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:28.534531    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1b22393f-e566-4822-a999-3927f0ab9455-node-exporter-textfile\") pod \"node-exporter-pxl99\" (UID: \"1b22393f-e566-4822-a999-3927f0ab9455\") " pod="openshift-monitoring/node-exporter-pxl99"
Jul 27 20:06:28.534629 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:28.534562    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1b22393f-e566-4822-a999-3927f0ab9455-node-exporter-tls\") pod \"node-exporter-pxl99\" (UID: \"1b22393f-e566-4822-a999-3927f0ab9455\") " pod="openshift-monitoring/node-exporter-pxl99"
Jul 27 20:06:28.534629 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:28.534606    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1b22393f-e566-4822-a999-3927f0ab9455-node-exporter-wtmp\") pod \"node-exporter-pxl99\" (UID: \"1b22393f-e566-4822-a999-3927f0ab9455\") " pod="openshift-monitoring/node-exporter-pxl99"
Jul 27 20:06:28.534787 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:28.534640    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1b22393f-e566-4822-a999-3927f0ab9455-node-exporter-accelerators-collector-config\") pod \"node-exporter-pxl99\" (UID: \"1b22393f-e566-4822-a999-3927f0ab9455\") " pod="openshift-monitoring/node-exporter-pxl99"
Jul 27 20:06:28.534787 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:28.534670    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2m58j\" (UniqueName: \"kubernetes.io/projected/1b22393f-e566-4822-a999-3927f0ab9455-kube-api-access-2m58j\") pod \"node-exporter-pxl99\" (UID: \"1b22393f-e566-4822-a999-3927f0ab9455\") " pod="openshift-monitoring/node-exporter-pxl99"
Jul 27 20:06:28.534787 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:06:28.534713    2557 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 27 20:06:28.534787 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:28.534734    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b22393f-e566-4822-a999-3927f0ab9455-metrics-client-ca\") pod \"node-exporter-pxl99\" (UID: \"1b22393f-e566-4822-a999-3927f0ab9455\") " pod="openshift-monitoring/node-exporter-pxl99"
Jul 27 20:06:28.534787 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:28.534783    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1b22393f-e566-4822-a999-3927f0ab9455-root\") pod \"node-exporter-pxl99\" (UID: \"1b22393f-e566-4822-a999-3927f0ab9455\") " pod="openshift-monitoring/node-exporter-pxl99"
Jul 27 20:06:28.535009 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:06:28.534791    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b22393f-e566-4822-a999-3927f0ab9455-node-exporter-tls podName:1b22393f-e566-4822-a999-3927f0ab9455 nodeName:}" failed. No retries permitted until 2026-07-27 20:06:29.034770709 +0000 UTC m=+137.609497078 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/1b22393f-e566-4822-a999-3927f0ab9455-node-exporter-tls") pod "node-exporter-pxl99" (UID: "1b22393f-e566-4822-a999-3927f0ab9455") : secret "node-exporter-tls" not found
Jul 27 20:06:28.535009 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:28.534811    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1b22393f-e566-4822-a999-3927f0ab9455-node-exporter-wtmp\") pod \"node-exporter-pxl99\" (UID: \"1b22393f-e566-4822-a999-3927f0ab9455\") " pod="openshift-monitoring/node-exporter-pxl99"
Jul 27 20:06:28.535009 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:28.534950    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1b22393f-e566-4822-a999-3927f0ab9455-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pxl99\" (UID: \"1b22393f-e566-4822-a999-3927f0ab9455\") " pod="openshift-monitoring/node-exporter-pxl99"
Jul 27 20:06:28.535138 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:28.535121    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1b22393f-e566-4822-a999-3927f0ab9455-node-exporter-textfile\") pod \"node-exporter-pxl99\" (UID: \"1b22393f-e566-4822-a999-3927f0ab9455\") " pod="openshift-monitoring/node-exporter-pxl99"
Jul 27 20:06:28.535465 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:28.535435    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1b22393f-e566-4822-a999-3927f0ab9455-node-exporter-accelerators-collector-config\") pod \"node-exporter-pxl99\" (UID: \"1b22393f-e566-4822-a999-3927f0ab9455\") " pod="openshift-monitoring/node-exporter-pxl99"
Jul 27 20:06:28.535520 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:28.535435    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b22393f-e566-4822-a999-3927f0ab9455-metrics-client-ca\") pod \"node-exporter-pxl99\" (UID: \"1b22393f-e566-4822-a999-3927f0ab9455\") " pod="openshift-monitoring/node-exporter-pxl99"
Jul 27 20:06:28.537153 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:28.537133    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1b22393f-e566-4822-a999-3927f0ab9455-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pxl99\" (UID: \"1b22393f-e566-4822-a999-3927f0ab9455\") " pod="openshift-monitoring/node-exporter-pxl99"
Jul 27 20:06:28.546466 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:28.546426    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2m58j\" (UniqueName: \"kubernetes.io/projected/1b22393f-e566-4822-a999-3927f0ab9455-kube-api-access-2m58j\") pod \"node-exporter-pxl99\" (UID: \"1b22393f-e566-4822-a999-3927f0ab9455\") " pod="openshift-monitoring/node-exporter-pxl99"
Jul 27 20:06:28.561873 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:28.561841    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8468f468dd-4bmjq"
Jul 27 20:06:28.651376 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:28.651305    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57794dfc97-dfk9c"]
Jul 27 20:06:28.678116 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:28.678072    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:28.787476 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:28.787417    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:28.883906 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:28.883866    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:28.985074 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:28.985043    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:29.038035 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:29.038006    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1b22393f-e566-4822-a999-3927f0ab9455-node-exporter-tls\") pod \"node-exporter-pxl99\" (UID: \"1b22393f-e566-4822-a999-3927f0ab9455\") " pod="openshift-monitoring/node-exporter-pxl99"
Jul 27 20:06:29.040332 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:29.040306    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1b22393f-e566-4822-a999-3927f0ab9455-node-exporter-tls\") pod \"node-exporter-pxl99\" (UID: \"1b22393f-e566-4822-a999-3927f0ab9455\") " pod="openshift-monitoring/node-exporter-pxl99"
Jul 27 20:06:29.081489 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:29.081434    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:29.327559 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:29.327481    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pxl99"
Jul 27 20:06:29.338035 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:29.337996    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:29.384349 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:06:29.384289    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b22393f_e566_4822_a999_3927f0ab9455.slice/crio-69273fa45e4812cca86db39c39f95e0fc5199039599178e1c2a7cf8b0ff4ebf9 WatchSource:0}: Error finding container 69273fa45e4812cca86db39c39f95e0fc5199039599178e1c2a7cf8b0ff4ebf9: Status 404 returned error can't find the container with id 69273fa45e4812cca86db39c39f95e0fc5199039599178e1c2a7cf8b0ff4ebf9
Jul 27 20:06:29.494791 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:29.494758    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:29.563279 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:29.563244    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pxl99" event={"ID":"1b22393f-e566-4822-a999-3927f0ab9455","Type":"ContainerStarted","Data":"69273fa45e4812cca86db39c39f95e0fc5199039599178e1c2a7cf8b0ff4ebf9"}
Jul 27 20:06:29.704123 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:29.704034    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:31.414999 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:31.414959    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:31.543020 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:31.542973    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:31.571784 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:31.571750    2557 generic.go:356] "Generic (PLEG): container finished" podID="1b22393f-e566-4822-a999-3927f0ab9455" containerID="c9965fc3d2fc7a3127e4f9a1028a36bd27a17c4898e64fcc49bd23a46d3c5151" exitCode=0
Jul 27 20:06:31.571966 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:31.571804    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pxl99" event={"ID":"1b22393f-e566-4822-a999-3927f0ab9455","Type":"ContainerDied","Data":"c9965fc3d2fc7a3127e4f9a1028a36bd27a17c4898e64fcc49bd23a46d3c5151"}
Jul 27 20:06:31.664857 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:31.664821    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:31.922643 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:31.922592    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:32.577752 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:32.577714    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pxl99" event={"ID":"1b22393f-e566-4822-a999-3927f0ab9455","Type":"ContainerStarted","Data":"bd57611664a858e7b8391399e74c4f7f542fa3c0e72d7499737f9c086faa4399"}
Jul 27 20:06:32.578231 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:32.577766    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pxl99" event={"ID":"1b22393f-e566-4822-a999-3927f0ab9455","Type":"ContainerStarted","Data":"38ac7873b29a04c1d33ae8fe2e66dce802eb0287b40008147b800b264f4d896f"}
Jul 27 20:06:32.630252 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:32.630197    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-pxl99" podStartSLOduration=3.1688626380000002 podStartE2EDuration="4.630177644s" totalImagesPullingTime="1.385014694s" totalInitContainerRuntime="76.300312ms" isStatefulPod=true podCreationTimestamp="2026-07-27 20:06:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:06:32.629443438 +0000 UTC m=+141.204169828" watchObservedRunningTime="2026-07-27 20:06:32.630177644 +0000 UTC m=+141.204904031"
Jul 27 20:06:32.801111 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:32.801072    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-585bb667b6-t88w8"]
Jul 27 20:06:32.815971 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:32.815948    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-585bb667b6-t88w8"
Jul 27 20:06:32.824328 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:32.824303    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 27 20:06:32.824447 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:32.824324    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 27 20:06:32.824447 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:32.824372    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-bd4nv\""
Jul 27 20:06:32.824580 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:32.824488    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-bnheqgeisc0ro\""
Jul 27 20:06:32.824580 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:32.824488    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 27 20:06:32.824661 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:32.824643    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 27 20:06:32.834269 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:32.834212    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-585bb667b6-t88w8"]
Jul 27 20:06:32.865885 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:32.865850    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8377262d-5d3b-482c-823a-e65e2e749c8e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-585bb667b6-t88w8\" (UID: \"8377262d-5d3b-482c-823a-e65e2e749c8e\") " pod="openshift-monitoring/metrics-server-585bb667b6-t88w8"
Jul 27 20:06:32.865885 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:32.865887    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8377262d-5d3b-482c-823a-e65e2e749c8e-metrics-server-audit-profiles\") pod \"metrics-server-585bb667b6-t88w8\" (UID: \"8377262d-5d3b-482c-823a-e65e2e749c8e\") " pod="openshift-monitoring/metrics-server-585bb667b6-t88w8"
Jul 27 20:06:32.866106 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:32.865905    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8377262d-5d3b-482c-823a-e65e2e749c8e-secret-metrics-server-tls\") pod \"metrics-server-585bb667b6-t88w8\" (UID: \"8377262d-5d3b-482c-823a-e65e2e749c8e\") " pod="openshift-monitoring/metrics-server-585bb667b6-t88w8"
Jul 27 20:06:32.866106 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:32.865921    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4j2lp\" (UniqueName: \"kubernetes.io/projected/8377262d-5d3b-482c-823a-e65e2e749c8e-kube-api-access-4j2lp\") pod \"metrics-server-585bb667b6-t88w8\" (UID: \"8377262d-5d3b-482c-823a-e65e2e749c8e\") " pod="openshift-monitoring/metrics-server-585bb667b6-t88w8"
Jul 27 20:06:32.866106 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:32.865981    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8377262d-5d3b-482c-823a-e65e2e749c8e-secret-metrics-server-client-certs\") pod \"metrics-server-585bb667b6-t88w8\" (UID: \"8377262d-5d3b-482c-823a-e65e2e749c8e\") " pod="openshift-monitoring/metrics-server-585bb667b6-t88w8"
Jul 27 20:06:32.866106 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:32.866007    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8377262d-5d3b-482c-823a-e65e2e749c8e-client-ca-bundle\") pod \"metrics-server-585bb667b6-t88w8\" (UID: \"8377262d-5d3b-482c-823a-e65e2e749c8e\") " pod="openshift-monitoring/metrics-server-585bb667b6-t88w8"
Jul 27 20:06:32.866106 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:32.866044    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8377262d-5d3b-482c-823a-e65e2e749c8e-audit-log\") pod \"metrics-server-585bb667b6-t88w8\" (UID: \"8377262d-5d3b-482c-823a-e65e2e749c8e\") " pod="openshift-monitoring/metrics-server-585bb667b6-t88w8"
Jul 27 20:06:32.966634 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:32.966600    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8377262d-5d3b-482c-823a-e65e2e749c8e-client-ca-bundle\") pod \"metrics-server-585bb667b6-t88w8\" (UID: \"8377262d-5d3b-482c-823a-e65e2e749c8e\") " pod="openshift-monitoring/metrics-server-585bb667b6-t88w8"
Jul 27 20:06:32.966634 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:32.966646    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8377262d-5d3b-482c-823a-e65e2e749c8e-audit-log\") pod \"metrics-server-585bb667b6-t88w8\" (UID: \"8377262d-5d3b-482c-823a-e65e2e749c8e\") " pod="openshift-monitoring/metrics-server-585bb667b6-t88w8"
Jul 27 20:06:32.966865 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:32.966709    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8377262d-5d3b-482c-823a-e65e2e749c8e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-585bb667b6-t88w8\" (UID: \"8377262d-5d3b-482c-823a-e65e2e749c8e\") " pod="openshift-monitoring/metrics-server-585bb667b6-t88w8"
Jul 27 20:06:32.966865 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:32.966733    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8377262d-5d3b-482c-823a-e65e2e749c8e-metrics-server-audit-profiles\") pod \"metrics-server-585bb667b6-t88w8\" (UID: \"8377262d-5d3b-482c-823a-e65e2e749c8e\") " pod="openshift-monitoring/metrics-server-585bb667b6-t88w8"
Jul 27 20:06:32.966865 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:32.966757    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8377262d-5d3b-482c-823a-e65e2e749c8e-secret-metrics-server-tls\") pod \"metrics-server-585bb667b6-t88w8\" (UID: \"8377262d-5d3b-482c-823a-e65e2e749c8e\") " pod="openshift-monitoring/metrics-server-585bb667b6-t88w8"
Jul 27 20:06:32.966865 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:32.966782    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4j2lp\" (UniqueName: \"kubernetes.io/projected/8377262d-5d3b-482c-823a-e65e2e749c8e-kube-api-access-4j2lp\") pod \"metrics-server-585bb667b6-t88w8\" (UID: \"8377262d-5d3b-482c-823a-e65e2e749c8e\") " pod="openshift-monitoring/metrics-server-585bb667b6-t88w8"
Jul 27 20:06:32.966865 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:32.966825    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8377262d-5d3b-482c-823a-e65e2e749c8e-secret-metrics-server-client-certs\") pod \"metrics-server-585bb667b6-t88w8\" (UID: \"8377262d-5d3b-482c-823a-e65e2e749c8e\") " pod="openshift-monitoring/metrics-server-585bb667b6-t88w8"
Jul 27 20:06:32.967160 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:32.967128    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8377262d-5d3b-482c-823a-e65e2e749c8e-audit-log\") pod \"metrics-server-585bb667b6-t88w8\" (UID: \"8377262d-5d3b-482c-823a-e65e2e749c8e\") " pod="openshift-monitoring/metrics-server-585bb667b6-t88w8"
Jul 27 20:06:32.967781 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:32.967754    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8377262d-5d3b-482c-823a-e65e2e749c8e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-585bb667b6-t88w8\" (UID: \"8377262d-5d3b-482c-823a-e65e2e749c8e\") " pod="openshift-monitoring/metrics-server-585bb667b6-t88w8"
Jul 27 20:06:32.967899 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:32.967827    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8377262d-5d3b-482c-823a-e65e2e749c8e-metrics-server-audit-profiles\") pod \"metrics-server-585bb667b6-t88w8\" (UID: \"8377262d-5d3b-482c-823a-e65e2e749c8e\") " pod="openshift-monitoring/metrics-server-585bb667b6-t88w8"
Jul 27 20:06:32.969181 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:32.969159    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8377262d-5d3b-482c-823a-e65e2e749c8e-client-ca-bundle\") pod \"metrics-server-585bb667b6-t88w8\" (UID: \"8377262d-5d3b-482c-823a-e65e2e749c8e\") " pod="openshift-monitoring/metrics-server-585bb667b6-t88w8"
Jul 27 20:06:32.969370 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:32.969351    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8377262d-5d3b-482c-823a-e65e2e749c8e-secret-metrics-server-client-certs\") pod \"metrics-server-585bb667b6-t88w8\" (UID: \"8377262d-5d3b-482c-823a-e65e2e749c8e\") " pod="openshift-monitoring/metrics-server-585bb667b6-t88w8"
Jul 27 20:06:32.969598 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:32.969582    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8377262d-5d3b-482c-823a-e65e2e749c8e-secret-metrics-server-tls\") pod \"metrics-server-585bb667b6-t88w8\" (UID: \"8377262d-5d3b-482c-823a-e65e2e749c8e\") " pod="openshift-monitoring/metrics-server-585bb667b6-t88w8"
Jul 27 20:06:32.976033 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:32.976008    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4j2lp\" (UniqueName: \"kubernetes.io/projected/8377262d-5d3b-482c-823a-e65e2e749c8e-kube-api-access-4j2lp\") pod \"metrics-server-585bb667b6-t88w8\" (UID: \"8377262d-5d3b-482c-823a-e65e2e749c8e\") " pod="openshift-monitoring/metrics-server-585bb667b6-t88w8"
Jul 27 20:06:33.102731 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:33.102659    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-sdqvc"]
Jul 27 20:06:33.105914 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:33.105869    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:33.125443 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:33.125416    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-585bb667b6-t88w8"
Jul 27 20:06:33.126686 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:33.126670    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-sdqvc"
Jul 27 20:06:33.133381 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:33.133351    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 27 20:06:33.133832 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:33.133800    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-8svrb\""
Jul 27 20:06:33.134782 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:33.134760    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-sdqvc"]
Jul 27 20:06:33.167885 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:33.167852    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxkbr\" (UniqueName: \"kubernetes.io/projected/88658199-cd52-4664-8191-99b2fa784744-kube-api-access-jxkbr\") pod \"monitoring-plugin-68b7fc9574-sdqvc\" (UID: \"88658199-cd52-4664-8191-99b2fa784744\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-sdqvc"
Jul 27 20:06:33.168048 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:33.167920    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/88658199-cd52-4664-8191-99b2fa784744-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-sdqvc\" (UID: \"88658199-cd52-4664-8191-99b2fa784744\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-sdqvc"
Jul 27 20:06:33.250844 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:33.250806    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:33.268868 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:33.268841    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/88658199-cd52-4664-8191-99b2fa784744-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-sdqvc\" (UID: \"88658199-cd52-4664-8191-99b2fa784744\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-sdqvc"
Jul 27 20:06:33.269046 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:33.268928    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxkbr\" (UniqueName: \"kubernetes.io/projected/88658199-cd52-4664-8191-99b2fa784744-kube-api-access-jxkbr\") pod \"monitoring-plugin-68b7fc9574-sdqvc\" (UID: \"88658199-cd52-4664-8191-99b2fa784744\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-sdqvc"
Jul 27 20:06:33.269046 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:06:33.269006    2557 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 27 20:06:33.269156 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:06:33.269080    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88658199-cd52-4664-8191-99b2fa784744-monitoring-plugin-cert podName:88658199-cd52-4664-8191-99b2fa784744 nodeName:}" failed. No retries permitted until 2026-07-27 20:06:33.769058035 +0000 UTC m=+142.343784402 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/88658199-cd52-4664-8191-99b2fa784744-monitoring-plugin-cert") pod "monitoring-plugin-68b7fc9574-sdqvc" (UID: "88658199-cd52-4664-8191-99b2fa784744") : secret "monitoring-plugin-cert" not found
Jul 27 20:06:33.279642 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:33.279617    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxkbr\" (UniqueName: \"kubernetes.io/projected/88658199-cd52-4664-8191-99b2fa784744-kube-api-access-jxkbr\") pod \"monitoring-plugin-68b7fc9574-sdqvc\" (UID: \"88658199-cd52-4664-8191-99b2fa784744\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-sdqvc"
Jul 27 20:06:33.284699 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:33.283437    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-585bb667b6-t88w8"]
Jul 27 20:06:33.286030 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:06:33.286005    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8377262d_5d3b_482c_823a_e65e2e749c8e.slice/crio-eaa20c7be10690b870a7962ba1e125c6aa000a04a0582f91a103893af224be3f WatchSource:0}: Error finding container eaa20c7be10690b870a7962ba1e125c6aa000a04a0582f91a103893af224be3f: Status 404 returned error can't find the container with id eaa20c7be10690b870a7962ba1e125c6aa000a04a0582f91a103893af224be3f
Jul 27 20:06:33.348333 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:33.348294    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:33.457670 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:33.457579    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:33.582796 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:33.582760    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-585bb667b6-t88w8" event={"ID":"8377262d-5d3b-482c-823a-e65e2e749c8e","Type":"ContainerStarted","Data":"eaa20c7be10690b870a7962ba1e125c6aa000a04a0582f91a103893af224be3f"}
Jul 27 20:06:33.774126 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:33.774091    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/88658199-cd52-4664-8191-99b2fa784744-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-sdqvc\" (UID: \"88658199-cd52-4664-8191-99b2fa784744\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-sdqvc"
Jul 27 20:06:33.776855 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:33.776836    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/88658199-cd52-4664-8191-99b2fa784744-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-sdqvc\" (UID: \"88658199-cd52-4664-8191-99b2fa784744\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-sdqvc"
Jul 27 20:06:33.968651 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:33.968595    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:34.037263 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:34.037173    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-sdqvc"
Jul 27 20:06:34.061522 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:34.061489    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:34.202404 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:34.202369    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-sdqvc"]
Jul 27 20:06:34.205834 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:06:34.205804    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88658199_cd52_4664_8191_99b2fa784744.slice/crio-b0d877c1560ced58dfecc8ab1ba23b6f03d4748e54a2374894430803a95ffa4b WatchSource:0}: Error finding container b0d877c1560ced58dfecc8ab1ba23b6f03d4748e54a2374894430803a95ffa4b: Status 404 returned error can't find the container with id b0d877c1560ced58dfecc8ab1ba23b6f03d4748e54a2374894430803a95ffa4b
Jul 27 20:06:34.587927 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:34.587886    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-sdqvc" event={"ID":"88658199-cd52-4664-8191-99b2fa784744","Type":"ContainerStarted","Data":"b0d877c1560ced58dfecc8ab1ba23b6f03d4748e54a2374894430803a95ffa4b"}
Jul 27 20:06:34.747273 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:34.747227    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:36.597164 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:36.597129    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-sdqvc" event={"ID":"88658199-cd52-4664-8191-99b2fa784744","Type":"ContainerStarted","Data":"1e3a0569e709d34e871463d543a1e7470084cc4c68b31f28fd61ebf12ed8f756"}
Jul 27 20:06:36.597676 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:36.597198    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-sdqvc"
Jul 27 20:06:36.598823 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:36.598795    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-585bb667b6-t88w8" event={"ID":"8377262d-5d3b-482c-823a-e65e2e749c8e","Type":"ContainerStarted","Data":"ae103a22d2d2110e2af956d0d6f00d8d3f546140e74c6679ebec370596857430"}
Jul 27 20:06:36.602434 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:36.602409    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-sdqvc"
Jul 27 20:06:36.670341 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:36.670236    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-sdqvc" podStartSLOduration=1.480269542 podStartE2EDuration="3.670220798s" totalImagesPullingTime="2.189951256s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:06:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:06:36.640240405 +0000 UTC m=+145.214966793" watchObservedRunningTime="2026-07-27 20:06:36.670220798 +0000 UTC m=+145.244947229"
Jul 27 20:06:36.707087 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:36.707028    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-585bb667b6-t88w8" podStartSLOduration=1.974679319 podStartE2EDuration="4.707006114s" totalImagesPullingTime="2.732326795s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:06:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:06:36.705302482 +0000 UTC m=+145.280028862" watchObservedRunningTime="2026-07-27 20:06:36.707006114 +0000 UTC m=+145.281732503"
Jul 27 20:06:36.954278 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:36.954131    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:37.055055 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:37.055021    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:37.263006 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:37.262964    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:37.332414 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:37.332376    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:42.623801 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:42.623763    2557 generic.go:356] "Generic (PLEG): container finished" podID="3a7e2235-bcb7-46dd-9ac1-cd7fa374c19a" containerID="fb961a923484f66cc3d07f8c0cf737e28831502ba8806f1478465cfee69224da" exitCode=0
Jul 27 20:06:42.624237 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:42.623838    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-qf7sz" event={"ID":"3a7e2235-bcb7-46dd-9ac1-cd7fa374c19a","Type":"ContainerDied","Data":"fb961a923484f66cc3d07f8c0cf737e28831502ba8806f1478465cfee69224da"}
Jul 27 20:06:42.624237 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:42.624150    2557 scope.go:117] "RemoveContainer" containerID="fb961a923484f66cc3d07f8c0cf737e28831502ba8806f1478465cfee69224da"
Jul 27 20:06:43.631152 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:43.631117    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-qf7sz" event={"ID":"3a7e2235-bcb7-46dd-9ac1-cd7fa374c19a","Type":"ContainerStarted","Data":"9b511935ec5ef465853e9f18bf35f060e319a9a162cfa95a6581f1f66a201078"}
Jul 27 20:06:44.211301 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:44.211261    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8468f468dd-4bmjq"]
Jul 27 20:06:44.463279 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:44.463189    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:44.526663 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:44.526634    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:47.613262 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:47.613223    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:47.810918 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:47.810884    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:47.928513 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:47.928411    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:51.993710 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:51.993676    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:52.082733 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:52.082695    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:53.126031 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:53.125999    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-585bb667b6-t88w8"
Jul 27 20:06:53.126502 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:53.126057    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-585bb667b6-t88w8"
Jul 27 20:06:53.670162 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:53.670119    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-57794dfc97-dfk9c" podUID="a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7" containerName="console" containerID="cri-o://0628938f83ad6dec82b2a53fd5f1de80cd57a02e58942708d7904d42d458df74" gracePeriod=15
Jul 27 20:06:53.940884 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:53.940808    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57794dfc97-dfk9c"
Jul 27 20:06:54.031135 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:54.031096    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7-console-oauth-config\") pod \"a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7\" (UID: \"a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7\") "
Jul 27 20:06:54.031135 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:54.031141    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7-console-serving-cert\") pod \"a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7\" (UID: \"a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7\") "
Jul 27 20:06:54.031396 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:54.031188    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7-console-config\") pod \"a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7\" (UID: \"a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7\") "
Jul 27 20:06:54.031396 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:54.031213    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pt29r\" (UniqueName: \"kubernetes.io/projected/a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7-kube-api-access-pt29r\") pod \"a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7\" (UID: \"a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7\") "
Jul 27 20:06:54.031541 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:54.031391    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7-oauth-serving-cert\") pod \"a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7\" (UID: \"a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7\") "
Jul 27 20:06:54.031541 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:54.031443    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7-service-ca\") pod \"a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7\" (UID: \"a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7\") "
Jul 27 20:06:54.031739 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:54.031712    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7-console-config" (OuterVolumeSpecName: "console-config") pod "a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7" (UID: "a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:06:54.031923 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:54.031886    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7" (UID: "a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:06:54.031923 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:54.031902    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7-service-ca" (OuterVolumeSpecName: "service-ca") pod "a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7" (UID: "a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:06:54.033551 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:54.033523    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7" (UID: "a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:06:54.033633 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:54.033591    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7" (UID: "a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:06:54.033633 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:54.033618    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7-kube-api-access-pt29r" (OuterVolumeSpecName: "kube-api-access-pt29r") pod "a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7" (UID: "a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7"). InnerVolumeSpecName "kube-api-access-pt29r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:06:54.132417 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:54.132380    2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7-oauth-serving-cert\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:06:54.132417 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:54.132408    2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7-service-ca\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:06:54.132417 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:54.132418    2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7-console-oauth-config\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:06:54.132417 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:54.132429    2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7-console-serving-cert\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:06:54.132905 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:54.132439    2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7-console-config\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:06:54.132905 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:54.132447    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pt29r\" (UniqueName: \"kubernetes.io/projected/a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7-kube-api-access-pt29r\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:06:54.672870 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:54.672839    2557 generic.go:356] "Generic (PLEG): container finished" podID="a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7" containerID="0628938f83ad6dec82b2a53fd5f1de80cd57a02e58942708d7904d42d458df74" exitCode=0
Jul 27 20:06:54.673038 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:54.672886    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57794dfc97-dfk9c"
Jul 27 20:06:54.673038 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:54.672886    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57794dfc97-dfk9c" event={"ID":"a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7","Type":"ContainerDied","Data":"0628938f83ad6dec82b2a53fd5f1de80cd57a02e58942708d7904d42d458df74"}
Jul 27 20:06:54.673038 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:54.673010    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57794dfc97-dfk9c" event={"ID":"a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7","Type":"ContainerDied","Data":"e75486b80838ffd439bb08ad0c95407a8ca070a5ad61cad15b268f8f329475ef"}
Jul 27 20:06:54.686340 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:54.686321    2557 scope.go:117] "RemoveContainer" containerID="0628938f83ad6dec82b2a53fd5f1de80cd57a02e58942708d7904d42d458df74"
Jul 27 20:06:54.694280 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:54.694261    2557 scope.go:117] "RemoveContainer" containerID="0628938f83ad6dec82b2a53fd5f1de80cd57a02e58942708d7904d42d458df74"
Jul 27 20:06:54.694554 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:06:54.694533    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0628938f83ad6dec82b2a53fd5f1de80cd57a02e58942708d7904d42d458df74\": container with ID starting with 0628938f83ad6dec82b2a53fd5f1de80cd57a02e58942708d7904d42d458df74 not found: ID does not exist" containerID="0628938f83ad6dec82b2a53fd5f1de80cd57a02e58942708d7904d42d458df74"
Jul 27 20:06:54.694627 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:54.694565    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0628938f83ad6dec82b2a53fd5f1de80cd57a02e58942708d7904d42d458df74"} err="failed to get container status \"0628938f83ad6dec82b2a53fd5f1de80cd57a02e58942708d7904d42d458df74\": rpc error: code = NotFound desc = could not find container \"0628938f83ad6dec82b2a53fd5f1de80cd57a02e58942708d7904d42d458df74\": container with ID starting with 0628938f83ad6dec82b2a53fd5f1de80cd57a02e58942708d7904d42d458df74 not found: ID does not exist"
Jul 27 20:06:54.702304 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:54.702285    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57794dfc97-dfk9c"]
Jul 27 20:06:54.712433 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:54.712403    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-57794dfc97-dfk9c"]
Jul 27 20:06:54.761247 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:54.761212    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:55.290839 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:55.290807    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:55.400413 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:55.400373    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:06:55.909553 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:06:55.909522    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7" path="/var/lib/kubelet/pods/a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7/volumes"
Jul 27 20:07:02.836827 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:02.836794    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:07:02.903999 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:02.903944    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:07:04.248993 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:04.248913    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:07:04.350385 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:04.350349    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:07:09.229672 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:09.229610    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-8468f468dd-4bmjq" podUID="19c97936-7d69-495c-94eb-884bcf3e80d1" containerName="console" containerID="cri-o://f592b53aea352f071c0e1f154715a2536167f5453b5669a72bf802bb77a39448" gracePeriod=15
Jul 27 20:07:09.506802 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:09.506726    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8468f468dd-4bmjq"
Jul 27 20:07:09.652629 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:09.652594    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m4kqz\" (UniqueName: \"kubernetes.io/projected/19c97936-7d69-495c-94eb-884bcf3e80d1-kube-api-access-m4kqz\") pod \"19c97936-7d69-495c-94eb-884bcf3e80d1\" (UID: \"19c97936-7d69-495c-94eb-884bcf3e80d1\") "
Jul 27 20:07:09.652629 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:09.652629    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/19c97936-7d69-495c-94eb-884bcf3e80d1-oauth-serving-cert\") pod \"19c97936-7d69-495c-94eb-884bcf3e80d1\" (UID: \"19c97936-7d69-495c-94eb-884bcf3e80d1\") "
Jul 27 20:07:09.652888 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:09.652665    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19c97936-7d69-495c-94eb-884bcf3e80d1-trusted-ca-bundle\") pod \"19c97936-7d69-495c-94eb-884bcf3e80d1\" (UID: \"19c97936-7d69-495c-94eb-884bcf3e80d1\") "
Jul 27 20:07:09.652888 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:09.652704    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/19c97936-7d69-495c-94eb-884bcf3e80d1-console-oauth-config\") pod \"19c97936-7d69-495c-94eb-884bcf3e80d1\" (UID: \"19c97936-7d69-495c-94eb-884bcf3e80d1\") "
Jul 27 20:07:09.652888 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:09.652731    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/19c97936-7d69-495c-94eb-884bcf3e80d1-console-config\") pod \"19c97936-7d69-495c-94eb-884bcf3e80d1\" (UID: \"19c97936-7d69-495c-94eb-884bcf3e80d1\") "
Jul 27 20:07:09.652888 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:09.652753    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/19c97936-7d69-495c-94eb-884bcf3e80d1-console-serving-cert\") pod \"19c97936-7d69-495c-94eb-884bcf3e80d1\" (UID: \"19c97936-7d69-495c-94eb-884bcf3e80d1\") "
Jul 27 20:07:09.652888 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:09.652815    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/19c97936-7d69-495c-94eb-884bcf3e80d1-service-ca\") pod \"19c97936-7d69-495c-94eb-884bcf3e80d1\" (UID: \"19c97936-7d69-495c-94eb-884bcf3e80d1\") "
Jul 27 20:07:09.653280 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:09.653176    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19c97936-7d69-495c-94eb-884bcf3e80d1-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "19c97936-7d69-495c-94eb-884bcf3e80d1" (UID: "19c97936-7d69-495c-94eb-884bcf3e80d1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:07:09.653280 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:09.653260    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19c97936-7d69-495c-94eb-884bcf3e80d1-console-config" (OuterVolumeSpecName: "console-config") pod "19c97936-7d69-495c-94eb-884bcf3e80d1" (UID: "19c97936-7d69-495c-94eb-884bcf3e80d1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:07:09.653422 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:09.653251    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19c97936-7d69-495c-94eb-884bcf3e80d1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "19c97936-7d69-495c-94eb-884bcf3e80d1" (UID: "19c97936-7d69-495c-94eb-884bcf3e80d1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:07:09.653422 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:09.653313    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19c97936-7d69-495c-94eb-884bcf3e80d1-service-ca" (OuterVolumeSpecName: "service-ca") pod "19c97936-7d69-495c-94eb-884bcf3e80d1" (UID: "19c97936-7d69-495c-94eb-884bcf3e80d1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:07:09.653422 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:09.653385    2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/19c97936-7d69-495c-94eb-884bcf3e80d1-service-ca\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:07:09.653422 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:09.653404    2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/19c97936-7d69-495c-94eb-884bcf3e80d1-oauth-serving-cert\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:07:09.653422 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:09.653417    2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19c97936-7d69-495c-94eb-884bcf3e80d1-trusted-ca-bundle\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:07:09.653697 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:09.653431    2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/19c97936-7d69-495c-94eb-884bcf3e80d1-console-config\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:07:09.655048 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:09.655006    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19c97936-7d69-495c-94eb-884bcf3e80d1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "19c97936-7d69-495c-94eb-884bcf3e80d1" (UID: "19c97936-7d69-495c-94eb-884bcf3e80d1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:07:09.655048 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:09.655019    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19c97936-7d69-495c-94eb-884bcf3e80d1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "19c97936-7d69-495c-94eb-884bcf3e80d1" (UID: "19c97936-7d69-495c-94eb-884bcf3e80d1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:07:09.655225 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:09.655077    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19c97936-7d69-495c-94eb-884bcf3e80d1-kube-api-access-m4kqz" (OuterVolumeSpecName: "kube-api-access-m4kqz") pod "19c97936-7d69-495c-94eb-884bcf3e80d1" (UID: "19c97936-7d69-495c-94eb-884bcf3e80d1"). InnerVolumeSpecName "kube-api-access-m4kqz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:07:09.734652 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:09.734616    2557 generic.go:356] "Generic (PLEG): container finished" podID="19c97936-7d69-495c-94eb-884bcf3e80d1" containerID="f592b53aea352f071c0e1f154715a2536167f5453b5669a72bf802bb77a39448" exitCode=0
Jul 27 20:07:09.734823 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:09.734665    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8468f468dd-4bmjq"
Jul 27 20:07:09.734823 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:09.734706    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8468f468dd-4bmjq" event={"ID":"19c97936-7d69-495c-94eb-884bcf3e80d1","Type":"ContainerDied","Data":"f592b53aea352f071c0e1f154715a2536167f5453b5669a72bf802bb77a39448"}
Jul 27 20:07:09.734823 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:09.734759    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8468f468dd-4bmjq" event={"ID":"19c97936-7d69-495c-94eb-884bcf3e80d1","Type":"ContainerDied","Data":"07b9b9e7f15d16eeb928888d830e4e563ad216a07358ab7459370d38a44f3ffb"}
Jul 27 20:07:09.734823 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:09.734786    2557 scope.go:117] "RemoveContainer" containerID="f592b53aea352f071c0e1f154715a2536167f5453b5669a72bf802bb77a39448"
Jul 27 20:07:09.743053 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:09.743035    2557 scope.go:117] "RemoveContainer" containerID="f592b53aea352f071c0e1f154715a2536167f5453b5669a72bf802bb77a39448"
Jul 27 20:07:09.743311 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:07:09.743293    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f592b53aea352f071c0e1f154715a2536167f5453b5669a72bf802bb77a39448\": container with ID starting with f592b53aea352f071c0e1f154715a2536167f5453b5669a72bf802bb77a39448 not found: ID does not exist" containerID="f592b53aea352f071c0e1f154715a2536167f5453b5669a72bf802bb77a39448"
Jul 27 20:07:09.743376 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:09.743321    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f592b53aea352f071c0e1f154715a2536167f5453b5669a72bf802bb77a39448"} err="failed to get container status \"f592b53aea352f071c0e1f154715a2536167f5453b5669a72bf802bb77a39448\": rpc error: code = NotFound desc = could not find container \"f592b53aea352f071c0e1f154715a2536167f5453b5669a72bf802bb77a39448\": container with ID starting with f592b53aea352f071c0e1f154715a2536167f5453b5669a72bf802bb77a39448 not found: ID does not exist"
Jul 27 20:07:09.754272 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:09.754248    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m4kqz\" (UniqueName: \"kubernetes.io/projected/19c97936-7d69-495c-94eb-884bcf3e80d1-kube-api-access-m4kqz\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:07:09.754272 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:09.754271    2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/19c97936-7d69-495c-94eb-884bcf3e80d1-console-oauth-config\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:07:09.754436 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:09.754281    2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/19c97936-7d69-495c-94eb-884bcf3e80d1-console-serving-cert\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:07:09.780959 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:09.780891    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8468f468dd-4bmjq"]
Jul 27 20:07:09.786508 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:09.786487    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8468f468dd-4bmjq"]
Jul 27 20:07:09.909087 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:09.909057    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19c97936-7d69-495c-94eb-884bcf3e80d1" path="/var/lib/kubelet/pods/19c97936-7d69-495c-94eb-884bcf3e80d1/volumes"
Jul 27 20:07:13.131736 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:13.131707    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-585bb667b6-t88w8"
Jul 27 20:07:13.135563 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:13.135526    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-585bb667b6-t88w8"
Jul 27 20:07:47.680133 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:47.680096    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:07:48.017323 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:48.017262    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:07:52.783054 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:52.783016    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-85f6df5b45-chj2s"]
Jul 27 20:07:52.783577 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:52.783508    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19c97936-7d69-495c-94eb-884bcf3e80d1" containerName="console"
Jul 27 20:07:52.783577 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:52.783530    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="19c97936-7d69-495c-94eb-884bcf3e80d1" containerName="console"
Jul 27 20:07:52.783577 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:52.783544    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7" containerName="console"
Jul 27 20:07:52.783577 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:52.783551    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7" containerName="console"
Jul 27 20:07:52.783803 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:52.783624    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="19c97936-7d69-495c-94eb-884bcf3e80d1" containerName="console"
Jul 27 20:07:52.783803 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:52.783635    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="a09eb9e4-a5ed-43c5-8fdb-6eef8f65cbd7" containerName="console"
Jul 27 20:07:52.786905 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:52.786881    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-85f6df5b45-chj2s"
Jul 27 20:07:52.791555 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:52.791523    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 27 20:07:52.791721 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:52.791588    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-h5mw7\""
Jul 27 20:07:52.791721 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:52.791662    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 27 20:07:52.791721 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:52.791541    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 27 20:07:52.791721 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:52.791714    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 27 20:07:52.792604 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:52.792586    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 27 20:07:52.793893 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:52.793869    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bffc27a7-4b68-4c70-9179-a2d3d987e03e-serving-certs-ca-bundle\") pod \"telemeter-client-85f6df5b45-chj2s\" (UID: \"bffc27a7-4b68-4c70-9179-a2d3d987e03e\") " pod="openshift-monitoring/telemeter-client-85f6df5b45-chj2s"
Jul 27 20:07:52.794004 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:52.793912    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bffc27a7-4b68-4c70-9179-a2d3d987e03e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-85f6df5b45-chj2s\" (UID: \"bffc27a7-4b68-4c70-9179-a2d3d987e03e\") " pod="openshift-monitoring/telemeter-client-85f6df5b45-chj2s"
Jul 27 20:07:52.794004 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:52.793946    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/bffc27a7-4b68-4c70-9179-a2d3d987e03e-secret-telemeter-client\") pod \"telemeter-client-85f6df5b45-chj2s\" (UID: \"bffc27a7-4b68-4c70-9179-a2d3d987e03e\") " pod="openshift-monitoring/telemeter-client-85f6df5b45-chj2s"
Jul 27 20:07:52.794004 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:52.793999    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/bffc27a7-4b68-4c70-9179-a2d3d987e03e-telemeter-client-tls\") pod \"telemeter-client-85f6df5b45-chj2s\" (UID: \"bffc27a7-4b68-4c70-9179-a2d3d987e03e\") " pod="openshift-monitoring/telemeter-client-85f6df5b45-chj2s"
Jul 27 20:07:52.794148 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:52.794023    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/bffc27a7-4b68-4c70-9179-a2d3d987e03e-federate-client-tls\") pod \"telemeter-client-85f6df5b45-chj2s\" (UID: \"bffc27a7-4b68-4c70-9179-a2d3d987e03e\") " pod="openshift-monitoring/telemeter-client-85f6df5b45-chj2s"
Jul 27 20:07:52.794148 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:52.794061    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bffc27a7-4b68-4c70-9179-a2d3d987e03e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-85f6df5b45-chj2s\" (UID: \"bffc27a7-4b68-4c70-9179-a2d3d987e03e\") " pod="openshift-monitoring/telemeter-client-85f6df5b45-chj2s"
Jul 27 20:07:52.794148 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:52.794085    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hc2rq\" (UniqueName: \"kubernetes.io/projected/bffc27a7-4b68-4c70-9179-a2d3d987e03e-kube-api-access-hc2rq\") pod \"telemeter-client-85f6df5b45-chj2s\" (UID: \"bffc27a7-4b68-4c70-9179-a2d3d987e03e\") " pod="openshift-monitoring/telemeter-client-85f6df5b45-chj2s"
Jul 27 20:07:52.794293 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:52.794146    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bffc27a7-4b68-4c70-9179-a2d3d987e03e-metrics-client-ca\") pod \"telemeter-client-85f6df5b45-chj2s\" (UID: \"bffc27a7-4b68-4c70-9179-a2d3d987e03e\") " pod="openshift-monitoring/telemeter-client-85f6df5b45-chj2s"
Jul 27 20:07:52.796487 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:52.796443    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 27 20:07:52.801431 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:52.801394    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-85f6df5b45-chj2s"]
Jul 27 20:07:52.894566 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:52.894519    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/bffc27a7-4b68-4c70-9179-a2d3d987e03e-telemeter-client-tls\") pod \"telemeter-client-85f6df5b45-chj2s\" (UID: \"bffc27a7-4b68-4c70-9179-a2d3d987e03e\") " pod="openshift-monitoring/telemeter-client-85f6df5b45-chj2s"
Jul 27 20:07:52.894880 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:52.894855    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/bffc27a7-4b68-4c70-9179-a2d3d987e03e-federate-client-tls\") pod \"telemeter-client-85f6df5b45-chj2s\" (UID: \"bffc27a7-4b68-4c70-9179-a2d3d987e03e\") " pod="openshift-monitoring/telemeter-client-85f6df5b45-chj2s"
Jul 27 20:07:52.895062 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:52.895046    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bffc27a7-4b68-4c70-9179-a2d3d987e03e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-85f6df5b45-chj2s\" (UID: \"bffc27a7-4b68-4c70-9179-a2d3d987e03e\") " pod="openshift-monitoring/telemeter-client-85f6df5b45-chj2s"
Jul 27 20:07:52.895215 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:52.895201    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hc2rq\" (UniqueName: \"kubernetes.io/projected/bffc27a7-4b68-4c70-9179-a2d3d987e03e-kube-api-access-hc2rq\") pod \"telemeter-client-85f6df5b45-chj2s\" (UID: \"bffc27a7-4b68-4c70-9179-a2d3d987e03e\") " pod="openshift-monitoring/telemeter-client-85f6df5b45-chj2s"
Jul 27 20:07:52.895696 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:52.895671    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bffc27a7-4b68-4c70-9179-a2d3d987e03e-metrics-client-ca\") pod \"telemeter-client-85f6df5b45-chj2s\" (UID: \"bffc27a7-4b68-4c70-9179-a2d3d987e03e\") " pod="openshift-monitoring/telemeter-client-85f6df5b45-chj2s"
Jul 27 20:07:52.896648 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:52.896627    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bffc27a7-4b68-4c70-9179-a2d3d987e03e-serving-certs-ca-bundle\") pod \"telemeter-client-85f6df5b45-chj2s\" (UID: \"bffc27a7-4b68-4c70-9179-a2d3d987e03e\") " pod="openshift-monitoring/telemeter-client-85f6df5b45-chj2s"
Jul 27 20:07:52.897831 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:52.897145    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bffc27a7-4b68-4c70-9179-a2d3d987e03e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-85f6df5b45-chj2s\" (UID: \"bffc27a7-4b68-4c70-9179-a2d3d987e03e\") " pod="openshift-monitoring/telemeter-client-85f6df5b45-chj2s"
Jul 27 20:07:52.897831 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:52.897212    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/bffc27a7-4b68-4c70-9179-a2d3d987e03e-secret-telemeter-client\") pod \"telemeter-client-85f6df5b45-chj2s\" (UID: \"bffc27a7-4b68-4c70-9179-a2d3d987e03e\") " pod="openshift-monitoring/telemeter-client-85f6df5b45-chj2s"
Jul 27 20:07:52.897831 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:52.897496    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bffc27a7-4b68-4c70-9179-a2d3d987e03e-serving-certs-ca-bundle\") pod \"telemeter-client-85f6df5b45-chj2s\" (UID: \"bffc27a7-4b68-4c70-9179-a2d3d987e03e\") " pod="openshift-monitoring/telemeter-client-85f6df5b45-chj2s"
Jul 27 20:07:52.897831 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:52.896516    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bffc27a7-4b68-4c70-9179-a2d3d987e03e-metrics-client-ca\") pod \"telemeter-client-85f6df5b45-chj2s\" (UID: \"bffc27a7-4b68-4c70-9179-a2d3d987e03e\") " pod="openshift-monitoring/telemeter-client-85f6df5b45-chj2s"
Jul 27 20:07:52.898376 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:52.898318    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bffc27a7-4b68-4c70-9179-a2d3d987e03e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-85f6df5b45-chj2s\" (UID: \"bffc27a7-4b68-4c70-9179-a2d3d987e03e\") " pod="openshift-monitoring/telemeter-client-85f6df5b45-chj2s"
Jul 27 20:07:52.899024 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:52.898678    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/bffc27a7-4b68-4c70-9179-a2d3d987e03e-federate-client-tls\") pod \"telemeter-client-85f6df5b45-chj2s\" (UID: \"bffc27a7-4b68-4c70-9179-a2d3d987e03e\") " pod="openshift-monitoring/telemeter-client-85f6df5b45-chj2s"
Jul 27 20:07:52.899024 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:52.898753    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bffc27a7-4b68-4c70-9179-a2d3d987e03e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-85f6df5b45-chj2s\" (UID: \"bffc27a7-4b68-4c70-9179-a2d3d987e03e\") " pod="openshift-monitoring/telemeter-client-85f6df5b45-chj2s"
Jul 27 20:07:52.899751 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:52.899723    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/bffc27a7-4b68-4c70-9179-a2d3d987e03e-telemeter-client-tls\") pod \"telemeter-client-85f6df5b45-chj2s\" (UID: \"bffc27a7-4b68-4c70-9179-a2d3d987e03e\") " pod="openshift-monitoring/telemeter-client-85f6df5b45-chj2s"
Jul 27 20:07:52.899837 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:52.899813    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/bffc27a7-4b68-4c70-9179-a2d3d987e03e-secret-telemeter-client\") pod \"telemeter-client-85f6df5b45-chj2s\" (UID: \"bffc27a7-4b68-4c70-9179-a2d3d987e03e\") " pod="openshift-monitoring/telemeter-client-85f6df5b45-chj2s"
Jul 27 20:07:52.904585 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:52.904554    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hc2rq\" (UniqueName: \"kubernetes.io/projected/bffc27a7-4b68-4c70-9179-a2d3d987e03e-kube-api-access-hc2rq\") pod \"telemeter-client-85f6df5b45-chj2s\" (UID: \"bffc27a7-4b68-4c70-9179-a2d3d987e03e\") " pod="openshift-monitoring/telemeter-client-85f6df5b45-chj2s"
Jul 27 20:07:53.098022 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:53.097914    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-85f6df5b45-chj2s"
Jul 27 20:07:53.253286 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:53.253246    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-85f6df5b45-chj2s"]
Jul 27 20:07:53.256891 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:07:53.256860    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbffc27a7_4b68_4c70_9179_a2d3d987e03e.slice/crio-4a702968b242fc923a05c3bb91b94bb92c362027395f1425d9a4f192f3beb4d8 WatchSource:0}: Error finding container 4a702968b242fc923a05c3bb91b94bb92c362027395f1425d9a4f192f3beb4d8: Status 404 returned error can't find the container with id 4a702968b242fc923a05c3bb91b94bb92c362027395f1425d9a4f192f3beb4d8
Jul 27 20:07:53.895550 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:53.895518    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-85f6df5b45-chj2s" event={"ID":"bffc27a7-4b68-4c70-9179-a2d3d987e03e","Type":"ContainerStarted","Data":"4a702968b242fc923a05c3bb91b94bb92c362027395f1425d9a4f192f3beb4d8"}
Jul 27 20:07:55.909822 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:55.909743    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-85f6df5b45-chj2s" event={"ID":"bffc27a7-4b68-4c70-9179-a2d3d987e03e","Type":"ContainerStarted","Data":"3cf37670d3756af2c83a93c1678291a3fb428a5d040d4010a2cb7d631e7f8f7c"}
Jul 27 20:07:57.916343 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:57.916305    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-85f6df5b45-chj2s" event={"ID":"bffc27a7-4b68-4c70-9179-a2d3d987e03e","Type":"ContainerStarted","Data":"23c903e37ffe2fd5dda323a268fd5efda92ad86e800bbf7903e6b91c3b32f5f0"}
Jul 27 20:07:57.916744 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:57.916367    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-85f6df5b45-chj2s" event={"ID":"bffc27a7-4b68-4c70-9179-a2d3d987e03e","Type":"ContainerStarted","Data":"5b42275a2f01d4e61dd513235df4622b2f44926bda1885cf66c377eebc19b438"}
Jul 27 20:07:57.941162 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:57.941109    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-85f6df5b45-chj2s" podStartSLOduration=2.265639882 podStartE2EDuration="5.941093416s" totalImagesPullingTime="3.675453534s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:07:52 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:07:57.940224854 +0000 UTC m=+226.514951244" watchObservedRunningTime="2026-07-27 20:07:57.941093416 +0000 UTC m=+226.515819804"
Jul 27 20:07:58.462905 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:58.462857    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:07:58.863675 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:58.863638    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8596b8bc78-m6k2v"]
Jul 27 20:07:58.866958 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:58.866934    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8596b8bc78-m6k2v"
Jul 27 20:07:58.869541 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:58.869513    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 27 20:07:58.870196 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:58.870181    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-k7t6n\""
Jul 27 20:07:58.870713 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:58.870693    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 27 20:07:58.870830 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:58.870758    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 27 20:07:58.870830 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:58.870777    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 27 20:07:58.870945 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:58.870833    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 27 20:07:58.875431 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:58.875410    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 27 20:07:58.879094 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:58.879070    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8596b8bc78-m6k2v"]
Jul 27 20:07:58.924362 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:58.924331    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:07:58.946679 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:58.946638    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1d004fe2-f5bd-47ea-963e-8510b237fa3d-service-ca\") pod \"console-8596b8bc78-m6k2v\" (UID: \"1d004fe2-f5bd-47ea-963e-8510b237fa3d\") " pod="openshift-console/console-8596b8bc78-m6k2v"
Jul 27 20:07:58.946679 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:58.946676    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d004fe2-f5bd-47ea-963e-8510b237fa3d-trusted-ca-bundle\") pod \"console-8596b8bc78-m6k2v\" (UID: \"1d004fe2-f5bd-47ea-963e-8510b237fa3d\") " pod="openshift-console/console-8596b8bc78-m6k2v"
Jul 27 20:07:58.946879 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:58.946696    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1d004fe2-f5bd-47ea-963e-8510b237fa3d-oauth-serving-cert\") pod \"console-8596b8bc78-m6k2v\" (UID: \"1d004fe2-f5bd-47ea-963e-8510b237fa3d\") " pod="openshift-console/console-8596b8bc78-m6k2v"
Jul 27 20:07:58.946879 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:58.946806    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1d004fe2-f5bd-47ea-963e-8510b237fa3d-console-serving-cert\") pod \"console-8596b8bc78-m6k2v\" (UID: \"1d004fe2-f5bd-47ea-963e-8510b237fa3d\") " pod="openshift-console/console-8596b8bc78-m6k2v"
Jul 27 20:07:58.946879 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:58.946874    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1d004fe2-f5bd-47ea-963e-8510b237fa3d-console-oauth-config\") pod \"console-8596b8bc78-m6k2v\" (UID: \"1d004fe2-f5bd-47ea-963e-8510b237fa3d\") " pod="openshift-console/console-8596b8bc78-m6k2v"
Jul 27 20:07:58.946989 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:58.946902    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djgjm\" (UniqueName: \"kubernetes.io/projected/1d004fe2-f5bd-47ea-963e-8510b237fa3d-kube-api-access-djgjm\") pod \"console-8596b8bc78-m6k2v\" (UID: \"1d004fe2-f5bd-47ea-963e-8510b237fa3d\") " pod="openshift-console/console-8596b8bc78-m6k2v"
Jul 27 20:07:58.947164 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:58.947141    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1d004fe2-f5bd-47ea-963e-8510b237fa3d-console-config\") pod \"console-8596b8bc78-m6k2v\" (UID: \"1d004fe2-f5bd-47ea-963e-8510b237fa3d\") " pod="openshift-console/console-8596b8bc78-m6k2v"
Jul 27 20:07:59.026045 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:59.026002    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:07:59.048418 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:59.048354    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1d004fe2-f5bd-47ea-963e-8510b237fa3d-console-config\") pod \"console-8596b8bc78-m6k2v\" (UID: \"1d004fe2-f5bd-47ea-963e-8510b237fa3d\") " pod="openshift-console/console-8596b8bc78-m6k2v"
Jul 27 20:07:59.049028 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:59.048985    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1d004fe2-f5bd-47ea-963e-8510b237fa3d-service-ca\") pod \"console-8596b8bc78-m6k2v\" (UID: \"1d004fe2-f5bd-47ea-963e-8510b237fa3d\") " pod="openshift-console/console-8596b8bc78-m6k2v"
Jul 27 20:07:59.049174 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:59.049038    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d004fe2-f5bd-47ea-963e-8510b237fa3d-trusted-ca-bundle\") pod \"console-8596b8bc78-m6k2v\" (UID: \"1d004fe2-f5bd-47ea-963e-8510b237fa3d\") " pod="openshift-console/console-8596b8bc78-m6k2v"
Jul 27 20:07:59.049174 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:59.049069    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1d004fe2-f5bd-47ea-963e-8510b237fa3d-oauth-serving-cert\") pod \"console-8596b8bc78-m6k2v\" (UID: \"1d004fe2-f5bd-47ea-963e-8510b237fa3d\") " pod="openshift-console/console-8596b8bc78-m6k2v"
Jul 27 20:07:59.049174 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:59.049100    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1d004fe2-f5bd-47ea-963e-8510b237fa3d-console-serving-cert\") pod \"console-8596b8bc78-m6k2v\" (UID: \"1d004fe2-f5bd-47ea-963e-8510b237fa3d\") " pod="openshift-console/console-8596b8bc78-m6k2v"
Jul 27 20:07:59.049174 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:59.049140    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1d004fe2-f5bd-47ea-963e-8510b237fa3d-console-oauth-config\") pod \"console-8596b8bc78-m6k2v\" (UID: \"1d004fe2-f5bd-47ea-963e-8510b237fa3d\") " pod="openshift-console/console-8596b8bc78-m6k2v"
Jul 27 20:07:59.049174 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:59.049169    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djgjm\" (UniqueName: \"kubernetes.io/projected/1d004fe2-f5bd-47ea-963e-8510b237fa3d-kube-api-access-djgjm\") pod \"console-8596b8bc78-m6k2v\" (UID: \"1d004fe2-f5bd-47ea-963e-8510b237fa3d\") " pod="openshift-console/console-8596b8bc78-m6k2v"
Jul 27 20:07:59.049641 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:59.049615    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1d004fe2-f5bd-47ea-963e-8510b237fa3d-service-ca\") pod \"console-8596b8bc78-m6k2v\" (UID: \"1d004fe2-f5bd-47ea-963e-8510b237fa3d\") " pod="openshift-console/console-8596b8bc78-m6k2v"
Jul 27 20:07:59.049922 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:59.049890    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1d004fe2-f5bd-47ea-963e-8510b237fa3d-console-config\") pod \"console-8596b8bc78-m6k2v\" (UID: \"1d004fe2-f5bd-47ea-963e-8510b237fa3d\") " pod="openshift-console/console-8596b8bc78-m6k2v"
Jul 27 20:07:59.050166 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:59.050141    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1d004fe2-f5bd-47ea-963e-8510b237fa3d-oauth-serving-cert\") pod \"console-8596b8bc78-m6k2v\" (UID: \"1d004fe2-f5bd-47ea-963e-8510b237fa3d\") " pod="openshift-console/console-8596b8bc78-m6k2v"
Jul 27 20:07:59.050244 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:59.050187    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d004fe2-f5bd-47ea-963e-8510b237fa3d-trusted-ca-bundle\") pod \"console-8596b8bc78-m6k2v\" (UID: \"1d004fe2-f5bd-47ea-963e-8510b237fa3d\") " pod="openshift-console/console-8596b8bc78-m6k2v"
Jul 27 20:07:59.052260 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:59.052242    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1d004fe2-f5bd-47ea-963e-8510b237fa3d-console-oauth-config\") pod \"console-8596b8bc78-m6k2v\" (UID: \"1d004fe2-f5bd-47ea-963e-8510b237fa3d\") " pod="openshift-console/console-8596b8bc78-m6k2v"
Jul 27 20:07:59.052504 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:59.052484    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1d004fe2-f5bd-47ea-963e-8510b237fa3d-console-serving-cert\") pod \"console-8596b8bc78-m6k2v\" (UID: \"1d004fe2-f5bd-47ea-963e-8510b237fa3d\") " pod="openshift-console/console-8596b8bc78-m6k2v"
Jul 27 20:07:59.064474 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:59.064428    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djgjm\" (UniqueName: \"kubernetes.io/projected/1d004fe2-f5bd-47ea-963e-8510b237fa3d-kube-api-access-djgjm\") pod \"console-8596b8bc78-m6k2v\" (UID: \"1d004fe2-f5bd-47ea-963e-8510b237fa3d\") " pod="openshift-console/console-8596b8bc78-m6k2v"
Jul 27 20:07:59.125996 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:59.125887    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:07:59.179540 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:59.179498    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8596b8bc78-m6k2v"
Jul 27 20:07:59.334355 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:59.334317    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8596b8bc78-m6k2v"]
Jul 27 20:07:59.337348 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:07:59.337322    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d004fe2_f5bd_47ea_963e_8510b237fa3d.slice/crio-ea184816c79deb17fb94b284ca56c03a05138c2e1cf8e83348846e9e246842de WatchSource:0}: Error finding container ea184816c79deb17fb94b284ca56c03a05138c2e1cf8e83348846e9e246842de: Status 404 returned error can't find the container with id ea184816c79deb17fb94b284ca56c03a05138c2e1cf8e83348846e9e246842de
Jul 27 20:07:59.667579 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:59.667492    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:07:59.768866 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:59.768836    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:07:59.926573 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:59.926490    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8596b8bc78-m6k2v" event={"ID":"1d004fe2-f5bd-47ea-963e-8510b237fa3d","Type":"ContainerStarted","Data":"f1cd51555e34191508523fd8698864423775d205a5b5a970552c2a877f6e0364"}
Jul 27 20:07:59.926573 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:59.926545    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8596b8bc78-m6k2v" event={"ID":"1d004fe2-f5bd-47ea-963e-8510b237fa3d","Type":"ContainerStarted","Data":"ea184816c79deb17fb94b284ca56c03a05138c2e1cf8e83348846e9e246842de"}
Jul 27 20:07:59.946376 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:07:59.946332    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8596b8bc78-m6k2v" podStartSLOduration=1.946316715 podStartE2EDuration="1.946316715s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:07:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:07:59.9455916 +0000 UTC m=+228.520318000" watchObservedRunningTime="2026-07-27 20:07:59.946316715 +0000 UTC m=+228.521043104"
Jul 27 20:08:09.180727 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:08:09.180668    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8596b8bc78-m6k2v"
Jul 27 20:08:09.180727 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:08:09.180746    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8596b8bc78-m6k2v"
Jul 27 20:08:09.185652 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:08:09.185627    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8596b8bc78-m6k2v"
Jul 27 20:08:09.966516 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:08:09.966489    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8596b8bc78-m6k2v"
Jul 27 20:08:10.145663 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:08:10.145628    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:08:10.245693 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:08:10.245666    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:08:10.348068 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:08:10.348038    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:08:30.321370 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:08:30.321324    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:08:30.382037 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:08:30.382005    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:09:02.903004 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:02.902962    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:09:02.964134 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:02.964100    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:09:11.765869 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:11.765837    2557 kubelet.go:1648] "Image garbage collection succeeded"
Jul 27 20:09:14.899819 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:14.899781    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:09:14.960407 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:14.960374    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:09:16.302698 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:16.302653    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f984bd458-gh29t"]
Jul 27 20:09:16.305737 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:16.305720    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f984bd458-gh29t"
Jul 27 20:09:16.321227 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:16.321198    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f984bd458-gh29t"]
Jul 27 20:09:16.360904 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:16.360870    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zr2dz\" (UniqueName: \"kubernetes.io/projected/d42cea1b-6052-4860-95fb-845e9ce271c8-kube-api-access-zr2dz\") pod \"console-5f984bd458-gh29t\" (UID: \"d42cea1b-6052-4860-95fb-845e9ce271c8\") " pod="openshift-console/console-5f984bd458-gh29t"
Jul 27 20:09:16.361110 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:16.360930    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d42cea1b-6052-4860-95fb-845e9ce271c8-trusted-ca-bundle\") pod \"console-5f984bd458-gh29t\" (UID: \"d42cea1b-6052-4860-95fb-845e9ce271c8\") " pod="openshift-console/console-5f984bd458-gh29t"
Jul 27 20:09:16.361110 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:16.361008    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d42cea1b-6052-4860-95fb-845e9ce271c8-service-ca\") pod \"console-5f984bd458-gh29t\" (UID: \"d42cea1b-6052-4860-95fb-845e9ce271c8\") " pod="openshift-console/console-5f984bd458-gh29t"
Jul 27 20:09:16.361110 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:16.361073    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d42cea1b-6052-4860-95fb-845e9ce271c8-console-oauth-config\") pod \"console-5f984bd458-gh29t\" (UID: \"d42cea1b-6052-4860-95fb-845e9ce271c8\") " pod="openshift-console/console-5f984bd458-gh29t"
Jul 27 20:09:16.361110 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:16.361103    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d42cea1b-6052-4860-95fb-845e9ce271c8-console-serving-cert\") pod \"console-5f984bd458-gh29t\" (UID: \"d42cea1b-6052-4860-95fb-845e9ce271c8\") " pod="openshift-console/console-5f984bd458-gh29t"
Jul 27 20:09:16.361367 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:16.361145    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d42cea1b-6052-4860-95fb-845e9ce271c8-oauth-serving-cert\") pod \"console-5f984bd458-gh29t\" (UID: \"d42cea1b-6052-4860-95fb-845e9ce271c8\") " pod="openshift-console/console-5f984bd458-gh29t"
Jul 27 20:09:16.361367 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:16.361169    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d42cea1b-6052-4860-95fb-845e9ce271c8-console-config\") pod \"console-5f984bd458-gh29t\" (UID: \"d42cea1b-6052-4860-95fb-845e9ce271c8\") " pod="openshift-console/console-5f984bd458-gh29t"
Jul 27 20:09:16.361511 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:16.361431    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:09:16.462292 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:16.462255    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d42cea1b-6052-4860-95fb-845e9ce271c8-trusted-ca-bundle\") pod \"console-5f984bd458-gh29t\" (UID: \"d42cea1b-6052-4860-95fb-845e9ce271c8\") " pod="openshift-console/console-5f984bd458-gh29t"
Jul 27 20:09:16.462509 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:16.462306    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d42cea1b-6052-4860-95fb-845e9ce271c8-service-ca\") pod \"console-5f984bd458-gh29t\" (UID: \"d42cea1b-6052-4860-95fb-845e9ce271c8\") " pod="openshift-console/console-5f984bd458-gh29t"
Jul 27 20:09:16.462509 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:16.462389    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d42cea1b-6052-4860-95fb-845e9ce271c8-console-oauth-config\") pod \"console-5f984bd458-gh29t\" (UID: \"d42cea1b-6052-4860-95fb-845e9ce271c8\") " pod="openshift-console/console-5f984bd458-gh29t"
Jul 27 20:09:16.462509 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:16.462416    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d42cea1b-6052-4860-95fb-845e9ce271c8-console-serving-cert\") pod \"console-5f984bd458-gh29t\" (UID: \"d42cea1b-6052-4860-95fb-845e9ce271c8\") " pod="openshift-console/console-5f984bd458-gh29t"
Jul 27 20:09:16.462509 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:16.462441    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d42cea1b-6052-4860-95fb-845e9ce271c8-oauth-serving-cert\") pod \"console-5f984bd458-gh29t\" (UID: \"d42cea1b-6052-4860-95fb-845e9ce271c8\") " pod="openshift-console/console-5f984bd458-gh29t"
Jul 27 20:09:16.462741 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:16.462569    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d42cea1b-6052-4860-95fb-845e9ce271c8-console-config\") pod \"console-5f984bd458-gh29t\" (UID: \"d42cea1b-6052-4860-95fb-845e9ce271c8\") " pod="openshift-console/console-5f984bd458-gh29t"
Jul 27 20:09:16.462741 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:16.462614    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zr2dz\" (UniqueName: \"kubernetes.io/projected/d42cea1b-6052-4860-95fb-845e9ce271c8-kube-api-access-zr2dz\") pod \"console-5f984bd458-gh29t\" (UID: \"d42cea1b-6052-4860-95fb-845e9ce271c8\") " pod="openshift-console/console-5f984bd458-gh29t"
Jul 27 20:09:16.463123 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:16.463096    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d42cea1b-6052-4860-95fb-845e9ce271c8-service-ca\") pod \"console-5f984bd458-gh29t\" (UID: \"d42cea1b-6052-4860-95fb-845e9ce271c8\") " pod="openshift-console/console-5f984bd458-gh29t"
Jul 27 20:09:16.463253 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:16.463201    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d42cea1b-6052-4860-95fb-845e9ce271c8-trusted-ca-bundle\") pod \"console-5f984bd458-gh29t\" (UID: \"d42cea1b-6052-4860-95fb-845e9ce271c8\") " pod="openshift-console/console-5f984bd458-gh29t"
Jul 27 20:09:16.463253 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:16.463205    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d42cea1b-6052-4860-95fb-845e9ce271c8-oauth-serving-cert\") pod \"console-5f984bd458-gh29t\" (UID: \"d42cea1b-6052-4860-95fb-845e9ce271c8\") " pod="openshift-console/console-5f984bd458-gh29t"
Jul 27 20:09:16.463253 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:16.463247    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d42cea1b-6052-4860-95fb-845e9ce271c8-console-config\") pod \"console-5f984bd458-gh29t\" (UID: \"d42cea1b-6052-4860-95fb-845e9ce271c8\") " pod="openshift-console/console-5f984bd458-gh29t"
Jul 27 20:09:16.464923 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:16.464895    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d42cea1b-6052-4860-95fb-845e9ce271c8-console-serving-cert\") pod \"console-5f984bd458-gh29t\" (UID: \"d42cea1b-6052-4860-95fb-845e9ce271c8\") " pod="openshift-console/console-5f984bd458-gh29t"
Jul 27 20:09:16.465007 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:16.464928    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d42cea1b-6052-4860-95fb-845e9ce271c8-console-oauth-config\") pod \"console-5f984bd458-gh29t\" (UID: \"d42cea1b-6052-4860-95fb-845e9ce271c8\") " pod="openshift-console/console-5f984bd458-gh29t"
Jul 27 20:09:16.470500 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:16.470480    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zr2dz\" (UniqueName: \"kubernetes.io/projected/d42cea1b-6052-4860-95fb-845e9ce271c8-kube-api-access-zr2dz\") pod \"console-5f984bd458-gh29t\" (UID: \"d42cea1b-6052-4860-95fb-845e9ce271c8\") " pod="openshift-console/console-5f984bd458-gh29t"
Jul 27 20:09:16.615170 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:16.615085    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f984bd458-gh29t"
Jul 27 20:09:16.748266 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:16.748161    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f984bd458-gh29t"]
Jul 27 20:09:16.750550 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:09:16.750518    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd42cea1b_6052_4860_95fb_845e9ce271c8.slice/crio-5fb28d822cc9d247412b0ad7c3e3a7c9b4617f7529cca5e650c939de9534f6b3 WatchSource:0}: Error finding container 5fb28d822cc9d247412b0ad7c3e3a7c9b4617f7529cca5e650c939de9534f6b3: Status 404 returned error can't find the container with id 5fb28d822cc9d247412b0ad7c3e3a7c9b4617f7529cca5e650c939de9534f6b3
Jul 27 20:09:17.214012 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:17.213975    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f984bd458-gh29t" event={"ID":"d42cea1b-6052-4860-95fb-845e9ce271c8","Type":"ContainerStarted","Data":"7fd629ec374197bdd6a95cf054e7c5016579a4918eabc11f3b969c937db62f49"}
Jul 27 20:09:17.214189 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:17.214026    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f984bd458-gh29t" event={"ID":"d42cea1b-6052-4860-95fb-845e9ce271c8","Type":"ContainerStarted","Data":"5fb28d822cc9d247412b0ad7c3e3a7c9b4617f7529cca5e650c939de9534f6b3"}
Jul 27 20:09:17.232365 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:17.232315    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5f984bd458-gh29t" podStartSLOduration=1.232298367 podStartE2EDuration="1.232298367s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:09:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:09:17.231002795 +0000 UTC m=+305.805729183" watchObservedRunningTime="2026-07-27 20:09:17.232298367 +0000 UTC m=+305.807024754"
Jul 27 20:09:21.954925 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:21.954872    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:09:22.054776 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:22.054734    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:09:26.615945 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:26.615910    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f984bd458-gh29t"
Jul 27 20:09:26.616356 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:26.615975    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f984bd458-gh29t"
Jul 27 20:09:26.620615 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:26.620591    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5f984bd458-gh29t"
Jul 27 20:09:27.257534 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:27.257507    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5f984bd458-gh29t"
Jul 27 20:09:27.308740 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:27.308702    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8596b8bc78-m6k2v"]
Jul 27 20:09:27.406332 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:27.406286    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:09:27.508157 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:27.508062    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:09:27.568701 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:27.568664    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:09:52.329063 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:52.329009    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-8596b8bc78-m6k2v" podUID="1d004fe2-f5bd-47ea-963e-8510b237fa3d" containerName="console" containerID="cri-o://f1cd51555e34191508523fd8698864423775d205a5b5a970552c2a877f6e0364" gracePeriod=15
Jul 27 20:09:52.575580 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:52.575552    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8596b8bc78-m6k2v"
Jul 27 20:09:52.662633 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:52.662546    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1d004fe2-f5bd-47ea-963e-8510b237fa3d-service-ca\") pod \"1d004fe2-f5bd-47ea-963e-8510b237fa3d\" (UID: \"1d004fe2-f5bd-47ea-963e-8510b237fa3d\") "
Jul 27 20:09:52.662633 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:52.662578    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1d004fe2-f5bd-47ea-963e-8510b237fa3d-oauth-serving-cert\") pod \"1d004fe2-f5bd-47ea-963e-8510b237fa3d\" (UID: \"1d004fe2-f5bd-47ea-963e-8510b237fa3d\") "
Jul 27 20:09:52.662820 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:52.662725    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1d004fe2-f5bd-47ea-963e-8510b237fa3d-console-config\") pod \"1d004fe2-f5bd-47ea-963e-8510b237fa3d\" (UID: \"1d004fe2-f5bd-47ea-963e-8510b237fa3d\") "
Jul 27 20:09:52.662820 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:52.662786    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1d004fe2-f5bd-47ea-963e-8510b237fa3d-console-serving-cert\") pod \"1d004fe2-f5bd-47ea-963e-8510b237fa3d\" (UID: \"1d004fe2-f5bd-47ea-963e-8510b237fa3d\") "
Jul 27 20:09:52.662820 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:52.662816    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1d004fe2-f5bd-47ea-963e-8510b237fa3d-console-oauth-config\") pod \"1d004fe2-f5bd-47ea-963e-8510b237fa3d\" (UID: \"1d004fe2-f5bd-47ea-963e-8510b237fa3d\") "
Jul 27 20:09:52.662934 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:52.662874    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d004fe2-f5bd-47ea-963e-8510b237fa3d-trusted-ca-bundle\") pod \"1d004fe2-f5bd-47ea-963e-8510b237fa3d\" (UID: \"1d004fe2-f5bd-47ea-963e-8510b237fa3d\") "
Jul 27 20:09:52.662934 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:52.662917    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-djgjm\" (UniqueName: \"kubernetes.io/projected/1d004fe2-f5bd-47ea-963e-8510b237fa3d-kube-api-access-djgjm\") pod \"1d004fe2-f5bd-47ea-963e-8510b237fa3d\" (UID: \"1d004fe2-f5bd-47ea-963e-8510b237fa3d\") "
Jul 27 20:09:52.663036 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:52.662984    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d004fe2-f5bd-47ea-963e-8510b237fa3d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1d004fe2-f5bd-47ea-963e-8510b237fa3d" (UID: "1d004fe2-f5bd-47ea-963e-8510b237fa3d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:09:52.663087 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:52.663041    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d004fe2-f5bd-47ea-963e-8510b237fa3d-service-ca" (OuterVolumeSpecName: "service-ca") pod "1d004fe2-f5bd-47ea-963e-8510b237fa3d" (UID: "1d004fe2-f5bd-47ea-963e-8510b237fa3d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:09:52.663144 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:52.663111    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d004fe2-f5bd-47ea-963e-8510b237fa3d-console-config" (OuterVolumeSpecName: "console-config") pod "1d004fe2-f5bd-47ea-963e-8510b237fa3d" (UID: "1d004fe2-f5bd-47ea-963e-8510b237fa3d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:09:52.663368 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:52.663227    2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1d004fe2-f5bd-47ea-963e-8510b237fa3d-service-ca\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:09:52.663368 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:52.663251    2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1d004fe2-f5bd-47ea-963e-8510b237fa3d-oauth-serving-cert\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:09:52.663368 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:52.663267    2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1d004fe2-f5bd-47ea-963e-8510b237fa3d-console-config\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:09:52.663368 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:52.663354    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d004fe2-f5bd-47ea-963e-8510b237fa3d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1d004fe2-f5bd-47ea-963e-8510b237fa3d" (UID: "1d004fe2-f5bd-47ea-963e-8510b237fa3d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:09:52.664982 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:52.664956    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d004fe2-f5bd-47ea-963e-8510b237fa3d-kube-api-access-djgjm" (OuterVolumeSpecName: "kube-api-access-djgjm") pod "1d004fe2-f5bd-47ea-963e-8510b237fa3d" (UID: "1d004fe2-f5bd-47ea-963e-8510b237fa3d"). InnerVolumeSpecName "kube-api-access-djgjm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:09:52.664982 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:52.664953    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d004fe2-f5bd-47ea-963e-8510b237fa3d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1d004fe2-f5bd-47ea-963e-8510b237fa3d" (UID: "1d004fe2-f5bd-47ea-963e-8510b237fa3d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:09:52.665157 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:52.664987    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d004fe2-f5bd-47ea-963e-8510b237fa3d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1d004fe2-f5bd-47ea-963e-8510b237fa3d" (UID: "1d004fe2-f5bd-47ea-963e-8510b237fa3d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:09:52.763630 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:52.763595    2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1d004fe2-f5bd-47ea-963e-8510b237fa3d-console-serving-cert\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:09:52.763630 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:52.763623    2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1d004fe2-f5bd-47ea-963e-8510b237fa3d-console-oauth-config\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:09:52.763630 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:52.763633    2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d004fe2-f5bd-47ea-963e-8510b237fa3d-trusted-ca-bundle\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:09:52.763856 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:52.763644    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-djgjm\" (UniqueName: \"kubernetes.io/projected/1d004fe2-f5bd-47ea-963e-8510b237fa3d-kube-api-access-djgjm\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:09:53.355345 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:53.355304    2557 generic.go:356] "Generic (PLEG): container finished" podID="1d004fe2-f5bd-47ea-963e-8510b237fa3d" containerID="f1cd51555e34191508523fd8698864423775d205a5b5a970552c2a877f6e0364" exitCode=0
Jul 27 20:09:53.355345 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:53.355347    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8596b8bc78-m6k2v"
Jul 27 20:09:53.355820 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:53.355392    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8596b8bc78-m6k2v" event={"ID":"1d004fe2-f5bd-47ea-963e-8510b237fa3d","Type":"ContainerDied","Data":"f1cd51555e34191508523fd8698864423775d205a5b5a970552c2a877f6e0364"}
Jul 27 20:09:53.355820 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:53.355438    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8596b8bc78-m6k2v" event={"ID":"1d004fe2-f5bd-47ea-963e-8510b237fa3d","Type":"ContainerDied","Data":"ea184816c79deb17fb94b284ca56c03a05138c2e1cf8e83348846e9e246842de"}
Jul 27 20:09:53.355820 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:53.355480    2557 scope.go:117] "RemoveContainer" containerID="f1cd51555e34191508523fd8698864423775d205a5b5a970552c2a877f6e0364"
Jul 27 20:09:53.363875 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:53.363855    2557 scope.go:117] "RemoveContainer" containerID="f1cd51555e34191508523fd8698864423775d205a5b5a970552c2a877f6e0364"
Jul 27 20:09:53.364151 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:09:53.364134    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1cd51555e34191508523fd8698864423775d205a5b5a970552c2a877f6e0364\": container with ID starting with f1cd51555e34191508523fd8698864423775d205a5b5a970552c2a877f6e0364 not found: ID does not exist" containerID="f1cd51555e34191508523fd8698864423775d205a5b5a970552c2a877f6e0364"
Jul 27 20:09:53.364209 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:53.364158    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1cd51555e34191508523fd8698864423775d205a5b5a970552c2a877f6e0364"} err="failed to get container status \"f1cd51555e34191508523fd8698864423775d205a5b5a970552c2a877f6e0364\": rpc error: code = NotFound desc = could not find container \"f1cd51555e34191508523fd8698864423775d205a5b5a970552c2a877f6e0364\": container with ID starting with f1cd51555e34191508523fd8698864423775d205a5b5a970552c2a877f6e0364 not found: ID does not exist"
Jul 27 20:09:53.376009 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:53.375982    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8596b8bc78-m6k2v"]
Jul 27 20:09:53.378226 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:53.378202    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8596b8bc78-m6k2v"]
Jul 27 20:09:53.909325 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:09:53.909288    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d004fe2-f5bd-47ea-963e-8510b237fa3d" path="/var/lib/kubelet/pods/1d004fe2-f5bd-47ea-963e-8510b237fa3d/volumes"
Jul 27 20:10:05.475901 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:05.475811    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:10:21.831713 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:21.831674    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:10:21.929662 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:21.929626    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:10:22.569632 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:22.569600    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409pdth"]
Jul 27 20:10:22.569904 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:22.569893    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d004fe2-f5bd-47ea-963e-8510b237fa3d" containerName="console"
Jul 27 20:10:22.569951 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:22.569905    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d004fe2-f5bd-47ea-963e-8510b237fa3d" containerName="console"
Jul 27 20:10:22.570001 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:22.569955    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d004fe2-f5bd-47ea-963e-8510b237fa3d" containerName="console"
Jul 27 20:10:22.573970 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:22.573952    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409pdth"
Jul 27 20:10:22.576671 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:22.576652    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 27 20:10:22.577646 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:22.577628    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 27 20:10:22.577766 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:22.577721    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jl9gk\""
Jul 27 20:10:22.585689 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:22.585667    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409pdth"]
Jul 27 20:10:22.689696 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:22.689658    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d4713598-19b3-4516-944f-8107dbf3b2da-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409pdth\" (UID: \"d4713598-19b3-4516-944f-8107dbf3b2da\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409pdth"
Jul 27 20:10:22.689696 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:22.689695    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d4713598-19b3-4516-944f-8107dbf3b2da-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409pdth\" (UID: \"d4713598-19b3-4516-944f-8107dbf3b2da\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409pdth"
Jul 27 20:10:22.689909 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:22.689713    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghnsx\" (UniqueName: \"kubernetes.io/projected/d4713598-19b3-4516-944f-8107dbf3b2da-kube-api-access-ghnsx\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409pdth\" (UID: \"d4713598-19b3-4516-944f-8107dbf3b2da\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409pdth"
Jul 27 20:10:22.790538 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:22.790505    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d4713598-19b3-4516-944f-8107dbf3b2da-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409pdth\" (UID: \"d4713598-19b3-4516-944f-8107dbf3b2da\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409pdth"
Jul 27 20:10:22.790538 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:22.790542    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d4713598-19b3-4516-944f-8107dbf3b2da-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409pdth\" (UID: \"d4713598-19b3-4516-944f-8107dbf3b2da\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409pdth"
Jul 27 20:10:22.790767 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:22.790561    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghnsx\" (UniqueName: \"kubernetes.io/projected/d4713598-19b3-4516-944f-8107dbf3b2da-kube-api-access-ghnsx\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409pdth\" (UID: \"d4713598-19b3-4516-944f-8107dbf3b2da\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409pdth"
Jul 27 20:10:22.790909 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:22.790886    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d4713598-19b3-4516-944f-8107dbf3b2da-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409pdth\" (UID: \"d4713598-19b3-4516-944f-8107dbf3b2da\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409pdth"
Jul 27 20:10:22.790974 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:22.790924    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d4713598-19b3-4516-944f-8107dbf3b2da-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409pdth\" (UID: \"d4713598-19b3-4516-944f-8107dbf3b2da\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409pdth"
Jul 27 20:10:22.799079 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:22.799052    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghnsx\" (UniqueName: \"kubernetes.io/projected/d4713598-19b3-4516-944f-8107dbf3b2da-kube-api-access-ghnsx\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409pdth\" (UID: \"d4713598-19b3-4516-944f-8107dbf3b2da\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409pdth"
Jul 27 20:10:22.883797 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:22.883692    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409pdth"
Jul 27 20:10:23.012701 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:23.012675    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409pdth"]
Jul 27 20:10:23.015283 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:10:23.015239    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4713598_19b3_4516_944f_8107dbf3b2da.slice/crio-34af913925f8553f87144d6c961cd7457e699fc1efab516a57a929bcafcc0d5f WatchSource:0}: Error finding container 34af913925f8553f87144d6c961cd7457e699fc1efab516a57a929bcafcc0d5f: Status 404 returned error can't find the container with id 34af913925f8553f87144d6c961cd7457e699fc1efab516a57a929bcafcc0d5f
Jul 27 20:10:23.017290 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:23.017270    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 20:10:23.478358 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:23.478323    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409pdth" event={"ID":"d4713598-19b3-4516-944f-8107dbf3b2da","Type":"ContainerStarted","Data":"34af913925f8553f87144d6c961cd7457e699fc1efab516a57a929bcafcc0d5f"}
Jul 27 20:10:30.508232 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:30.508187    2557 generic.go:356] "Generic (PLEG): container finished" podID="d4713598-19b3-4516-944f-8107dbf3b2da" containerID="abd00368d4b7f0ba88cdf993a23a4efa382004b183045f32e6976b699a0fe59c" exitCode=0
Jul 27 20:10:30.508712 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:30.508264    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409pdth" event={"ID":"d4713598-19b3-4516-944f-8107dbf3b2da","Type":"ContainerDied","Data":"abd00368d4b7f0ba88cdf993a23a4efa382004b183045f32e6976b699a0fe59c"}
Jul 27 20:10:33.522424 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:33.522391    2557 generic.go:356] "Generic (PLEG): container finished" podID="d4713598-19b3-4516-944f-8107dbf3b2da" containerID="9c67a6a617cf12f924cb2bd2eaf42c1f65ac080a78a90383ae5f27ef4a9438c8" exitCode=0
Jul 27 20:10:33.522818 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:33.522473    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409pdth" event={"ID":"d4713598-19b3-4516-944f-8107dbf3b2da","Type":"ContainerDied","Data":"9c67a6a617cf12f924cb2bd2eaf42c1f65ac080a78a90383ae5f27ef4a9438c8"}
Jul 27 20:10:40.553245 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:40.553213    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409pdth" event={"ID":"d4713598-19b3-4516-944f-8107dbf3b2da","Type":"ContainerStarted","Data":"aaab3d1a2b3e1170173bacbad078d64e8e81d875904c824af37c0ad27963f4c4"}
Jul 27 20:10:40.571795 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:40.571748    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409pdth" podStartSLOduration=2.324485689 podStartE2EDuration="18.571732029s" totalImagesPullingTime="16.24724634s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:10:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:10:40.570893405 +0000 UTC m=+389.145619798" watchObservedRunningTime="2026-07-27 20:10:40.571732029 +0000 UTC m=+389.146458451"
Jul 27 20:10:41.559011 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:41.558970    2557 generic.go:356] "Generic (PLEG): container finished" podID="d4713598-19b3-4516-944f-8107dbf3b2da" containerID="aaab3d1a2b3e1170173bacbad078d64e8e81d875904c824af37c0ad27963f4c4" exitCode=0
Jul 27 20:10:41.559485 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:41.559023    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409pdth" event={"ID":"d4713598-19b3-4516-944f-8107dbf3b2da","Type":"ContainerDied","Data":"aaab3d1a2b3e1170173bacbad078d64e8e81d875904c824af37c0ad27963f4c4"}
Jul 27 20:10:42.693870 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:42.693844    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409pdth"
Jul 27 20:10:42.864247 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:42.864144    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ghnsx\" (UniqueName: \"kubernetes.io/projected/d4713598-19b3-4516-944f-8107dbf3b2da-kube-api-access-ghnsx\") pod \"d4713598-19b3-4516-944f-8107dbf3b2da\" (UID: \"d4713598-19b3-4516-944f-8107dbf3b2da\") "
Jul 27 20:10:42.864247 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:42.864240    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d4713598-19b3-4516-944f-8107dbf3b2da-bundle\") pod \"d4713598-19b3-4516-944f-8107dbf3b2da\" (UID: \"d4713598-19b3-4516-944f-8107dbf3b2da\") "
Jul 27 20:10:42.864247 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:42.864258    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d4713598-19b3-4516-944f-8107dbf3b2da-util\") pod \"d4713598-19b3-4516-944f-8107dbf3b2da\" (UID: \"d4713598-19b3-4516-944f-8107dbf3b2da\") "
Jul 27 20:10:42.864868 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:42.864831    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4713598-19b3-4516-944f-8107dbf3b2da-bundle" (OuterVolumeSpecName: "bundle") pod "d4713598-19b3-4516-944f-8107dbf3b2da" (UID: "d4713598-19b3-4516-944f-8107dbf3b2da"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:10:42.866417 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:42.866395    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4713598-19b3-4516-944f-8107dbf3b2da-kube-api-access-ghnsx" (OuterVolumeSpecName: "kube-api-access-ghnsx") pod "d4713598-19b3-4516-944f-8107dbf3b2da" (UID: "d4713598-19b3-4516-944f-8107dbf3b2da"). InnerVolumeSpecName "kube-api-access-ghnsx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:10:42.868470 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:42.868439    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4713598-19b3-4516-944f-8107dbf3b2da-util" (OuterVolumeSpecName: "util") pod "d4713598-19b3-4516-944f-8107dbf3b2da" (UID: "d4713598-19b3-4516-944f-8107dbf3b2da"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:10:42.965084 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:42.965039    2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d4713598-19b3-4516-944f-8107dbf3b2da-bundle\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:10:42.965084 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:42.965076    2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d4713598-19b3-4516-944f-8107dbf3b2da-util\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:10:42.965084 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:42.965088    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ghnsx\" (UniqueName: \"kubernetes.io/projected/d4713598-19b3-4516-944f-8107dbf3b2da-kube-api-access-ghnsx\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:10:43.568480 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:43.568433    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409pdth" event={"ID":"d4713598-19b3-4516-944f-8107dbf3b2da","Type":"ContainerDied","Data":"34af913925f8553f87144d6c961cd7457e699fc1efab516a57a929bcafcc0d5f"}
Jul 27 20:10:43.568676 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:43.568490    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="34af913925f8553f87144d6c961cd7457e699fc1efab516a57a929bcafcc0d5f"
Jul 27 20:10:43.568676 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:43.568441    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409pdth"
Jul 27 20:10:48.910551 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:48.910511    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:10:50.295861 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:50.295829    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:10:50.907832 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:50.907770    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dsbbm"]
Jul 27 20:10:50.908222 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:50.908200    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4713598-19b3-4516-944f-8107dbf3b2da" containerName="util"
Jul 27 20:10:50.908343 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:50.908247    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4713598-19b3-4516-944f-8107dbf3b2da" containerName="util"
Jul 27 20:10:50.908343 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:50.908288    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4713598-19b3-4516-944f-8107dbf3b2da" containerName="extract"
Jul 27 20:10:50.908343 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:50.908297    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4713598-19b3-4516-944f-8107dbf3b2da" containerName="extract"
Jul 27 20:10:50.908343 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:50.908309    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4713598-19b3-4516-944f-8107dbf3b2da" containerName="pull"
Jul 27 20:10:50.908343 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:50.908317    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4713598-19b3-4516-944f-8107dbf3b2da" containerName="pull"
Jul 27 20:10:50.908615 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:50.908403    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4713598-19b3-4516-944f-8107dbf3b2da" containerName="extract"
Jul 27 20:10:50.911951 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:50.911929    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dsbbm"
Jul 27 20:10:50.914683 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:50.914659    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-xfzhb\""
Jul 27 20:10:50.914683 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:50.914676    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 27 20:10:50.914881 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:50.914750    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 27 20:10:50.931374 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:50.931347    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dsbbm"]
Jul 27 20:10:51.025607 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:51.025576    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rj26h\" (UniqueName: \"kubernetes.io/projected/7f4b2238-ab04-4f8b-abe4-4e5bfb7fb3da-kube-api-access-rj26h\") pod \"cert-manager-operator-controller-manager-55c444bf86-dsbbm\" (UID: \"7f4b2238-ab04-4f8b-abe4-4e5bfb7fb3da\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dsbbm"
Jul 27 20:10:51.025607 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:51.025612    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f4b2238-ab04-4f8b-abe4-4e5bfb7fb3da-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-dsbbm\" (UID: \"7f4b2238-ab04-4f8b-abe4-4e5bfb7fb3da\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dsbbm"
Jul 27 20:10:51.126646 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:51.126610    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rj26h\" (UniqueName: \"kubernetes.io/projected/7f4b2238-ab04-4f8b-abe4-4e5bfb7fb3da-kube-api-access-rj26h\") pod \"cert-manager-operator-controller-manager-55c444bf86-dsbbm\" (UID: \"7f4b2238-ab04-4f8b-abe4-4e5bfb7fb3da\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dsbbm"
Jul 27 20:10:51.126646 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:51.126650    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f4b2238-ab04-4f8b-abe4-4e5bfb7fb3da-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-dsbbm\" (UID: \"7f4b2238-ab04-4f8b-abe4-4e5bfb7fb3da\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dsbbm"
Jul 27 20:10:51.127075 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:51.127057    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f4b2238-ab04-4f8b-abe4-4e5bfb7fb3da-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-dsbbm\" (UID: \"7f4b2238-ab04-4f8b-abe4-4e5bfb7fb3da\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dsbbm"
Jul 27 20:10:51.137892 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:51.137860    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rj26h\" (UniqueName: \"kubernetes.io/projected/7f4b2238-ab04-4f8b-abe4-4e5bfb7fb3da-kube-api-access-rj26h\") pod \"cert-manager-operator-controller-manager-55c444bf86-dsbbm\" (UID: \"7f4b2238-ab04-4f8b-abe4-4e5bfb7fb3da\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dsbbm"
Jul 27 20:10:51.220702 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:51.220617    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dsbbm"
Jul 27 20:10:51.365265 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:51.365231    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dsbbm"]
Jul 27 20:10:51.368933 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:10:51.368904    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f4b2238_ab04_4f8b_abe4_4e5bfb7fb3da.slice/crio-fd675d88cfec3161e90a042f858646449ef6e223055fda14056cf1cbb94dbd9c WatchSource:0}: Error finding container fd675d88cfec3161e90a042f858646449ef6e223055fda14056cf1cbb94dbd9c: Status 404 returned error can't find the container with id fd675d88cfec3161e90a042f858646449ef6e223055fda14056cf1cbb94dbd9c
Jul 27 20:10:51.602722 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:51.602682    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dsbbm" event={"ID":"7f4b2238-ab04-4f8b-abe4-4e5bfb7fb3da","Type":"ContainerStarted","Data":"fd675d88cfec3161e90a042f858646449ef6e223055fda14056cf1cbb94dbd9c"}
Jul 27 20:10:52.642876 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:52.642833    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:10:52.745402 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:52.745362    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:10:53.614633 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:53.614595    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dsbbm" event={"ID":"7f4b2238-ab04-4f8b-abe4-4e5bfb7fb3da","Type":"ContainerStarted","Data":"adbeab1a9d790b3c08bf5d5a06eb82291f435b6e685a8c7804d6899324d6613a"}
Jul 27 20:10:53.643301 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:53.643228    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dsbbm" podStartSLOduration=1.516578945 podStartE2EDuration="3.643207891s" totalImagesPullingTime="2.126628946s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:10:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:10:53.64106407 +0000 UTC m=+402.215790459" watchObservedRunningTime="2026-07-27 20:10:53.643207891 +0000 UTC m=+402.217934280"
Jul 27 20:10:54.130635 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:54.130596    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:10:54.267524 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:54.267484    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:10:54.386063 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:54.385954    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:10:55.074356 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:55.074324    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89tqc"]
Jul 27 20:10:55.077831 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:55.077807    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89tqc"
Jul 27 20:10:55.080889 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:55.080861    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 27 20:10:55.080889 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:55.080861    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 27 20:10:55.081049 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:55.080886    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jl9gk\""
Jul 27 20:10:55.088198 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:55.088179    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89tqc"]
Jul 27 20:10:55.169170 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:55.169136    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b553b63e-18ef-419f-bd64-0564fc0d281d-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89tqc\" (UID: \"b553b63e-18ef-419f-bd64-0564fc0d281d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89tqc"
Jul 27 20:10:55.169342 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:55.169230    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhg2z\" (UniqueName: \"kubernetes.io/projected/b553b63e-18ef-419f-bd64-0564fc0d281d-kube-api-access-xhg2z\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89tqc\" (UID: \"b553b63e-18ef-419f-bd64-0564fc0d281d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89tqc"
Jul 27 20:10:55.169342 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:55.169262    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b553b63e-18ef-419f-bd64-0564fc0d281d-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89tqc\" (UID: \"b553b63e-18ef-419f-bd64-0564fc0d281d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89tqc"
Jul 27 20:10:55.269773 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:55.269740    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b553b63e-18ef-419f-bd64-0564fc0d281d-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89tqc\" (UID: \"b553b63e-18ef-419f-bd64-0564fc0d281d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89tqc"
Jul 27 20:10:55.269941 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:55.269826    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhg2z\" (UniqueName: \"kubernetes.io/projected/b553b63e-18ef-419f-bd64-0564fc0d281d-kube-api-access-xhg2z\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89tqc\" (UID: \"b553b63e-18ef-419f-bd64-0564fc0d281d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89tqc"
Jul 27 20:10:55.269941 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:55.269859    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b553b63e-18ef-419f-bd64-0564fc0d281d-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89tqc\" (UID: \"b553b63e-18ef-419f-bd64-0564fc0d281d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89tqc"
Jul 27 20:10:55.270194 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:55.270170    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b553b63e-18ef-419f-bd64-0564fc0d281d-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89tqc\" (UID: \"b553b63e-18ef-419f-bd64-0564fc0d281d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89tqc"
Jul 27 20:10:55.270240 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:55.270180    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b553b63e-18ef-419f-bd64-0564fc0d281d-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89tqc\" (UID: \"b553b63e-18ef-419f-bd64-0564fc0d281d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89tqc"
Jul 27 20:10:55.278633 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:55.278608    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhg2z\" (UniqueName: \"kubernetes.io/projected/b553b63e-18ef-419f-bd64-0564fc0d281d-kube-api-access-xhg2z\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89tqc\" (UID: \"b553b63e-18ef-419f-bd64-0564fc0d281d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89tqc"
Jul 27 20:10:55.386875 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:55.386797    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89tqc"
Jul 27 20:10:55.526508 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:55.526481    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89tqc"]
Jul 27 20:10:55.528934 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:10:55.528908    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb553b63e_18ef_419f_bd64_0564fc0d281d.slice/crio-422d08bf9116d0528d09ea8bff7d905279c496aeaf50349c28af85873e367818 WatchSource:0}: Error finding container 422d08bf9116d0528d09ea8bff7d905279c496aeaf50349c28af85873e367818: Status 404 returned error can't find the container with id 422d08bf9116d0528d09ea8bff7d905279c496aeaf50349c28af85873e367818
Jul 27 20:10:55.623900 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:55.623869    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89tqc" event={"ID":"b553b63e-18ef-419f-bd64-0564fc0d281d","Type":"ContainerStarted","Data":"1ce939051169baa40909befcfd0e6655e88683ae4f27c130af8d9451a826e2fc"}
Jul 27 20:10:55.624026 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:55.623920    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89tqc" event={"ID":"b553b63e-18ef-419f-bd64-0564fc0d281d","Type":"ContainerStarted","Data":"422d08bf9116d0528d09ea8bff7d905279c496aeaf50349c28af85873e367818"}
Jul 27 20:10:56.568145 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:56.568060    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:10:56.629174 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:56.629138    2557 generic.go:356] "Generic (PLEG): container finished" podID="b553b63e-18ef-419f-bd64-0564fc0d281d" containerID="1ce939051169baa40909befcfd0e6655e88683ae4f27c130af8d9451a826e2fc" exitCode=0
Jul 27 20:10:56.629341 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:56.629189    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89tqc" event={"ID":"b553b63e-18ef-419f-bd64-0564fc0d281d","Type":"ContainerDied","Data":"1ce939051169baa40909befcfd0e6655e88683ae4f27c130af8d9451a826e2fc"}
Jul 27 20:10:56.782677 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:56.782627    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:10:57.005463 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:57.005415    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-cjvtf"]
Jul 27 20:10:57.008693 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:57.008675    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-cjvtf"
Jul 27 20:10:57.011136 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:57.011109    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 27 20:10:57.011307 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:57.011232    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-h89r5\""
Jul 27 20:10:57.011400 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:57.011387    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 27 20:10:57.020772 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:57.020749    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-cjvtf"]
Jul 27 20:10:57.082621 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:57.082591    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4bnl\" (UniqueName: \"kubernetes.io/projected/eae2db2c-3c20-438f-968b-84bdc377b14a-kube-api-access-n4bnl\") pod \"cert-manager-cainjector-559cdd8c87-cjvtf\" (UID: \"eae2db2c-3c20-438f-968b-84bdc377b14a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-cjvtf"
Jul 27 20:10:57.082768 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:57.082648    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eae2db2c-3c20-438f-968b-84bdc377b14a-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-cjvtf\" (UID: \"eae2db2c-3c20-438f-968b-84bdc377b14a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-cjvtf"
Jul 27 20:10:57.183945 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:57.183901    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4bnl\" (UniqueName: \"kubernetes.io/projected/eae2db2c-3c20-438f-968b-84bdc377b14a-kube-api-access-n4bnl\") pod \"cert-manager-cainjector-559cdd8c87-cjvtf\" (UID: \"eae2db2c-3c20-438f-968b-84bdc377b14a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-cjvtf"
Jul 27 20:10:57.184131 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:57.183959    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eae2db2c-3c20-438f-968b-84bdc377b14a-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-cjvtf\" (UID: \"eae2db2c-3c20-438f-968b-84bdc377b14a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-cjvtf"
Jul 27 20:10:57.193851 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:57.193826    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4bnl\" (UniqueName: \"kubernetes.io/projected/eae2db2c-3c20-438f-968b-84bdc377b14a-kube-api-access-n4bnl\") pod \"cert-manager-cainjector-559cdd8c87-cjvtf\" (UID: \"eae2db2c-3c20-438f-968b-84bdc377b14a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-cjvtf"
Jul 27 20:10:57.194009 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:57.193988    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eae2db2c-3c20-438f-968b-84bdc377b14a-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-cjvtf\" (UID: \"eae2db2c-3c20-438f-968b-84bdc377b14a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-cjvtf"
Jul 27 20:10:57.330346 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:57.330263    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-cjvtf"
Jul 27 20:10:57.459795 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:57.459775    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-cjvtf"]
Jul 27 20:10:57.462043 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:10:57.462017    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeae2db2c_3c20_438f_968b_84bdc377b14a.slice/crio-32d7d0656c2bac685b6ff7d2d77b9c645e43bfb21dbc6da3ebf1f471971bb15f WatchSource:0}: Error finding container 32d7d0656c2bac685b6ff7d2d77b9c645e43bfb21dbc6da3ebf1f471971bb15f: Status 404 returned error can't find the container with id 32d7d0656c2bac685b6ff7d2d77b9c645e43bfb21dbc6da3ebf1f471971bb15f
Jul 27 20:10:57.563493 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:57.563444    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:10:57.635265 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:57.635185    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-cjvtf" event={"ID":"eae2db2c-3c20-438f-968b-84bdc377b14a","Type":"ContainerStarted","Data":"32d7d0656c2bac685b6ff7d2d77b9c645e43bfb21dbc6da3ebf1f471971bb15f"}
Jul 27 20:10:59.631125 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:59.631088    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:10:59.647361 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:59.647325    2557 generic.go:356] "Generic (PLEG): container finished" podID="b553b63e-18ef-419f-bd64-0564fc0d281d" containerID="f3c911e0d64355bebfac0501818549b3c4e045e13e351d03cd94e82c12287257" exitCode=0
Jul 27 20:10:59.647577 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:59.647419    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89tqc" event={"ID":"b553b63e-18ef-419f-bd64-0564fc0d281d","Type":"ContainerDied","Data":"f3c911e0d64355bebfac0501818549b3c4e045e13e351d03cd94e82c12287257"}
Jul 27 20:10:59.732124 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:10:59.732090    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:11:00.660564 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:00.660524    2557 generic.go:356] "Generic (PLEG): container finished" podID="b553b63e-18ef-419f-bd64-0564fc0d281d" containerID="ed1eb2b379590d4c990ada84f550a05b6b741909bfe4ab54446dc21eeb414f66" exitCode=0
Jul 27 20:11:00.661082 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:00.660571    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89tqc" event={"ID":"b553b63e-18ef-419f-bd64-0564fc0d281d","Type":"ContainerDied","Data":"ed1eb2b379590d4c990ada84f550a05b6b741909bfe4ab54446dc21eeb414f66"}
Jul 27 20:11:00.750336 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:00.750305    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-vgjv8"]
Jul 27 20:11:00.753232 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:00.753213    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-vgjv8"
Jul 27 20:11:00.755702 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:00.755684    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-g44kb\""
Jul 27 20:11:00.763058 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:00.763034    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-vgjv8"]
Jul 27 20:11:00.811302 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:00.811272    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/70b2dabd-0a87-433f-80e6-6af7cb4412c4-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-vgjv8\" (UID: \"70b2dabd-0a87-433f-80e6-6af7cb4412c4\") " pod="cert-manager/cert-manager-webhook-6486ffd997-vgjv8"
Jul 27 20:11:00.811476 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:00.811313    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htxt5\" (UniqueName: \"kubernetes.io/projected/70b2dabd-0a87-433f-80e6-6af7cb4412c4-kube-api-access-htxt5\") pod \"cert-manager-webhook-6486ffd997-vgjv8\" (UID: \"70b2dabd-0a87-433f-80e6-6af7cb4412c4\") " pod="cert-manager/cert-manager-webhook-6486ffd997-vgjv8"
Jul 27 20:11:00.912620 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:00.912531    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/70b2dabd-0a87-433f-80e6-6af7cb4412c4-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-vgjv8\" (UID: \"70b2dabd-0a87-433f-80e6-6af7cb4412c4\") " pod="cert-manager/cert-manager-webhook-6486ffd997-vgjv8"
Jul 27 20:11:00.912620 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:00.912581    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htxt5\" (UniqueName: \"kubernetes.io/projected/70b2dabd-0a87-433f-80e6-6af7cb4412c4-kube-api-access-htxt5\") pod \"cert-manager-webhook-6486ffd997-vgjv8\" (UID: \"70b2dabd-0a87-433f-80e6-6af7cb4412c4\") " pod="cert-manager/cert-manager-webhook-6486ffd997-vgjv8"
Jul 27 20:11:00.921152 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:00.921127    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/70b2dabd-0a87-433f-80e6-6af7cb4412c4-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-vgjv8\" (UID: \"70b2dabd-0a87-433f-80e6-6af7cb4412c4\") " pod="cert-manager/cert-manager-webhook-6486ffd997-vgjv8"
Jul 27 20:11:00.921357 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:00.921339    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-htxt5\" (UniqueName: \"kubernetes.io/projected/70b2dabd-0a87-433f-80e6-6af7cb4412c4-kube-api-access-htxt5\") pod \"cert-manager-webhook-6486ffd997-vgjv8\" (UID: \"70b2dabd-0a87-433f-80e6-6af7cb4412c4\") " pod="cert-manager/cert-manager-webhook-6486ffd997-vgjv8"
Jul 27 20:11:01.062294 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:01.062263    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-vgjv8"
Jul 27 20:11:01.211746 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:01.211564    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-vgjv8"]
Jul 27 20:11:01.213706 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:11:01.213679    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod70b2dabd_0a87_433f_80e6_6af7cb4412c4.slice/crio-1cbe95267e33fa7cacd191aaf21f55816f960825f925718e9824146933920e71 WatchSource:0}: Error finding container 1cbe95267e33fa7cacd191aaf21f55816f960825f925718e9824146933920e71: Status 404 returned error can't find the container with id 1cbe95267e33fa7cacd191aaf21f55816f960825f925718e9824146933920e71
Jul 27 20:11:01.665998 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:01.665960    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-cjvtf" event={"ID":"eae2db2c-3c20-438f-968b-84bdc377b14a","Type":"ContainerStarted","Data":"b160b9668cb96143bb8f9760c8ee9e5b647aa1b1cdde6a7f6a1369e0faf3df39"}
Jul 27 20:11:01.667545 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:01.667517    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-vgjv8" event={"ID":"70b2dabd-0a87-433f-80e6-6af7cb4412c4","Type":"ContainerStarted","Data":"b565719be0a4a4b95f86b12392fd905ae7452c84e66852607409943685f0ba03"}
Jul 27 20:11:01.667658 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:01.667558    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-vgjv8" event={"ID":"70b2dabd-0a87-433f-80e6-6af7cb4412c4","Type":"ContainerStarted","Data":"1cbe95267e33fa7cacd191aaf21f55816f960825f925718e9824146933920e71"}
Jul 27 20:11:01.667718 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:01.667702    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-vgjv8"
Jul 27 20:11:01.684702 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:01.684643    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-cjvtf" podStartSLOduration=2.3794535740000002 podStartE2EDuration="5.684619212s" totalImagesPullingTime="3.305165638s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:10:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:11:01.683336777 +0000 UTC m=+410.258063167" watchObservedRunningTime="2026-07-27 20:11:01.684619212 +0000 UTC m=+410.259345604"
Jul 27 20:11:01.699568 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:01.699468    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-vgjv8" podStartSLOduration=1.699433494 podStartE2EDuration="1.699433494s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:11:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:11:01.699315395 +0000 UTC m=+410.274041785" watchObservedRunningTime="2026-07-27 20:11:01.699433494 +0000 UTC m=+410.274159884"
Jul 27 20:11:01.787561 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:01.787537    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89tqc"
Jul 27 20:11:01.820362 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:01.820333    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xhg2z\" (UniqueName: \"kubernetes.io/projected/b553b63e-18ef-419f-bd64-0564fc0d281d-kube-api-access-xhg2z\") pod \"b553b63e-18ef-419f-bd64-0564fc0d281d\" (UID: \"b553b63e-18ef-419f-bd64-0564fc0d281d\") "
Jul 27 20:11:01.820543 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:01.820373    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b553b63e-18ef-419f-bd64-0564fc0d281d-bundle\") pod \"b553b63e-18ef-419f-bd64-0564fc0d281d\" (UID: \"b553b63e-18ef-419f-bd64-0564fc0d281d\") "
Jul 27 20:11:01.820543 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:01.820392    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b553b63e-18ef-419f-bd64-0564fc0d281d-util\") pod \"b553b63e-18ef-419f-bd64-0564fc0d281d\" (UID: \"b553b63e-18ef-419f-bd64-0564fc0d281d\") "
Jul 27 20:11:01.820812 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:01.820786    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b553b63e-18ef-419f-bd64-0564fc0d281d-bundle" (OuterVolumeSpecName: "bundle") pod "b553b63e-18ef-419f-bd64-0564fc0d281d" (UID: "b553b63e-18ef-419f-bd64-0564fc0d281d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:11:01.822545 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:01.822525    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b553b63e-18ef-419f-bd64-0564fc0d281d-kube-api-access-xhg2z" (OuterVolumeSpecName: "kube-api-access-xhg2z") pod "b553b63e-18ef-419f-bd64-0564fc0d281d" (UID: "b553b63e-18ef-419f-bd64-0564fc0d281d"). InnerVolumeSpecName "kube-api-access-xhg2z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:11:01.825142 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:01.825120    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b553b63e-18ef-419f-bd64-0564fc0d281d-util" (OuterVolumeSpecName: "util") pod "b553b63e-18ef-419f-bd64-0564fc0d281d" (UID: "b553b63e-18ef-419f-bd64-0564fc0d281d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:11:01.920855 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:01.920828    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xhg2z\" (UniqueName: \"kubernetes.io/projected/b553b63e-18ef-419f-bd64-0564fc0d281d-kube-api-access-xhg2z\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:11:01.920855 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:01.920848    2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b553b63e-18ef-419f-bd64-0564fc0d281d-bundle\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:11:01.920855 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:01.920857    2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b553b63e-18ef-419f-bd64-0564fc0d281d-util\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:11:02.673737 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:02.673698    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89tqc" event={"ID":"b553b63e-18ef-419f-bd64-0564fc0d281d","Type":"ContainerDied","Data":"422d08bf9116d0528d09ea8bff7d905279c496aeaf50349c28af85873e367818"}
Jul 27 20:11:02.674121 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:02.673760    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="422d08bf9116d0528d09ea8bff7d905279c496aeaf50349c28af85873e367818"
Jul 27 20:11:02.674121 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:02.673723    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89tqc"
Jul 27 20:11:04.177883 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:04.177852    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:11:07.145313 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:07.145275    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:11:07.240003 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:07.239966    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:11:07.675791 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:07.675762    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-vgjv8"
Jul 27 20:11:14.007938 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:14.007898    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:11:14.110806 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:14.110771    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:11:15.792496 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:15.792462    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqxrmk"]
Jul 27 20:11:15.792969 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:15.792750    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b553b63e-18ef-419f-bd64-0564fc0d281d" containerName="extract"
Jul 27 20:11:15.792969 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:15.792762    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="b553b63e-18ef-419f-bd64-0564fc0d281d" containerName="extract"
Jul 27 20:11:15.792969 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:15.792771    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b553b63e-18ef-419f-bd64-0564fc0d281d" containerName="util"
Jul 27 20:11:15.792969 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:15.792776    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="b553b63e-18ef-419f-bd64-0564fc0d281d" containerName="util"
Jul 27 20:11:15.792969 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:15.792782    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b553b63e-18ef-419f-bd64-0564fc0d281d" containerName="pull"
Jul 27 20:11:15.792969 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:15.792787    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="b553b63e-18ef-419f-bd64-0564fc0d281d" containerName="pull"
Jul 27 20:11:15.792969 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:15.792836    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="b553b63e-18ef-419f-bd64-0564fc0d281d" containerName="extract"
Jul 27 20:11:15.796024 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:15.796006    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqxrmk"
Jul 27 20:11:15.798639 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:15.798618    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jl9gk\""
Jul 27 20:11:15.798639 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:15.798635    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 27 20:11:15.798885 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:15.798653    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 27 20:11:15.805542 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:15.805520    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqxrmk"]
Jul 27 20:11:15.828307 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:15.828284    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9d5459d9-5d6b-47c6-90cd-57e268d7067d-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqxrmk\" (UID: \"9d5459d9-5d6b-47c6-90cd-57e268d7067d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqxrmk"
Jul 27 20:11:15.828422 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:15.828334    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qj84h\" (UniqueName: \"kubernetes.io/projected/9d5459d9-5d6b-47c6-90cd-57e268d7067d-kube-api-access-qj84h\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqxrmk\" (UID: \"9d5459d9-5d6b-47c6-90cd-57e268d7067d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqxrmk"
Jul 27 20:11:15.828422 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:15.828362    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9d5459d9-5d6b-47c6-90cd-57e268d7067d-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqxrmk\" (UID: \"9d5459d9-5d6b-47c6-90cd-57e268d7067d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqxrmk"
Jul 27 20:11:15.929799 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:15.929760    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9d5459d9-5d6b-47c6-90cd-57e268d7067d-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqxrmk\" (UID: \"9d5459d9-5d6b-47c6-90cd-57e268d7067d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqxrmk"
Jul 27 20:11:15.929977 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:15.929815    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9d5459d9-5d6b-47c6-90cd-57e268d7067d-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqxrmk\" (UID: \"9d5459d9-5d6b-47c6-90cd-57e268d7067d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqxrmk"
Jul 27 20:11:15.929977 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:15.929855    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qj84h\" (UniqueName: \"kubernetes.io/projected/9d5459d9-5d6b-47c6-90cd-57e268d7067d-kube-api-access-qj84h\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqxrmk\" (UID: \"9d5459d9-5d6b-47c6-90cd-57e268d7067d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqxrmk"
Jul 27 20:11:15.930143 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:15.930121    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9d5459d9-5d6b-47c6-90cd-57e268d7067d-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqxrmk\" (UID: \"9d5459d9-5d6b-47c6-90cd-57e268d7067d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqxrmk"
Jul 27 20:11:15.930231 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:15.930210    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9d5459d9-5d6b-47c6-90cd-57e268d7067d-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqxrmk\" (UID: \"9d5459d9-5d6b-47c6-90cd-57e268d7067d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqxrmk"
Jul 27 20:11:15.935368 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:15.935339    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:11:15.937815 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:15.937787    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qj84h\" (UniqueName: \"kubernetes.io/projected/9d5459d9-5d6b-47c6-90cd-57e268d7067d-kube-api-access-qj84h\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqxrmk\" (UID: \"9d5459d9-5d6b-47c6-90cd-57e268d7067d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqxrmk"
Jul 27 20:11:16.106983 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:16.106904    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqxrmk"
Jul 27 20:11:16.243909 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:16.243880    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqxrmk"]
Jul 27 20:11:16.246254 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:11:16.246222    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d5459d9_5d6b_47c6_90cd_57e268d7067d.slice/crio-7b98b89c17edc655c38828996ebe57b5e3a6879858cdf55da64d2617d1b74ed2 WatchSource:0}: Error finding container 7b98b89c17edc655c38828996ebe57b5e3a6879858cdf55da64d2617d1b74ed2: Status 404 returned error can't find the container with id 7b98b89c17edc655c38828996ebe57b5e3a6879858cdf55da64d2617d1b74ed2
Jul 27 20:11:16.736176 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:16.736142    2557 generic.go:356] "Generic (PLEG): container finished" podID="9d5459d9-5d6b-47c6-90cd-57e268d7067d" containerID="c1478a96be6c6aea2424bc030a6aa585bb8a40cff7c8237f303b4715fd6ea9a1" exitCode=0
Jul 27 20:11:16.736356 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:16.736194    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqxrmk" event={"ID":"9d5459d9-5d6b-47c6-90cd-57e268d7067d","Type":"ContainerDied","Data":"c1478a96be6c6aea2424bc030a6aa585bb8a40cff7c8237f303b4715fd6ea9a1"}
Jul 27 20:11:16.736356 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:16.736230    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqxrmk" event={"ID":"9d5459d9-5d6b-47c6-90cd-57e268d7067d","Type":"ContainerStarted","Data":"7b98b89c17edc655c38828996ebe57b5e3a6879858cdf55da64d2617d1b74ed2"}
Jul 27 20:11:17.742647 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:17.742612    2557 generic.go:356] "Generic (PLEG): container finished" podID="9d5459d9-5d6b-47c6-90cd-57e268d7067d" containerID="a91e5497136dcdcee3129dfc155feda8725045b82ca35480136a865dfec4a1f9" exitCode=0
Jul 27 20:11:17.743010 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:17.742681    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqxrmk" event={"ID":"9d5459d9-5d6b-47c6-90cd-57e268d7067d","Type":"ContainerDied","Data":"a91e5497136dcdcee3129dfc155feda8725045b82ca35480136a865dfec4a1f9"}
Jul 27 20:11:18.750101 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:18.750065    2557 generic.go:356] "Generic (PLEG): container finished" podID="9d5459d9-5d6b-47c6-90cd-57e268d7067d" containerID="875d1a6ccc7156f1676d7470ce09329bb9ad32179784d934a31198d425dc681b" exitCode=0
Jul 27 20:11:18.750551 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:18.750142    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqxrmk" event={"ID":"9d5459d9-5d6b-47c6-90cd-57e268d7067d","Type":"ContainerDied","Data":"875d1a6ccc7156f1676d7470ce09329bb9ad32179784d934a31198d425dc681b"}
Jul 27 20:11:19.889749 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:19.889716    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqxrmk"
Jul 27 20:11:19.964171 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:19.964136    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9d5459d9-5d6b-47c6-90cd-57e268d7067d-util\") pod \"9d5459d9-5d6b-47c6-90cd-57e268d7067d\" (UID: \"9d5459d9-5d6b-47c6-90cd-57e268d7067d\") "
Jul 27 20:11:19.964353 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:19.964210    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9d5459d9-5d6b-47c6-90cd-57e268d7067d-bundle\") pod \"9d5459d9-5d6b-47c6-90cd-57e268d7067d\" (UID: \"9d5459d9-5d6b-47c6-90cd-57e268d7067d\") "
Jul 27 20:11:19.964353 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:19.964238    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qj84h\" (UniqueName: \"kubernetes.io/projected/9d5459d9-5d6b-47c6-90cd-57e268d7067d-kube-api-access-qj84h\") pod \"9d5459d9-5d6b-47c6-90cd-57e268d7067d\" (UID: \"9d5459d9-5d6b-47c6-90cd-57e268d7067d\") "
Jul 27 20:11:19.965034 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:19.965005    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d5459d9-5d6b-47c6-90cd-57e268d7067d-bundle" (OuterVolumeSpecName: "bundle") pod "9d5459d9-5d6b-47c6-90cd-57e268d7067d" (UID: "9d5459d9-5d6b-47c6-90cd-57e268d7067d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:11:19.966412 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:19.966392    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d5459d9-5d6b-47c6-90cd-57e268d7067d-kube-api-access-qj84h" (OuterVolumeSpecName: "kube-api-access-qj84h") pod "9d5459d9-5d6b-47c6-90cd-57e268d7067d" (UID: "9d5459d9-5d6b-47c6-90cd-57e268d7067d"). InnerVolumeSpecName "kube-api-access-qj84h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:11:19.969628 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:19.969590    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d5459d9-5d6b-47c6-90cd-57e268d7067d-util" (OuterVolumeSpecName: "util") pod "9d5459d9-5d6b-47c6-90cd-57e268d7067d" (UID: "9d5459d9-5d6b-47c6-90cd-57e268d7067d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:11:20.065604 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:20.065523    2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9d5459d9-5d6b-47c6-90cd-57e268d7067d-util\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:11:20.065604 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:20.065559    2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9d5459d9-5d6b-47c6-90cd-57e268d7067d-bundle\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:11:20.065604 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:20.065574    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qj84h\" (UniqueName: \"kubernetes.io/projected/9d5459d9-5d6b-47c6-90cd-57e268d7067d-kube-api-access-qj84h\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:11:20.763650 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:20.763621    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqxrmk"
Jul 27 20:11:20.763826 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:20.763620    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqxrmk" event={"ID":"9d5459d9-5d6b-47c6-90cd-57e268d7067d","Type":"ContainerDied","Data":"7b98b89c17edc655c38828996ebe57b5e3a6879858cdf55da64d2617d1b74ed2"}
Jul 27 20:11:20.763826 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:20.763743    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7b98b89c17edc655c38828996ebe57b5e3a6879858cdf55da64d2617d1b74ed2"
Jul 27 20:11:29.047537 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:29.047496    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:11:29.152841 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:29.152802    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:11:31.911033 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:31.910976    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:11:32.035960 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:32.035921    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:11:32.707911 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:32.707879    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:11:33.036179 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:33.036139    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:11:33.136992 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:33.136961    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:11:33.164779 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:33.164740    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67944f57b-bl5h9"]
Jul 27 20:11:33.165109 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:33.165095    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d5459d9-5d6b-47c6-90cd-57e268d7067d" containerName="extract"
Jul 27 20:11:33.165166 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:33.165110    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d5459d9-5d6b-47c6-90cd-57e268d7067d" containerName="extract"
Jul 27 20:11:33.165166 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:33.165129    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d5459d9-5d6b-47c6-90cd-57e268d7067d" containerName="pull"
Jul 27 20:11:33.165166 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:33.165135    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d5459d9-5d6b-47c6-90cd-57e268d7067d" containerName="pull"
Jul 27 20:11:33.165166 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:33.165142    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d5459d9-5d6b-47c6-90cd-57e268d7067d" containerName="util"
Jul 27 20:11:33.165166 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:33.165150    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d5459d9-5d6b-47c6-90cd-57e268d7067d" containerName="util"
Jul 27 20:11:33.165317 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:33.165210    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d5459d9-5d6b-47c6-90cd-57e268d7067d" containerName="extract"
Jul 27 20:11:33.218494 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:33.218433    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67944f57b-bl5h9"]
Jul 27 20:11:33.218662 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:33.218565    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-67944f57b-bl5h9"
Jul 27 20:11:33.221300 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:33.221256    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 27 20:11:33.221492 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:33.221304    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-nflwb\""
Jul 27 20:11:33.221621 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:33.221602    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 27 20:11:33.221669 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:33.221656    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 27 20:11:33.221712 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:33.221656    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 27 20:11:33.278317 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:33.278278    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6bbd94fb-4407-41ac-a3fd-c03150ba8728-webhook-cert\") pod \"opendatahub-operator-controller-manager-67944f57b-bl5h9\" (UID: \"6bbd94fb-4407-41ac-a3fd-c03150ba8728\") " pod="opendatahub/opendatahub-operator-controller-manager-67944f57b-bl5h9"
Jul 27 20:11:33.278514 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:33.278320    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5dj8\" (UniqueName: \"kubernetes.io/projected/6bbd94fb-4407-41ac-a3fd-c03150ba8728-kube-api-access-d5dj8\") pod \"opendatahub-operator-controller-manager-67944f57b-bl5h9\" (UID: \"6bbd94fb-4407-41ac-a3fd-c03150ba8728\") " pod="opendatahub/opendatahub-operator-controller-manager-67944f57b-bl5h9"
Jul 27 20:11:33.278514 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:33.278412    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6bbd94fb-4407-41ac-a3fd-c03150ba8728-tmp\") pod \"opendatahub-operator-controller-manager-67944f57b-bl5h9\" (UID: \"6bbd94fb-4407-41ac-a3fd-c03150ba8728\") " pod="opendatahub/opendatahub-operator-controller-manager-67944f57b-bl5h9"
Jul 27 20:11:33.278514 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:33.278483    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6bbd94fb-4407-41ac-a3fd-c03150ba8728-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67944f57b-bl5h9\" (UID: \"6bbd94fb-4407-41ac-a3fd-c03150ba8728\") " pod="opendatahub/opendatahub-operator-controller-manager-67944f57b-bl5h9"
Jul 27 20:11:33.278662 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:33.278538    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6bbd94fb-4407-41ac-a3fd-c03150ba8728-manifests\") pod \"opendatahub-operator-controller-manager-67944f57b-bl5h9\" (UID: \"6bbd94fb-4407-41ac-a3fd-c03150ba8728\") " pod="opendatahub/opendatahub-operator-controller-manager-67944f57b-bl5h9"
Jul 27 20:11:33.301221 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:33.301132    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:11:33.379211 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:33.379166    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5dj8\" (UniqueName: \"kubernetes.io/projected/6bbd94fb-4407-41ac-a3fd-c03150ba8728-kube-api-access-d5dj8\") pod \"opendatahub-operator-controller-manager-67944f57b-bl5h9\" (UID: \"6bbd94fb-4407-41ac-a3fd-c03150ba8728\") " pod="opendatahub/opendatahub-operator-controller-manager-67944f57b-bl5h9"
Jul 27 20:11:33.379403 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:33.379244    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6bbd94fb-4407-41ac-a3fd-c03150ba8728-tmp\") pod \"opendatahub-operator-controller-manager-67944f57b-bl5h9\" (UID: \"6bbd94fb-4407-41ac-a3fd-c03150ba8728\") " pod="opendatahub/opendatahub-operator-controller-manager-67944f57b-bl5h9"
Jul 27 20:11:33.379403 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:33.379278    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6bbd94fb-4407-41ac-a3fd-c03150ba8728-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67944f57b-bl5h9\" (UID: \"6bbd94fb-4407-41ac-a3fd-c03150ba8728\") " pod="opendatahub/opendatahub-operator-controller-manager-67944f57b-bl5h9"
Jul 27 20:11:33.379403 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:33.379325    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6bbd94fb-4407-41ac-a3fd-c03150ba8728-manifests\") pod \"opendatahub-operator-controller-manager-67944f57b-bl5h9\" (UID: \"6bbd94fb-4407-41ac-a3fd-c03150ba8728\") " pod="opendatahub/opendatahub-operator-controller-manager-67944f57b-bl5h9"
Jul 27 20:11:33.379403 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:33.379358    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6bbd94fb-4407-41ac-a3fd-c03150ba8728-webhook-cert\") pod \"opendatahub-operator-controller-manager-67944f57b-bl5h9\" (UID: \"6bbd94fb-4407-41ac-a3fd-c03150ba8728\") " pod="opendatahub/opendatahub-operator-controller-manager-67944f57b-bl5h9"
Jul 27 20:11:33.379802 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:33.379780    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6bbd94fb-4407-41ac-a3fd-c03150ba8728-manifests\") pod \"opendatahub-operator-controller-manager-67944f57b-bl5h9\" (UID: \"6bbd94fb-4407-41ac-a3fd-c03150ba8728\") " pod="opendatahub/opendatahub-operator-controller-manager-67944f57b-bl5h9"
Jul 27 20:11:33.381960 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:33.381925    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6bbd94fb-4407-41ac-a3fd-c03150ba8728-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67944f57b-bl5h9\" (UID: \"6bbd94fb-4407-41ac-a3fd-c03150ba8728\") " pod="opendatahub/opendatahub-operator-controller-manager-67944f57b-bl5h9"
Jul 27 20:11:33.382165 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:33.382143    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6bbd94fb-4407-41ac-a3fd-c03150ba8728-tmp\") pod \"opendatahub-operator-controller-manager-67944f57b-bl5h9\" (UID: \"6bbd94fb-4407-41ac-a3fd-c03150ba8728\") " pod="opendatahub/opendatahub-operator-controller-manager-67944f57b-bl5h9"
Jul 27 20:11:33.382275 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:33.382259    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6bbd94fb-4407-41ac-a3fd-c03150ba8728-webhook-cert\") pod \"opendatahub-operator-controller-manager-67944f57b-bl5h9\" (UID: \"6bbd94fb-4407-41ac-a3fd-c03150ba8728\") " pod="opendatahub/opendatahub-operator-controller-manager-67944f57b-bl5h9"
Jul 27 20:11:33.387899 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:33.387871    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5dj8\" (UniqueName: \"kubernetes.io/projected/6bbd94fb-4407-41ac-a3fd-c03150ba8728-kube-api-access-d5dj8\") pod \"opendatahub-operator-controller-manager-67944f57b-bl5h9\" (UID: \"6bbd94fb-4407-41ac-a3fd-c03150ba8728\") " pod="opendatahub/opendatahub-operator-controller-manager-67944f57b-bl5h9"
Jul 27 20:11:33.397543 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:33.397509    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:11:33.496728 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:33.496658    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:11:33.528735 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:33.528703    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-67944f57b-bl5h9"
Jul 27 20:11:33.600967 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:33.600931    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:11:33.701322 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:33.701299    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67944f57b-bl5h9"]
Jul 27 20:11:33.704118 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:11:33.704083    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bbd94fb_4407_41ac_a3fd_c03150ba8728.slice/crio-8c6ae15da6becb578b1d1bdb813cb8463fe983686686d744c77b0b04fc76cc14 WatchSource:0}: Error finding container 8c6ae15da6becb578b1d1bdb813cb8463fe983686686d744c77b0b04fc76cc14: Status 404 returned error can't find the container with id 8c6ae15da6becb578b1d1bdb813cb8463fe983686686d744c77b0b04fc76cc14
Jul 27 20:11:33.705758 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:33.705735    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:11:33.787109 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:33.787074    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:11:33.826368 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:33.826287    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67944f57b-bl5h9" event={"ID":"6bbd94fb-4407-41ac-a3fd-c03150ba8728","Type":"ContainerStarted","Data":"8c6ae15da6becb578b1d1bdb813cb8463fe983686686d744c77b0b04fc76cc14"}
Jul 27 20:11:33.889817 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:33.889778    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:11:36.842837 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:36.842798    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67944f57b-bl5h9" event={"ID":"6bbd94fb-4407-41ac-a3fd-c03150ba8728","Type":"ContainerStarted","Data":"5ee44cbd7da5a8e48373e5a83eed780859a8ad8d91af04da84a43c9d9bcd9396"}
Jul 27 20:11:37.849890 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:37.849854    2557 generic.go:356] "Generic (PLEG): container finished" podID="6bbd94fb-4407-41ac-a3fd-c03150ba8728" containerID="5ee44cbd7da5a8e48373e5a83eed780859a8ad8d91af04da84a43c9d9bcd9396" exitCode=0
Jul 27 20:11:37.850364 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:37.849984    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67944f57b-bl5h9" event={"ID":"6bbd94fb-4407-41ac-a3fd-c03150ba8728","Type":"ContainerDied","Data":"5ee44cbd7da5a8e48373e5a83eed780859a8ad8d91af04da84a43c9d9bcd9396"}
Jul 27 20:11:38.857607 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:38.857567    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67944f57b-bl5h9" event={"ID":"6bbd94fb-4407-41ac-a3fd-c03150ba8728","Type":"ContainerStarted","Data":"0dd44f14327ad48890aff71f24f9642390de0c505ef2d6d6f012a4bdb193f8c5"}
Jul 27 20:11:38.857970 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:38.857720    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-67944f57b-bl5h9"
Jul 27 20:11:38.886792 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:38.886688    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-67944f57b-bl5h9" podStartSLOduration=1.395279074 podStartE2EDuration="5.88667066s" totalImagesPullingTime="3.488778057s" totalInitContainerRuntime="1.002613529s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:11:33 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:11:38.8850833 +0000 UTC m=+447.459809699" watchObservedRunningTime="2026-07-27 20:11:38.88667066 +0000 UTC m=+447.461397049"
Jul 27 20:11:44.718825 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:44.718793    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:11:44.805559 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:44.805520    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:11:47.365945 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:47.365901    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:11:47.470259 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:47.470220    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:11:49.864350 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:49.864319    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-67944f57b-bl5h9"
Jul 27 20:11:51.271349 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:51.271314    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7f9b5765bb-c28mp"]
Jul 27 20:11:51.279601 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:51.279578    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7f9b5765bb-c28mp"
Jul 27 20:11:51.282969 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:51.282942    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 27 20:11:51.283100 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:51.282994    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 27 20:11:51.283100 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:51.283014    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 27 20:11:51.283100 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:51.283076    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 27 20:11:51.283294 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:51.283273    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 27 20:11:51.283386 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:51.283353    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-cndlz\""
Jul 27 20:11:51.284668 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:51.284649    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7f9b5765bb-c28mp"]
Jul 27 20:11:51.442813 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:51.442775    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3df8d979-ae40-4bdc-bd95-5bebeddf80a3-cert\") pod \"lws-controller-manager-7f9b5765bb-c28mp\" (UID: \"3df8d979-ae40-4bdc-bd95-5bebeddf80a3\") " pod="openshift-lws-operator/lws-controller-manager-7f9b5765bb-c28mp"
Jul 27 20:11:51.442992 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:51.442835    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tcnk\" (UniqueName: \"kubernetes.io/projected/3df8d979-ae40-4bdc-bd95-5bebeddf80a3-kube-api-access-9tcnk\") pod \"lws-controller-manager-7f9b5765bb-c28mp\" (UID: \"3df8d979-ae40-4bdc-bd95-5bebeddf80a3\") " pod="openshift-lws-operator/lws-controller-manager-7f9b5765bb-c28mp"
Jul 27 20:11:51.442992 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:51.442924    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3df8d979-ae40-4bdc-bd95-5bebeddf80a3-metrics-cert\") pod \"lws-controller-manager-7f9b5765bb-c28mp\" (UID: \"3df8d979-ae40-4bdc-bd95-5bebeddf80a3\") " pod="openshift-lws-operator/lws-controller-manager-7f9b5765bb-c28mp"
Jul 27 20:11:51.442992 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:51.442961    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3df8d979-ae40-4bdc-bd95-5bebeddf80a3-manager-config\") pod \"lws-controller-manager-7f9b5765bb-c28mp\" (UID: \"3df8d979-ae40-4bdc-bd95-5bebeddf80a3\") " pod="openshift-lws-operator/lws-controller-manager-7f9b5765bb-c28mp"
Jul 27 20:11:51.543943 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:51.543852    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3df8d979-ae40-4bdc-bd95-5bebeddf80a3-cert\") pod \"lws-controller-manager-7f9b5765bb-c28mp\" (UID: \"3df8d979-ae40-4bdc-bd95-5bebeddf80a3\") " pod="openshift-lws-operator/lws-controller-manager-7f9b5765bb-c28mp"
Jul 27 20:11:51.543943 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:51.543900    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tcnk\" (UniqueName: \"kubernetes.io/projected/3df8d979-ae40-4bdc-bd95-5bebeddf80a3-kube-api-access-9tcnk\") pod \"lws-controller-manager-7f9b5765bb-c28mp\" (UID: \"3df8d979-ae40-4bdc-bd95-5bebeddf80a3\") " pod="openshift-lws-operator/lws-controller-manager-7f9b5765bb-c28mp"
Jul 27 20:11:51.543943 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:51.543933    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3df8d979-ae40-4bdc-bd95-5bebeddf80a3-metrics-cert\") pod \"lws-controller-manager-7f9b5765bb-c28mp\" (UID: \"3df8d979-ae40-4bdc-bd95-5bebeddf80a3\") " pod="openshift-lws-operator/lws-controller-manager-7f9b5765bb-c28mp"
Jul 27 20:11:51.544227 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:51.543952    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3df8d979-ae40-4bdc-bd95-5bebeddf80a3-manager-config\") pod \"lws-controller-manager-7f9b5765bb-c28mp\" (UID: \"3df8d979-ae40-4bdc-bd95-5bebeddf80a3\") " pod="openshift-lws-operator/lws-controller-manager-7f9b5765bb-c28mp"
Jul 27 20:11:51.544618 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:51.544596    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3df8d979-ae40-4bdc-bd95-5bebeddf80a3-manager-config\") pod \"lws-controller-manager-7f9b5765bb-c28mp\" (UID: \"3df8d979-ae40-4bdc-bd95-5bebeddf80a3\") " pod="openshift-lws-operator/lws-controller-manager-7f9b5765bb-c28mp"
Jul 27 20:11:51.546328 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:51.546299    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3df8d979-ae40-4bdc-bd95-5bebeddf80a3-cert\") pod \"lws-controller-manager-7f9b5765bb-c28mp\" (UID: \"3df8d979-ae40-4bdc-bd95-5bebeddf80a3\") " pod="openshift-lws-operator/lws-controller-manager-7f9b5765bb-c28mp"
Jul 27 20:11:51.546437 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:51.546419    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3df8d979-ae40-4bdc-bd95-5bebeddf80a3-metrics-cert\") pod \"lws-controller-manager-7f9b5765bb-c28mp\" (UID: \"3df8d979-ae40-4bdc-bd95-5bebeddf80a3\") " pod="openshift-lws-operator/lws-controller-manager-7f9b5765bb-c28mp"
Jul 27 20:11:51.558596 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:51.558575    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tcnk\" (UniqueName: \"kubernetes.io/projected/3df8d979-ae40-4bdc-bd95-5bebeddf80a3-kube-api-access-9tcnk\") pod \"lws-controller-manager-7f9b5765bb-c28mp\" (UID: \"3df8d979-ae40-4bdc-bd95-5bebeddf80a3\") " pod="openshift-lws-operator/lws-controller-manager-7f9b5765bb-c28mp"
Jul 27 20:11:51.591394 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:51.591360    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7f9b5765bb-c28mp"
Jul 27 20:11:51.742283 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:51.742257    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7f9b5765bb-c28mp"]
Jul 27 20:11:51.745065 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:11:51.745033    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3df8d979_ae40_4bdc_bd95_5bebeddf80a3.slice/crio-b467392c9e6cc883ef1d174ecf62e55de7e8e01f52f1d6b67afdbf3b477f2b9a WatchSource:0}: Error finding container b467392c9e6cc883ef1d174ecf62e55de7e8e01f52f1d6b67afdbf3b477f2b9a: Status 404 returned error can't find the container with id b467392c9e6cc883ef1d174ecf62e55de7e8e01f52f1d6b67afdbf3b477f2b9a
Jul 27 20:11:51.918153 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:51.918071    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7f9b5765bb-c28mp" event={"ID":"3df8d979-ae40-4bdc-bd95-5bebeddf80a3","Type":"ContainerStarted","Data":"b467392c9e6cc883ef1d174ecf62e55de7e8e01f52f1d6b67afdbf3b477f2b9a"}
Jul 27 20:11:52.126089 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:52.126054    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:11:52.261372 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:52.261335    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:11:52.797751 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:52.797682    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:11:52.874896 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:52.874832    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-c9f4f89b5-v6th7"]
Jul 27 20:11:52.878340 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:52.878318    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-c9f4f89b5-v6th7"
Jul 27 20:11:52.883331 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:52.883295    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 27 20:11:52.883534 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:52.883351    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 27 20:11:52.883534 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:52.883308    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-rn2xj\""
Jul 27 20:11:52.904719 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:52.904685    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-c9f4f89b5-v6th7"]
Jul 27 20:11:52.955395 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:52.955361    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tl62h\" (UniqueName: \"kubernetes.io/projected/d791007e-8813-475d-8f39-919a47610c39-kube-api-access-tl62h\") pod \"kube-auth-proxy-c9f4f89b5-v6th7\" (UID: \"d791007e-8813-475d-8f39-919a47610c39\") " pod="openshift-ingress/kube-auth-proxy-c9f4f89b5-v6th7"
Jul 27 20:11:52.955590 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:52.955468    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d791007e-8813-475d-8f39-919a47610c39-tmp\") pod \"kube-auth-proxy-c9f4f89b5-v6th7\" (UID: \"d791007e-8813-475d-8f39-919a47610c39\") " pod="openshift-ingress/kube-auth-proxy-c9f4f89b5-v6th7"
Jul 27 20:11:52.955590 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:52.955555    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d791007e-8813-475d-8f39-919a47610c39-tls-certs\") pod \"kube-auth-proxy-c9f4f89b5-v6th7\" (UID: \"d791007e-8813-475d-8f39-919a47610c39\") " pod="openshift-ingress/kube-auth-proxy-c9f4f89b5-v6th7"
Jul 27 20:11:53.056247 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:53.056145    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d791007e-8813-475d-8f39-919a47610c39-tls-certs\") pod \"kube-auth-proxy-c9f4f89b5-v6th7\" (UID: \"d791007e-8813-475d-8f39-919a47610c39\") " pod="openshift-ingress/kube-auth-proxy-c9f4f89b5-v6th7"
Jul 27 20:11:53.056247 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:53.056220    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tl62h\" (UniqueName: \"kubernetes.io/projected/d791007e-8813-475d-8f39-919a47610c39-kube-api-access-tl62h\") pod \"kube-auth-proxy-c9f4f89b5-v6th7\" (UID: \"d791007e-8813-475d-8f39-919a47610c39\") " pod="openshift-ingress/kube-auth-proxy-c9f4f89b5-v6th7"
Jul 27 20:11:53.056522 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:53.056263    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d791007e-8813-475d-8f39-919a47610c39-tmp\") pod \"kube-auth-proxy-c9f4f89b5-v6th7\" (UID: \"d791007e-8813-475d-8f39-919a47610c39\") " pod="openshift-ingress/kube-auth-proxy-c9f4f89b5-v6th7"
Jul 27 20:11:53.056522 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:11:53.056310    2557 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 27 20:11:53.056522 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:11:53.056390    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d791007e-8813-475d-8f39-919a47610c39-tls-certs podName:d791007e-8813-475d-8f39-919a47610c39 nodeName:}" failed. No retries permitted until 2026-07-27 20:11:53.556368582 +0000 UTC m=+462.131094951 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/d791007e-8813-475d-8f39-919a47610c39-tls-certs") pod "kube-auth-proxy-c9f4f89b5-v6th7" (UID: "d791007e-8813-475d-8f39-919a47610c39") : secret "kube-auth-proxy-tls" not found
Jul 27 20:11:53.059244 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:53.059211    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d791007e-8813-475d-8f39-919a47610c39-tmp\") pod \"kube-auth-proxy-c9f4f89b5-v6th7\" (UID: \"d791007e-8813-475d-8f39-919a47610c39\") " pod="openshift-ingress/kube-auth-proxy-c9f4f89b5-v6th7"
Jul 27 20:11:53.087793 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:53.087757    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tl62h\" (UniqueName: \"kubernetes.io/projected/d791007e-8813-475d-8f39-919a47610c39-kube-api-access-tl62h\") pod \"kube-auth-proxy-c9f4f89b5-v6th7\" (UID: \"d791007e-8813-475d-8f39-919a47610c39\") " pod="openshift-ingress/kube-auth-proxy-c9f4f89b5-v6th7"
Jul 27 20:11:53.385205 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:53.385107    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:11:53.482080 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:53.482047    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:11:53.560650 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:53.560605    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d791007e-8813-475d-8f39-919a47610c39-tls-certs\") pod \"kube-auth-proxy-c9f4f89b5-v6th7\" (UID: \"d791007e-8813-475d-8f39-919a47610c39\") " pod="openshift-ingress/kube-auth-proxy-c9f4f89b5-v6th7"
Jul 27 20:11:53.563214 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:53.563194    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d791007e-8813-475d-8f39-919a47610c39-tls-certs\") pod \"kube-auth-proxy-c9f4f89b5-v6th7\" (UID: \"d791007e-8813-475d-8f39-919a47610c39\") " pod="openshift-ingress/kube-auth-proxy-c9f4f89b5-v6th7"
Jul 27 20:11:53.791956 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:53.791918    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-c9f4f89b5-v6th7"
Jul 27 20:11:53.814811 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:53.814776    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:11:53.932878 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:53.932839    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7f9b5765bb-c28mp" event={"ID":"3df8d979-ae40-4bdc-bd95-5bebeddf80a3","Type":"ContainerStarted","Data":"e80c051e1f83de511e8decd3be159672d225760baf648d8051c3f6bac1d2c163"}
Jul 27 20:11:53.933047 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:53.932949    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7f9b5765bb-c28mp"
Jul 27 20:11:53.960834 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:53.960782    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7f9b5765bb-c28mp" podStartSLOduration=1.208522268 podStartE2EDuration="2.960765557s" totalImagesPullingTime="1.752243289s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:11:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:11:53.958648973 +0000 UTC m=+462.533375387" watchObservedRunningTime="2026-07-27 20:11:53.960765557 +0000 UTC m=+462.535491944"
Jul 27 20:11:53.967294 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:53.967270    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-c9f4f89b5-v6th7"]
Jul 27 20:11:53.969920 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:11:53.969894    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd791007e_8813_475d_8f39_919a47610c39.slice/crio-4a87cecea3be5a8b885dc3c4a4bcbc60642849e2b93ed23a4348e622bc11dfbe WatchSource:0}: Error finding container 4a87cecea3be5a8b885dc3c4a4bcbc60642849e2b93ed23a4348e622bc11dfbe: Status 404 returned error can't find the container with id 4a87cecea3be5a8b885dc3c4a4bcbc60642849e2b93ed23a4348e622bc11dfbe
Jul 27 20:11:54.185278 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:54.185196    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:11:54.590056 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:54.590021    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:11:54.798091 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:54.798053    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:11:54.907006 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:54.906922    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:11:54.946854 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:54.946802    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-c9f4f89b5-v6th7" event={"ID":"d791007e-8813-475d-8f39-919a47610c39","Type":"ContainerStarted","Data":"4a87cecea3be5a8b885dc3c4a4bcbc60642849e2b93ed23a4348e622bc11dfbe"}
Jul 27 20:11:56.188975 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:56.188937    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:11:56.958128 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:56.958089    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-c9f4f89b5-v6th7" event={"ID":"d791007e-8813-475d-8f39-919a47610c39","Type":"ContainerStarted","Data":"38c25352a21fd133e025d9dba299e9f1d0f4e9c40a1cb1ba4b63e126fe14816e"}
Jul 27 20:11:56.974864 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:11:56.974700    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-c9f4f89b5-v6th7" podStartSLOduration=2.209576356 podStartE2EDuration="4.974681365s" totalImagesPullingTime="2.765105009s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:11:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:11:56.974065313 +0000 UTC m=+465.548791729" watchObservedRunningTime="2026-07-27 20:11:56.974681365 +0000 UTC m=+465.549407756"
Jul 27 20:12:00.698741 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:12:00.698705    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:12:00.800742 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:12:00.800701    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:12:01.015662 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:12:01.015630    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:12:01.283518 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:12:01.283410    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:12:01.369360 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:12:01.369328    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:12:04.078786 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:12:04.078732    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:12:04.200653 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:12:04.200609    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:12:04.378767 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:12:04.378680    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:12:04.597245 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:12:04.597214    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:12:04.777123 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:12:04.777080    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:12:04.949603 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:12:04.949578    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7f9b5765bb-c28mp"
Jul 27 20:12:27.513484 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:12:27.513418    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:12:27.570188 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:12:27.570138    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:12:47.404839 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:12:47.404804    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:12:53.618185 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:12:53.618136    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:12:53.714164 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:12:53.714128    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:12:53.850119 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:12:53.850082    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:13:09.143065 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:09.142979    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73224sl"]
Jul 27 20:13:09.146742 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:09.146719    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73224sl"
Jul 27 20:13:09.149624 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:09.149602    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-f9gbg\""
Jul 27 20:13:09.150513 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:09.150495    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 27 20:13:09.150610 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:09.150547    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 27 20:13:09.160110 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:09.160089    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73224sl"]
Jul 27 20:13:09.202260 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:09.202231    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1f28c73-9a95-401a-aa5c-2014fe34d569-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73224sl\" (UID: \"f1f28c73-9a95-401a-aa5c-2014fe34d569\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73224sl"
Jul 27 20:13:09.202421 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:09.202273    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nvvm\" (UniqueName: \"kubernetes.io/projected/f1f28c73-9a95-401a-aa5c-2014fe34d569-kube-api-access-6nvvm\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73224sl\" (UID: \"f1f28c73-9a95-401a-aa5c-2014fe34d569\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73224sl"
Jul 27 20:13:09.202421 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:09.202305    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1f28c73-9a95-401a-aa5c-2014fe34d569-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73224sl\" (UID: \"f1f28c73-9a95-401a-aa5c-2014fe34d569\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73224sl"
Jul 27 20:13:09.302924 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:09.302894    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1f28c73-9a95-401a-aa5c-2014fe34d569-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73224sl\" (UID: \"f1f28c73-9a95-401a-aa5c-2014fe34d569\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73224sl"
Jul 27 20:13:09.303063 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:09.302929    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nvvm\" (UniqueName: \"kubernetes.io/projected/f1f28c73-9a95-401a-aa5c-2014fe34d569-kube-api-access-6nvvm\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73224sl\" (UID: \"f1f28c73-9a95-401a-aa5c-2014fe34d569\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73224sl"
Jul 27 20:13:09.303063 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:09.302950    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1f28c73-9a95-401a-aa5c-2014fe34d569-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73224sl\" (UID: \"f1f28c73-9a95-401a-aa5c-2014fe34d569\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73224sl"
Jul 27 20:13:09.303278 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:09.303260    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1f28c73-9a95-401a-aa5c-2014fe34d569-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73224sl\" (UID: \"f1f28c73-9a95-401a-aa5c-2014fe34d569\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73224sl"
Jul 27 20:13:09.303316 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:09.303288    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1f28c73-9a95-401a-aa5c-2014fe34d569-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73224sl\" (UID: \"f1f28c73-9a95-401a-aa5c-2014fe34d569\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73224sl"
Jul 27 20:13:09.312029 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:09.312006    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nvvm\" (UniqueName: \"kubernetes.io/projected/f1f28c73-9a95-401a-aa5c-2014fe34d569-kube-api-access-6nvvm\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73224sl\" (UID: \"f1f28c73-9a95-401a-aa5c-2014fe34d569\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73224sl"
Jul 27 20:13:09.456361 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:09.456278    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73224sl"
Jul 27 20:13:09.593663 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:09.593637    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73224sl"]
Jul 27 20:13:09.595305 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:13:09.595280    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1f28c73_9a95_401a_aa5c_2014fe34d569.slice/crio-c664fae1dff63a79a1daa255b31d7382b39d02fce5fb881a2a0ff3091c993499 WatchSource:0}: Error finding container c664fae1dff63a79a1daa255b31d7382b39d02fce5fb881a2a0ff3091c993499: Status 404 returned error can't find the container with id c664fae1dff63a79a1daa255b31d7382b39d02fce5fb881a2a0ff3091c993499
Jul 27 20:13:09.939921 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:09.939886    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tlh72"]
Jul 27 20:13:09.943281 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:09.943262    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tlh72"
Jul 27 20:13:09.952301 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:09.952278    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tlh72"]
Jul 27 20:13:10.009156 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:10.009097    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a3bbd56f-2091-40e6-92a4-bb2050447750-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tlh72\" (UID: \"a3bbd56f-2091-40e6-92a4-bb2050447750\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tlh72"
Jul 27 20:13:10.009343 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:10.009196    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a3bbd56f-2091-40e6-92a4-bb2050447750-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tlh72\" (UID: \"a3bbd56f-2091-40e6-92a4-bb2050447750\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tlh72"
Jul 27 20:13:10.009343 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:10.009241    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdcql\" (UniqueName: \"kubernetes.io/projected/a3bbd56f-2091-40e6-92a4-bb2050447750-kube-api-access-xdcql\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tlh72\" (UID: \"a3bbd56f-2091-40e6-92a4-bb2050447750\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tlh72"
Jul 27 20:13:10.109909 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:10.109850    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a3bbd56f-2091-40e6-92a4-bb2050447750-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tlh72\" (UID: \"a3bbd56f-2091-40e6-92a4-bb2050447750\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tlh72"
Jul 27 20:13:10.110073 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:10.109928    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdcql\" (UniqueName: \"kubernetes.io/projected/a3bbd56f-2091-40e6-92a4-bb2050447750-kube-api-access-xdcql\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tlh72\" (UID: \"a3bbd56f-2091-40e6-92a4-bb2050447750\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tlh72"
Jul 27 20:13:10.110073 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:10.109970    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a3bbd56f-2091-40e6-92a4-bb2050447750-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tlh72\" (UID: \"a3bbd56f-2091-40e6-92a4-bb2050447750\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tlh72"
Jul 27 20:13:10.110221 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:10.110200    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a3bbd56f-2091-40e6-92a4-bb2050447750-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tlh72\" (UID: \"a3bbd56f-2091-40e6-92a4-bb2050447750\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tlh72"
Jul 27 20:13:10.110322 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:10.110304    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a3bbd56f-2091-40e6-92a4-bb2050447750-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tlh72\" (UID: \"a3bbd56f-2091-40e6-92a4-bb2050447750\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tlh72"
Jul 27 20:13:10.118640 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:10.118616    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdcql\" (UniqueName: \"kubernetes.io/projected/a3bbd56f-2091-40e6-92a4-bb2050447750-kube-api-access-xdcql\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tlh72\" (UID: \"a3bbd56f-2091-40e6-92a4-bb2050447750\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tlh72"
Jul 27 20:13:10.253048 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:10.253019    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tlh72"
Jul 27 20:13:10.288469 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:10.288421    2557 generic.go:356] "Generic (PLEG): container finished" podID="f1f28c73-9a95-401a-aa5c-2014fe34d569" containerID="fa7f6ed906ca0ea47ef739922dafa31f24d114020856f79139574cd17c48fdea" exitCode=0
Jul 27 20:13:10.288638 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:10.288495    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73224sl" event={"ID":"f1f28c73-9a95-401a-aa5c-2014fe34d569","Type":"ContainerDied","Data":"fa7f6ed906ca0ea47ef739922dafa31f24d114020856f79139574cd17c48fdea"}
Jul 27 20:13:10.288638 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:10.288545    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73224sl" event={"ID":"f1f28c73-9a95-401a-aa5c-2014fe34d569","Type":"ContainerStarted","Data":"c664fae1dff63a79a1daa255b31d7382b39d02fce5fb881a2a0ff3091c993499"}
Jul 27 20:13:10.392313 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:10.392286    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tlh72"]
Jul 27 20:13:10.393720 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:13:10.393688    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3bbd56f_2091_40e6_92a4_bb2050447750.slice/crio-be6b47a6f1559e5d0b142a9478375e779c308faa49ac8cf410bf051436fda490 WatchSource:0}: Error finding container be6b47a6f1559e5d0b142a9478375e779c308faa49ac8cf410bf051436fda490: Status 404 returned error can't find the container with id be6b47a6f1559e5d0b142a9478375e779c308faa49ac8cf410bf051436fda490
Jul 27 20:13:10.750353 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:10.750326    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x5f9t"]
Jul 27 20:13:10.754302 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:10.754285    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x5f9t"
Jul 27 20:13:10.763400 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:10.763378    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x5f9t"]
Jul 27 20:13:10.815560 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:10.815525    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e5cb12b-b83d-4906-b247-e76e13ab5dfb-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x5f9t\" (UID: \"1e5cb12b-b83d-4906-b247-e76e13ab5dfb\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x5f9t"
Jul 27 20:13:10.815704 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:10.815566    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e5cb12b-b83d-4906-b247-e76e13ab5dfb-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x5f9t\" (UID: \"1e5cb12b-b83d-4906-b247-e76e13ab5dfb\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x5f9t"
Jul 27 20:13:10.815704 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:10.815589    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghff4\" (UniqueName: \"kubernetes.io/projected/1e5cb12b-b83d-4906-b247-e76e13ab5dfb-kube-api-access-ghff4\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x5f9t\" (UID: \"1e5cb12b-b83d-4906-b247-e76e13ab5dfb\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x5f9t"
Jul 27 20:13:10.916517 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:10.916486    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e5cb12b-b83d-4906-b247-e76e13ab5dfb-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x5f9t\" (UID: \"1e5cb12b-b83d-4906-b247-e76e13ab5dfb\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x5f9t"
Jul 27 20:13:10.916682 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:10.916524    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e5cb12b-b83d-4906-b247-e76e13ab5dfb-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x5f9t\" (UID: \"1e5cb12b-b83d-4906-b247-e76e13ab5dfb\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x5f9t"
Jul 27 20:13:10.916682 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:10.916551    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghff4\" (UniqueName: \"kubernetes.io/projected/1e5cb12b-b83d-4906-b247-e76e13ab5dfb-kube-api-access-ghff4\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x5f9t\" (UID: \"1e5cb12b-b83d-4906-b247-e76e13ab5dfb\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x5f9t"
Jul 27 20:13:10.916881 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:10.916861    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e5cb12b-b83d-4906-b247-e76e13ab5dfb-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x5f9t\" (UID: \"1e5cb12b-b83d-4906-b247-e76e13ab5dfb\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x5f9t"
Jul 27 20:13:10.916921 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:10.916891    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e5cb12b-b83d-4906-b247-e76e13ab5dfb-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x5f9t\" (UID: \"1e5cb12b-b83d-4906-b247-e76e13ab5dfb\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x5f9t"
Jul 27 20:13:10.926520 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:10.926490    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghff4\" (UniqueName: \"kubernetes.io/projected/1e5cb12b-b83d-4906-b247-e76e13ab5dfb-kube-api-access-ghff4\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x5f9t\" (UID: \"1e5cb12b-b83d-4906-b247-e76e13ab5dfb\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x5f9t"
Jul 27 20:13:11.063373 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:11.063295    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x5f9t"
Jul 27 20:13:11.184413 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:11.184383    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759snwfw"]
Jul 27 20:13:11.188479 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:11.188418    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759snwfw"
Jul 27 20:13:11.196573 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:11.196549    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759snwfw"]
Jul 27 20:13:11.236282 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:11.236260    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x5f9t"]
Jul 27 20:13:11.242347 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:13:11.242323    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e5cb12b_b83d_4906_b247_e76e13ab5dfb.slice/crio-59915f33fe9fe818e977105b52ec76395faa16b484569c3c350bbd1cd2c78601 WatchSource:0}: Error finding container 59915f33fe9fe818e977105b52ec76395faa16b484569c3c350bbd1cd2c78601: Status 404 returned error can't find the container with id 59915f33fe9fe818e977105b52ec76395faa16b484569c3c350bbd1cd2c78601
Jul 27 20:13:11.296646 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:11.296568    2557 generic.go:356] "Generic (PLEG): container finished" podID="f1f28c73-9a95-401a-aa5c-2014fe34d569" containerID="eb15d152e2d1b961b328a1f9ebc34b13c971465ab961975827ac68759eac3363" exitCode=0
Jul 27 20:13:11.297004 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:11.296651    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73224sl" event={"ID":"f1f28c73-9a95-401a-aa5c-2014fe34d569","Type":"ContainerDied","Data":"eb15d152e2d1b961b328a1f9ebc34b13c971465ab961975827ac68759eac3363"}
Jul 27 20:13:11.298433 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:11.298409    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x5f9t" event={"ID":"1e5cb12b-b83d-4906-b247-e76e13ab5dfb","Type":"ContainerStarted","Data":"59915f33fe9fe818e977105b52ec76395faa16b484569c3c350bbd1cd2c78601"}
Jul 27 20:13:11.299909 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:11.299884    2557 generic.go:356] "Generic (PLEG): container finished" podID="a3bbd56f-2091-40e6-92a4-bb2050447750" containerID="bccf03a039fc7432e49b231f41bcfb485959996d92359f945a9877ec1e0fa683" exitCode=0
Jul 27 20:13:11.299989 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:11.299941    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tlh72" event={"ID":"a3bbd56f-2091-40e6-92a4-bb2050447750","Type":"ContainerDied","Data":"bccf03a039fc7432e49b231f41bcfb485959996d92359f945a9877ec1e0fa683"}
Jul 27 20:13:11.299989 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:11.299977    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tlh72" event={"ID":"a3bbd56f-2091-40e6-92a4-bb2050447750","Type":"ContainerStarted","Data":"be6b47a6f1559e5d0b142a9478375e779c308faa49ac8cf410bf051436fda490"}
Jul 27 20:13:11.323655 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:11.323433    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87f1030a-335b-4bfa-b6ad-915a09c7768e-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759snwfw\" (UID: \"87f1030a-335b-4bfa-b6ad-915a09c7768e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759snwfw"
Jul 27 20:13:11.323655 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:11.323530    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgb65\" (UniqueName: \"kubernetes.io/projected/87f1030a-335b-4bfa-b6ad-915a09c7768e-kube-api-access-mgb65\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759snwfw\" (UID: \"87f1030a-335b-4bfa-b6ad-915a09c7768e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759snwfw"
Jul 27 20:13:11.323857 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:11.323742    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87f1030a-335b-4bfa-b6ad-915a09c7768e-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759snwfw\" (UID: \"87f1030a-335b-4bfa-b6ad-915a09c7768e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759snwfw"
Jul 27 20:13:11.424919 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:11.424889    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87f1030a-335b-4bfa-b6ad-915a09c7768e-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759snwfw\" (UID: \"87f1030a-335b-4bfa-b6ad-915a09c7768e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759snwfw"
Jul 27 20:13:11.425019 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:11.424975    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87f1030a-335b-4bfa-b6ad-915a09c7768e-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759snwfw\" (UID: \"87f1030a-335b-4bfa-b6ad-915a09c7768e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759snwfw"
Jul 27 20:13:11.425019 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:11.424997    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgb65\" (UniqueName: \"kubernetes.io/projected/87f1030a-335b-4bfa-b6ad-915a09c7768e-kube-api-access-mgb65\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759snwfw\" (UID: \"87f1030a-335b-4bfa-b6ad-915a09c7768e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759snwfw"
Jul 27 20:13:11.425306 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:11.425275    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87f1030a-335b-4bfa-b6ad-915a09c7768e-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759snwfw\" (UID: \"87f1030a-335b-4bfa-b6ad-915a09c7768e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759snwfw"
Jul 27 20:13:11.425424 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:11.425359    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87f1030a-335b-4bfa-b6ad-915a09c7768e-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759snwfw\" (UID: \"87f1030a-335b-4bfa-b6ad-915a09c7768e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759snwfw"
Jul 27 20:13:11.437498 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:11.437446    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgb65\" (UniqueName: \"kubernetes.io/projected/87f1030a-335b-4bfa-b6ad-915a09c7768e-kube-api-access-mgb65\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759snwfw\" (UID: \"87f1030a-335b-4bfa-b6ad-915a09c7768e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759snwfw"
Jul 27 20:13:11.530742 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:11.530710    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759snwfw"
Jul 27 20:13:11.664395 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:11.664370    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759snwfw"]
Jul 27 20:13:11.666873 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:13:11.666842    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87f1030a_335b_4bfa_b6ad_915a09c7768e.slice/crio-9d3c8abdb75aabcda473f7fbb72ba5b68761d50823e8e4576b99ebbec5bfa0d3 WatchSource:0}: Error finding container 9d3c8abdb75aabcda473f7fbb72ba5b68761d50823e8e4576b99ebbec5bfa0d3: Status 404 returned error can't find the container with id 9d3c8abdb75aabcda473f7fbb72ba5b68761d50823e8e4576b99ebbec5bfa0d3
Jul 27 20:13:12.306233 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:12.306200    2557 generic.go:356] "Generic (PLEG): container finished" podID="a3bbd56f-2091-40e6-92a4-bb2050447750" containerID="96901c7c88b5a57325f8bd0892b125530f82b532dbba9f08108496e60eca982d" exitCode=0
Jul 27 20:13:12.306615 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:12.306271    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tlh72" event={"ID":"a3bbd56f-2091-40e6-92a4-bb2050447750","Type":"ContainerDied","Data":"96901c7c88b5a57325f8bd0892b125530f82b532dbba9f08108496e60eca982d"}
Jul 27 20:13:12.307813 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:12.307716    2557 generic.go:356] "Generic (PLEG): container finished" podID="87f1030a-335b-4bfa-b6ad-915a09c7768e" containerID="df3afbd6744e2e82c679be4fce0171fd00eee41939fa729787bd7151245e1bd7" exitCode=0
Jul 27 20:13:12.307879 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:12.307854    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759snwfw" event={"ID":"87f1030a-335b-4bfa-b6ad-915a09c7768e","Type":"ContainerDied","Data":"df3afbd6744e2e82c679be4fce0171fd00eee41939fa729787bd7151245e1bd7"}
Jul 27 20:13:12.307923 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:12.307911    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759snwfw" event={"ID":"87f1030a-335b-4bfa-b6ad-915a09c7768e","Type":"ContainerStarted","Data":"9d3c8abdb75aabcda473f7fbb72ba5b68761d50823e8e4576b99ebbec5bfa0d3"}
Jul 27 20:13:12.310191 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:12.310172    2557 generic.go:356] "Generic (PLEG): container finished" podID="f1f28c73-9a95-401a-aa5c-2014fe34d569" containerID="3beea5b738b6e80e0143537c54e751e11b853d059f379a9f6229f7227791dca8" exitCode=0
Jul 27 20:13:12.310282 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:12.310235    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73224sl" event={"ID":"f1f28c73-9a95-401a-aa5c-2014fe34d569","Type":"ContainerDied","Data":"3beea5b738b6e80e0143537c54e751e11b853d059f379a9f6229f7227791dca8"}
Jul 27 20:13:12.311728 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:12.311706    2557 generic.go:356] "Generic (PLEG): container finished" podID="1e5cb12b-b83d-4906-b247-e76e13ab5dfb" containerID="6dea1692d606d0b77a8f9fe115af27facb829c40ab24b9dd3804964644c353c5" exitCode=0
Jul 27 20:13:12.311823 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:12.311752    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x5f9t" event={"ID":"1e5cb12b-b83d-4906-b247-e76e13ab5dfb","Type":"ContainerDied","Data":"6dea1692d606d0b77a8f9fe115af27facb829c40ab24b9dd3804964644c353c5"}
Jul 27 20:13:13.319021 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:13.318994    2557 generic.go:356] "Generic (PLEG): container finished" podID="a3bbd56f-2091-40e6-92a4-bb2050447750" containerID="2ae476aede06ef54e296652a4bc8a3bfbd27bba313e4892942ba2dc78a960cad" exitCode=0
Jul 27 20:13:13.319327 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:13.319083    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tlh72" event={"ID":"a3bbd56f-2091-40e6-92a4-bb2050447750","Type":"ContainerDied","Data":"2ae476aede06ef54e296652a4bc8a3bfbd27bba313e4892942ba2dc78a960cad"}
Jul 27 20:13:13.522801 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:13.522776    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73224sl"
Jul 27 20:13:13.644945 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:13.644914    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1f28c73-9a95-401a-aa5c-2014fe34d569-util\") pod \"f1f28c73-9a95-401a-aa5c-2014fe34d569\" (UID: \"f1f28c73-9a95-401a-aa5c-2014fe34d569\") "
Jul 27 20:13:13.645149 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:13.644982    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1f28c73-9a95-401a-aa5c-2014fe34d569-bundle\") pod \"f1f28c73-9a95-401a-aa5c-2014fe34d569\" (UID: \"f1f28c73-9a95-401a-aa5c-2014fe34d569\") "
Jul 27 20:13:13.645149 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:13.645018    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6nvvm\" (UniqueName: \"kubernetes.io/projected/f1f28c73-9a95-401a-aa5c-2014fe34d569-kube-api-access-6nvvm\") pod \"f1f28c73-9a95-401a-aa5c-2014fe34d569\" (UID: \"f1f28c73-9a95-401a-aa5c-2014fe34d569\") "
Jul 27 20:13:13.645569 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:13.645540    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1f28c73-9a95-401a-aa5c-2014fe34d569-bundle" (OuterVolumeSpecName: "bundle") pod "f1f28c73-9a95-401a-aa5c-2014fe34d569" (UID: "f1f28c73-9a95-401a-aa5c-2014fe34d569"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:13:13.647321 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:13.647300    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1f28c73-9a95-401a-aa5c-2014fe34d569-kube-api-access-6nvvm" (OuterVolumeSpecName: "kube-api-access-6nvvm") pod "f1f28c73-9a95-401a-aa5c-2014fe34d569" (UID: "f1f28c73-9a95-401a-aa5c-2014fe34d569"). InnerVolumeSpecName "kube-api-access-6nvvm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:13:13.651052 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:13.651028    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1f28c73-9a95-401a-aa5c-2014fe34d569-util" (OuterVolumeSpecName: "util") pod "f1f28c73-9a95-401a-aa5c-2014fe34d569" (UID: "f1f28c73-9a95-401a-aa5c-2014fe34d569"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:13:13.746309 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:13.746275    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6nvvm\" (UniqueName: \"kubernetes.io/projected/f1f28c73-9a95-401a-aa5c-2014fe34d569-kube-api-access-6nvvm\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:13:13.746309 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:13.746308    2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1f28c73-9a95-401a-aa5c-2014fe34d569-util\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:13:13.746536 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:13.746319    2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1f28c73-9a95-401a-aa5c-2014fe34d569-bundle\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:13:14.325841 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:14.325803    2557 generic.go:356] "Generic (PLEG): container finished" podID="1e5cb12b-b83d-4906-b247-e76e13ab5dfb" containerID="e19b15c322991d0e05ad7e3e3bb042594f34a5310dd2eea11b20d416ffbad3ce" exitCode=0
Jul 27 20:13:14.326279 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:14.325894    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x5f9t" event={"ID":"1e5cb12b-b83d-4906-b247-e76e13ab5dfb","Type":"ContainerDied","Data":"e19b15c322991d0e05ad7e3e3bb042594f34a5310dd2eea11b20d416ffbad3ce"}
Jul 27 20:13:14.327715 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:14.327691    2557 generic.go:356] "Generic (PLEG): container finished" podID="87f1030a-335b-4bfa-b6ad-915a09c7768e" containerID="16959d0e184c122d7e2bb60893d1367eeeb0f5ec2e941c74de11e2dd22a2887a" exitCode=0
Jul 27 20:13:14.327785 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:14.327767    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759snwfw" event={"ID":"87f1030a-335b-4bfa-b6ad-915a09c7768e","Type":"ContainerDied","Data":"16959d0e184c122d7e2bb60893d1367eeeb0f5ec2e941c74de11e2dd22a2887a"}
Jul 27 20:13:14.329663 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:14.329640    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73224sl" event={"ID":"f1f28c73-9a95-401a-aa5c-2014fe34d569","Type":"ContainerDied","Data":"c664fae1dff63a79a1daa255b31d7382b39d02fce5fb881a2a0ff3091c993499"}
Jul 27 20:13:14.329745 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:14.329672    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73224sl"
Jul 27 20:13:14.329745 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:14.329684    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c664fae1dff63a79a1daa255b31d7382b39d02fce5fb881a2a0ff3091c993499"
Jul 27 20:13:14.475814 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:14.475229    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tlh72"
Jul 27 20:13:14.554061 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:14.554033    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a3bbd56f-2091-40e6-92a4-bb2050447750-util\") pod \"a3bbd56f-2091-40e6-92a4-bb2050447750\" (UID: \"a3bbd56f-2091-40e6-92a4-bb2050447750\") "
Jul 27 20:13:14.554207 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:14.554071    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xdcql\" (UniqueName: \"kubernetes.io/projected/a3bbd56f-2091-40e6-92a4-bb2050447750-kube-api-access-xdcql\") pod \"a3bbd56f-2091-40e6-92a4-bb2050447750\" (UID: \"a3bbd56f-2091-40e6-92a4-bb2050447750\") "
Jul 27 20:13:14.554207 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:14.554147    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a3bbd56f-2091-40e6-92a4-bb2050447750-bundle\") pod \"a3bbd56f-2091-40e6-92a4-bb2050447750\" (UID: \"a3bbd56f-2091-40e6-92a4-bb2050447750\") "
Jul 27 20:13:14.554772 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:14.554744    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3bbd56f-2091-40e6-92a4-bb2050447750-bundle" (OuterVolumeSpecName: "bundle") pod "a3bbd56f-2091-40e6-92a4-bb2050447750" (UID: "a3bbd56f-2091-40e6-92a4-bb2050447750"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:13:14.556136 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:14.556114    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3bbd56f-2091-40e6-92a4-bb2050447750-kube-api-access-xdcql" (OuterVolumeSpecName: "kube-api-access-xdcql") pod "a3bbd56f-2091-40e6-92a4-bb2050447750" (UID: "a3bbd56f-2091-40e6-92a4-bb2050447750"). InnerVolumeSpecName "kube-api-access-xdcql". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:13:14.559117 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:14.559087    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3bbd56f-2091-40e6-92a4-bb2050447750-util" (OuterVolumeSpecName: "util") pod "a3bbd56f-2091-40e6-92a4-bb2050447750" (UID: "a3bbd56f-2091-40e6-92a4-bb2050447750"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:13:14.655741 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:14.655662    2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a3bbd56f-2091-40e6-92a4-bb2050447750-bundle\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:13:14.655741 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:14.655689    2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a3bbd56f-2091-40e6-92a4-bb2050447750-util\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:13:14.655741 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:14.655699    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xdcql\" (UniqueName: \"kubernetes.io/projected/a3bbd56f-2091-40e6-92a4-bb2050447750-kube-api-access-xdcql\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:13:15.337216 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:15.337174    2557 generic.go:356] "Generic (PLEG): container finished" podID="1e5cb12b-b83d-4906-b247-e76e13ab5dfb" containerID="77f94eb38d68164720408a3ef8e34f0bfd51ac2921d33225cdeff993289d3b40" exitCode=0
Jul 27 20:13:15.337686 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:15.337235    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x5f9t" event={"ID":"1e5cb12b-b83d-4906-b247-e76e13ab5dfb","Type":"ContainerDied","Data":"77f94eb38d68164720408a3ef8e34f0bfd51ac2921d33225cdeff993289d3b40"}
Jul 27 20:13:15.339187 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:15.339162    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tlh72" event={"ID":"a3bbd56f-2091-40e6-92a4-bb2050447750","Type":"ContainerDied","Data":"be6b47a6f1559e5d0b142a9478375e779c308faa49ac8cf410bf051436fda490"}
Jul 27 20:13:15.339270 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:15.339199    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="be6b47a6f1559e5d0b142a9478375e779c308faa49ac8cf410bf051436fda490"
Jul 27 20:13:15.339270 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:15.339169    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tlh72"
Jul 27 20:13:15.341412 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:15.341392    2557 generic.go:356] "Generic (PLEG): container finished" podID="87f1030a-335b-4bfa-b6ad-915a09c7768e" containerID="9772af358b2f0fdd38dedc8ffd6f77d5c06927aad7d362b3438cda98a1ff9106" exitCode=0
Jul 27 20:13:15.341541 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:15.341416    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759snwfw" event={"ID":"87f1030a-335b-4bfa-b6ad-915a09c7768e","Type":"ContainerDied","Data":"9772af358b2f0fdd38dedc8ffd6f77d5c06927aad7d362b3438cda98a1ff9106"}
Jul 27 20:13:16.480868 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:16.480841    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759snwfw"
Jul 27 20:13:16.505530 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:16.505509    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x5f9t"
Jul 27 20:13:16.573064 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:16.573031    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e5cb12b-b83d-4906-b247-e76e13ab5dfb-bundle\") pod \"1e5cb12b-b83d-4906-b247-e76e13ab5dfb\" (UID: \"1e5cb12b-b83d-4906-b247-e76e13ab5dfb\") "
Jul 27 20:13:16.573064 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:16.573065    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e5cb12b-b83d-4906-b247-e76e13ab5dfb-util\") pod \"1e5cb12b-b83d-4906-b247-e76e13ab5dfb\" (UID: \"1e5cb12b-b83d-4906-b247-e76e13ab5dfb\") "
Jul 27 20:13:16.573348 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:16.573114    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87f1030a-335b-4bfa-b6ad-915a09c7768e-util\") pod \"87f1030a-335b-4bfa-b6ad-915a09c7768e\" (UID: \"87f1030a-335b-4bfa-b6ad-915a09c7768e\") "
Jul 27 20:13:16.573348 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:16.573158    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mgb65\" (UniqueName: \"kubernetes.io/projected/87f1030a-335b-4bfa-b6ad-915a09c7768e-kube-api-access-mgb65\") pod \"87f1030a-335b-4bfa-b6ad-915a09c7768e\" (UID: \"87f1030a-335b-4bfa-b6ad-915a09c7768e\") "
Jul 27 20:13:16.573348 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:16.573191    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87f1030a-335b-4bfa-b6ad-915a09c7768e-bundle\") pod \"87f1030a-335b-4bfa-b6ad-915a09c7768e\" (UID: \"87f1030a-335b-4bfa-b6ad-915a09c7768e\") "
Jul 27 20:13:16.573348 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:16.573220    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ghff4\" (UniqueName: \"kubernetes.io/projected/1e5cb12b-b83d-4906-b247-e76e13ab5dfb-kube-api-access-ghff4\") pod \"1e5cb12b-b83d-4906-b247-e76e13ab5dfb\" (UID: \"1e5cb12b-b83d-4906-b247-e76e13ab5dfb\") "
Jul 27 20:13:16.573595 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:16.573567    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e5cb12b-b83d-4906-b247-e76e13ab5dfb-bundle" (OuterVolumeSpecName: "bundle") pod "1e5cb12b-b83d-4906-b247-e76e13ab5dfb" (UID: "1e5cb12b-b83d-4906-b247-e76e13ab5dfb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:13:16.574033 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:16.574006    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87f1030a-335b-4bfa-b6ad-915a09c7768e-bundle" (OuterVolumeSpecName: "bundle") pod "87f1030a-335b-4bfa-b6ad-915a09c7768e" (UID: "87f1030a-335b-4bfa-b6ad-915a09c7768e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:13:16.575481 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:16.575440    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e5cb12b-b83d-4906-b247-e76e13ab5dfb-kube-api-access-ghff4" (OuterVolumeSpecName: "kube-api-access-ghff4") pod "1e5cb12b-b83d-4906-b247-e76e13ab5dfb" (UID: "1e5cb12b-b83d-4906-b247-e76e13ab5dfb"). InnerVolumeSpecName "kube-api-access-ghff4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:13:16.575634 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:16.575616    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87f1030a-335b-4bfa-b6ad-915a09c7768e-kube-api-access-mgb65" (OuterVolumeSpecName: "kube-api-access-mgb65") pod "87f1030a-335b-4bfa-b6ad-915a09c7768e" (UID: "87f1030a-335b-4bfa-b6ad-915a09c7768e"). InnerVolumeSpecName "kube-api-access-mgb65". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:13:16.578879 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:16.578854    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e5cb12b-b83d-4906-b247-e76e13ab5dfb-util" (OuterVolumeSpecName: "util") pod "1e5cb12b-b83d-4906-b247-e76e13ab5dfb" (UID: "1e5cb12b-b83d-4906-b247-e76e13ab5dfb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:13:16.579155 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:16.579136    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87f1030a-335b-4bfa-b6ad-915a09c7768e-util" (OuterVolumeSpecName: "util") pod "87f1030a-335b-4bfa-b6ad-915a09c7768e" (UID: "87f1030a-335b-4bfa-b6ad-915a09c7768e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:13:16.674871 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:16.674781    2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87f1030a-335b-4bfa-b6ad-915a09c7768e-util\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:13:16.674871 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:16.674812    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mgb65\" (UniqueName: \"kubernetes.io/projected/87f1030a-335b-4bfa-b6ad-915a09c7768e-kube-api-access-mgb65\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:13:16.674871 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:16.674823    2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87f1030a-335b-4bfa-b6ad-915a09c7768e-bundle\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:13:16.674871 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:16.674832    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ghff4\" (UniqueName: \"kubernetes.io/projected/1e5cb12b-b83d-4906-b247-e76e13ab5dfb-kube-api-access-ghff4\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:13:16.674871 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:16.674854    2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e5cb12b-b83d-4906-b247-e76e13ab5dfb-bundle\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:13:16.674871 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:16.674862    2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e5cb12b-b83d-4906-b247-e76e13ab5dfb-util\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:13:17.353171 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:17.353143    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x5f9t"
Jul 27 20:13:17.353352 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:17.353147    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x5f9t" event={"ID":"1e5cb12b-b83d-4906-b247-e76e13ab5dfb","Type":"ContainerDied","Data":"59915f33fe9fe818e977105b52ec76395faa16b484569c3c350bbd1cd2c78601"}
Jul 27 20:13:17.353352 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:17.353253    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="59915f33fe9fe818e977105b52ec76395faa16b484569c3c350bbd1cd2c78601"
Jul 27 20:13:17.362098 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:17.362070    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759snwfw"
Jul 27 20:13:17.362098 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:17.362075    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759snwfw" event={"ID":"87f1030a-335b-4bfa-b6ad-915a09c7768e","Type":"ContainerDied","Data":"9d3c8abdb75aabcda473f7fbb72ba5b68761d50823e8e4576b99ebbec5bfa0d3"}
Jul 27 20:13:17.362313 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:17.362140    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9d3c8abdb75aabcda473f7fbb72ba5b68761d50823e8e4576b99ebbec5bfa0d3"
Jul 27 20:13:22.758719 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:22.758683    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:13:23.347558 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:23.347528    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:13:24.388321 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:24.388286    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:13:24.493986 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:24.493937    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:13:27.967221 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:27.967172    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:13:30.783508 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:30.783473    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:13:31.444176 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:31.444144    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:13:33.428901 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:33.428861    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:13:33.732281 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:33.732248    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:13:36.452043 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:36.452004    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:13:38.581106 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:38.581060    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:13:38.679787 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:38.679755    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:13:39.043416 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:39.043381    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:13:39.160373 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:39.160333    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:13:42.772887 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:42.772856    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:13:42.876200 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:42.876156    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:13:45.560736 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:45.560697    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:13:45.621579 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:45.621545    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:13:48.091601 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:48.091569    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-28k56"]
Jul 27 20:13:48.091981 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:48.091875    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e5cb12b-b83d-4906-b247-e76e13ab5dfb" containerName="pull"
Jul 27 20:13:48.091981 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:48.091885    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e5cb12b-b83d-4906-b247-e76e13ab5dfb" containerName="pull"
Jul 27 20:13:48.091981 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:48.091894    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e5cb12b-b83d-4906-b247-e76e13ab5dfb" containerName="extract"
Jul 27 20:13:48.091981 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:48.091899    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e5cb12b-b83d-4906-b247-e76e13ab5dfb" containerName="extract"
Jul 27 20:13:48.091981 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:48.091908    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3bbd56f-2091-40e6-92a4-bb2050447750" containerName="pull"
Jul 27 20:13:48.091981 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:48.091913    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3bbd56f-2091-40e6-92a4-bb2050447750" containerName="pull"
Jul 27 20:13:48.091981 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:48.091921    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1f28c73-9a95-401a-aa5c-2014fe34d569" containerName="util"
Jul 27 20:13:48.091981 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:48.091925    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1f28c73-9a95-401a-aa5c-2014fe34d569" containerName="util"
Jul 27 20:13:48.091981 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:48.091931    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1f28c73-9a95-401a-aa5c-2014fe34d569" containerName="pull"
Jul 27 20:13:48.091981 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:48.091936    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1f28c73-9a95-401a-aa5c-2014fe34d569" containerName="pull"
Jul 27 20:13:48.091981 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:48.091941    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87f1030a-335b-4bfa-b6ad-915a09c7768e" containerName="util"
Jul 27 20:13:48.091981 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:48.091948    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="87f1030a-335b-4bfa-b6ad-915a09c7768e" containerName="util"
Jul 27 20:13:48.091981 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:48.091954    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3bbd56f-2091-40e6-92a4-bb2050447750" containerName="extract"
Jul 27 20:13:48.091981 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:48.091959    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3bbd56f-2091-40e6-92a4-bb2050447750" containerName="extract"
Jul 27 20:13:48.091981 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:48.091967    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e5cb12b-b83d-4906-b247-e76e13ab5dfb" containerName="util"
Jul 27 20:13:48.091981 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:48.091972    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e5cb12b-b83d-4906-b247-e76e13ab5dfb" containerName="util"
Jul 27 20:13:48.091981 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:48.091977    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87f1030a-335b-4bfa-b6ad-915a09c7768e" containerName="extract"
Jul 27 20:13:48.091981 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:48.091982    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="87f1030a-335b-4bfa-b6ad-915a09c7768e" containerName="extract"
Jul 27 20:13:48.091981 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:48.091988    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1f28c73-9a95-401a-aa5c-2014fe34d569" containerName="extract"
Jul 27 20:13:48.091981 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:48.091994    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1f28c73-9a95-401a-aa5c-2014fe34d569" containerName="extract"
Jul 27 20:13:48.092686 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:48.092001    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87f1030a-335b-4bfa-b6ad-915a09c7768e" containerName="pull"
Jul 27 20:13:48.092686 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:48.092007    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="87f1030a-335b-4bfa-b6ad-915a09c7768e" containerName="pull"
Jul 27 20:13:48.092686 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:48.092013    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3bbd56f-2091-40e6-92a4-bb2050447750" containerName="util"
Jul 27 20:13:48.092686 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:48.092018    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3bbd56f-2091-40e6-92a4-bb2050447750" containerName="util"
Jul 27 20:13:48.092686 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:48.092072    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1f28c73-9a95-401a-aa5c-2014fe34d569" containerName="extract"
Jul 27 20:13:48.092686 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:48.092078    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3bbd56f-2091-40e6-92a4-bb2050447750" containerName="extract"
Jul 27 20:13:48.092686 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:48.092084    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="87f1030a-335b-4bfa-b6ad-915a09c7768e" containerName="extract"
Jul 27 20:13:48.092686 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:48.092089    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e5cb12b-b83d-4906-b247-e76e13ab5dfb" containerName="extract"
Jul 27 20:13:48.096709 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:48.096692    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-28k56"
Jul 27 20:13:48.099990 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:48.099964    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 27 20:13:48.100114 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:48.100003    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 27 20:13:48.100114 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:48.099970    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 27 20:13:48.100114 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:48.099975    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 27 20:13:48.100833 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:48.100818    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-f9gbg\""
Jul 27 20:13:48.103855 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:48.103827    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:13:48.105549 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:48.105526    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-28k56"]
Jul 27 20:13:48.119132 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:48.119104    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/89ba8ef0-9e77-4890-9df6-b69a4779c3ed-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-28k56\" (UID: \"89ba8ef0-9e77-4890-9df6-b69a4779c3ed\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-28k56"
Jul 27 20:13:48.119279 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:48.119148    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/89ba8ef0-9e77-4890-9df6-b69a4779c3ed-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-28k56\" (UID: \"89ba8ef0-9e77-4890-9df6-b69a4779c3ed\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-28k56"
Jul 27 20:13:48.119279 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:48.119199    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppd7x\" (UniqueName: \"kubernetes.io/projected/89ba8ef0-9e77-4890-9df6-b69a4779c3ed-kube-api-access-ppd7x\") pod \"kuadrant-console-plugin-66b5774985-28k56\" (UID: \"89ba8ef0-9e77-4890-9df6-b69a4779c3ed\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-28k56"
Jul 27 20:13:48.219581 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:48.219552    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/89ba8ef0-9e77-4890-9df6-b69a4779c3ed-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-28k56\" (UID: \"89ba8ef0-9e77-4890-9df6-b69a4779c3ed\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-28k56"
Jul 27 20:13:48.219783 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:48.219617    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppd7x\" (UniqueName: \"kubernetes.io/projected/89ba8ef0-9e77-4890-9df6-b69a4779c3ed-kube-api-access-ppd7x\") pod \"kuadrant-console-plugin-66b5774985-28k56\" (UID: \"89ba8ef0-9e77-4890-9df6-b69a4779c3ed\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-28k56"
Jul 27 20:13:48.219783 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:48.219640    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/89ba8ef0-9e77-4890-9df6-b69a4779c3ed-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-28k56\" (UID: \"89ba8ef0-9e77-4890-9df6-b69a4779c3ed\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-28k56"
Jul 27 20:13:48.219783 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:13:48.219712    2557 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 27 20:13:48.219950 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:13:48.219807    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89ba8ef0-9e77-4890-9df6-b69a4779c3ed-plugin-serving-cert podName:89ba8ef0-9e77-4890-9df6-b69a4779c3ed nodeName:}" failed. No retries permitted until 2026-07-27 20:13:48.719781838 +0000 UTC m=+577.294508203 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/89ba8ef0-9e77-4890-9df6-b69a4779c3ed-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-28k56" (UID: "89ba8ef0-9e77-4890-9df6-b69a4779c3ed") : secret "plugin-serving-cert" not found
Jul 27 20:13:48.220238 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:48.220219    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/89ba8ef0-9e77-4890-9df6-b69a4779c3ed-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-28k56\" (UID: \"89ba8ef0-9e77-4890-9df6-b69a4779c3ed\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-28k56"
Jul 27 20:13:48.228334 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:48.228309    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppd7x\" (UniqueName: \"kubernetes.io/projected/89ba8ef0-9e77-4890-9df6-b69a4779c3ed-kube-api-access-ppd7x\") pod \"kuadrant-console-plugin-66b5774985-28k56\" (UID: \"89ba8ef0-9e77-4890-9df6-b69a4779c3ed\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-28k56"
Jul 27 20:13:48.722765 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:48.722724    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/89ba8ef0-9e77-4890-9df6-b69a4779c3ed-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-28k56\" (UID: \"89ba8ef0-9e77-4890-9df6-b69a4779c3ed\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-28k56"
Jul 27 20:13:48.722979 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:13:48.722878    2557 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 27 20:13:48.722979 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:13:48.722963    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89ba8ef0-9e77-4890-9df6-b69a4779c3ed-plugin-serving-cert podName:89ba8ef0-9e77-4890-9df6-b69a4779c3ed nodeName:}" failed. No retries permitted until 2026-07-27 20:13:49.722943785 +0000 UTC m=+578.297670172 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/89ba8ef0-9e77-4890-9df6-b69a4779c3ed-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-28k56" (UID: "89ba8ef0-9e77-4890-9df6-b69a4779c3ed") : secret "plugin-serving-cert" not found
Jul 27 20:13:48.788906 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:48.788873    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:13:49.730748 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:49.730693    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/89ba8ef0-9e77-4890-9df6-b69a4779c3ed-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-28k56\" (UID: \"89ba8ef0-9e77-4890-9df6-b69a4779c3ed\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-28k56"
Jul 27 20:13:49.733127 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:49.733108    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/89ba8ef0-9e77-4890-9df6-b69a4779c3ed-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-28k56\" (UID: \"89ba8ef0-9e77-4890-9df6-b69a4779c3ed\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-28k56"
Jul 27 20:13:49.906917 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:49.906882    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-28k56"
Jul 27 20:13:50.042537 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:50.042507    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-28k56"]
Jul 27 20:13:50.044535 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:13:50.044504    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod89ba8ef0_9e77_4890_9df6_b69a4779c3ed.slice/crio-82d9df681b6bb1730c422b736ab307071f0271bb57a4932dea12f1aa79025e65 WatchSource:0}: Error finding container 82d9df681b6bb1730c422b736ab307071f0271bb57a4932dea12f1aa79025e65: Status 404 returned error can't find the container with id 82d9df681b6bb1730c422b736ab307071f0271bb57a4932dea12f1aa79025e65
Jul 27 20:13:50.153433 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:50.153396    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:13:50.252067 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:50.251976    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:13:50.522524 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:50.522427    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-28k56" event={"ID":"89ba8ef0-9e77-4890-9df6-b69a4779c3ed","Type":"ContainerStarted","Data":"82d9df681b6bb1730c422b736ab307071f0271bb57a4932dea12f1aa79025e65"}
Jul 27 20:13:57.737572 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:57.737524    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:13:57.836016 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:57.835975    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:13:58.237759 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:58.237730    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:13:58.366761 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:58.366725    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:13:58.817394 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:58.813240    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:13:58.923665 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:13:58.923624    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:14:02.195214 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:14:02.195158    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:14:02.292656 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:14:02.292620    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:14:04.392074 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:14:04.392033    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:14:04.493877 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:14:04.493846    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:14:08.935139 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:14:08.935100    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:14:09.037121 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:14:09.037077    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:14:13.662286 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:14:13.662244    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-28k56" event={"ID":"89ba8ef0-9e77-4890-9df6-b69a4779c3ed","Type":"ContainerStarted","Data":"ec93cc9c7cf238ad4caec2b91f020d331d746b30308bb6da21218d8d671d3939"}
Jul 27 20:14:13.692515 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:14:13.692444    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-28k56" podStartSLOduration=3.02012821 podStartE2EDuration="25.692425824s" totalImagesPullingTime="22.672297614s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:13:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:14:13.690345795 +0000 UTC m=+602.265072187" watchObservedRunningTime="2026-07-27 20:14:13.692425824 +0000 UTC m=+602.267152211"
Jul 27 20:14:27.710974 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:14:27.710935    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:14:27.806745 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:14:27.806708    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:14:41.524370 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:14:41.524289    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:14:41.621020 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:14:41.620984    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:14:41.738660 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:14:41.738612    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:14:42.015824 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:14:42.015791    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:14:42.019205 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:14:42.019186    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-45lq6"
Jul 27 20:14:42.021552 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:14:42.021531    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 27 20:14:42.029184 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:14:42.029160    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:14:42.057557 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:14:42.057529    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:14:42.104656 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:14:42.104624    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6478h\" (UniqueName: \"kubernetes.io/projected/5d078287-04fe-4f68-b32b-36d3de178562-kube-api-access-6478h\") pod \"limitador-limitador-54d6d988d5-45lq6\" (UID: \"5d078287-04fe-4f68-b32b-36d3de178562\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-45lq6"
Jul 27 20:14:42.104828 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:14:42.104696    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5d078287-04fe-4f68-b32b-36d3de178562-config-file\") pod \"limitador-limitador-54d6d988d5-45lq6\" (UID: \"5d078287-04fe-4f68-b32b-36d3de178562\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-45lq6"
Jul 27 20:14:42.205870 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:14:42.205834    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5d078287-04fe-4f68-b32b-36d3de178562-config-file\") pod \"limitador-limitador-54d6d988d5-45lq6\" (UID: \"5d078287-04fe-4f68-b32b-36d3de178562\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-45lq6"
Jul 27 20:14:42.206046 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:14:42.205899    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6478h\" (UniqueName: \"kubernetes.io/projected/5d078287-04fe-4f68-b32b-36d3de178562-kube-api-access-6478h\") pod \"limitador-limitador-54d6d988d5-45lq6\" (UID: \"5d078287-04fe-4f68-b32b-36d3de178562\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-45lq6"
Jul 27 20:14:42.206494 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:14:42.206444    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5d078287-04fe-4f68-b32b-36d3de178562-config-file\") pod \"limitador-limitador-54d6d988d5-45lq6\" (UID: \"5d078287-04fe-4f68-b32b-36d3de178562\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-45lq6"
Jul 27 20:14:42.214294 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:14:42.214267    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6478h\" (UniqueName: \"kubernetes.io/projected/5d078287-04fe-4f68-b32b-36d3de178562-kube-api-access-6478h\") pod \"limitador-limitador-54d6d988d5-45lq6\" (UID: \"5d078287-04fe-4f68-b32b-36d3de178562\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-45lq6"
Jul 27 20:14:42.330292 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:14:42.330195    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-45lq6"
Jul 27 20:14:42.354812 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:14:42.354783    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-rsqd9"]
Jul 27 20:14:42.358215 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:14:42.358197    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-rsqd9"
Jul 27 20:14:42.360704 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:14:42.360685    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-dx8hl\""
Jul 27 20:14:42.367165 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:14:42.367139    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-rsqd9"]
Jul 27 20:14:42.401397 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:14:42.401364    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:14:42.407495 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:14:42.407469    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z856f\" (UniqueName: \"kubernetes.io/projected/135119e2-22f2-4ae5-9b61-5535ceaf764d-kube-api-access-z856f\") pod \"authorino-58cd955675-rsqd9\" (UID: \"135119e2-22f2-4ae5-9b61-5535ceaf764d\") " pod="kuadrant-system/authorino-58cd955675-rsqd9"
Jul 27 20:14:42.468008 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:14:42.467982    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:14:42.470653 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:14:42.470612    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d078287_04fe_4f68_b32b_36d3de178562.slice/crio-946b3ad6cc190e79fb1d4236298dbc1ff25f9ead83ef12375cb51580bdbc59fd WatchSource:0}: Error finding container 946b3ad6cc190e79fb1d4236298dbc1ff25f9ead83ef12375cb51580bdbc59fd: Status 404 returned error can't find the container with id 946b3ad6cc190e79fb1d4236298dbc1ff25f9ead83ef12375cb51580bdbc59fd
Jul 27 20:14:42.473805 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:14:42.473774    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:14:42.508338 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:14:42.508301    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z856f\" (UniqueName: \"kubernetes.io/projected/135119e2-22f2-4ae5-9b61-5535ceaf764d-kube-api-access-z856f\") pod \"authorino-58cd955675-rsqd9\" (UID: \"135119e2-22f2-4ae5-9b61-5535ceaf764d\") " pod="kuadrant-system/authorino-58cd955675-rsqd9"
Jul 27 20:14:42.516488 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:14:42.516442    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z856f\" (UniqueName: \"kubernetes.io/projected/135119e2-22f2-4ae5-9b61-5535ceaf764d-kube-api-access-z856f\") pod \"authorino-58cd955675-rsqd9\" (UID: \"135119e2-22f2-4ae5-9b61-5535ceaf764d\") " pod="kuadrant-system/authorino-58cd955675-rsqd9"
Jul 27 20:14:42.669396 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:14:42.669287    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-rsqd9"
Jul 27 20:14:42.727434 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:14:42.727402    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-gcfdf"]
Jul 27 20:14:42.731412 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:14:42.731095    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-gcfdf"
Jul 27 20:14:42.741415 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:14:42.741388    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-gcfdf"]
Jul 27 20:14:42.809309 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:14:42.809223    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-rsqd9"]
Jul 27 20:14:42.812585 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:14:42.812289    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5ckh\" (UniqueName: \"kubernetes.io/projected/6bf74e89-c959-4ca2-b045-13d978da7071-kube-api-access-w5ckh\") pod \"authorino-75d556bd77-gcfdf\" (UID: \"6bf74e89-c959-4ca2-b045-13d978da7071\") " pod="kuadrant-system/authorino-75d556bd77-gcfdf"
Jul 27 20:14:42.815999 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:14:42.815972    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-45lq6" event={"ID":"5d078287-04fe-4f68-b32b-36d3de178562","Type":"ContainerStarted","Data":"946b3ad6cc190e79fb1d4236298dbc1ff25f9ead83ef12375cb51580bdbc59fd"}
Jul 27 20:14:42.913513 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:14:42.913472    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5ckh\" (UniqueName: \"kubernetes.io/projected/6bf74e89-c959-4ca2-b045-13d978da7071-kube-api-access-w5ckh\") pod \"authorino-75d556bd77-gcfdf\" (UID: \"6bf74e89-c959-4ca2-b045-13d978da7071\") " pod="kuadrant-system/authorino-75d556bd77-gcfdf"
Jul 27 20:14:42.926270 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:14:42.926199    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5ckh\" (UniqueName: \"kubernetes.io/projected/6bf74e89-c959-4ca2-b045-13d978da7071-kube-api-access-w5ckh\") pod \"authorino-75d556bd77-gcfdf\" (UID: \"6bf74e89-c959-4ca2-b045-13d978da7071\") " pod="kuadrant-system/authorino-75d556bd77-gcfdf"
Jul 27 20:14:43.043138 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:14:43.043097    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-gcfdf"
Jul 27 20:14:43.232079 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:14:43.231966    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-gcfdf"]
Jul 27 20:14:43.236750 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:14:43.236526    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6bf74e89_c959_4ca2_b045_13d978da7071.slice/crio-7252530292a1104ad009974c98851200d1e3844c25c8a1d0ebfbd116dac609ad WatchSource:0}: Error finding container 7252530292a1104ad009974c98851200d1e3844c25c8a1d0ebfbd116dac609ad: Status 404 returned error can't find the container with id 7252530292a1104ad009974c98851200d1e3844c25c8a1d0ebfbd116dac609ad
Jul 27 20:14:43.836327 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:14:43.836286    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-gcfdf" event={"ID":"6bf74e89-c959-4ca2-b045-13d978da7071","Type":"ContainerStarted","Data":"7252530292a1104ad009974c98851200d1e3844c25c8a1d0ebfbd116dac609ad"}
Jul 27 20:14:43.839789 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:14:43.839760    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-rsqd9" event={"ID":"135119e2-22f2-4ae5-9b61-5535ceaf764d","Type":"ContainerStarted","Data":"790e37163900a8399dc625e9050ea47f932622a5fa2dc52ea94279ab79907ffe"}
Jul 27 20:14:47.865698 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:14:47.865663    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-45lq6" event={"ID":"5d078287-04fe-4f68-b32b-36d3de178562","Type":"ContainerStarted","Data":"b0f8fe03a553ba6d764dc169658820029b963f938b14345047dbdc8eeb8c0e06"}
Jul 27 20:14:47.866195 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:14:47.865773    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-45lq6"
Jul 27 20:14:47.867241 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:14:47.867213    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-gcfdf" event={"ID":"6bf74e89-c959-4ca2-b045-13d978da7071","Type":"ContainerStarted","Data":"db1ed2abacf814a5eefd9b426224e2a878c571e9cd2777d30c1151d2880c2a33"}
Jul 27 20:14:47.868748 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:14:47.868727    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-rsqd9" event={"ID":"135119e2-22f2-4ae5-9b61-5535ceaf764d","Type":"ContainerStarted","Data":"c900b690ef7186ef02a283c4c94299c2603fc75c63dd70c9e1c6369aa6829989"}
Jul 27 20:14:47.883203 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:14:47.883165    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-45lq6" podStartSLOduration=1.9117218 podStartE2EDuration="6.88315212s" totalImagesPullingTime="4.97143032s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:14:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:14:47.882172037 +0000 UTC m=+636.456898426" watchObservedRunningTime="2026-07-27 20:14:47.88315212 +0000 UTC m=+636.457878507"
Jul 27 20:14:47.897274 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:14:47.897237    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-rsqd9" podStartSLOduration=1.275750343 podStartE2EDuration="5.897227858s" totalImagesPullingTime="4.621477515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:14:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:14:47.896565398 +0000 UTC m=+636.471291789" watchObservedRunningTime="2026-07-27 20:14:47.897227858 +0000 UTC m=+636.471954245"
Jul 27 20:14:47.912074 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:14:47.912030    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-gcfdf" podStartSLOduration=1.71614322 podStartE2EDuration="5.91201095s" totalImagesPullingTime="4.19586773s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:14:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:14:47.910483657 +0000 UTC m=+636.485210462" watchObservedRunningTime="2026-07-27 20:14:47.91201095 +0000 UTC m=+636.486737360"
Jul 27 20:14:47.938914 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:14:47.938883    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-rsqd9"]
Jul 27 20:14:49.879567 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:14:49.879510    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-rsqd9" podUID="135119e2-22f2-4ae5-9b61-5535ceaf764d" containerName="authorino" containerID="cri-o://c900b690ef7186ef02a283c4c94299c2603fc75c63dd70c9e1c6369aa6829989" gracePeriod=30
Jul 27 20:14:50.119683 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:14:50.119659    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-rsqd9"
Jul 27 20:14:50.183030 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:14:50.182955    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z856f\" (UniqueName: \"kubernetes.io/projected/135119e2-22f2-4ae5-9b61-5535ceaf764d-kube-api-access-z856f\") pod \"135119e2-22f2-4ae5-9b61-5535ceaf764d\" (UID: \"135119e2-22f2-4ae5-9b61-5535ceaf764d\") "
Jul 27 20:14:50.184899 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:14:50.184876    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/135119e2-22f2-4ae5-9b61-5535ceaf764d-kube-api-access-z856f" (OuterVolumeSpecName: "kube-api-access-z856f") pod "135119e2-22f2-4ae5-9b61-5535ceaf764d" (UID: "135119e2-22f2-4ae5-9b61-5535ceaf764d"). InnerVolumeSpecName "kube-api-access-z856f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:14:50.284316 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:14:50.284284    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z856f\" (UniqueName: \"kubernetes.io/projected/135119e2-22f2-4ae5-9b61-5535ceaf764d-kube-api-access-z856f\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:14:50.885851 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:14:50.885817    2557 generic.go:356] "Generic (PLEG): container finished" podID="135119e2-22f2-4ae5-9b61-5535ceaf764d" containerID="c900b690ef7186ef02a283c4c94299c2603fc75c63dd70c9e1c6369aa6829989" exitCode=0
Jul 27 20:14:50.886332 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:14:50.885865    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-rsqd9"
Jul 27 20:14:50.886332 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:14:50.885909    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-rsqd9" event={"ID":"135119e2-22f2-4ae5-9b61-5535ceaf764d","Type":"ContainerDied","Data":"c900b690ef7186ef02a283c4c94299c2603fc75c63dd70c9e1c6369aa6829989"}
Jul 27 20:14:50.886332 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:14:50.885956    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-rsqd9" event={"ID":"135119e2-22f2-4ae5-9b61-5535ceaf764d","Type":"ContainerDied","Data":"790e37163900a8399dc625e9050ea47f932622a5fa2dc52ea94279ab79907ffe"}
Jul 27 20:14:50.886332 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:14:50.885976    2557 scope.go:117] "RemoveContainer" containerID="c900b690ef7186ef02a283c4c94299c2603fc75c63dd70c9e1c6369aa6829989"
Jul 27 20:14:50.895424 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:14:50.895403    2557 scope.go:117] "RemoveContainer" containerID="c900b690ef7186ef02a283c4c94299c2603fc75c63dd70c9e1c6369aa6829989"
Jul 27 20:14:50.895680 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:14:50.895662    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c900b690ef7186ef02a283c4c94299c2603fc75c63dd70c9e1c6369aa6829989\": container with ID starting with c900b690ef7186ef02a283c4c94299c2603fc75c63dd70c9e1c6369aa6829989 not found: ID does not exist" containerID="c900b690ef7186ef02a283c4c94299c2603fc75c63dd70c9e1c6369aa6829989"
Jul 27 20:14:50.895751 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:14:50.895688    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c900b690ef7186ef02a283c4c94299c2603fc75c63dd70c9e1c6369aa6829989"} err="failed to get container status \"c900b690ef7186ef02a283c4c94299c2603fc75c63dd70c9e1c6369aa6829989\": rpc error: code = NotFound desc = could not find container \"c900b690ef7186ef02a283c4c94299c2603fc75c63dd70c9e1c6369aa6829989\": container with ID starting with c900b690ef7186ef02a283c4c94299c2603fc75c63dd70c9e1c6369aa6829989 not found: ID does not exist"
Jul 27 20:14:50.907799 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:14:50.907777    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-rsqd9"]
Jul 27 20:14:50.911515 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:14:50.911495    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-rsqd9"]
Jul 27 20:14:51.910560 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:14:51.910524    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="135119e2-22f2-4ae5-9b61-5535ceaf764d" path="/var/lib/kubelet/pods/135119e2-22f2-4ae5-9b61-5535ceaf764d/volumes"
Jul 27 20:14:58.875223 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:14:58.875188    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-45lq6"
Jul 27 20:15:00.910530 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:00.910498    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:15:01.007445 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:01.007408    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:15:01.418371 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:01.418332    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:15:09.844225 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:09.844185    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:15:15.174595 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:15.174556    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:15:15.416900 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:15.416865    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-wjxm4"]
Jul 27 20:15:15.417231 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:15.417215    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="135119e2-22f2-4ae5-9b61-5535ceaf764d" containerName="authorino"
Jul 27 20:15:15.417231 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:15.417232    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="135119e2-22f2-4ae5-9b61-5535ceaf764d" containerName="authorino"
Jul 27 20:15:15.417346 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:15.417326    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="135119e2-22f2-4ae5-9b61-5535ceaf764d" containerName="authorino"
Jul 27 20:15:15.423652 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:15.423633    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-wjxm4"
Jul 27 20:15:15.428105 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:15.428051    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-wjxm4"]
Jul 27 20:15:15.509078 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:15.509047    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78pz5\" (UniqueName: \"kubernetes.io/projected/01ff873c-6d74-4e47-b436-d82107a5da56-kube-api-access-78pz5\") pod \"authorino-5d4b67c446-wjxm4\" (UID: \"01ff873c-6d74-4e47-b436-d82107a5da56\") " pod="kuadrant-system/authorino-5d4b67c446-wjxm4"
Jul 27 20:15:15.578999 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:15.578965    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:15:15.609651 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:15.609609    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78pz5\" (UniqueName: \"kubernetes.io/projected/01ff873c-6d74-4e47-b436-d82107a5da56-kube-api-access-78pz5\") pod \"authorino-5d4b67c446-wjxm4\" (UID: \"01ff873c-6d74-4e47-b436-d82107a5da56\") " pod="kuadrant-system/authorino-5d4b67c446-wjxm4"
Jul 27 20:15:15.618467 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:15.618423    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-78pz5\" (UniqueName: \"kubernetes.io/projected/01ff873c-6d74-4e47-b436-d82107a5da56-kube-api-access-78pz5\") pod \"authorino-5d4b67c446-wjxm4\" (UID: \"01ff873c-6d74-4e47-b436-d82107a5da56\") " pod="kuadrant-system/authorino-5d4b67c446-wjxm4"
Jul 27 20:15:15.670058 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:15.670022    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-wjxm4"]
Jul 27 20:15:15.670276 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:15.670264    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-wjxm4"
Jul 27 20:15:15.700568 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:15.700537    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7b9cd586f9-fk5rp"]
Jul 27 20:15:15.706067 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:15.706045    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b9cd586f9-fk5rp"
Jul 27 20:15:15.712291 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:15.712264    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7b9cd586f9-fk5rp"]
Jul 27 20:15:15.807962 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:15.807936    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-wjxm4"]
Jul 27 20:15:15.810012 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:15:15.809991    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod01ff873c_6d74_4e47_b436_d82107a5da56.slice/crio-d508ba239e3186a447edd90245671fc66b8cc9777caac45b83a6b1b70b40c0fe WatchSource:0}: Error finding container d508ba239e3186a447edd90245671fc66b8cc9777caac45b83a6b1b70b40c0fe: Status 404 returned error can't find the container with id d508ba239e3186a447edd90245671fc66b8cc9777caac45b83a6b1b70b40c0fe
Jul 27 20:15:15.811444 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:15.811417    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npd5d\" (UniqueName: \"kubernetes.io/projected/5a85d25d-3828-4f58-9d51-6a40652d28e5-kube-api-access-npd5d\") pod \"authorino-7b9cd586f9-fk5rp\" (UID: \"5a85d25d-3828-4f58-9d51-6a40652d28e5\") " pod="kuadrant-system/authorino-7b9cd586f9-fk5rp"
Jul 27 20:15:15.912448 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:15.912412    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npd5d\" (UniqueName: \"kubernetes.io/projected/5a85d25d-3828-4f58-9d51-6a40652d28e5-kube-api-access-npd5d\") pod \"authorino-7b9cd586f9-fk5rp\" (UID: \"5a85d25d-3828-4f58-9d51-6a40652d28e5\") " pod="kuadrant-system/authorino-7b9cd586f9-fk5rp"
Jul 27 20:15:15.921627 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:15.921598    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-npd5d\" (UniqueName: \"kubernetes.io/projected/5a85d25d-3828-4f58-9d51-6a40652d28e5-kube-api-access-npd5d\") pod \"authorino-7b9cd586f9-fk5rp\" (UID: \"5a85d25d-3828-4f58-9d51-6a40652d28e5\") " pod="kuadrant-system/authorino-7b9cd586f9-fk5rp"
Jul 27 20:15:16.013023 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:16.012987    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7b9cd586f9-fk5rp"]
Jul 27 20:15:16.013255 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:16.013240    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b9cd586f9-fk5rp"
Jul 27 20:15:16.015976 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:16.015945    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-wjxm4" event={"ID":"01ff873c-6d74-4e47-b436-d82107a5da56","Type":"ContainerStarted","Data":"d508ba239e3186a447edd90245671fc66b8cc9777caac45b83a6b1b70b40c0fe"}
Jul 27 20:15:16.038729 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:16.038702    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6675954f9-csdnn"]
Jul 27 20:15:16.044049 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:16.044026    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6675954f9-csdnn"
Jul 27 20:15:16.046403 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:16.046382    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 27 20:15:16.050167 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:16.050135    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6675954f9-csdnn"]
Jul 27 20:15:16.153347 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:16.153321    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7b9cd586f9-fk5rp"]
Jul 27 20:15:16.162447 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:15:16.162418    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5a85d25d_3828_4f58_9d51_6a40652d28e5.slice/crio-a8740cf6072ff7506fceeefe0035730e0243a59e15d1055d30822f29822f59ab WatchSource:0}: Error finding container a8740cf6072ff7506fceeefe0035730e0243a59e15d1055d30822f29822f59ab: Status 404 returned error can't find the container with id a8740cf6072ff7506fceeefe0035730e0243a59e15d1055d30822f29822f59ab
Jul 27 20:15:16.214710 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:16.214681    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7xbm\" (UniqueName: \"kubernetes.io/projected/190da35b-4cb6-48d2-aa74-72c47c67b3a6-kube-api-access-c7xbm\") pod \"authorino-6675954f9-csdnn\" (UID: \"190da35b-4cb6-48d2-aa74-72c47c67b3a6\") " pod="kuadrant-system/authorino-6675954f9-csdnn"
Jul 27 20:15:16.215058 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:16.214723    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/190da35b-4cb6-48d2-aa74-72c47c67b3a6-tls-cert\") pod \"authorino-6675954f9-csdnn\" (UID: \"190da35b-4cb6-48d2-aa74-72c47c67b3a6\") " pod="kuadrant-system/authorino-6675954f9-csdnn"
Jul 27 20:15:16.315372 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:16.315276    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7xbm\" (UniqueName: \"kubernetes.io/projected/190da35b-4cb6-48d2-aa74-72c47c67b3a6-kube-api-access-c7xbm\") pod \"authorino-6675954f9-csdnn\" (UID: \"190da35b-4cb6-48d2-aa74-72c47c67b3a6\") " pod="kuadrant-system/authorino-6675954f9-csdnn"
Jul 27 20:15:16.315372 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:16.315322    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/190da35b-4cb6-48d2-aa74-72c47c67b3a6-tls-cert\") pod \"authorino-6675954f9-csdnn\" (UID: \"190da35b-4cb6-48d2-aa74-72c47c67b3a6\") " pod="kuadrant-system/authorino-6675954f9-csdnn"
Jul 27 20:15:16.317709 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:16.317682    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/190da35b-4cb6-48d2-aa74-72c47c67b3a6-tls-cert\") pod \"authorino-6675954f9-csdnn\" (UID: \"190da35b-4cb6-48d2-aa74-72c47c67b3a6\") " pod="kuadrant-system/authorino-6675954f9-csdnn"
Jul 27 20:15:16.324399 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:16.324375    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7xbm\" (UniqueName: \"kubernetes.io/projected/190da35b-4cb6-48d2-aa74-72c47c67b3a6-kube-api-access-c7xbm\") pod \"authorino-6675954f9-csdnn\" (UID: \"190da35b-4cb6-48d2-aa74-72c47c67b3a6\") " pod="kuadrant-system/authorino-6675954f9-csdnn"
Jul 27 20:15:16.355416 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:16.355377    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6675954f9-csdnn"
Jul 27 20:15:16.488948 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:16.488919    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6675954f9-csdnn"]
Jul 27 20:15:16.491879 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:15:16.491857    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod190da35b_4cb6_48d2_aa74_72c47c67b3a6.slice/crio-5c389a9b777985f6c5f5087b0cbbf75d2910f703d42c5e02ed06139aa3ec3bff WatchSource:0}: Error finding container 5c389a9b777985f6c5f5087b0cbbf75d2910f703d42c5e02ed06139aa3ec3bff: Status 404 returned error can't find the container with id 5c389a9b777985f6c5f5087b0cbbf75d2910f703d42c5e02ed06139aa3ec3bff
Jul 27 20:15:17.022654 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:17.022618    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6675954f9-csdnn" event={"ID":"190da35b-4cb6-48d2-aa74-72c47c67b3a6","Type":"ContainerStarted","Data":"7dc0316a1be317799074ecb5fac67ecd821e89fcf66b002398751260f1d9de6b"}
Jul 27 20:15:17.022843 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:17.022669    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6675954f9-csdnn" event={"ID":"190da35b-4cb6-48d2-aa74-72c47c67b3a6","Type":"ContainerStarted","Data":"5c389a9b777985f6c5f5087b0cbbf75d2910f703d42c5e02ed06139aa3ec3bff"}
Jul 27 20:15:17.024078 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:17.024041    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-wjxm4" event={"ID":"01ff873c-6d74-4e47-b436-d82107a5da56","Type":"ContainerStarted","Data":"6449bff7d29c5564302ffcb8336f7b2582a7741b80f559acbd306fbd67ecd20a"}
Jul 27 20:15:17.024196 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:17.024084    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-wjxm4" podUID="01ff873c-6d74-4e47-b436-d82107a5da56" containerName="authorino" containerID="cri-o://6449bff7d29c5564302ffcb8336f7b2582a7741b80f559acbd306fbd67ecd20a" gracePeriod=30
Jul 27 20:15:17.025580 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:17.025547    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7b9cd586f9-fk5rp" event={"ID":"5a85d25d-3828-4f58-9d51-6a40652d28e5","Type":"ContainerStarted","Data":"d0484d156472c27e4bf0ec8d31f7acb2096225bb30d635cab917edbe744a0fcf"}
Jul 27 20:15:17.025667 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:17.025579    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7b9cd586f9-fk5rp" podUID="5a85d25d-3828-4f58-9d51-6a40652d28e5" containerName="authorino" containerID="cri-o://d0484d156472c27e4bf0ec8d31f7acb2096225bb30d635cab917edbe744a0fcf" gracePeriod=30
Jul 27 20:15:17.025667 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:17.025596    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7b9cd586f9-fk5rp" event={"ID":"5a85d25d-3828-4f58-9d51-6a40652d28e5","Type":"ContainerStarted","Data":"a8740cf6072ff7506fceeefe0035730e0243a59e15d1055d30822f29822f59ab"}
Jul 27 20:15:17.045575 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:17.045520    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6675954f9-csdnn" podStartSLOduration=0.733571347 podStartE2EDuration="1.045499013s" totalImagesPullingTime="311.927666ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:15:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:15:17.044344845 +0000 UTC m=+665.619071235" watchObservedRunningTime="2026-07-27 20:15:17.045499013 +0000 UTC m=+665.620225396"
Jul 27 20:15:17.062264 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:17.062159    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-wjxm4" podStartSLOduration=1.740942393 podStartE2EDuration="2.062143986s" totalImagesPullingTime="321.201593ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:15:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:15:17.060318633 +0000 UTC m=+665.635045021" watchObservedRunningTime="2026-07-27 20:15:17.062143986 +0000 UTC m=+665.636870369"
Jul 27 20:15:17.088810 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:17.088760    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7b9cd586f9-fk5rp" podStartSLOduration=1.778090362 podStartE2EDuration="2.08874154s" totalImagesPullingTime="310.651178ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:15:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:15:17.085924999 +0000 UTC m=+665.660651388" watchObservedRunningTime="2026-07-27 20:15:17.08874154 +0000 UTC m=+665.663467929"
Jul 27 20:15:17.095192 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:17.095162    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-gcfdf"]
Jul 27 20:15:17.095363 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:17.095342    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-gcfdf" podUID="6bf74e89-c959-4ca2-b045-13d978da7071" containerName="authorino" containerID="cri-o://db1ed2abacf814a5eefd9b426224e2a878c571e9cd2777d30c1151d2880c2a33" gracePeriod=30
Jul 27 20:15:17.342170 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:17.342144    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-wjxm4"
Jul 27 20:15:17.382767 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:17.382743    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b9cd586f9-fk5rp"
Jul 27 20:15:17.385852 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:17.385831    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-gcfdf"
Jul 27 20:15:17.427572 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:17.427544    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-78pz5\" (UniqueName: \"kubernetes.io/projected/01ff873c-6d74-4e47-b436-d82107a5da56-kube-api-access-78pz5\") pod \"01ff873c-6d74-4e47-b436-d82107a5da56\" (UID: \"01ff873c-6d74-4e47-b436-d82107a5da56\") "
Jul 27 20:15:17.429536 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:17.429511    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01ff873c-6d74-4e47-b436-d82107a5da56-kube-api-access-78pz5" (OuterVolumeSpecName: "kube-api-access-78pz5") pod "01ff873c-6d74-4e47-b436-d82107a5da56" (UID: "01ff873c-6d74-4e47-b436-d82107a5da56"). InnerVolumeSpecName "kube-api-access-78pz5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:15:17.528526 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:17.528491    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-npd5d\" (UniqueName: \"kubernetes.io/projected/5a85d25d-3828-4f58-9d51-6a40652d28e5-kube-api-access-npd5d\") pod \"5a85d25d-3828-4f58-9d51-6a40652d28e5\" (UID: \"5a85d25d-3828-4f58-9d51-6a40652d28e5\") "
Jul 27 20:15:17.528700 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:17.528593    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w5ckh\" (UniqueName: \"kubernetes.io/projected/6bf74e89-c959-4ca2-b045-13d978da7071-kube-api-access-w5ckh\") pod \"6bf74e89-c959-4ca2-b045-13d978da7071\" (UID: \"6bf74e89-c959-4ca2-b045-13d978da7071\") "
Jul 27 20:15:17.528842 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:17.528825    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-78pz5\" (UniqueName: \"kubernetes.io/projected/01ff873c-6d74-4e47-b436-d82107a5da56-kube-api-access-78pz5\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:15:17.530740 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:17.530700    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a85d25d-3828-4f58-9d51-6a40652d28e5-kube-api-access-npd5d" (OuterVolumeSpecName: "kube-api-access-npd5d") pod "5a85d25d-3828-4f58-9d51-6a40652d28e5" (UID: "5a85d25d-3828-4f58-9d51-6a40652d28e5"). InnerVolumeSpecName "kube-api-access-npd5d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:15:17.530883 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:17.530745    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bf74e89-c959-4ca2-b045-13d978da7071-kube-api-access-w5ckh" (OuterVolumeSpecName: "kube-api-access-w5ckh") pod "6bf74e89-c959-4ca2-b045-13d978da7071" (UID: "6bf74e89-c959-4ca2-b045-13d978da7071"). InnerVolumeSpecName "kube-api-access-w5ckh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:15:17.630025 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:17.629995    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w5ckh\" (UniqueName: \"kubernetes.io/projected/6bf74e89-c959-4ca2-b045-13d978da7071-kube-api-access-w5ckh\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:15:17.630025 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:17.630024    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-npd5d\" (UniqueName: \"kubernetes.io/projected/5a85d25d-3828-4f58-9d51-6a40652d28e5-kube-api-access-npd5d\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:15:18.032923 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:18.032883    2557 generic.go:356] "Generic (PLEG): container finished" podID="6bf74e89-c959-4ca2-b045-13d978da7071" containerID="db1ed2abacf814a5eefd9b426224e2a878c571e9cd2777d30c1151d2880c2a33" exitCode=0
Jul 27 20:15:18.033105 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:18.032928    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-gcfdf"
Jul 27 20:15:18.033105 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:18.032963    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-gcfdf" event={"ID":"6bf74e89-c959-4ca2-b045-13d978da7071","Type":"ContainerDied","Data":"db1ed2abacf814a5eefd9b426224e2a878c571e9cd2777d30c1151d2880c2a33"}
Jul 27 20:15:18.033105 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:18.033003    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-gcfdf" event={"ID":"6bf74e89-c959-4ca2-b045-13d978da7071","Type":"ContainerDied","Data":"7252530292a1104ad009974c98851200d1e3844c25c8a1d0ebfbd116dac609ad"}
Jul 27 20:15:18.033105 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:18.033021    2557 scope.go:117] "RemoveContainer" containerID="db1ed2abacf814a5eefd9b426224e2a878c571e9cd2777d30c1151d2880c2a33"
Jul 27 20:15:18.034394 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:18.034364    2557 generic.go:356] "Generic (PLEG): container finished" podID="01ff873c-6d74-4e47-b436-d82107a5da56" containerID="6449bff7d29c5564302ffcb8336f7b2582a7741b80f559acbd306fbd67ecd20a" exitCode=0
Jul 27 20:15:18.034544 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:18.034403    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-wjxm4"
Jul 27 20:15:18.034544 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:18.034439    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-wjxm4" event={"ID":"01ff873c-6d74-4e47-b436-d82107a5da56","Type":"ContainerDied","Data":"6449bff7d29c5564302ffcb8336f7b2582a7741b80f559acbd306fbd67ecd20a"}
Jul 27 20:15:18.034544 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:18.034488    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-wjxm4" event={"ID":"01ff873c-6d74-4e47-b436-d82107a5da56","Type":"ContainerDied","Data":"d508ba239e3186a447edd90245671fc66b8cc9777caac45b83a6b1b70b40c0fe"}
Jul 27 20:15:18.036155 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:18.036128    2557 generic.go:356] "Generic (PLEG): container finished" podID="5a85d25d-3828-4f58-9d51-6a40652d28e5" containerID="d0484d156472c27e4bf0ec8d31f7acb2096225bb30d635cab917edbe744a0fcf" exitCode=0
Jul 27 20:15:18.036269 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:18.036166    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b9cd586f9-fk5rp"
Jul 27 20:15:18.036269 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:18.036220    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7b9cd586f9-fk5rp" event={"ID":"5a85d25d-3828-4f58-9d51-6a40652d28e5","Type":"ContainerDied","Data":"d0484d156472c27e4bf0ec8d31f7acb2096225bb30d635cab917edbe744a0fcf"}
Jul 27 20:15:18.036269 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:18.036248    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7b9cd586f9-fk5rp" event={"ID":"5a85d25d-3828-4f58-9d51-6a40652d28e5","Type":"ContainerDied","Data":"a8740cf6072ff7506fceeefe0035730e0243a59e15d1055d30822f29822f59ab"}
Jul 27 20:15:18.042629 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:18.042613    2557 scope.go:117] "RemoveContainer" containerID="db1ed2abacf814a5eefd9b426224e2a878c571e9cd2777d30c1151d2880c2a33"
Jul 27 20:15:18.042884 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:15:18.042862    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db1ed2abacf814a5eefd9b426224e2a878c571e9cd2777d30c1151d2880c2a33\": container with ID starting with db1ed2abacf814a5eefd9b426224e2a878c571e9cd2777d30c1151d2880c2a33 not found: ID does not exist" containerID="db1ed2abacf814a5eefd9b426224e2a878c571e9cd2777d30c1151d2880c2a33"
Jul 27 20:15:18.042947 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:18.042894    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db1ed2abacf814a5eefd9b426224e2a878c571e9cd2777d30c1151d2880c2a33"} err="failed to get container status \"db1ed2abacf814a5eefd9b426224e2a878c571e9cd2777d30c1151d2880c2a33\": rpc error: code = NotFound desc = could not find container \"db1ed2abacf814a5eefd9b426224e2a878c571e9cd2777d30c1151d2880c2a33\": container with ID starting with db1ed2abacf814a5eefd9b426224e2a878c571e9cd2777d30c1151d2880c2a33 not found: ID does not exist"
Jul 27 20:15:18.042947 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:18.042911    2557 scope.go:117] "RemoveContainer" containerID="6449bff7d29c5564302ffcb8336f7b2582a7741b80f559acbd306fbd67ecd20a"
Jul 27 20:15:18.050859 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:18.050841    2557 scope.go:117] "RemoveContainer" containerID="6449bff7d29c5564302ffcb8336f7b2582a7741b80f559acbd306fbd67ecd20a"
Jul 27 20:15:18.051099 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:15:18.051079    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6449bff7d29c5564302ffcb8336f7b2582a7741b80f559acbd306fbd67ecd20a\": container with ID starting with 6449bff7d29c5564302ffcb8336f7b2582a7741b80f559acbd306fbd67ecd20a not found: ID does not exist" containerID="6449bff7d29c5564302ffcb8336f7b2582a7741b80f559acbd306fbd67ecd20a"
Jul 27 20:15:18.051148 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:18.051107    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6449bff7d29c5564302ffcb8336f7b2582a7741b80f559acbd306fbd67ecd20a"} err="failed to get container status \"6449bff7d29c5564302ffcb8336f7b2582a7741b80f559acbd306fbd67ecd20a\": rpc error: code = NotFound desc = could not find container \"6449bff7d29c5564302ffcb8336f7b2582a7741b80f559acbd306fbd67ecd20a\": container with ID starting with 6449bff7d29c5564302ffcb8336f7b2582a7741b80f559acbd306fbd67ecd20a not found: ID does not exist"
Jul 27 20:15:18.051148 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:18.051123    2557 scope.go:117] "RemoveContainer" containerID="d0484d156472c27e4bf0ec8d31f7acb2096225bb30d635cab917edbe744a0fcf"
Jul 27 20:15:18.058953 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:18.058936    2557 scope.go:117] "RemoveContainer" containerID="d0484d156472c27e4bf0ec8d31f7acb2096225bb30d635cab917edbe744a0fcf"
Jul 27 20:15:18.059231 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:15:18.059209    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0484d156472c27e4bf0ec8d31f7acb2096225bb30d635cab917edbe744a0fcf\": container with ID starting with d0484d156472c27e4bf0ec8d31f7acb2096225bb30d635cab917edbe744a0fcf not found: ID does not exist" containerID="d0484d156472c27e4bf0ec8d31f7acb2096225bb30d635cab917edbe744a0fcf"
Jul 27 20:15:18.059326 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:18.059236    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0484d156472c27e4bf0ec8d31f7acb2096225bb30d635cab917edbe744a0fcf"} err="failed to get container status \"d0484d156472c27e4bf0ec8d31f7acb2096225bb30d635cab917edbe744a0fcf\": rpc error: code = NotFound desc = could not find container \"d0484d156472c27e4bf0ec8d31f7acb2096225bb30d635cab917edbe744a0fcf\": container with ID starting with d0484d156472c27e4bf0ec8d31f7acb2096225bb30d635cab917edbe744a0fcf not found: ID does not exist"
Jul 27 20:15:18.060532 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:18.060513    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-gcfdf"]
Jul 27 20:15:18.062504 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:18.062486    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-gcfdf"]
Jul 27 20:15:18.072865 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:18.072846    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7b9cd586f9-fk5rp"]
Jul 27 20:15:18.076709 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:18.076689    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7b9cd586f9-fk5rp"]
Jul 27 20:15:18.087103 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:18.087084    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-wjxm4"]
Jul 27 20:15:18.091264 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:18.091244    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-wjxm4"]
Jul 27 20:15:19.910617 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:19.910577    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01ff873c-6d74-4e47-b436-d82107a5da56" path="/var/lib/kubelet/pods/01ff873c-6d74-4e47-b436-d82107a5da56/volumes"
Jul 27 20:15:19.911057 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:19.910902    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a85d25d-3828-4f58-9d51-6a40652d28e5" path="/var/lib/kubelet/pods/5a85d25d-3828-4f58-9d51-6a40652d28e5/volumes"
Jul 27 20:15:19.911167 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:19.911155    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6bf74e89-c959-4ca2-b045-13d978da7071" path="/var/lib/kubelet/pods/6bf74e89-c959-4ca2-b045-13d978da7071/volumes"
Jul 27 20:15:21.817891 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:21.817853    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:15:21.918581 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:21.918551    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:15:21.984051 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:21.984001    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:15:25.105384 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:25.105332    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:15:25.203964 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:25.203927    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:15:33.132958 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:33.132928    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:15:33.218543 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:33.218507    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:15:54.649031 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:54.648967    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:15:55.961920 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:55.961871    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:15:57.894587 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:57.894535    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:15:57.991141 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:57.991102    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:15:58.459027 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:58.458987    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:15:58.559411 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:58.559380    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:15:58.997693 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:58.997659    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:15:59.024347 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:59.024314    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:15:59.099083 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:15:59.099049    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:16:08.901020 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:16:08.900914    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:16:09.001920 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:16:09.001881    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:16:23.835874 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:16:23.835837    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:16:24.489782 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:16:24.489745    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:16:37.099660 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:16:37.099621    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:16:40.624258 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:16:40.624224    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:16:46.101376 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:16:46.101333    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:17:00.088590 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:17:00.088552    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:17:00.902310 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:17:00.902258    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:17:21.532494 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:17:21.532434    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:17:22.691732 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:17:22.691688    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:17:31.021245 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:17:31.021209    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:17:32.603897 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:17:32.603866    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:17:41.801437 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:17:41.801346    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:17:44.497220 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:17:44.497182    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:17:49.293665 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:17:49.293625    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-q9plc"]
Jul 27 20:17:49.294174 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:17:49.294127    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bf74e89-c959-4ca2-b045-13d978da7071" containerName="authorino"
Jul 27 20:17:49.294174 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:17:49.294146    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bf74e89-c959-4ca2-b045-13d978da7071" containerName="authorino"
Jul 27 20:17:49.294174 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:17:49.294158    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a85d25d-3828-4f58-9d51-6a40652d28e5" containerName="authorino"
Jul 27 20:17:49.294174 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:17:49.294167    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a85d25d-3828-4f58-9d51-6a40652d28e5" containerName="authorino"
Jul 27 20:17:49.294380 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:17:49.294182    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01ff873c-6d74-4e47-b436-d82107a5da56" containerName="authorino"
Jul 27 20:17:49.294380 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:17:49.294191    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="01ff873c-6d74-4e47-b436-d82107a5da56" containerName="authorino"
Jul 27 20:17:49.294380 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:17:49.294292    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="6bf74e89-c959-4ca2-b045-13d978da7071" containerName="authorino"
Jul 27 20:17:49.294380 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:17:49.294304    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="01ff873c-6d74-4e47-b436-d82107a5da56" containerName="authorino"
Jul 27 20:17:49.294380 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:17:49.294315    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a85d25d-3828-4f58-9d51-6a40652d28e5" containerName="authorino"
Jul 27 20:17:49.297582 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:17:49.297550    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-q9plc"
Jul 27 20:17:49.301185 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:17:49.301158    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 27 20:17:49.301326 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:17:49.301185    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 27 20:17:49.301326 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:17:49.301202    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-qvwsc\""
Jul 27 20:17:49.301326 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:17:49.301187    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 27 20:17:49.306740 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:17:49.306717    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-q9plc"]
Jul 27 20:17:49.394518 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:17:49.394467    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:17:49.435146 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:17:49.435104    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9z45\" (UniqueName: \"kubernetes.io/projected/96ea0c83-b0af-4039-898d-49f5c9484ecb-kube-api-access-z9z45\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-q9plc\" (UID: \"96ea0c83-b0af-4039-898d-49f5c9484ecb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-q9plc"
Jul 27 20:17:49.435357 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:17:49.435156    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/96ea0c83-b0af-4039-898d-49f5c9484ecb-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-q9plc\" (UID: \"96ea0c83-b0af-4039-898d-49f5c9484ecb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-q9plc"
Jul 27 20:17:49.435357 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:17:49.435184    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/96ea0c83-b0af-4039-898d-49f5c9484ecb-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-q9plc\" (UID: \"96ea0c83-b0af-4039-898d-49f5c9484ecb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-q9plc"
Jul 27 20:17:49.435357 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:17:49.435201    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/96ea0c83-b0af-4039-898d-49f5c9484ecb-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-q9plc\" (UID: \"96ea0c83-b0af-4039-898d-49f5c9484ecb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-q9plc"
Jul 27 20:17:49.435357 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:17:49.435239    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/96ea0c83-b0af-4039-898d-49f5c9484ecb-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-q9plc\" (UID: \"96ea0c83-b0af-4039-898d-49f5c9484ecb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-q9plc"
Jul 27 20:17:49.435357 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:17:49.435325    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/96ea0c83-b0af-4039-898d-49f5c9484ecb-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-q9plc\" (UID: \"96ea0c83-b0af-4039-898d-49f5c9484ecb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-q9plc"
Jul 27 20:17:49.536547 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:17:49.536501    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/96ea0c83-b0af-4039-898d-49f5c9484ecb-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-q9plc\" (UID: \"96ea0c83-b0af-4039-898d-49f5c9484ecb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-q9plc"
Jul 27 20:17:49.536547 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:17:49.536548    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/96ea0c83-b0af-4039-898d-49f5c9484ecb-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-q9plc\" (UID: \"96ea0c83-b0af-4039-898d-49f5c9484ecb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-q9plc"
Jul 27 20:17:49.536797 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:17:49.536572    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/96ea0c83-b0af-4039-898d-49f5c9484ecb-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-q9plc\" (UID: \"96ea0c83-b0af-4039-898d-49f5c9484ecb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-q9plc"
Jul 27 20:17:49.536797 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:17:49.536664    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/96ea0c83-b0af-4039-898d-49f5c9484ecb-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-q9plc\" (UID: \"96ea0c83-b0af-4039-898d-49f5c9484ecb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-q9plc"
Jul 27 20:17:49.536797 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:17:49.536720    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/96ea0c83-b0af-4039-898d-49f5c9484ecb-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-q9plc\" (UID: \"96ea0c83-b0af-4039-898d-49f5c9484ecb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-q9plc"
Jul 27 20:17:49.536797 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:17:49.536768    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9z45\" (UniqueName: \"kubernetes.io/projected/96ea0c83-b0af-4039-898d-49f5c9484ecb-kube-api-access-z9z45\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-q9plc\" (UID: \"96ea0c83-b0af-4039-898d-49f5c9484ecb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-q9plc"
Jul 27 20:17:49.537001 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:17:49.536975    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/96ea0c83-b0af-4039-898d-49f5c9484ecb-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-q9plc\" (UID: \"96ea0c83-b0af-4039-898d-49f5c9484ecb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-q9plc"
Jul 27 20:17:49.537001 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:17:49.536994    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/96ea0c83-b0af-4039-898d-49f5c9484ecb-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-q9plc\" (UID: \"96ea0c83-b0af-4039-898d-49f5c9484ecb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-q9plc"
Jul 27 20:17:49.537196 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:17:49.537175    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/96ea0c83-b0af-4039-898d-49f5c9484ecb-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-q9plc\" (UID: \"96ea0c83-b0af-4039-898d-49f5c9484ecb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-q9plc"
Jul 27 20:17:49.539019 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:17:49.538995    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/96ea0c83-b0af-4039-898d-49f5c9484ecb-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-q9plc\" (UID: \"96ea0c83-b0af-4039-898d-49f5c9484ecb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-q9plc"
Jul 27 20:17:49.539167 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:17:49.539146    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/96ea0c83-b0af-4039-898d-49f5c9484ecb-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-q9plc\" (UID: \"96ea0c83-b0af-4039-898d-49f5c9484ecb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-q9plc"
Jul 27 20:17:49.545885 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:17:49.545832    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9z45\" (UniqueName: \"kubernetes.io/projected/96ea0c83-b0af-4039-898d-49f5c9484ecb-kube-api-access-z9z45\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-q9plc\" (UID: \"96ea0c83-b0af-4039-898d-49f5c9484ecb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-q9plc"
Jul 27 20:17:49.606962 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:17:49.606919    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-q9plc"
Jul 27 20:17:49.745906 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:17:49.745873    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-q9plc"]
Jul 27 20:17:49.747301 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:17:49.747272    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod96ea0c83_b0af_4039_898d_49f5c9484ecb.slice/crio-3e5f18629078c8c05f80ae7dbb628a6cc5d7d0a82992b1eec96647c877129a7a WatchSource:0}: Error finding container 3e5f18629078c8c05f80ae7dbb628a6cc5d7d0a82992b1eec96647c877129a7a: Status 404 returned error can't find the container with id 3e5f18629078c8c05f80ae7dbb628a6cc5d7d0a82992b1eec96647c877129a7a
Jul 27 20:17:49.748648 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:17:49.748634    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 20:17:49.812008 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:17:49.811918    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-q9plc" event={"ID":"96ea0c83-b0af-4039-898d-49f5c9484ecb","Type":"ContainerStarted","Data":"3e5f18629078c8c05f80ae7dbb628a6cc5d7d0a82992b1eec96647c877129a7a"}
Jul 27 20:17:51.825884 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:17:51.825845    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-q9plc" event={"ID":"96ea0c83-b0af-4039-898d-49f5c9484ecb","Type":"ContainerStarted","Data":"25f9aea627cb4a4a547c79139e3c75876bab4769083a546494e6b1be20fd21cd"}
Jul 27 20:17:51.844870 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:17:51.844821    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-q9plc" podStartSLOduration=1.743097035 podStartE2EDuration="2.844805476s" totalImagesPullingTime="1.101708441s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:17:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:17:51.842529112 +0000 UTC m=+820.417255508" watchObservedRunningTime="2026-07-27 20:17:51.844805476 +0000 UTC m=+820.419531841"
Jul 27 20:17:59.194383 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:17:59.194344    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:17:59.607475 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:17:59.607414    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-q9plc"
Jul 27 20:17:59.607649 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:17:59.607508    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-q9plc"
Jul 27 20:17:59.620019 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:17:59.619987    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-q9plc"
Jul 27 20:17:59.877115 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:17:59.877023    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-q9plc"
Jul 27 20:18:30.596154 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:30.596091    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:18:30.697731 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:30.697695    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:18:30.802047 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:30.802013    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-78b888cfff-7zhxk"]
Jul 27 20:18:30.805570 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:30.805550    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78b888cfff-7zhxk"
Jul 27 20:18:30.818229 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:30.818198    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78b888cfff-7zhxk"]
Jul 27 20:18:30.864341 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:30.864260    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:18:30.880447 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:30.880414    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/de773639-8566-4a1b-a844-c7870ed663da-service-ca\") pod \"console-78b888cfff-7zhxk\" (UID: \"de773639-8566-4a1b-a844-c7870ed663da\") " pod="openshift-console/console-78b888cfff-7zhxk"
Jul 27 20:18:30.880636 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:30.880468    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/de773639-8566-4a1b-a844-c7870ed663da-console-serving-cert\") pod \"console-78b888cfff-7zhxk\" (UID: \"de773639-8566-4a1b-a844-c7870ed663da\") " pod="openshift-console/console-78b888cfff-7zhxk"
Jul 27 20:18:30.880636 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:30.880512    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/de773639-8566-4a1b-a844-c7870ed663da-console-oauth-config\") pod \"console-78b888cfff-7zhxk\" (UID: \"de773639-8566-4a1b-a844-c7870ed663da\") " pod="openshift-console/console-78b888cfff-7zhxk"
Jul 27 20:18:30.880636 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:30.880552    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/de773639-8566-4a1b-a844-c7870ed663da-oauth-serving-cert\") pod \"console-78b888cfff-7zhxk\" (UID: \"de773639-8566-4a1b-a844-c7870ed663da\") " pod="openshift-console/console-78b888cfff-7zhxk"
Jul 27 20:18:30.880636 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:30.880623    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/de773639-8566-4a1b-a844-c7870ed663da-console-config\") pod \"console-78b888cfff-7zhxk\" (UID: \"de773639-8566-4a1b-a844-c7870ed663da\") " pod="openshift-console/console-78b888cfff-7zhxk"
Jul 27 20:18:30.880779 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:30.880639    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78bsd\" (UniqueName: \"kubernetes.io/projected/de773639-8566-4a1b-a844-c7870ed663da-kube-api-access-78bsd\") pod \"console-78b888cfff-7zhxk\" (UID: \"de773639-8566-4a1b-a844-c7870ed663da\") " pod="openshift-console/console-78b888cfff-7zhxk"
Jul 27 20:18:30.880779 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:30.880686    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de773639-8566-4a1b-a844-c7870ed663da-trusted-ca-bundle\") pod \"console-78b888cfff-7zhxk\" (UID: \"de773639-8566-4a1b-a844-c7870ed663da\") " pod="openshift-console/console-78b888cfff-7zhxk"
Jul 27 20:18:30.981632 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:30.981593    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/de773639-8566-4a1b-a844-c7870ed663da-console-config\") pod \"console-78b888cfff-7zhxk\" (UID: \"de773639-8566-4a1b-a844-c7870ed663da\") " pod="openshift-console/console-78b888cfff-7zhxk"
Jul 27 20:18:30.981632 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:30.981635    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78bsd\" (UniqueName: \"kubernetes.io/projected/de773639-8566-4a1b-a844-c7870ed663da-kube-api-access-78bsd\") pod \"console-78b888cfff-7zhxk\" (UID: \"de773639-8566-4a1b-a844-c7870ed663da\") " pod="openshift-console/console-78b888cfff-7zhxk"
Jul 27 20:18:30.981841 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:30.981691    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de773639-8566-4a1b-a844-c7870ed663da-trusted-ca-bundle\") pod \"console-78b888cfff-7zhxk\" (UID: \"de773639-8566-4a1b-a844-c7870ed663da\") " pod="openshift-console/console-78b888cfff-7zhxk"
Jul 27 20:18:30.981841 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:30.981764    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/de773639-8566-4a1b-a844-c7870ed663da-service-ca\") pod \"console-78b888cfff-7zhxk\" (UID: \"de773639-8566-4a1b-a844-c7870ed663da\") " pod="openshift-console/console-78b888cfff-7zhxk"
Jul 27 20:18:30.981841 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:30.981793    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/de773639-8566-4a1b-a844-c7870ed663da-console-serving-cert\") pod \"console-78b888cfff-7zhxk\" (UID: \"de773639-8566-4a1b-a844-c7870ed663da\") " pod="openshift-console/console-78b888cfff-7zhxk"
Jul 27 20:18:30.981841 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:30.981823    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/de773639-8566-4a1b-a844-c7870ed663da-console-oauth-config\") pod \"console-78b888cfff-7zhxk\" (UID: \"de773639-8566-4a1b-a844-c7870ed663da\") " pod="openshift-console/console-78b888cfff-7zhxk"
Jul 27 20:18:30.982042 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:30.981851    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/de773639-8566-4a1b-a844-c7870ed663da-oauth-serving-cert\") pod \"console-78b888cfff-7zhxk\" (UID: \"de773639-8566-4a1b-a844-c7870ed663da\") " pod="openshift-console/console-78b888cfff-7zhxk"
Jul 27 20:18:30.982556 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:30.982530    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/de773639-8566-4a1b-a844-c7870ed663da-console-config\") pod \"console-78b888cfff-7zhxk\" (UID: \"de773639-8566-4a1b-a844-c7870ed663da\") " pod="openshift-console/console-78b888cfff-7zhxk"
Jul 27 20:18:30.982687 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:30.982559    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/de773639-8566-4a1b-a844-c7870ed663da-service-ca\") pod \"console-78b888cfff-7zhxk\" (UID: \"de773639-8566-4a1b-a844-c7870ed663da\") " pod="openshift-console/console-78b888cfff-7zhxk"
Jul 27 20:18:30.982687 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:30.982619    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/de773639-8566-4a1b-a844-c7870ed663da-oauth-serving-cert\") pod \"console-78b888cfff-7zhxk\" (UID: \"de773639-8566-4a1b-a844-c7870ed663da\") " pod="openshift-console/console-78b888cfff-7zhxk"
Jul 27 20:18:30.982687 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:30.982650    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de773639-8566-4a1b-a844-c7870ed663da-trusted-ca-bundle\") pod \"console-78b888cfff-7zhxk\" (UID: \"de773639-8566-4a1b-a844-c7870ed663da\") " pod="openshift-console/console-78b888cfff-7zhxk"
Jul 27 20:18:30.984197 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:30.984166    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/de773639-8566-4a1b-a844-c7870ed663da-console-serving-cert\") pod \"console-78b888cfff-7zhxk\" (UID: \"de773639-8566-4a1b-a844-c7870ed663da\") " pod="openshift-console/console-78b888cfff-7zhxk"
Jul 27 20:18:30.984308 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:30.984246    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/de773639-8566-4a1b-a844-c7870ed663da-console-oauth-config\") pod \"console-78b888cfff-7zhxk\" (UID: \"de773639-8566-4a1b-a844-c7870ed663da\") " pod="openshift-console/console-78b888cfff-7zhxk"
Jul 27 20:18:31.001130 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:31.001105    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-78bsd\" (UniqueName: \"kubernetes.io/projected/de773639-8566-4a1b-a844-c7870ed663da-kube-api-access-78bsd\") pod \"console-78b888cfff-7zhxk\" (UID: \"de773639-8566-4a1b-a844-c7870ed663da\") " pod="openshift-console/console-78b888cfff-7zhxk"
Jul 27 20:18:31.060313 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:31.060277    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:18:31.115208 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:31.115116    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78b888cfff-7zhxk"
Jul 27 20:18:31.176919 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:31.176879    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:18:31.261081 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:31.261057    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78b888cfff-7zhxk"]
Jul 27 20:18:31.263866 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:18:31.263840    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde773639_8566_4a1b_a844_c7870ed663da.slice/crio-19b8f54f3400b9064e01ddebf081d2fa4a8855ed40855787aaab1c67a57b3289 WatchSource:0}: Error finding container 19b8f54f3400b9064e01ddebf081d2fa4a8855ed40855787aaab1c67a57b3289: Status 404 returned error can't find the container with id 19b8f54f3400b9064e01ddebf081d2fa4a8855ed40855787aaab1c67a57b3289
Jul 27 20:18:31.617330 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:31.617301    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:18:31.689993 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:31.689952    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:18:32.025990 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:32.025957    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78b888cfff-7zhxk" event={"ID":"de773639-8566-4a1b-a844-c7870ed663da","Type":"ContainerStarted","Data":"f41a2d38da071a40e714ab19b3aaf48518836577989b059dcaa6242d1a4675c6"}
Jul 27 20:18:32.026171 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:32.026003    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78b888cfff-7zhxk" event={"ID":"de773639-8566-4a1b-a844-c7870ed663da","Type":"ContainerStarted","Data":"19b8f54f3400b9064e01ddebf081d2fa4a8855ed40855787aaab1c67a57b3289"}
Jul 27 20:18:32.047760 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:32.047712    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-78b888cfff-7zhxk" podStartSLOduration=2.047696612 podStartE2EDuration="2.047696612s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:18:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:18:32.04618808 +0000 UTC m=+860.620914480" watchObservedRunningTime="2026-07-27 20:18:32.047696612 +0000 UTC m=+860.622422999"
Jul 27 20:18:41.115908 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:41.115873    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-78b888cfff-7zhxk"
Jul 27 20:18:41.116311 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:41.115944    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-78b888cfff-7zhxk"
Jul 27 20:18:41.120673 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:41.120652    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-78b888cfff-7zhxk"
Jul 27 20:18:42.084397 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:42.084371    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-78b888cfff-7zhxk"
Jul 27 20:18:42.093138 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:42.093108    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5778fdbcb6-tm9gt"]
Jul 27 20:18:42.096651 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:42.096629    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5778fdbcb6-tm9gt"
Jul 27 20:18:42.105151 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:42.105101    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5778fdbcb6-tm9gt"]
Jul 27 20:18:42.141289 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:42.141247    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f984bd458-gh29t"]
Jul 27 20:18:42.181491 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:42.181441    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/77e5c699-4ef0-4403-8549-57a760aae76b-tls-cert\") pod \"authorino-5778fdbcb6-tm9gt\" (UID: \"77e5c699-4ef0-4403-8549-57a760aae76b\") " pod="kuadrant-system/authorino-5778fdbcb6-tm9gt"
Jul 27 20:18:42.181491 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:42.181494    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mkm2\" (UniqueName: \"kubernetes.io/projected/77e5c699-4ef0-4403-8549-57a760aae76b-kube-api-access-2mkm2\") pod \"authorino-5778fdbcb6-tm9gt\" (UID: \"77e5c699-4ef0-4403-8549-57a760aae76b\") " pod="kuadrant-system/authorino-5778fdbcb6-tm9gt"
Jul 27 20:18:42.239506 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:42.239441    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:18:42.282659 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:42.282615    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/77e5c699-4ef0-4403-8549-57a760aae76b-tls-cert\") pod \"authorino-5778fdbcb6-tm9gt\" (UID: \"77e5c699-4ef0-4403-8549-57a760aae76b\") " pod="kuadrant-system/authorino-5778fdbcb6-tm9gt"
Jul 27 20:18:42.282793 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:42.282664    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mkm2\" (UniqueName: \"kubernetes.io/projected/77e5c699-4ef0-4403-8549-57a760aae76b-kube-api-access-2mkm2\") pod \"authorino-5778fdbcb6-tm9gt\" (UID: \"77e5c699-4ef0-4403-8549-57a760aae76b\") " pod="kuadrant-system/authorino-5778fdbcb6-tm9gt"
Jul 27 20:18:42.285193 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:42.285171    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/77e5c699-4ef0-4403-8549-57a760aae76b-tls-cert\") pod \"authorino-5778fdbcb6-tm9gt\" (UID: \"77e5c699-4ef0-4403-8549-57a760aae76b\") " pod="kuadrant-system/authorino-5778fdbcb6-tm9gt"
Jul 27 20:18:42.291305 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:42.291278    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mkm2\" (UniqueName: \"kubernetes.io/projected/77e5c699-4ef0-4403-8549-57a760aae76b-kube-api-access-2mkm2\") pod \"authorino-5778fdbcb6-tm9gt\" (UID: \"77e5c699-4ef0-4403-8549-57a760aae76b\") " pod="kuadrant-system/authorino-5778fdbcb6-tm9gt"
Jul 27 20:18:42.340699 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:42.340607    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:18:42.407032 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:42.406993    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5778fdbcb6-tm9gt"
Jul 27 20:18:42.441661 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:42.441625    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:18:42.541878 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:42.541854    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5778fdbcb6-tm9gt"]
Jul 27 20:18:42.544410 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:18:42.544381    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod77e5c699_4ef0_4403_8549_57a760aae76b.slice/crio-55c7028239421358ac69630a9a7ea8b360f3c641c2db8cc5f94e5243a0798c4b WatchSource:0}: Error finding container 55c7028239421358ac69630a9a7ea8b360f3c641c2db8cc5f94e5243a0798c4b: Status 404 returned error can't find the container with id 55c7028239421358ac69630a9a7ea8b360f3c641c2db8cc5f94e5243a0798c4b
Jul 27 20:18:43.086605 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:43.086568    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5778fdbcb6-tm9gt" event={"ID":"77e5c699-4ef0-4403-8549-57a760aae76b","Type":"ContainerStarted","Data":"55c7028239421358ac69630a9a7ea8b360f3c641c2db8cc5f94e5243a0798c4b"}
Jul 27 20:18:44.096434 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:44.096393    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5778fdbcb6-tm9gt" event={"ID":"77e5c699-4ef0-4403-8549-57a760aae76b","Type":"ContainerStarted","Data":"17e6bfd4618a6a28b6d49db4bb3e3f3233a995470e3279fe23f759733a7f5578"}
Jul 27 20:18:44.113719 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:44.113651    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5778fdbcb6-tm9gt" podStartSLOduration=1.539002389 podStartE2EDuration="2.113629225s" totalImagesPullingTime="574.626836ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:18:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:18:44.111936267 +0000 UTC m=+872.686662648" watchObservedRunningTime="2026-07-27 20:18:44.113629225 +0000 UTC m=+872.688355614"
Jul 27 20:18:44.141570 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:44.141532    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6675954f9-csdnn"]
Jul 27 20:18:44.141781 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:44.141753    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-6675954f9-csdnn" podUID="190da35b-4cb6-48d2-aa74-72c47c67b3a6" containerName="authorino" containerID="cri-o://7dc0316a1be317799074ecb5fac67ecd821e89fcf66b002398751260f1d9de6b" gracePeriod=30
Jul 27 20:18:44.409244 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:44.409218    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6675954f9-csdnn"
Jul 27 20:18:44.502642 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:44.502602    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/190da35b-4cb6-48d2-aa74-72c47c67b3a6-tls-cert\") pod \"190da35b-4cb6-48d2-aa74-72c47c67b3a6\" (UID: \"190da35b-4cb6-48d2-aa74-72c47c67b3a6\") "
Jul 27 20:18:44.502840 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:44.502753    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c7xbm\" (UniqueName: \"kubernetes.io/projected/190da35b-4cb6-48d2-aa74-72c47c67b3a6-kube-api-access-c7xbm\") pod \"190da35b-4cb6-48d2-aa74-72c47c67b3a6\" (UID: \"190da35b-4cb6-48d2-aa74-72c47c67b3a6\") "
Jul 27 20:18:44.505603 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:44.505563    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/190da35b-4cb6-48d2-aa74-72c47c67b3a6-kube-api-access-c7xbm" (OuterVolumeSpecName: "kube-api-access-c7xbm") pod "190da35b-4cb6-48d2-aa74-72c47c67b3a6" (UID: "190da35b-4cb6-48d2-aa74-72c47c67b3a6"). InnerVolumeSpecName "kube-api-access-c7xbm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:18:44.513770 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:44.513739    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/190da35b-4cb6-48d2-aa74-72c47c67b3a6-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "190da35b-4cb6-48d2-aa74-72c47c67b3a6" (UID: "190da35b-4cb6-48d2-aa74-72c47c67b3a6"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:18:44.603784 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:44.603745    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c7xbm\" (UniqueName: \"kubernetes.io/projected/190da35b-4cb6-48d2-aa74-72c47c67b3a6-kube-api-access-c7xbm\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:18:44.603784 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:44.603777    2557 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/190da35b-4cb6-48d2-aa74-72c47c67b3a6-tls-cert\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:18:44.906714 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:44.906678    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:18:45.004580 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:45.004550    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:18:45.102418 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:45.102380    2557 generic.go:356] "Generic (PLEG): container finished" podID="190da35b-4cb6-48d2-aa74-72c47c67b3a6" containerID="7dc0316a1be317799074ecb5fac67ecd821e89fcf66b002398751260f1d9de6b" exitCode=0
Jul 27 20:18:45.102879 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:45.102431    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6675954f9-csdnn"
Jul 27 20:18:45.102879 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:45.102491    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6675954f9-csdnn" event={"ID":"190da35b-4cb6-48d2-aa74-72c47c67b3a6","Type":"ContainerDied","Data":"7dc0316a1be317799074ecb5fac67ecd821e89fcf66b002398751260f1d9de6b"}
Jul 27 20:18:45.102879 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:45.102545    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6675954f9-csdnn" event={"ID":"190da35b-4cb6-48d2-aa74-72c47c67b3a6","Type":"ContainerDied","Data":"5c389a9b777985f6c5f5087b0cbbf75d2910f703d42c5e02ed06139aa3ec3bff"}
Jul 27 20:18:45.102879 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:45.102566    2557 scope.go:117] "RemoveContainer" containerID="7dc0316a1be317799074ecb5fac67ecd821e89fcf66b002398751260f1d9de6b"
Jul 27 20:18:45.112816 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:45.112795    2557 scope.go:117] "RemoveContainer" containerID="7dc0316a1be317799074ecb5fac67ecd821e89fcf66b002398751260f1d9de6b"
Jul 27 20:18:45.113081 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:18:45.113059    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7dc0316a1be317799074ecb5fac67ecd821e89fcf66b002398751260f1d9de6b\": container with ID starting with 7dc0316a1be317799074ecb5fac67ecd821e89fcf66b002398751260f1d9de6b not found: ID does not exist" containerID="7dc0316a1be317799074ecb5fac67ecd821e89fcf66b002398751260f1d9de6b"
Jul 27 20:18:45.113137 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:45.113097    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7dc0316a1be317799074ecb5fac67ecd821e89fcf66b002398751260f1d9de6b"} err="failed to get container status \"7dc0316a1be317799074ecb5fac67ecd821e89fcf66b002398751260f1d9de6b\": rpc error: code = NotFound desc = could not find container \"7dc0316a1be317799074ecb5fac67ecd821e89fcf66b002398751260f1d9de6b\": container with ID starting with 7dc0316a1be317799074ecb5fac67ecd821e89fcf66b002398751260f1d9de6b not found: ID does not exist"
Jul 27 20:18:45.128493 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:45.128445    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6675954f9-csdnn"]
Jul 27 20:18:45.147579 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:45.147546    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6675954f9-csdnn"]
Jul 27 20:18:45.914647 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:45.912366    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="190da35b-4cb6-48d2-aa74-72c47c67b3a6" path="/var/lib/kubelet/pods/190da35b-4cb6-48d2-aa74-72c47c67b3a6/volumes"
Jul 27 20:18:47.227278 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:47.227239    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:18:47.312782 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:47.312743    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:18:47.724675 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:18:47.724630    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:19:07.166678 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:19:07.166597    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5f984bd458-gh29t" podUID="d42cea1b-6052-4860-95fb-845e9ce271c8" containerName="console" containerID="cri-o://7fd629ec374197bdd6a95cf054e7c5016579a4918eabc11f3b969c937db62f49" gracePeriod=15
Jul 27 20:19:07.254379 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:19:07.254345    2557 patch_prober.go:28] interesting pod/console-5f984bd458-gh29t container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.134.0.25:8443/health\": dial tcp 10.134.0.25:8443: connect: connection refused" start-of-body=
Jul 27 20:19:07.254554 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:19:07.254414    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-5f984bd458-gh29t" podUID="d42cea1b-6052-4860-95fb-845e9ce271c8" containerName="console" probeResult="failure" output="Get \"https://10.134.0.25:8443/health\": dial tcp 10.134.0.25:8443: connect: connection refused"
Jul 27 20:19:07.416983 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:19:07.416922    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f984bd458-gh29t"
Jul 27 20:19:07.498780 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:19:07.498739    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d42cea1b-6052-4860-95fb-845e9ce271c8-trusted-ca-bundle\") pod \"d42cea1b-6052-4860-95fb-845e9ce271c8\" (UID: \"d42cea1b-6052-4860-95fb-845e9ce271c8\") "
Jul 27 20:19:07.498780 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:19:07.498783    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d42cea1b-6052-4860-95fb-845e9ce271c8-console-config\") pod \"d42cea1b-6052-4860-95fb-845e9ce271c8\" (UID: \"d42cea1b-6052-4860-95fb-845e9ce271c8\") "
Jul 27 20:19:07.499030 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:19:07.498805    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zr2dz\" (UniqueName: \"kubernetes.io/projected/d42cea1b-6052-4860-95fb-845e9ce271c8-kube-api-access-zr2dz\") pod \"d42cea1b-6052-4860-95fb-845e9ce271c8\" (UID: \"d42cea1b-6052-4860-95fb-845e9ce271c8\") "
Jul 27 20:19:07.499030 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:19:07.498932    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d42cea1b-6052-4860-95fb-845e9ce271c8-service-ca\") pod \"d42cea1b-6052-4860-95fb-845e9ce271c8\" (UID: \"d42cea1b-6052-4860-95fb-845e9ce271c8\") "
Jul 27 20:19:07.499030 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:19:07.498967    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d42cea1b-6052-4860-95fb-845e9ce271c8-console-oauth-config\") pod \"d42cea1b-6052-4860-95fb-845e9ce271c8\" (UID: \"d42cea1b-6052-4860-95fb-845e9ce271c8\") "
Jul 27 20:19:07.499030 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:19:07.498985    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d42cea1b-6052-4860-95fb-845e9ce271c8-console-serving-cert\") pod \"d42cea1b-6052-4860-95fb-845e9ce271c8\" (UID: \"d42cea1b-6052-4860-95fb-845e9ce271c8\") "
Jul 27 20:19:07.499243 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:19:07.499044    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d42cea1b-6052-4860-95fb-845e9ce271c8-oauth-serving-cert\") pod \"d42cea1b-6052-4860-95fb-845e9ce271c8\" (UID: \"d42cea1b-6052-4860-95fb-845e9ce271c8\") "
Jul 27 20:19:07.499243 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:19:07.499204    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d42cea1b-6052-4860-95fb-845e9ce271c8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d42cea1b-6052-4860-95fb-845e9ce271c8" (UID: "d42cea1b-6052-4860-95fb-845e9ce271c8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:19:07.499345 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:19:07.499289    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d42cea1b-6052-4860-95fb-845e9ce271c8-service-ca" (OuterVolumeSpecName: "service-ca") pod "d42cea1b-6052-4860-95fb-845e9ce271c8" (UID: "d42cea1b-6052-4860-95fb-845e9ce271c8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:19:07.499345 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:19:07.499302    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d42cea1b-6052-4860-95fb-845e9ce271c8-console-config" (OuterVolumeSpecName: "console-config") pod "d42cea1b-6052-4860-95fb-845e9ce271c8" (UID: "d42cea1b-6052-4860-95fb-845e9ce271c8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:19:07.499445 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:19:07.499356    2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d42cea1b-6052-4860-95fb-845e9ce271c8-trusted-ca-bundle\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:19:07.499585 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:19:07.499564    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d42cea1b-6052-4860-95fb-845e9ce271c8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d42cea1b-6052-4860-95fb-845e9ce271c8" (UID: "d42cea1b-6052-4860-95fb-845e9ce271c8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:19:07.500991 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:19:07.500971    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d42cea1b-6052-4860-95fb-845e9ce271c8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d42cea1b-6052-4860-95fb-845e9ce271c8" (UID: "d42cea1b-6052-4860-95fb-845e9ce271c8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:19:07.501481 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:19:07.501440    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d42cea1b-6052-4860-95fb-845e9ce271c8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d42cea1b-6052-4860-95fb-845e9ce271c8" (UID: "d42cea1b-6052-4860-95fb-845e9ce271c8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:19:07.501550 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:19:07.501472    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d42cea1b-6052-4860-95fb-845e9ce271c8-kube-api-access-zr2dz" (OuterVolumeSpecName: "kube-api-access-zr2dz") pod "d42cea1b-6052-4860-95fb-845e9ce271c8" (UID: "d42cea1b-6052-4860-95fb-845e9ce271c8"). InnerVolumeSpecName "kube-api-access-zr2dz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:19:07.600091 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:19:07.600046    2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d42cea1b-6052-4860-95fb-845e9ce271c8-console-config\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:19:07.600091 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:19:07.600089    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zr2dz\" (UniqueName: \"kubernetes.io/projected/d42cea1b-6052-4860-95fb-845e9ce271c8-kube-api-access-zr2dz\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:19:07.600091 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:19:07.600102    2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d42cea1b-6052-4860-95fb-845e9ce271c8-service-ca\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:19:07.600320 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:19:07.600111    2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d42cea1b-6052-4860-95fb-845e9ce271c8-console-oauth-config\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:19:07.600320 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:19:07.600119    2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d42cea1b-6052-4860-95fb-845e9ce271c8-console-serving-cert\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:19:07.600320 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:19:07.600130    2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d42cea1b-6052-4860-95fb-845e9ce271c8-oauth-serving-cert\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:19:08.227061 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:19:08.227020    2557 generic.go:356] "Generic (PLEG): container finished" podID="d42cea1b-6052-4860-95fb-845e9ce271c8" containerID="7fd629ec374197bdd6a95cf054e7c5016579a4918eabc11f3b969c937db62f49" exitCode=0
Jul 27 20:19:08.227578 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:19:08.227075    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f984bd458-gh29t"
Jul 27 20:19:08.227578 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:19:08.227110    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f984bd458-gh29t" event={"ID":"d42cea1b-6052-4860-95fb-845e9ce271c8","Type":"ContainerDied","Data":"7fd629ec374197bdd6a95cf054e7c5016579a4918eabc11f3b969c937db62f49"}
Jul 27 20:19:08.227578 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:19:08.227164    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f984bd458-gh29t" event={"ID":"d42cea1b-6052-4860-95fb-845e9ce271c8","Type":"ContainerDied","Data":"5fb28d822cc9d247412b0ad7c3e3a7c9b4617f7529cca5e650c939de9534f6b3"}
Jul 27 20:19:08.227578 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:19:08.227192    2557 scope.go:117] "RemoveContainer" containerID="7fd629ec374197bdd6a95cf054e7c5016579a4918eabc11f3b969c937db62f49"
Jul 27 20:19:08.236210 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:19:08.236190    2557 scope.go:117] "RemoveContainer" containerID="7fd629ec374197bdd6a95cf054e7c5016579a4918eabc11f3b969c937db62f49"
Jul 27 20:19:08.236567 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:19:08.236545    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7fd629ec374197bdd6a95cf054e7c5016579a4918eabc11f3b969c937db62f49\": container with ID starting with 7fd629ec374197bdd6a95cf054e7c5016579a4918eabc11f3b969c937db62f49 not found: ID does not exist" containerID="7fd629ec374197bdd6a95cf054e7c5016579a4918eabc11f3b969c937db62f49"
Jul 27 20:19:08.236642 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:19:08.236580    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7fd629ec374197bdd6a95cf054e7c5016579a4918eabc11f3b969c937db62f49"} err="failed to get container status \"7fd629ec374197bdd6a95cf054e7c5016579a4918eabc11f3b969c937db62f49\": rpc error: code = NotFound desc = could not find container \"7fd629ec374197bdd6a95cf054e7c5016579a4918eabc11f3b969c937db62f49\": container with ID starting with 7fd629ec374197bdd6a95cf054e7c5016579a4918eabc11f3b969c937db62f49 not found: ID does not exist"
Jul 27 20:19:08.245488 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:19:08.245463    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f984bd458-gh29t"]
Jul 27 20:19:08.249373 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:19:08.249351    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5f984bd458-gh29t"]
Jul 27 20:19:09.915473 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:19:09.915414    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d42cea1b-6052-4860-95fb-845e9ce271c8" path="/var/lib/kubelet/pods/d42cea1b-6052-4860-95fb-845e9ce271c8/volumes"
Jul 27 20:19:19.927314 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:19:19.927275    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:19:29.509979 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:19:29.509940    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:19:40.298750 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:19:40.298706    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:20:56.043699 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:20:56.043663    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:20:57.429395 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:20:57.429367    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:21:21.999666 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:21:21.999629    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:21:31.340749 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:21:31.340702    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:21:34.013384 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:21:34.013339    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:21:34.106758 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:21:34.106719    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:21:34.234643 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:21:34.234609    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:21:40.377962 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:21:40.377932    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:21:40.488151 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:21:40.488110    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:21:40.631340 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:21:40.631245    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:21:40.776441 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:21:40.776411    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:21:46.540555 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:21:46.540524    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:21:46.598168 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:21:46.598137    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:22:03.394258 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:22:03.394218    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:22:13.097013 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:22:13.096973    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:22:22.796379 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:22:22.796337    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:22:30.593821 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:22:30.593778    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:22:31.030032 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:22:31.029995    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:22:31.131245 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:22:31.131212    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:22:40.897847 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:22:40.897807    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:22:50.701874 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:22:50.701831    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:23:02.005823 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:23:02.005789    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:23:03.195512 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:23:03.195479    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:23:13.099979 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:23:13.099934    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:23:37.702733 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:23:37.702652    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:23:49.601121 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:23:49.601075    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:24:15.496813 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:24:15.496774    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:24:26.124932 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:24:26.124892    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:24:36.194572 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:24:36.194532    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:24:51.826057 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:24:51.826017    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:25:01.606100 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:25:01.606062    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:25:11.305995 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:25:11.305906    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:25:20.797013 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:25:20.796973    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:25:30.795167 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:25:30.795127    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:26:16.294078 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:26:16.294037    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:26:17.608801 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:26:17.608729    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:27:19.094320 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:27:19.094278    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:27:23.975812 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:27:23.975759    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:27:29.911119 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:27:29.911086    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:27:44.400779 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:27:44.400733    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:27:58.909612 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:27:58.909576    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:28:11.716880 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:28:11.716845    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:28:19.738024 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:28:19.737988    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:28:30.693819 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:28:30.693786    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:28:41.201352 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:28:41.201320    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:28:50.563463 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:28:50.563422    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:29:01.694694 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:29:01.694654    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:29:13.014245 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:29:13.014211    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:29:20.296876 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:29:20.296840    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:29:41.687579 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:29:41.687543    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:29:49.393063 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:29:49.393012    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:29:57.496652 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:29:57.496615    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-5d22cccf-kserve-68b974bf59-l9k7j"]
Jul 27 20:29:57.497169 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:29:57.497149    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="190da35b-4cb6-48d2-aa74-72c47c67b3a6" containerName="authorino"
Jul 27 20:29:57.497237 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:29:57.497172    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="190da35b-4cb6-48d2-aa74-72c47c67b3a6" containerName="authorino"
Jul 27 20:29:57.497237 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:29:57.497201    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d42cea1b-6052-4860-95fb-845e9ce271c8" containerName="console"
Jul 27 20:29:57.497237 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:29:57.497210    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d42cea1b-6052-4860-95fb-845e9ce271c8" containerName="console"
Jul 27 20:29:57.497394 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:29:57.497314    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="190da35b-4cb6-48d2-aa74-72c47c67b3a6" containerName="authorino"
Jul 27 20:29:57.497394 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:29:57.497327    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="d42cea1b-6052-4860-95fb-845e9ce271c8" containerName="console"
Jul 27 20:29:57.500219 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:29:57.500194    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-5d22cccf-kserve-68b974bf59-l9k7j"
Jul 27 20:29:57.502575 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:29:57.502555    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-5d22cccf-kserve-self-signed-certs\""
Jul 27 20:29:57.515832 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:29:57.515807    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-5d22cccf-kserve-68b974bf59-l9k7j"]
Jul 27 20:29:57.548601 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:29:57.548565    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:29:57.584248 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:29:57.584214    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cdd284e3-12de-4ea2-afb3-01eb21378608-dshm\") pod \"e2e-same-id-a-5d22cccf-kserve-68b974bf59-l9k7j\" (UID: \"cdd284e3-12de-4ea2-afb3-01eb21378608\") " pod="llm/e2e-same-id-a-5d22cccf-kserve-68b974bf59-l9k7j"
Jul 27 20:29:57.584422 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:29:57.584272    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cdd284e3-12de-4ea2-afb3-01eb21378608-tmp-dir\") pod \"e2e-same-id-a-5d22cccf-kserve-68b974bf59-l9k7j\" (UID: \"cdd284e3-12de-4ea2-afb3-01eb21378608\") " pod="llm/e2e-same-id-a-5d22cccf-kserve-68b974bf59-l9k7j"
Jul 27 20:29:57.584422 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:29:57.584294    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cdd284e3-12de-4ea2-afb3-01eb21378608-tls-certs\") pod \"e2e-same-id-a-5d22cccf-kserve-68b974bf59-l9k7j\" (UID: \"cdd284e3-12de-4ea2-afb3-01eb21378608\") " pod="llm/e2e-same-id-a-5d22cccf-kserve-68b974bf59-l9k7j"
Jul 27 20:29:57.584422 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:29:57.584316    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cdd284e3-12de-4ea2-afb3-01eb21378608-home\") pod \"e2e-same-id-a-5d22cccf-kserve-68b974bf59-l9k7j\" (UID: \"cdd284e3-12de-4ea2-afb3-01eb21378608\") " pod="llm/e2e-same-id-a-5d22cccf-kserve-68b974bf59-l9k7j"
Jul 27 20:29:57.584422 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:29:57.584334    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cdd284e3-12de-4ea2-afb3-01eb21378608-model-cache\") pod \"e2e-same-id-a-5d22cccf-kserve-68b974bf59-l9k7j\" (UID: \"cdd284e3-12de-4ea2-afb3-01eb21378608\") " pod="llm/e2e-same-id-a-5d22cccf-kserve-68b974bf59-l9k7j"
Jul 27 20:29:57.584422 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:29:57.584382    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfnz8\" (UniqueName: \"kubernetes.io/projected/cdd284e3-12de-4ea2-afb3-01eb21378608-kube-api-access-lfnz8\") pod \"e2e-same-id-a-5d22cccf-kserve-68b974bf59-l9k7j\" (UID: \"cdd284e3-12de-4ea2-afb3-01eb21378608\") " pod="llm/e2e-same-id-a-5d22cccf-kserve-68b974bf59-l9k7j"
Jul 27 20:29:57.685701 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:29:57.685663    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cdd284e3-12de-4ea2-afb3-01eb21378608-dshm\") pod \"e2e-same-id-a-5d22cccf-kserve-68b974bf59-l9k7j\" (UID: \"cdd284e3-12de-4ea2-afb3-01eb21378608\") " pod="llm/e2e-same-id-a-5d22cccf-kserve-68b974bf59-l9k7j"
Jul 27 20:29:57.685897 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:29:57.685713    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cdd284e3-12de-4ea2-afb3-01eb21378608-tmp-dir\") pod \"e2e-same-id-a-5d22cccf-kserve-68b974bf59-l9k7j\" (UID: \"cdd284e3-12de-4ea2-afb3-01eb21378608\") " pod="llm/e2e-same-id-a-5d22cccf-kserve-68b974bf59-l9k7j"
Jul 27 20:29:57.685897 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:29:57.685739    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cdd284e3-12de-4ea2-afb3-01eb21378608-tls-certs\") pod \"e2e-same-id-a-5d22cccf-kserve-68b974bf59-l9k7j\" (UID: \"cdd284e3-12de-4ea2-afb3-01eb21378608\") " pod="llm/e2e-same-id-a-5d22cccf-kserve-68b974bf59-l9k7j"
Jul 27 20:29:57.685897 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:29:57.685770    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cdd284e3-12de-4ea2-afb3-01eb21378608-home\") pod \"e2e-same-id-a-5d22cccf-kserve-68b974bf59-l9k7j\" (UID: \"cdd284e3-12de-4ea2-afb3-01eb21378608\") " pod="llm/e2e-same-id-a-5d22cccf-kserve-68b974bf59-l9k7j"
Jul 27 20:29:57.685897 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:29:57.685793    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cdd284e3-12de-4ea2-afb3-01eb21378608-model-cache\") pod \"e2e-same-id-a-5d22cccf-kserve-68b974bf59-l9k7j\" (UID: \"cdd284e3-12de-4ea2-afb3-01eb21378608\") " pod="llm/e2e-same-id-a-5d22cccf-kserve-68b974bf59-l9k7j"
Jul 27 20:29:57.686115 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:29:57.685943    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfnz8\" (UniqueName: \"kubernetes.io/projected/cdd284e3-12de-4ea2-afb3-01eb21378608-kube-api-access-lfnz8\") pod \"e2e-same-id-a-5d22cccf-kserve-68b974bf59-l9k7j\" (UID: \"cdd284e3-12de-4ea2-afb3-01eb21378608\") " pod="llm/e2e-same-id-a-5d22cccf-kserve-68b974bf59-l9k7j"
Jul 27 20:29:57.686668 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:29:57.686640    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cdd284e3-12de-4ea2-afb3-01eb21378608-home\") pod \"e2e-same-id-a-5d22cccf-kserve-68b974bf59-l9k7j\" (UID: \"cdd284e3-12de-4ea2-afb3-01eb21378608\") " pod="llm/e2e-same-id-a-5d22cccf-kserve-68b974bf59-l9k7j"
Jul 27 20:29:57.686849 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:29:57.686564    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cdd284e3-12de-4ea2-afb3-01eb21378608-tmp-dir\") pod \"e2e-same-id-a-5d22cccf-kserve-68b974bf59-l9k7j\" (UID: \"cdd284e3-12de-4ea2-afb3-01eb21378608\") " pod="llm/e2e-same-id-a-5d22cccf-kserve-68b974bf59-l9k7j"
Jul 27 20:29:57.686952 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:29:57.686760    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cdd284e3-12de-4ea2-afb3-01eb21378608-model-cache\") pod \"e2e-same-id-a-5d22cccf-kserve-68b974bf59-l9k7j\" (UID: \"cdd284e3-12de-4ea2-afb3-01eb21378608\") " pod="llm/e2e-same-id-a-5d22cccf-kserve-68b974bf59-l9k7j"
Jul 27 20:29:57.689937 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:29:57.689908    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cdd284e3-12de-4ea2-afb3-01eb21378608-dshm\") pod \"e2e-same-id-a-5d22cccf-kserve-68b974bf59-l9k7j\" (UID: \"cdd284e3-12de-4ea2-afb3-01eb21378608\") " pod="llm/e2e-same-id-a-5d22cccf-kserve-68b974bf59-l9k7j"
Jul 27 20:29:57.693822 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:29:57.693112    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cdd284e3-12de-4ea2-afb3-01eb21378608-tls-certs\") pod \"e2e-same-id-a-5d22cccf-kserve-68b974bf59-l9k7j\" (UID: \"cdd284e3-12de-4ea2-afb3-01eb21378608\") " pod="llm/e2e-same-id-a-5d22cccf-kserve-68b974bf59-l9k7j"
Jul 27 20:29:57.696150 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:29:57.696126    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfnz8\" (UniqueName: \"kubernetes.io/projected/cdd284e3-12de-4ea2-afb3-01eb21378608-kube-api-access-lfnz8\") pod \"e2e-same-id-a-5d22cccf-kserve-68b974bf59-l9k7j\" (UID: \"cdd284e3-12de-4ea2-afb3-01eb21378608\") " pod="llm/e2e-same-id-a-5d22cccf-kserve-68b974bf59-l9k7j"
Jul 27 20:29:57.809753 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:29:57.809657    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-5d22cccf-kserve-68b974bf59-l9k7j"
Jul 27 20:29:57.947907 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:29:57.947879    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-5d22cccf-kserve-68b974bf59-l9k7j"]
Jul 27 20:29:57.949806 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:29:57.949776    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcdd284e3_12de_4ea2_afb3_01eb21378608.slice/crio-01794c6ff2d79f423822b5d08d7b971483346057ef1a5afe224900be74825991 WatchSource:0}: Error finding container 01794c6ff2d79f423822b5d08d7b971483346057ef1a5afe224900be74825991: Status 404 returned error can't find the container with id 01794c6ff2d79f423822b5d08d7b971483346057ef1a5afe224900be74825991
Jul 27 20:29:58.606365 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:29:58.606331    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-5d22cccf-kserve-68b974bf59-l9k7j" event={"ID":"cdd284e3-12de-4ea2-afb3-01eb21378608","Type":"ContainerStarted","Data":"cf0abf3b169a3f9c71b5927010491f48452125f4f446b97eb1bd073f7106b465"}
Jul 27 20:29:58.606765 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:29:58.606373    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-5d22cccf-kserve-68b974bf59-l9k7j" event={"ID":"cdd284e3-12de-4ea2-afb3-01eb21378608","Type":"ContainerStarted","Data":"01794c6ff2d79f423822b5d08d7b971483346057ef1a5afe224900be74825991"}
Jul 27 20:29:58.623301 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:29:58.623245    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-5d22cccf-kserve-68b974bf59-l9k7j" podStartSLOduration=1.6232304119999998 podStartE2EDuration="1.623230412s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:29:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:29:58.62188145 +0000 UTC m=+1547.196607837" watchObservedRunningTime="2026-07-27 20:29:58.623230412 +0000 UTC m=+1547.197956799"
Jul 27 20:30:01.594097 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:30:01.594054    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:30:07.810774 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:30:07.810672    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-5d22cccf-kserve-68b974bf59-l9k7j"
Jul 27 20:30:07.810774 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:30:07.810734    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-5d22cccf-kserve-68b974bf59-l9k7j"
Jul 27 20:30:07.823378 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:30:07.823345    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-5d22cccf-kserve-68b974bf59-l9k7j"
Jul 27 20:30:08.669931 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:30:08.669898    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-5d22cccf-kserve-68b974bf59-l9k7j"
Jul 27 20:30:26.307055 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:30:26.307014    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-5d22cccf-kserve-658554948c-ngxjl"]
Jul 27 20:30:26.310716 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:30:26.310694    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-5d22cccf-kserve-658554948c-ngxjl"
Jul 27 20:30:26.313053 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:30:26.313029    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-5d22cccf-kserve-self-signed-certs\""
Jul 27 20:30:26.318814 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:30:26.318789    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-5d22cccf-kserve-658554948c-ngxjl"]
Jul 27 20:30:26.439330 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:30:26.439288    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91b59dd1-6698-4491-897b-e4061d656afb-tls-certs\") pod \"e2e-same-id-b-5d22cccf-kserve-658554948c-ngxjl\" (UID: \"91b59dd1-6698-4491-897b-e4061d656afb\") " pod="llm/e2e-same-id-b-5d22cccf-kserve-658554948c-ngxjl"
Jul 27 20:30:26.439330 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:30:26.439328    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91b59dd1-6698-4491-897b-e4061d656afb-home\") pod \"e2e-same-id-b-5d22cccf-kserve-658554948c-ngxjl\" (UID: \"91b59dd1-6698-4491-897b-e4061d656afb\") " pod="llm/e2e-same-id-b-5d22cccf-kserve-658554948c-ngxjl"
Jul 27 20:30:26.439608 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:30:26.439346    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91b59dd1-6698-4491-897b-e4061d656afb-dshm\") pod \"e2e-same-id-b-5d22cccf-kserve-658554948c-ngxjl\" (UID: \"91b59dd1-6698-4491-897b-e4061d656afb\") " pod="llm/e2e-same-id-b-5d22cccf-kserve-658554948c-ngxjl"
Jul 27 20:30:26.439608 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:30:26.439439    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91b59dd1-6698-4491-897b-e4061d656afb-tmp-dir\") pod \"e2e-same-id-b-5d22cccf-kserve-658554948c-ngxjl\" (UID: \"91b59dd1-6698-4491-897b-e4061d656afb\") " pod="llm/e2e-same-id-b-5d22cccf-kserve-658554948c-ngxjl"
Jul 27 20:30:26.439608 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:30:26.439564    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91b59dd1-6698-4491-897b-e4061d656afb-model-cache\") pod \"e2e-same-id-b-5d22cccf-kserve-658554948c-ngxjl\" (UID: \"91b59dd1-6698-4491-897b-e4061d656afb\") " pod="llm/e2e-same-id-b-5d22cccf-kserve-658554948c-ngxjl"
Jul 27 20:30:26.439708 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:30:26.439623    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6m65w\" (UniqueName: \"kubernetes.io/projected/91b59dd1-6698-4491-897b-e4061d656afb-kube-api-access-6m65w\") pod \"e2e-same-id-b-5d22cccf-kserve-658554948c-ngxjl\" (UID: \"91b59dd1-6698-4491-897b-e4061d656afb\") " pod="llm/e2e-same-id-b-5d22cccf-kserve-658554948c-ngxjl"
Jul 27 20:30:26.540751 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:30:26.540715    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91b59dd1-6698-4491-897b-e4061d656afb-tmp-dir\") pod \"e2e-same-id-b-5d22cccf-kserve-658554948c-ngxjl\" (UID: \"91b59dd1-6698-4491-897b-e4061d656afb\") " pod="llm/e2e-same-id-b-5d22cccf-kserve-658554948c-ngxjl"
Jul 27 20:30:26.540926 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:30:26.540777    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91b59dd1-6698-4491-897b-e4061d656afb-model-cache\") pod \"e2e-same-id-b-5d22cccf-kserve-658554948c-ngxjl\" (UID: \"91b59dd1-6698-4491-897b-e4061d656afb\") " pod="llm/e2e-same-id-b-5d22cccf-kserve-658554948c-ngxjl"
Jul 27 20:30:26.540926 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:30:26.540835    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6m65w\" (UniqueName: \"kubernetes.io/projected/91b59dd1-6698-4491-897b-e4061d656afb-kube-api-access-6m65w\") pod \"e2e-same-id-b-5d22cccf-kserve-658554948c-ngxjl\" (UID: \"91b59dd1-6698-4491-897b-e4061d656afb\") " pod="llm/e2e-same-id-b-5d22cccf-kserve-658554948c-ngxjl"
Jul 27 20:30:26.540926 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:30:26.540869    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91b59dd1-6698-4491-897b-e4061d656afb-tls-certs\") pod \"e2e-same-id-b-5d22cccf-kserve-658554948c-ngxjl\" (UID: \"91b59dd1-6698-4491-897b-e4061d656afb\") " pod="llm/e2e-same-id-b-5d22cccf-kserve-658554948c-ngxjl"
Jul 27 20:30:26.540926 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:30:26.540893    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91b59dd1-6698-4491-897b-e4061d656afb-home\") pod \"e2e-same-id-b-5d22cccf-kserve-658554948c-ngxjl\" (UID: \"91b59dd1-6698-4491-897b-e4061d656afb\") " pod="llm/e2e-same-id-b-5d22cccf-kserve-658554948c-ngxjl"
Jul 27 20:30:26.540926 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:30:26.540915    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91b59dd1-6698-4491-897b-e4061d656afb-dshm\") pod \"e2e-same-id-b-5d22cccf-kserve-658554948c-ngxjl\" (UID: \"91b59dd1-6698-4491-897b-e4061d656afb\") " pod="llm/e2e-same-id-b-5d22cccf-kserve-658554948c-ngxjl"
Jul 27 20:30:26.541235 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:30:26.541212    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91b59dd1-6698-4491-897b-e4061d656afb-tmp-dir\") pod \"e2e-same-id-b-5d22cccf-kserve-658554948c-ngxjl\" (UID: \"91b59dd1-6698-4491-897b-e4061d656afb\") " pod="llm/e2e-same-id-b-5d22cccf-kserve-658554948c-ngxjl"
Jul 27 20:30:26.541235 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:30:26.541223    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91b59dd1-6698-4491-897b-e4061d656afb-model-cache\") pod \"e2e-same-id-b-5d22cccf-kserve-658554948c-ngxjl\" (UID: \"91b59dd1-6698-4491-897b-e4061d656afb\") " pod="llm/e2e-same-id-b-5d22cccf-kserve-658554948c-ngxjl"
Jul 27 20:30:26.541355 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:30:26.541311    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91b59dd1-6698-4491-897b-e4061d656afb-home\") pod \"e2e-same-id-b-5d22cccf-kserve-658554948c-ngxjl\" (UID: \"91b59dd1-6698-4491-897b-e4061d656afb\") " pod="llm/e2e-same-id-b-5d22cccf-kserve-658554948c-ngxjl"
Jul 27 20:30:26.543172 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:30:26.543146    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91b59dd1-6698-4491-897b-e4061d656afb-dshm\") pod \"e2e-same-id-b-5d22cccf-kserve-658554948c-ngxjl\" (UID: \"91b59dd1-6698-4491-897b-e4061d656afb\") " pod="llm/e2e-same-id-b-5d22cccf-kserve-658554948c-ngxjl"
Jul 27 20:30:26.543487 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:30:26.543446    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91b59dd1-6698-4491-897b-e4061d656afb-tls-certs\") pod \"e2e-same-id-b-5d22cccf-kserve-658554948c-ngxjl\" (UID: \"91b59dd1-6698-4491-897b-e4061d656afb\") " pod="llm/e2e-same-id-b-5d22cccf-kserve-658554948c-ngxjl"
Jul 27 20:30:26.548876 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:30:26.548853    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6m65w\" (UniqueName: \"kubernetes.io/projected/91b59dd1-6698-4491-897b-e4061d656afb-kube-api-access-6m65w\") pod \"e2e-same-id-b-5d22cccf-kserve-658554948c-ngxjl\" (UID: \"91b59dd1-6698-4491-897b-e4061d656afb\") " pod="llm/e2e-same-id-b-5d22cccf-kserve-658554948c-ngxjl"
Jul 27 20:30:26.621159 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:30:26.621066    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-5d22cccf-kserve-658554948c-ngxjl"
Jul 27 20:30:26.764618 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:30:26.764596    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-5d22cccf-kserve-658554948c-ngxjl"]
Jul 27 20:30:26.766239 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:30:26.766198    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod91b59dd1_6698_4491_897b_e4061d656afb.slice/crio-df07478251b3b92f97b5de8a6227bb12f94138364a660b347f3e844cffe86476 WatchSource:0}: Error finding container df07478251b3b92f97b5de8a6227bb12f94138364a660b347f3e844cffe86476: Status 404 returned error can't find the container with id df07478251b3b92f97b5de8a6227bb12f94138364a660b347f3e844cffe86476
Jul 27 20:30:27.179855 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:30:27.179816    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:30:27.757141 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:30:27.757099    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-5d22cccf-kserve-658554948c-ngxjl" event={"ID":"91b59dd1-6698-4491-897b-e4061d656afb","Type":"ContainerStarted","Data":"f759d28cdbb2bb18d466a1912327206341f2e27f829282fb065c7b9965dec3b2"}
Jul 27 20:30:27.757549 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:30:27.757151    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-5d22cccf-kserve-658554948c-ngxjl" event={"ID":"91b59dd1-6698-4491-897b-e4061d656afb","Type":"ContainerStarted","Data":"df07478251b3b92f97b5de8a6227bb12f94138364a660b347f3e844cffe86476"}
Jul 27 20:30:27.774300 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:30:27.774249    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-5d22cccf-kserve-658554948c-ngxjl" podStartSLOduration=1.774231517 podStartE2EDuration="1.774231517s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:30:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:30:27.772064747 +0000 UTC m=+1576.346791135" watchObservedRunningTime="2026-07-27 20:30:27.774231517 +0000 UTC m=+1576.348957945"
Jul 27 20:30:29.998768 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:30:29.998717    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:30:36.621991 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:30:36.621953    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-5d22cccf-kserve-658554948c-ngxjl"
Jul 27 20:30:36.621991 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:30:36.622003    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-5d22cccf-kserve-658554948c-ngxjl"
Jul 27 20:30:36.634824 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:30:36.634794    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-5d22cccf-kserve-658554948c-ngxjl"
Jul 27 20:30:36.823882 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:30:36.823846    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-5d22cccf-kserve-658554948c-ngxjl"
Jul 27 20:31:02.546850 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:31:02.546812    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-5d22cccf-kserve-68b974bf59-l9k7j"]
Jul 27 20:31:02.567051 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:31:02.567011    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:31:03.276479 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:31:03.276421    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-5d22cccf-kserve-658554948c-ngxjl"]
Jul 27 20:31:03.295775 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:31:03.295745    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:31:06.491486 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:31:06.491436    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:31:17.566973 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:31:17.566922    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-5d22cccf-kserve-68b974bf59-l9k7j" podUID="cdd284e3-12de-4ea2-afb3-01eb21378608" containerName="main" containerID="cri-o://cf0abf3b169a3f9c71b5927010491f48452125f4f446b97eb1bd073f7106b465" gracePeriod=45
Jul 27 20:31:17.825364 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:31:17.825303    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-5d22cccf-kserve-68b974bf59-l9k7j"
Jul 27 20:31:17.892689 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:31:17.892650    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cdd284e3-12de-4ea2-afb3-01eb21378608-model-cache\") pod \"cdd284e3-12de-4ea2-afb3-01eb21378608\" (UID: \"cdd284e3-12de-4ea2-afb3-01eb21378608\") "
Jul 27 20:31:17.892870 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:31:17.892716    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cdd284e3-12de-4ea2-afb3-01eb21378608-tmp-dir\") pod \"cdd284e3-12de-4ea2-afb3-01eb21378608\" (UID: \"cdd284e3-12de-4ea2-afb3-01eb21378608\") "
Jul 27 20:31:17.892870 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:31:17.892827    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cdd284e3-12de-4ea2-afb3-01eb21378608-dshm\") pod \"cdd284e3-12de-4ea2-afb3-01eb21378608\" (UID: \"cdd284e3-12de-4ea2-afb3-01eb21378608\") "
Jul 27 20:31:17.892996 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:31:17.892870    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cdd284e3-12de-4ea2-afb3-01eb21378608-home\") pod \"cdd284e3-12de-4ea2-afb3-01eb21378608\" (UID: \"cdd284e3-12de-4ea2-afb3-01eb21378608\") "
Jul 27 20:31:17.892996 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:31:17.892896    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lfnz8\" (UniqueName: \"kubernetes.io/projected/cdd284e3-12de-4ea2-afb3-01eb21378608-kube-api-access-lfnz8\") pod \"cdd284e3-12de-4ea2-afb3-01eb21378608\" (UID: \"cdd284e3-12de-4ea2-afb3-01eb21378608\") "
Jul 27 20:31:17.892996 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:31:17.892928    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cdd284e3-12de-4ea2-afb3-01eb21378608-tls-certs\") pod \"cdd284e3-12de-4ea2-afb3-01eb21378608\" (UID: \"cdd284e3-12de-4ea2-afb3-01eb21378608\") "
Jul 27 20:31:17.893165 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:31:17.892983    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cdd284e3-12de-4ea2-afb3-01eb21378608-model-cache" (OuterVolumeSpecName: "model-cache") pod "cdd284e3-12de-4ea2-afb3-01eb21378608" (UID: "cdd284e3-12de-4ea2-afb3-01eb21378608"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:31:17.893165 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:31:17.893044    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cdd284e3-12de-4ea2-afb3-01eb21378608-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "cdd284e3-12de-4ea2-afb3-01eb21378608" (UID: "cdd284e3-12de-4ea2-afb3-01eb21378608"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:31:17.893276 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:31:17.893161    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cdd284e3-12de-4ea2-afb3-01eb21378608-home" (OuterVolumeSpecName: "home") pod "cdd284e3-12de-4ea2-afb3-01eb21378608" (UID: "cdd284e3-12de-4ea2-afb3-01eb21378608"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:31:17.893320 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:31:17.893290    2557 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cdd284e3-12de-4ea2-afb3-01eb21378608-home\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:31:17.893320 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:31:17.893309    2557 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cdd284e3-12de-4ea2-afb3-01eb21378608-model-cache\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:31:17.893320 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:31:17.893319    2557 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cdd284e3-12de-4ea2-afb3-01eb21378608-tmp-dir\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:31:17.895225 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:31:17.895194    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cdd284e3-12de-4ea2-afb3-01eb21378608-dshm" (OuterVolumeSpecName: "dshm") pod "cdd284e3-12de-4ea2-afb3-01eb21378608" (UID: "cdd284e3-12de-4ea2-afb3-01eb21378608"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:31:17.895342 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:31:17.895234    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdd284e3-12de-4ea2-afb3-01eb21378608-kube-api-access-lfnz8" (OuterVolumeSpecName: "kube-api-access-lfnz8") pod "cdd284e3-12de-4ea2-afb3-01eb21378608" (UID: "cdd284e3-12de-4ea2-afb3-01eb21378608"). InnerVolumeSpecName "kube-api-access-lfnz8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:31:17.895342 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:31:17.895234    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cdd284e3-12de-4ea2-afb3-01eb21378608-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "cdd284e3-12de-4ea2-afb3-01eb21378608" (UID: "cdd284e3-12de-4ea2-afb3-01eb21378608"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:31:17.994772 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:31:17.994728    2557 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cdd284e3-12de-4ea2-afb3-01eb21378608-dshm\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:31:17.994772 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:31:17.994758    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lfnz8\" (UniqueName: \"kubernetes.io/projected/cdd284e3-12de-4ea2-afb3-01eb21378608-kube-api-access-lfnz8\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:31:17.994772 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:31:17.994771    2557 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cdd284e3-12de-4ea2-afb3-01eb21378608-tls-certs\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:31:18.038250 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:31:18.038213    2557 generic.go:356] "Generic (PLEG): container finished" podID="cdd284e3-12de-4ea2-afb3-01eb21378608" containerID="cf0abf3b169a3f9c71b5927010491f48452125f4f446b97eb1bd073f7106b465" exitCode=0
Jul 27 20:31:18.038250 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:31:18.038250    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-5d22cccf-kserve-68b974bf59-l9k7j"
Jul 27 20:31:18.038498 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:31:18.038274    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-5d22cccf-kserve-68b974bf59-l9k7j" event={"ID":"cdd284e3-12de-4ea2-afb3-01eb21378608","Type":"ContainerDied","Data":"cf0abf3b169a3f9c71b5927010491f48452125f4f446b97eb1bd073f7106b465"}
Jul 27 20:31:18.038498 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:31:18.038321    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-5d22cccf-kserve-68b974bf59-l9k7j" event={"ID":"cdd284e3-12de-4ea2-afb3-01eb21378608","Type":"ContainerDied","Data":"01794c6ff2d79f423822b5d08d7b971483346057ef1a5afe224900be74825991"}
Jul 27 20:31:18.038498 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:31:18.038342    2557 scope.go:117] "RemoveContainer" containerID="cf0abf3b169a3f9c71b5927010491f48452125f4f446b97eb1bd073f7106b465"
Jul 27 20:31:18.047415 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:31:18.047393    2557 scope.go:117] "RemoveContainer" containerID="cf0abf3b169a3f9c71b5927010491f48452125f4f446b97eb1bd073f7106b465"
Jul 27 20:31:18.047722 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:31:18.047702    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf0abf3b169a3f9c71b5927010491f48452125f4f446b97eb1bd073f7106b465\": container with ID starting with cf0abf3b169a3f9c71b5927010491f48452125f4f446b97eb1bd073f7106b465 not found: ID does not exist" containerID="cf0abf3b169a3f9c71b5927010491f48452125f4f446b97eb1bd073f7106b465"
Jul 27 20:31:18.047792 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:31:18.047731    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf0abf3b169a3f9c71b5927010491f48452125f4f446b97eb1bd073f7106b465"} err="failed to get container status \"cf0abf3b169a3f9c71b5927010491f48452125f4f446b97eb1bd073f7106b465\": rpc error: code = NotFound desc = could not find container \"cf0abf3b169a3f9c71b5927010491f48452125f4f446b97eb1bd073f7106b465\": container with ID starting with cf0abf3b169a3f9c71b5927010491f48452125f4f446b97eb1bd073f7106b465 not found: ID does not exist"
Jul 27 20:31:18.055715 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:31:18.055687    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-5d22cccf-kserve-68b974bf59-l9k7j"]
Jul 27 20:31:18.058885 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:31:18.058859    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-5d22cccf-kserve-68b974bf59-l9k7j"]
Jul 27 20:31:18.296514 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:31:18.296474    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-5d22cccf-kserve-658554948c-ngxjl" podUID="91b59dd1-6698-4491-897b-e4061d656afb" containerName="main" containerID="cri-o://f759d28cdbb2bb18d466a1912327206341f2e27f829282fb065c7b9965dec3b2" gracePeriod=45
Jul 27 20:31:18.547992 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:31:18.547926    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-5d22cccf-kserve-658554948c-ngxjl"
Jul 27 20:31:18.699192 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:31:18.699155    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91b59dd1-6698-4491-897b-e4061d656afb-tmp-dir\") pod \"91b59dd1-6698-4491-897b-e4061d656afb\" (UID: \"91b59dd1-6698-4491-897b-e4061d656afb\") "
Jul 27 20:31:18.699192 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:31:18.699195    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91b59dd1-6698-4491-897b-e4061d656afb-model-cache\") pod \"91b59dd1-6698-4491-897b-e4061d656afb\" (UID: \"91b59dd1-6698-4491-897b-e4061d656afb\") "
Jul 27 20:31:18.699732 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:31:18.699217    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91b59dd1-6698-4491-897b-e4061d656afb-dshm\") pod \"91b59dd1-6698-4491-897b-e4061d656afb\" (UID: \"91b59dd1-6698-4491-897b-e4061d656afb\") "
Jul 27 20:31:18.699732 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:31:18.699259    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91b59dd1-6698-4491-897b-e4061d656afb-tls-certs\") pod \"91b59dd1-6698-4491-897b-e4061d656afb\" (UID: \"91b59dd1-6698-4491-897b-e4061d656afb\") "
Jul 27 20:31:18.699732 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:31:18.699298    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6m65w\" (UniqueName: \"kubernetes.io/projected/91b59dd1-6698-4491-897b-e4061d656afb-kube-api-access-6m65w\") pod \"91b59dd1-6698-4491-897b-e4061d656afb\" (UID: \"91b59dd1-6698-4491-897b-e4061d656afb\") "
Jul 27 20:31:18.699732 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:31:18.699322    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91b59dd1-6698-4491-897b-e4061d656afb-home\") pod \"91b59dd1-6698-4491-897b-e4061d656afb\" (UID: \"91b59dd1-6698-4491-897b-e4061d656afb\") "
Jul 27 20:31:18.699732 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:31:18.699505    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91b59dd1-6698-4491-897b-e4061d656afb-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "91b59dd1-6698-4491-897b-e4061d656afb" (UID: "91b59dd1-6698-4491-897b-e4061d656afb"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:31:18.699732 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:31:18.699533    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91b59dd1-6698-4491-897b-e4061d656afb-model-cache" (OuterVolumeSpecName: "model-cache") pod "91b59dd1-6698-4491-897b-e4061d656afb" (UID: "91b59dd1-6698-4491-897b-e4061d656afb"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:31:18.699732 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:31:18.699680    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91b59dd1-6698-4491-897b-e4061d656afb-home" (OuterVolumeSpecName: "home") pod "91b59dd1-6698-4491-897b-e4061d656afb" (UID: "91b59dd1-6698-4491-897b-e4061d656afb"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:31:18.701519 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:31:18.701487    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91b59dd1-6698-4491-897b-e4061d656afb-dshm" (OuterVolumeSpecName: "dshm") pod "91b59dd1-6698-4491-897b-e4061d656afb" (UID: "91b59dd1-6698-4491-897b-e4061d656afb"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:31:18.701519 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:31:18.701509    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91b59dd1-6698-4491-897b-e4061d656afb-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "91b59dd1-6698-4491-897b-e4061d656afb" (UID: "91b59dd1-6698-4491-897b-e4061d656afb"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:31:18.701670 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:31:18.701553    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91b59dd1-6698-4491-897b-e4061d656afb-kube-api-access-6m65w" (OuterVolumeSpecName: "kube-api-access-6m65w") pod "91b59dd1-6698-4491-897b-e4061d656afb" (UID: "91b59dd1-6698-4491-897b-e4061d656afb"). InnerVolumeSpecName "kube-api-access-6m65w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:31:18.799967 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:31:18.799876    2557 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91b59dd1-6698-4491-897b-e4061d656afb-home\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:31:18.799967 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:31:18.799906    2557 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91b59dd1-6698-4491-897b-e4061d656afb-tmp-dir\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:31:18.799967 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:31:18.799917    2557 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91b59dd1-6698-4491-897b-e4061d656afb-model-cache\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:31:18.799967 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:31:18.799924    2557 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91b59dd1-6698-4491-897b-e4061d656afb-dshm\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:31:18.799967 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:31:18.799934    2557 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91b59dd1-6698-4491-897b-e4061d656afb-tls-certs\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:31:18.799967 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:31:18.799943    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6m65w\" (UniqueName: \"kubernetes.io/projected/91b59dd1-6698-4491-897b-e4061d656afb-kube-api-access-6m65w\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:31:19.045769 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:31:19.045732    2557 generic.go:356] "Generic (PLEG): container finished" podID="91b59dd1-6698-4491-897b-e4061d656afb" containerID="f759d28cdbb2bb18d466a1912327206341f2e27f829282fb065c7b9965dec3b2" exitCode=0
Jul 27 20:31:19.045947 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:31:19.045775    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-5d22cccf-kserve-658554948c-ngxjl"
Jul 27 20:31:19.045947 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:31:19.045808    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-5d22cccf-kserve-658554948c-ngxjl" event={"ID":"91b59dd1-6698-4491-897b-e4061d656afb","Type":"ContainerDied","Data":"f759d28cdbb2bb18d466a1912327206341f2e27f829282fb065c7b9965dec3b2"}
Jul 27 20:31:19.045947 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:31:19.045838    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-5d22cccf-kserve-658554948c-ngxjl" event={"ID":"91b59dd1-6698-4491-897b-e4061d656afb","Type":"ContainerDied","Data":"df07478251b3b92f97b5de8a6227bb12f94138364a660b347f3e844cffe86476"}
Jul 27 20:31:19.045947 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:31:19.045853    2557 scope.go:117] "RemoveContainer" containerID="f759d28cdbb2bb18d466a1912327206341f2e27f829282fb065c7b9965dec3b2"
Jul 27 20:31:19.060980 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:31:19.060957    2557 scope.go:117] "RemoveContainer" containerID="f759d28cdbb2bb18d466a1912327206341f2e27f829282fb065c7b9965dec3b2"
Jul 27 20:31:19.061251 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:31:19.061228    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f759d28cdbb2bb18d466a1912327206341f2e27f829282fb065c7b9965dec3b2\": container with ID starting with f759d28cdbb2bb18d466a1912327206341f2e27f829282fb065c7b9965dec3b2 not found: ID does not exist" containerID="f759d28cdbb2bb18d466a1912327206341f2e27f829282fb065c7b9965dec3b2"
Jul 27 20:31:19.061343 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:31:19.061256    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f759d28cdbb2bb18d466a1912327206341f2e27f829282fb065c7b9965dec3b2"} err="failed to get container status \"f759d28cdbb2bb18d466a1912327206341f2e27f829282fb065c7b9965dec3b2\": rpc error: code = NotFound desc = could not find container \"f759d28cdbb2bb18d466a1912327206341f2e27f829282fb065c7b9965dec3b2\": container with ID starting with f759d28cdbb2bb18d466a1912327206341f2e27f829282fb065c7b9965dec3b2 not found: ID does not exist"
Jul 27 20:31:19.070984 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:31:19.070958    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-5d22cccf-kserve-658554948c-ngxjl"]
Jul 27 20:31:19.074546 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:31:19.074527    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-5d22cccf-kserve-658554948c-ngxjl"]
Jul 27 20:31:19.495494 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:31:19.495121    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:31:19.911092 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:31:19.911008    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91b59dd1-6698-4491-897b-e4061d656afb" path="/var/lib/kubelet/pods/91b59dd1-6698-4491-897b-e4061d656afb/volumes"
Jul 27 20:31:19.911447 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:31:19.911407    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cdd284e3-12de-4ea2-afb3-01eb21378608" path="/var/lib/kubelet/pods/cdd284e3-12de-4ea2-afb3-01eb21378608/volumes"
Jul 27 20:31:30.692332 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:31:30.692288    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:31:42.091131 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:31:42.091094    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:31:53.491173 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:31:53.491138    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:32:02.691318 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:32:02.691281    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:32:12.996387 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:32:12.996349    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:32:18.479534 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:32:18.479496    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:32:20.277643 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:32:20.277599    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:32:22.793620 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:32:22.793584    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:32:32.184855 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:32:32.184811    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:32:39.198746 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:32:39.198662    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:32:45.191483 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:32:45.191433    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:32:54.592437 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:32:54.592387    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:33:03.901210 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:33:03.901166    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:33:05.984115 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:33:05.984080    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:33:13.557320 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:33:13.557284    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:33:24.490469 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:33:24.490410    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:33:31.198219 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:33:31.198179    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:33:48.389858 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:33:48.389822    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:34:00.503265 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:34:00.503216    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:34:13.388203 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:34:13.388157    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:34:14.684384 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:34:14.684345    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:34:26.295028 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:34:26.294975    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:34:35.993555 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:34:35.993509    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:34:36.307387 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:34:36.307275    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:34:39.531023 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:34:39.530981    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:34:39.630437 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:34:39.630391    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:34:39.968710 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:34:39.968633    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:34:45.818771 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:34:45.818730    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:34:45.920201 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:34:45.920164    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:34:46.047517 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:34:46.047476    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:34:46.097242 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:34:46.097143    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:34:46.377563 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:34:46.377447    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:34:46.743542 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:34:46.743507    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:34:48.495003 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:34:48.494962    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:34:48.588814 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:34:48.588778    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:34:48.665423 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:34:48.665383    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:34:48.767794 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:34:48.767706    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:34:49.196775 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:34:49.196670    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:34:49.293763 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:34:49.293725    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:34:49.301371 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:34:49.301336    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9c50dc8e-db7c55b68-xr5k7"]
Jul 27 20:34:49.301694 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:34:49.301681    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91b59dd1-6698-4491-897b-e4061d656afb" containerName="main"
Jul 27 20:34:49.301740 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:34:49.301697    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="91b59dd1-6698-4491-897b-e4061d656afb" containerName="main"
Jul 27 20:34:49.301740 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:34:49.301712    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdd284e3-12de-4ea2-afb3-01eb21378608" containerName="main"
Jul 27 20:34:49.301740 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:34:49.301717    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdd284e3-12de-4ea2-afb3-01eb21378608" containerName="main"
Jul 27 20:34:49.301833 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:34:49.301774    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="91b59dd1-6698-4491-897b-e4061d656afb" containerName="main"
Jul 27 20:34:49.301833 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:34:49.301786    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="cdd284e3-12de-4ea2-afb3-01eb21378608" containerName="main"
Jul 27 20:34:49.304816 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:34:49.304800    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-9c50dc8e-db7c55b68-xr5k7"
Jul 27 20:34:49.308692 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:34:49.308665    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-9c50dc8e\""
Jul 27 20:34:49.308847 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:34:49.308805    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-9c50dc8e-dockercfg-q945g\""
Jul 27 20:34:49.320135 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:34:49.320102    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9c50dc8e-db7c55b68-xr5k7"]
Jul 27 20:34:49.419795 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:34:49.419756    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zbkr\" (UniqueName: \"kubernetes.io/projected/d054228f-e890-40a5-99e9-126215f2b5eb-kube-api-access-2zbkr\") pod \"payload-pre-processing-e2e-ait-9c50dc8e-db7c55b68-xr5k7\" (UID: \"d054228f-e890-40a5-99e9-126215f2b5eb\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9c50dc8e-db7c55b68-xr5k7"
Jul 27 20:34:49.419953 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:34:49.419879    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d054228f-e890-40a5-99e9-126215f2b5eb-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-9c50dc8e-db7c55b68-xr5k7\" (UID: \"d054228f-e890-40a5-99e9-126215f2b5eb\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9c50dc8e-db7c55b68-xr5k7"
Jul 27 20:34:49.521124 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:34:49.521064    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zbkr\" (UniqueName: \"kubernetes.io/projected/d054228f-e890-40a5-99e9-126215f2b5eb-kube-api-access-2zbkr\") pod \"payload-pre-processing-e2e-ait-9c50dc8e-db7c55b68-xr5k7\" (UID: \"d054228f-e890-40a5-99e9-126215f2b5eb\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9c50dc8e-db7c55b68-xr5k7"
Jul 27 20:34:49.521648 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:34:49.521174    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d054228f-e890-40a5-99e9-126215f2b5eb-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-9c50dc8e-db7c55b68-xr5k7\" (UID: \"d054228f-e890-40a5-99e9-126215f2b5eb\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9c50dc8e-db7c55b68-xr5k7"
Jul 27 20:34:49.522023 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:34:49.521999    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d054228f-e890-40a5-99e9-126215f2b5eb-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-9c50dc8e-db7c55b68-xr5k7\" (UID: \"d054228f-e890-40a5-99e9-126215f2b5eb\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9c50dc8e-db7c55b68-xr5k7"
Jul 27 20:34:49.529489 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:34:49.529466    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zbkr\" (UniqueName: \"kubernetes.io/projected/d054228f-e890-40a5-99e9-126215f2b5eb-kube-api-access-2zbkr\") pod \"payload-pre-processing-e2e-ait-9c50dc8e-db7c55b68-xr5k7\" (UID: \"d054228f-e890-40a5-99e9-126215f2b5eb\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9c50dc8e-db7c55b68-xr5k7"
Jul 27 20:34:49.615521 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:34:49.615479    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-9c50dc8e-db7c55b68-xr5k7"
Jul 27 20:34:49.759645 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:34:49.759611    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9c50dc8e-db7c55b68-xr5k7"]
Jul 27 20:34:49.761669 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:34:49.761642    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd054228f_e890_40a5_99e9_126215f2b5eb.slice/crio-53a96986a548e98c38b9dcabc7e80c4588fb24c2b3797a8b3954538e12d1a1f6 WatchSource:0}: Error finding container 53a96986a548e98c38b9dcabc7e80c4588fb24c2b3797a8b3954538e12d1a1f6: Status 404 returned error can't find the container with id 53a96986a548e98c38b9dcabc7e80c4588fb24c2b3797a8b3954538e12d1a1f6
Jul 27 20:34:49.764049 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:34:49.764035    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 20:34:50.155203 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:34:50.155172    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-9c50dc8e-db7c55b68-xr5k7" event={"ID":"d054228f-e890-40a5-99e9-126215f2b5eb","Type":"ContainerStarted","Data":"53a96986a548e98c38b9dcabc7e80c4588fb24c2b3797a8b3954538e12d1a1f6"}
Jul 27 20:34:52.175172 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:34:52.175132    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-9c50dc8e-db7c55b68-xr5k7" event={"ID":"d054228f-e890-40a5-99e9-126215f2b5eb","Type":"ContainerStarted","Data":"3b1c7535ba0995f68ec6dd5491dcd875d2cf1b1aa86bf870fa7b6a516e145539"}
Jul 27 20:34:52.175646 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:34:52.175237    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-9c50dc8e-db7c55b68-xr5k7"
Jul 27 20:34:52.193202 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:34:52.193145    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-9c50dc8e-db7c55b68-xr5k7" podStartSLOduration=1.6451326499999999 podStartE2EDuration="3.193130204s" totalImagesPullingTime="1.547997554s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:34:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:34:52.190422579 +0000 UTC m=+1840.765148984" watchObservedRunningTime="2026-07-27 20:34:52.193130204 +0000 UTC m=+1840.767856592"
Jul 27 20:34:59.994249 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:34:59.994206    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:35:03.183176 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:03.183140    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-9c50dc8e-db7c55b68-xr5k7"
Jul 27 20:35:14.119424 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:14.119386    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9c50dc8e-lsrcf"]
Jul 27 20:35:14.122993 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:14.122976    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9c50dc8e-lsrcf"
Jul 27 20:35:14.125466 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:14.125425    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 20:35:14.125593 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:14.125541    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cwpct\""
Jul 27 20:35:14.131247 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:14.131224    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9c50dc8e-lsrcf"]
Jul 27 20:35:14.142236 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:14.142209    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c695e211-c6a6-4da6-8863-611b98ea0814-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9c50dc8e-lsrcf\" (UID: \"c695e211-c6a6-4da6-8863-611b98ea0814\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9c50dc8e-lsrcf"
Jul 27 20:35:14.243111 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:14.243067    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c695e211-c6a6-4da6-8863-611b98ea0814-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9c50dc8e-lsrcf\" (UID: \"c695e211-c6a6-4da6-8863-611b98ea0814\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9c50dc8e-lsrcf"
Jul 27 20:35:14.243730 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:14.243711    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c695e211-c6a6-4da6-8863-611b98ea0814-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9c50dc8e-lsrcf\" (UID: \"c695e211-c6a6-4da6-8863-611b98ea0814\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9c50dc8e-lsrcf"
Jul 27 20:35:14.434821 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:14.434735    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9c50dc8e-lsrcf"
Jul 27 20:35:14.571474 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:14.571430    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9c50dc8e-lsrcf"]
Jul 27 20:35:14.573106 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:35:14.573075    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc695e211_c6a6_4da6_8863_611b98ea0814.slice/crio-17c11b93d5a18bfde67295947042b8c4b88d7264f1f2e3931ce23666af42b1a0 WatchSource:0}: Error finding container 17c11b93d5a18bfde67295947042b8c4b88d7264f1f2e3931ce23666af42b1a0: Status 404 returned error can't find the container with id 17c11b93d5a18bfde67295947042b8c4b88d7264f1f2e3931ce23666af42b1a0
Jul 27 20:35:15.291409 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:15.291373    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9c50dc8e-lsrcf" event={"ID":"c695e211-c6a6-4da6-8863-611b98ea0814","Type":"ContainerStarted","Data":"17c11b93d5a18bfde67295947042b8c4b88d7264f1f2e3931ce23666af42b1a0"}
Jul 27 20:35:18.308803 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:18.308772    2557 generic.go:356] "Generic (PLEG): container finished" podID="c695e211-c6a6-4da6-8863-611b98ea0814" containerID="282cf3d12a7f2da4f7f05367d077a8d3b71069e57b82e22092f3f03804a17216" exitCode=0
Jul 27 20:35:18.309202 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:18.308854    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9c50dc8e-lsrcf" event={"ID":"c695e211-c6a6-4da6-8863-611b98ea0814","Type":"ContainerDied","Data":"282cf3d12a7f2da4f7f05367d077a8d3b71069e57b82e22092f3f03804a17216"}
Jul 27 20:35:19.456809 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:19.456774    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9c50dc8e-lsrcf"
Jul 27 20:35:19.583116 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:19.583016    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c695e211-c6a6-4da6-8863-611b98ea0814-maas-api-service-ca\") pod \"c695e211-c6a6-4da6-8863-611b98ea0814\" (UID: \"c695e211-c6a6-4da6-8863-611b98ea0814\") "
Jul 27 20:35:19.583387 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:19.583362    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c695e211-c6a6-4da6-8863-611b98ea0814-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c695e211-c6a6-4da6-8863-611b98ea0814" (UID: "c695e211-c6a6-4da6-8863-611b98ea0814"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:35:19.684006 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:19.683967    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c695e211-c6a6-4da6-8863-611b98ea0814-maas-api-service-ca\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:35:20.320785 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:20.320747    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9c50dc8e-lsrcf" event={"ID":"c695e211-c6a6-4da6-8863-611b98ea0814","Type":"ContainerDied","Data":"17c11b93d5a18bfde67295947042b8c4b88d7264f1f2e3931ce23666af42b1a0"}
Jul 27 20:35:20.320961 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:20.320805    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="17c11b93d5a18bfde67295947042b8c4b88d7264f1f2e3931ce23666af42b1a0"
Jul 27 20:35:20.320961 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:20.320761    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9c50dc8e-lsrcf"
Jul 27 20:35:20.716041 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:20.715910    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:20.779526 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:20.779486    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:24.527667 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:24.527625    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:24.562819 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:24.562785    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9c50dc8e-db7c55b68-xr5k7"]
Jul 27 20:35:24.563137 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:24.563106    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-9c50dc8e-db7c55b68-xr5k7" podUID="d054228f-e890-40a5-99e9-126215f2b5eb" containerName="payload-pre-processing" containerID="cri-o://3b1c7535ba0995f68ec6dd5491dcd875d2cf1b1aa86bf870fa7b6a516e145539" gracePeriod=30
Jul 27 20:35:24.629365 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:24.629332    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:24.730184 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:24.730112    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:24.814372 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:24.814345    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-9c50dc8e-db7c55b68-xr5k7"
Jul 27 20:35:24.823486 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:24.823441    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2zbkr\" (UniqueName: \"kubernetes.io/projected/d054228f-e890-40a5-99e9-126215f2b5eb-kube-api-access-2zbkr\") pod \"d054228f-e890-40a5-99e9-126215f2b5eb\" (UID: \"d054228f-e890-40a5-99e9-126215f2b5eb\") "
Jul 27 20:35:24.823639 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:24.823499    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d054228f-e890-40a5-99e9-126215f2b5eb-plugins-config-volume\") pod \"d054228f-e890-40a5-99e9-126215f2b5eb\" (UID: \"d054228f-e890-40a5-99e9-126215f2b5eb\") "
Jul 27 20:35:24.823891 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:24.823868    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d054228f-e890-40a5-99e9-126215f2b5eb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d054228f-e890-40a5-99e9-126215f2b5eb" (UID: "d054228f-e890-40a5-99e9-126215f2b5eb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:35:24.825726 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:24.825706    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d054228f-e890-40a5-99e9-126215f2b5eb-kube-api-access-2zbkr" (OuterVolumeSpecName: "kube-api-access-2zbkr") pod "d054228f-e890-40a5-99e9-126215f2b5eb" (UID: "d054228f-e890-40a5-99e9-126215f2b5eb"). InnerVolumeSpecName "kube-api-access-2zbkr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:35:24.924773 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:24.924736    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2zbkr\" (UniqueName: \"kubernetes.io/projected/d054228f-e890-40a5-99e9-126215f2b5eb-kube-api-access-2zbkr\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:35:24.924773 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:24.924765    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d054228f-e890-40a5-99e9-126215f2b5eb-plugins-config-volume\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:35:25.348881 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:25.348841    2557 generic.go:356] "Generic (PLEG): container finished" podID="d054228f-e890-40a5-99e9-126215f2b5eb" containerID="3b1c7535ba0995f68ec6dd5491dcd875d2cf1b1aa86bf870fa7b6a516e145539" exitCode=0
Jul 27 20:35:25.349065 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:25.348891    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-9c50dc8e-db7c55b68-xr5k7"
Jul 27 20:35:25.349065 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:25.348927    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-9c50dc8e-db7c55b68-xr5k7" event={"ID":"d054228f-e890-40a5-99e9-126215f2b5eb","Type":"ContainerDied","Data":"3b1c7535ba0995f68ec6dd5491dcd875d2cf1b1aa86bf870fa7b6a516e145539"}
Jul 27 20:35:25.349065 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:25.348984    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-9c50dc8e-db7c55b68-xr5k7" event={"ID":"d054228f-e890-40a5-99e9-126215f2b5eb","Type":"ContainerDied","Data":"53a96986a548e98c38b9dcabc7e80c4588fb24c2b3797a8b3954538e12d1a1f6"}
Jul 27 20:35:25.349065 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:25.349011    2557 scope.go:117] "RemoveContainer" containerID="3b1c7535ba0995f68ec6dd5491dcd875d2cf1b1aa86bf870fa7b6a516e145539"
Jul 27 20:35:25.358922 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:25.358902    2557 scope.go:117] "RemoveContainer" containerID="3b1c7535ba0995f68ec6dd5491dcd875d2cf1b1aa86bf870fa7b6a516e145539"
Jul 27 20:35:25.359181 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:35:25.359163    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b1c7535ba0995f68ec6dd5491dcd875d2cf1b1aa86bf870fa7b6a516e145539\": container with ID starting with 3b1c7535ba0995f68ec6dd5491dcd875d2cf1b1aa86bf870fa7b6a516e145539 not found: ID does not exist" containerID="3b1c7535ba0995f68ec6dd5491dcd875d2cf1b1aa86bf870fa7b6a516e145539"
Jul 27 20:35:25.359248 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:25.359190    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b1c7535ba0995f68ec6dd5491dcd875d2cf1b1aa86bf870fa7b6a516e145539"} err="failed to get container status \"3b1c7535ba0995f68ec6dd5491dcd875d2cf1b1aa86bf870fa7b6a516e145539\": rpc error: code = NotFound desc = could not find container \"3b1c7535ba0995f68ec6dd5491dcd875d2cf1b1aa86bf870fa7b6a516e145539\": container with ID starting with 3b1c7535ba0995f68ec6dd5491dcd875d2cf1b1aa86bf870fa7b6a516e145539 not found: ID does not exist"
Jul 27 20:35:25.373939 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:25.373911    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9c50dc8e-db7c55b68-xr5k7"]
Jul 27 20:35:25.375881 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:25.375859    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9c50dc8e-db7c55b68-xr5k7"]
Jul 27 20:35:25.910693 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:25.910655    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d054228f-e890-40a5-99e9-126215f2b5eb" path="/var/lib/kubelet/pods/d054228f-e890-40a5-99e9-126215f2b5eb/volumes"
Jul 27 20:35:27.692514 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:27.692482    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:35:29.201180 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:29.201102    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:29.206434 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:29.206405    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9c50dc8e-lsrcf"]
Jul 27 20:35:29.208343 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:29.208321    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9c50dc8e-lsrcf"]
Jul 27 20:35:29.385843 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:29.385806    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:29.598074 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:29.598035    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:29.845941 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:29.845879    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:29.911231 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:29.911148    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c695e211-c6a6-4da6-8863-611b98ea0814" path="/var/lib/kubelet/pods/c695e211-c6a6-4da6-8863-611b98ea0814/volumes"
Jul 27 20:35:29.943657 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:29.943625    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:30.073485 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:30.073431    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:30.406916 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:30.406879    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:30.507695 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:30.507657    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:35.718855 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:35.718767    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:35.937625 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:35.937585    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:36.230490 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:36.230430    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:36.497684 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:36.497595    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:36.589124 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:36.589088    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-73a591cd-765f46d59b-28b5n"]
Jul 27 20:35:36.589447 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:36.589434    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d054228f-e890-40a5-99e9-126215f2b5eb" containerName="payload-pre-processing"
Jul 27 20:35:36.589447 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:36.589461    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d054228f-e890-40a5-99e9-126215f2b5eb" containerName="payload-pre-processing"
Jul 27 20:35:36.589447 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:36.589471    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c695e211-c6a6-4da6-8863-611b98ea0814" containerName="revoke-keys"
Jul 27 20:35:36.589594 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:36.589476    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c695e211-c6a6-4da6-8863-611b98ea0814" containerName="revoke-keys"
Jul 27 20:35:36.589594 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:36.589548    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="d054228f-e890-40a5-99e9-126215f2b5eb" containerName="payload-pre-processing"
Jul 27 20:35:36.589594 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:36.589559    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="c695e211-c6a6-4da6-8863-611b98ea0814" containerName="revoke-keys"
Jul 27 20:35:36.591433 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:36.591402    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:36.595197 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:36.595182    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-73a591cd-765f46d59b-28b5n"
Jul 27 20:35:36.597755 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:36.597734    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-73a591cd\""
Jul 27 20:35:36.597857 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:36.597809    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-73a591cd-dockercfg-dxp9n\""
Jul 27 20:35:36.604013 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:36.603987    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-73a591cd-765f46d59b-28b5n"]
Jul 27 20:35:36.628054 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:36.628017    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9spp\" (UniqueName: \"kubernetes.io/projected/75d843b8-afe8-45f6-a453-e3d0d2333c12-kube-api-access-j9spp\") pod \"payload-pre-processing-e2e-migrate-73a591cd-765f46d59b-28b5n\" (UID: \"75d843b8-afe8-45f6-a453-e3d0d2333c12\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-73a591cd-765f46d59b-28b5n"
Jul 27 20:35:36.628054 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:36.628058    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/75d843b8-afe8-45f6-a453-e3d0d2333c12-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-73a591cd-765f46d59b-28b5n\" (UID: \"75d843b8-afe8-45f6-a453-e3d0d2333c12\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-73a591cd-765f46d59b-28b5n"
Jul 27 20:35:36.631413 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:36.631384    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-73a591cd-9774f7645-n4vsk"]
Jul 27 20:35:36.635364 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:36.635347    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-73a591cd-9774f7645-n4vsk"
Jul 27 20:35:36.644680 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:36.644649    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-73a591cd-9774f7645-n4vsk"]
Jul 27 20:35:36.729425 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:36.729392    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9spp\" (UniqueName: \"kubernetes.io/projected/75d843b8-afe8-45f6-a453-e3d0d2333c12-kube-api-access-j9spp\") pod \"payload-pre-processing-e2e-migrate-73a591cd-765f46d59b-28b5n\" (UID: \"75d843b8-afe8-45f6-a453-e3d0d2333c12\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-73a591cd-765f46d59b-28b5n"
Jul 27 20:35:36.729835 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:36.729437    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eb00cb4b-dfe9-44b3-b98c-d33bc0940af7-plugins-config-volume\") pod \"payload-processing-e2e-migrate-73a591cd-9774f7645-n4vsk\" (UID: \"eb00cb4b-dfe9-44b3-b98c-d33bc0940af7\") " pod="openshift-ingress/payload-processing-e2e-migrate-73a591cd-9774f7645-n4vsk"
Jul 27 20:35:36.729835 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:36.729472    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/75d843b8-afe8-45f6-a453-e3d0d2333c12-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-73a591cd-765f46d59b-28b5n\" (UID: \"75d843b8-afe8-45f6-a453-e3d0d2333c12\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-73a591cd-765f46d59b-28b5n"
Jul 27 20:35:36.729835 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:36.729545    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqmgf\" (UniqueName: \"kubernetes.io/projected/eb00cb4b-dfe9-44b3-b98c-d33bc0940af7-kube-api-access-bqmgf\") pod \"payload-processing-e2e-migrate-73a591cd-9774f7645-n4vsk\" (UID: \"eb00cb4b-dfe9-44b3-b98c-d33bc0940af7\") " pod="openshift-ingress/payload-processing-e2e-migrate-73a591cd-9774f7645-n4vsk"
Jul 27 20:35:36.730149 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:36.730132    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/75d843b8-afe8-45f6-a453-e3d0d2333c12-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-73a591cd-765f46d59b-28b5n\" (UID: \"75d843b8-afe8-45f6-a453-e3d0d2333c12\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-73a591cd-765f46d59b-28b5n"
Jul 27 20:35:36.737339 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:36.737310    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9spp\" (UniqueName: \"kubernetes.io/projected/75d843b8-afe8-45f6-a453-e3d0d2333c12-kube-api-access-j9spp\") pod \"payload-pre-processing-e2e-migrate-73a591cd-765f46d59b-28b5n\" (UID: \"75d843b8-afe8-45f6-a453-e3d0d2333c12\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-73a591cd-765f46d59b-28b5n"
Jul 27 20:35:36.830575 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:36.830445    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eb00cb4b-dfe9-44b3-b98c-d33bc0940af7-plugins-config-volume\") pod \"payload-processing-e2e-migrate-73a591cd-9774f7645-n4vsk\" (UID: \"eb00cb4b-dfe9-44b3-b98c-d33bc0940af7\") " pod="openshift-ingress/payload-processing-e2e-migrate-73a591cd-9774f7645-n4vsk"
Jul 27 20:35:36.830575 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:36.830534    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqmgf\" (UniqueName: \"kubernetes.io/projected/eb00cb4b-dfe9-44b3-b98c-d33bc0940af7-kube-api-access-bqmgf\") pod \"payload-processing-e2e-migrate-73a591cd-9774f7645-n4vsk\" (UID: \"eb00cb4b-dfe9-44b3-b98c-d33bc0940af7\") " pod="openshift-ingress/payload-processing-e2e-migrate-73a591cd-9774f7645-n4vsk"
Jul 27 20:35:36.831193 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:36.831172    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eb00cb4b-dfe9-44b3-b98c-d33bc0940af7-plugins-config-volume\") pod \"payload-processing-e2e-migrate-73a591cd-9774f7645-n4vsk\" (UID: \"eb00cb4b-dfe9-44b3-b98c-d33bc0940af7\") " pod="openshift-ingress/payload-processing-e2e-migrate-73a591cd-9774f7645-n4vsk"
Jul 27 20:35:36.838126 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:36.838101    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqmgf\" (UniqueName: \"kubernetes.io/projected/eb00cb4b-dfe9-44b3-b98c-d33bc0940af7-kube-api-access-bqmgf\") pod \"payload-processing-e2e-migrate-73a591cd-9774f7645-n4vsk\" (UID: \"eb00cb4b-dfe9-44b3-b98c-d33bc0940af7\") " pod="openshift-ingress/payload-processing-e2e-migrate-73a591cd-9774f7645-n4vsk"
Jul 27 20:35:36.906397 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:36.906355    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-73a591cd-765f46d59b-28b5n"
Jul 27 20:35:36.946468 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:36.946418    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-73a591cd-9774f7645-n4vsk"
Jul 27 20:35:37.060441 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:37.060414    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-73a591cd-765f46d59b-28b5n"]
Jul 27 20:35:37.063396 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:35:37.063364    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75d843b8_afe8_45f6_a453_e3d0d2333c12.slice/crio-5975045de3c74c42453a303d6b98cb7cc125140524cf874aff4e5fab3d90bb21 WatchSource:0}: Error finding container 5975045de3c74c42453a303d6b98cb7cc125140524cf874aff4e5fab3d90bb21: Status 404 returned error can't find the container with id 5975045de3c74c42453a303d6b98cb7cc125140524cf874aff4e5fab3d90bb21
Jul 27 20:35:37.102163 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:37.102137    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-73a591cd-9774f7645-n4vsk"]
Jul 27 20:35:37.104095 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:35:37.104066    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb00cb4b_dfe9_44b3_b98c_d33bc0940af7.slice/crio-d1bfd1187dea30e3860c0a1f6a1ab1c3e6dcef1b85e564a9f8b6ca19b53db23d WatchSource:0}: Error finding container d1bfd1187dea30e3860c0a1f6a1ab1c3e6dcef1b85e564a9f8b6ca19b53db23d: Status 404 returned error can't find the container with id d1bfd1187dea30e3860c0a1f6a1ab1c3e6dcef1b85e564a9f8b6ca19b53db23d
Jul 27 20:35:37.421607 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:37.421504    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-73a591cd-9774f7645-n4vsk" event={"ID":"eb00cb4b-dfe9-44b3-b98c-d33bc0940af7","Type":"ContainerStarted","Data":"b21e91649c9c10d7eaeb4994b189a6caf9a1ca83d5d99d5ce8cb0d0c874b006e"}
Jul 27 20:35:37.421772 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:37.421606    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-73a591cd-9774f7645-n4vsk"
Jul 27 20:35:37.421772 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:37.421633    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-73a591cd-9774f7645-n4vsk" event={"ID":"eb00cb4b-dfe9-44b3-b98c-d33bc0940af7","Type":"ContainerStarted","Data":"d1bfd1187dea30e3860c0a1f6a1ab1c3e6dcef1b85e564a9f8b6ca19b53db23d"}
Jul 27 20:35:37.423055 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:37.423027    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-73a591cd-765f46d59b-28b5n" event={"ID":"75d843b8-afe8-45f6-a453-e3d0d2333c12","Type":"ContainerStarted","Data":"4e8ec4a06ae8475636bd8566b589232fa8887afedc55a9a4cd74a98b8817f27d"}
Jul 27 20:35:37.423163 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:37.423082    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-73a591cd-765f46d59b-28b5n"
Jul 27 20:35:37.423163 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:37.423106    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-73a591cd-765f46d59b-28b5n" event={"ID":"75d843b8-afe8-45f6-a453-e3d0d2333c12","Type":"ContainerStarted","Data":"5975045de3c74c42453a303d6b98cb7cc125140524cf874aff4e5fab3d90bb21"}
Jul 27 20:35:37.440900 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:37.440849    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-73a591cd-9774f7645-n4vsk" podStartSLOduration=1.440830261 podStartE2EDuration="1.440830261s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:35:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:35:37.438235788 +0000 UTC m=+1886.012962176" watchObservedRunningTime="2026-07-27 20:35:37.440830261 +0000 UTC m=+1886.015556652"
Jul 27 20:35:37.455037 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:37.454983    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-73a591cd-765f46d59b-28b5n" podStartSLOduration=1.454967793 podStartE2EDuration="1.454967793s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:35:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:35:37.453248318 +0000 UTC m=+1886.027974703" watchObservedRunningTime="2026-07-27 20:35:37.454967793 +0000 UTC m=+1886.029694180"
Jul 27 20:35:42.994197 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:42.994155    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:35:48.431379 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:48.431341    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-73a591cd-9774f7645-n4vsk"
Jul 27 20:35:48.431885 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:35:48.431412    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-73a591cd-765f46d59b-28b5n"
Jul 27 20:36:06.851231 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:06.851191    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:06.907770 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:06.907731    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:11.173574 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:11.173536    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:11.192462 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:11.192417    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-73a591cd-9774f7645-n4vsk"]
Jul 27 20:36:11.192779 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:11.192719    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-73a591cd-9774f7645-n4vsk" podUID="eb00cb4b-dfe9-44b3-b98c-d33bc0940af7" containerName="payload-processing" containerID="cri-o://b21e91649c9c10d7eaeb4994b189a6caf9a1ca83d5d99d5ce8cb0d0c874b006e" gracePeriod=30
Jul 27 20:36:11.199353 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:11.199323    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-73a591cd-765f46d59b-28b5n"]
Jul 27 20:36:11.199623 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:11.199569    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-73a591cd-765f46d59b-28b5n" podUID="75d843b8-afe8-45f6-a453-e3d0d2333c12" containerName="payload-pre-processing" containerID="cri-o://4e8ec4a06ae8475636bd8566b589232fa8887afedc55a9a4cd74a98b8817f27d" gracePeriod=30
Jul 27 20:36:11.232503 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:11.232436    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:11.294567 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:11.294533    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:11.468035 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:11.468011    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-73a591cd-9774f7645-n4vsk"
Jul 27 20:36:11.470744 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:11.470727    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-73a591cd-765f46d59b-28b5n"
Jul 27 20:36:11.542400 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:11.542368    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eb00cb4b-dfe9-44b3-b98c-d33bc0940af7-plugins-config-volume\") pod \"eb00cb4b-dfe9-44b3-b98c-d33bc0940af7\" (UID: \"eb00cb4b-dfe9-44b3-b98c-d33bc0940af7\") "
Jul 27 20:36:11.542625 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:11.542417    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/75d843b8-afe8-45f6-a453-e3d0d2333c12-plugins-config-volume\") pod \"75d843b8-afe8-45f6-a453-e3d0d2333c12\" (UID: \"75d843b8-afe8-45f6-a453-e3d0d2333c12\") "
Jul 27 20:36:11.542625 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:11.542497    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bqmgf\" (UniqueName: \"kubernetes.io/projected/eb00cb4b-dfe9-44b3-b98c-d33bc0940af7-kube-api-access-bqmgf\") pod \"eb00cb4b-dfe9-44b3-b98c-d33bc0940af7\" (UID: \"eb00cb4b-dfe9-44b3-b98c-d33bc0940af7\") "
Jul 27 20:36:11.542625 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:11.542536    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j9spp\" (UniqueName: \"kubernetes.io/projected/75d843b8-afe8-45f6-a453-e3d0d2333c12-kube-api-access-j9spp\") pod \"75d843b8-afe8-45f6-a453-e3d0d2333c12\" (UID: \"75d843b8-afe8-45f6-a453-e3d0d2333c12\") "
Jul 27 20:36:11.542872 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:11.542849    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75d843b8-afe8-45f6-a453-e3d0d2333c12-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "75d843b8-afe8-45f6-a453-e3d0d2333c12" (UID: "75d843b8-afe8-45f6-a453-e3d0d2333c12"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:36:11.542929 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:11.542859    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb00cb4b-dfe9-44b3-b98c-d33bc0940af7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "eb00cb4b-dfe9-44b3-b98c-d33bc0940af7" (UID: "eb00cb4b-dfe9-44b3-b98c-d33bc0940af7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:36:11.544633 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:11.544607    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75d843b8-afe8-45f6-a453-e3d0d2333c12-kube-api-access-j9spp" (OuterVolumeSpecName: "kube-api-access-j9spp") pod "75d843b8-afe8-45f6-a453-e3d0d2333c12" (UID: "75d843b8-afe8-45f6-a453-e3d0d2333c12"). InnerVolumeSpecName "kube-api-access-j9spp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:36:11.544749 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:11.544695    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb00cb4b-dfe9-44b3-b98c-d33bc0940af7-kube-api-access-bqmgf" (OuterVolumeSpecName: "kube-api-access-bqmgf") pod "eb00cb4b-dfe9-44b3-b98c-d33bc0940af7" (UID: "eb00cb4b-dfe9-44b3-b98c-d33bc0940af7"). InnerVolumeSpecName "kube-api-access-bqmgf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:36:11.616429 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:11.616392    2557 generic.go:356] "Generic (PLEG): container finished" podID="eb00cb4b-dfe9-44b3-b98c-d33bc0940af7" containerID="b21e91649c9c10d7eaeb4994b189a6caf9a1ca83d5d99d5ce8cb0d0c874b006e" exitCode=0
Jul 27 20:36:11.616644 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:11.616436    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-73a591cd-9774f7645-n4vsk"
Jul 27 20:36:11.616644 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:11.616477    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-73a591cd-9774f7645-n4vsk" event={"ID":"eb00cb4b-dfe9-44b3-b98c-d33bc0940af7","Type":"ContainerDied","Data":"b21e91649c9c10d7eaeb4994b189a6caf9a1ca83d5d99d5ce8cb0d0c874b006e"}
Jul 27 20:36:11.616644 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:11.616533    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-73a591cd-9774f7645-n4vsk" event={"ID":"eb00cb4b-dfe9-44b3-b98c-d33bc0940af7","Type":"ContainerDied","Data":"d1bfd1187dea30e3860c0a1f6a1ab1c3e6dcef1b85e564a9f8b6ca19b53db23d"}
Jul 27 20:36:11.616644 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:11.616558    2557 scope.go:117] "RemoveContainer" containerID="b21e91649c9c10d7eaeb4994b189a6caf9a1ca83d5d99d5ce8cb0d0c874b006e"
Jul 27 20:36:11.617974 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:11.617956    2557 generic.go:356] "Generic (PLEG): container finished" podID="75d843b8-afe8-45f6-a453-e3d0d2333c12" containerID="4e8ec4a06ae8475636bd8566b589232fa8887afedc55a9a4cd74a98b8817f27d" exitCode=0
Jul 27 20:36:11.618080 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:11.618008    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-73a591cd-765f46d59b-28b5n"
Jul 27 20:36:11.618080 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:11.618044    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-73a591cd-765f46d59b-28b5n" event={"ID":"75d843b8-afe8-45f6-a453-e3d0d2333c12","Type":"ContainerDied","Data":"4e8ec4a06ae8475636bd8566b589232fa8887afedc55a9a4cd74a98b8817f27d"}
Jul 27 20:36:11.618080 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:11.618080    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-73a591cd-765f46d59b-28b5n" event={"ID":"75d843b8-afe8-45f6-a453-e3d0d2333c12","Type":"ContainerDied","Data":"5975045de3c74c42453a303d6b98cb7cc125140524cf874aff4e5fab3d90bb21"}
Jul 27 20:36:11.626214 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:11.626197    2557 scope.go:117] "RemoveContainer" containerID="b21e91649c9c10d7eaeb4994b189a6caf9a1ca83d5d99d5ce8cb0d0c874b006e"
Jul 27 20:36:11.626530 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:36:11.626510    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b21e91649c9c10d7eaeb4994b189a6caf9a1ca83d5d99d5ce8cb0d0c874b006e\": container with ID starting with b21e91649c9c10d7eaeb4994b189a6caf9a1ca83d5d99d5ce8cb0d0c874b006e not found: ID does not exist" containerID="b21e91649c9c10d7eaeb4994b189a6caf9a1ca83d5d99d5ce8cb0d0c874b006e"
Jul 27 20:36:11.626611 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:11.626538    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b21e91649c9c10d7eaeb4994b189a6caf9a1ca83d5d99d5ce8cb0d0c874b006e"} err="failed to get container status \"b21e91649c9c10d7eaeb4994b189a6caf9a1ca83d5d99d5ce8cb0d0c874b006e\": rpc error: code = NotFound desc = could not find container \"b21e91649c9c10d7eaeb4994b189a6caf9a1ca83d5d99d5ce8cb0d0c874b006e\": container with ID starting with b21e91649c9c10d7eaeb4994b189a6caf9a1ca83d5d99d5ce8cb0d0c874b006e not found: ID does not exist"
Jul 27 20:36:11.626611 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:11.626555    2557 scope.go:117] "RemoveContainer" containerID="4e8ec4a06ae8475636bd8566b589232fa8887afedc55a9a4cd74a98b8817f27d"
Jul 27 20:36:11.635076 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:11.635056    2557 scope.go:117] "RemoveContainer" containerID="4e8ec4a06ae8475636bd8566b589232fa8887afedc55a9a4cd74a98b8817f27d"
Jul 27 20:36:11.635328 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:36:11.635310    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e8ec4a06ae8475636bd8566b589232fa8887afedc55a9a4cd74a98b8817f27d\": container with ID starting with 4e8ec4a06ae8475636bd8566b589232fa8887afedc55a9a4cd74a98b8817f27d not found: ID does not exist" containerID="4e8ec4a06ae8475636bd8566b589232fa8887afedc55a9a4cd74a98b8817f27d"
Jul 27 20:36:11.635390 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:11.635332    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e8ec4a06ae8475636bd8566b589232fa8887afedc55a9a4cd74a98b8817f27d"} err="failed to get container status \"4e8ec4a06ae8475636bd8566b589232fa8887afedc55a9a4cd74a98b8817f27d\": rpc error: code = NotFound desc = could not find container \"4e8ec4a06ae8475636bd8566b589232fa8887afedc55a9a4cd74a98b8817f27d\": container with ID starting with 4e8ec4a06ae8475636bd8566b589232fa8887afedc55a9a4cd74a98b8817f27d not found: ID does not exist"
Jul 27 20:36:11.640817 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:11.640790    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-73a591cd-765f46d59b-28b5n"]
Jul 27 20:36:11.643380 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:11.643357    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eb00cb4b-dfe9-44b3-b98c-d33bc0940af7-plugins-config-volume\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:36:11.643380 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:11.643379    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/75d843b8-afe8-45f6-a453-e3d0d2333c12-plugins-config-volume\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:36:11.643588 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:11.643389    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bqmgf\" (UniqueName: \"kubernetes.io/projected/eb00cb4b-dfe9-44b3-b98c-d33bc0940af7-kube-api-access-bqmgf\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:36:11.643588 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:11.643398    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j9spp\" (UniqueName: \"kubernetes.io/projected/75d843b8-afe8-45f6-a453-e3d0d2333c12-kube-api-access-j9spp\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:36:11.644224 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:11.644201    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-73a591cd-765f46d59b-28b5n"]
Jul 27 20:36:11.653877 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:11.653856    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-73a591cd-9774f7645-n4vsk"]
Jul 27 20:36:11.657179 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:11.657156    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-73a591cd-9774f7645-n4vsk"]
Jul 27 20:36:11.912125 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:11.912093    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75d843b8-afe8-45f6-a453-e3d0d2333c12" path="/var/lib/kubelet/pods/75d843b8-afe8-45f6-a453-e3d0d2333c12/volumes"
Jul 27 20:36:11.912472 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:11.912437    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb00cb4b-dfe9-44b3-b98c-d33bc0940af7" path="/var/lib/kubelet/pods/eb00cb4b-dfe9-44b3-b98c-d33bc0940af7/volumes"
Jul 27 20:36:13.789210 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:13.789160    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:36:15.800015 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:15.799943    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:15.956724 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:15.956685    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:16.200928 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:16.200837    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:16.470025 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:16.469923    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:16.750700 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:16.750664    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:16.923038 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:16.923004    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:18.936215 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:18.936180    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:19.099522 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:19.099470    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:19.416718 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:19.416680    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:19.644645 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:19.644612    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:19.882942 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:19.882906    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:19.978219 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:19.978190    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:19.992919 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:19.992884    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-35ff59c0-78b9984c9b-8px2t"]
Jul 27 20:36:19.993317 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:19.993299    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75d843b8-afe8-45f6-a453-e3d0d2333c12" containerName="payload-pre-processing"
Jul 27 20:36:19.993317 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:19.993317    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="75d843b8-afe8-45f6-a453-e3d0d2333c12" containerName="payload-pre-processing"
Jul 27 20:36:19.993494 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:19.993327    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb00cb4b-dfe9-44b3-b98c-d33bc0940af7" containerName="payload-processing"
Jul 27 20:36:19.993494 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:19.993333    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb00cb4b-dfe9-44b3-b98c-d33bc0940af7" containerName="payload-processing"
Jul 27 20:36:19.993494 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:19.993401    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb00cb4b-dfe9-44b3-b98c-d33bc0940af7" containerName="payload-processing"
Jul 27 20:36:19.993494 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:19.993412    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="75d843b8-afe8-45f6-a453-e3d0d2333c12" containerName="payload-pre-processing"
Jul 27 20:36:19.996044 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:19.996025    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-35ff59c0-78b9984c9b-8px2t"
Jul 27 20:36:19.998331 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:19.998308    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-35ff59c0-dockercfg-qdxwm\""
Jul 27 20:36:19.998331 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:19.998327    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-35ff59c0\""
Jul 27 20:36:20.005671 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:20.005643    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-35ff59c0-78b9984c9b-8px2t"]
Jul 27 20:36:20.018362 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:20.018333    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-35ff59c0-9fb99bc4b-p4s6t"]
Jul 27 20:36:20.021895 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:20.021847    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-35ff59c0-9fb99bc4b-p4s6t"
Jul 27 20:36:20.031156 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:20.031132    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-35ff59c0-9fb99bc4b-p4s6t"]
Jul 27 20:36:20.120174 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:20.120142    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad6387c6-23e0-498b-9766-08cd4df7780e-plugins-config-volume\") pod \"payload-processing-e2e-ait-35ff59c0-9fb99bc4b-p4s6t\" (UID: \"ad6387c6-23e0-498b-9766-08cd4df7780e\") " pod="openshift-ingress/payload-processing-e2e-ait-35ff59c0-9fb99bc4b-p4s6t"
Jul 27 20:36:20.120382 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:20.120235    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mb49\" (UniqueName: \"kubernetes.io/projected/ad6387c6-23e0-498b-9766-08cd4df7780e-kube-api-access-5mb49\") pod \"payload-processing-e2e-ait-35ff59c0-9fb99bc4b-p4s6t\" (UID: \"ad6387c6-23e0-498b-9766-08cd4df7780e\") " pod="openshift-ingress/payload-processing-e2e-ait-35ff59c0-9fb99bc4b-p4s6t"
Jul 27 20:36:20.120382 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:20.120330    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnr2d\" (UniqueName: \"kubernetes.io/projected/9cda8193-0747-48f5-ba15-0c9c90dc295c-kube-api-access-nnr2d\") pod \"payload-pre-processing-e2e-ait-35ff59c0-78b9984c9b-8px2t\" (UID: \"9cda8193-0747-48f5-ba15-0c9c90dc295c\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-35ff59c0-78b9984c9b-8px2t"
Jul 27 20:36:20.120382 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:20.120374    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9cda8193-0747-48f5-ba15-0c9c90dc295c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-35ff59c0-78b9984c9b-8px2t\" (UID: \"9cda8193-0747-48f5-ba15-0c9c90dc295c\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-35ff59c0-78b9984c9b-8px2t"
Jul 27 20:36:20.221303 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:20.221202    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnr2d\" (UniqueName: \"kubernetes.io/projected/9cda8193-0747-48f5-ba15-0c9c90dc295c-kube-api-access-nnr2d\") pod \"payload-pre-processing-e2e-ait-35ff59c0-78b9984c9b-8px2t\" (UID: \"9cda8193-0747-48f5-ba15-0c9c90dc295c\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-35ff59c0-78b9984c9b-8px2t"
Jul 27 20:36:20.221303 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:20.221257    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9cda8193-0747-48f5-ba15-0c9c90dc295c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-35ff59c0-78b9984c9b-8px2t\" (UID: \"9cda8193-0747-48f5-ba15-0c9c90dc295c\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-35ff59c0-78b9984c9b-8px2t"
Jul 27 20:36:20.221303 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:20.221301    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad6387c6-23e0-498b-9766-08cd4df7780e-plugins-config-volume\") pod \"payload-processing-e2e-ait-35ff59c0-9fb99bc4b-p4s6t\" (UID: \"ad6387c6-23e0-498b-9766-08cd4df7780e\") " pod="openshift-ingress/payload-processing-e2e-ait-35ff59c0-9fb99bc4b-p4s6t"
Jul 27 20:36:20.221658 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:20.221365    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mb49\" (UniqueName: \"kubernetes.io/projected/ad6387c6-23e0-498b-9766-08cd4df7780e-kube-api-access-5mb49\") pod \"payload-processing-e2e-ait-35ff59c0-9fb99bc4b-p4s6t\" (UID: \"ad6387c6-23e0-498b-9766-08cd4df7780e\") " pod="openshift-ingress/payload-processing-e2e-ait-35ff59c0-9fb99bc4b-p4s6t"
Jul 27 20:36:20.222061 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:20.222033    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9cda8193-0747-48f5-ba15-0c9c90dc295c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-35ff59c0-78b9984c9b-8px2t\" (UID: \"9cda8193-0747-48f5-ba15-0c9c90dc295c\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-35ff59c0-78b9984c9b-8px2t"
Jul 27 20:36:20.222107 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:20.222059    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad6387c6-23e0-498b-9766-08cd4df7780e-plugins-config-volume\") pod \"payload-processing-e2e-ait-35ff59c0-9fb99bc4b-p4s6t\" (UID: \"ad6387c6-23e0-498b-9766-08cd4df7780e\") " pod="openshift-ingress/payload-processing-e2e-ait-35ff59c0-9fb99bc4b-p4s6t"
Jul 27 20:36:20.231931 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:20.231903    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnr2d\" (UniqueName: \"kubernetes.io/projected/9cda8193-0747-48f5-ba15-0c9c90dc295c-kube-api-access-nnr2d\") pod \"payload-pre-processing-e2e-ait-35ff59c0-78b9984c9b-8px2t\" (UID: \"9cda8193-0747-48f5-ba15-0c9c90dc295c\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-35ff59c0-78b9984c9b-8px2t"
Jul 27 20:36:20.235695 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:20.235666    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mb49\" (UniqueName: \"kubernetes.io/projected/ad6387c6-23e0-498b-9766-08cd4df7780e-kube-api-access-5mb49\") pod \"payload-processing-e2e-ait-35ff59c0-9fb99bc4b-p4s6t\" (UID: \"ad6387c6-23e0-498b-9766-08cd4df7780e\") " pod="openshift-ingress/payload-processing-e2e-ait-35ff59c0-9fb99bc4b-p4s6t"
Jul 27 20:36:20.307552 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:20.307513    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-35ff59c0-78b9984c9b-8px2t"
Jul 27 20:36:20.333515 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:20.333488    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-35ff59c0-9fb99bc4b-p4s6t"
Jul 27 20:36:20.472024 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:20.471779    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-35ff59c0-78b9984c9b-8px2t"]
Jul 27 20:36:20.486039 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:20.486013    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-35ff59c0-9fb99bc4b-p4s6t"]
Jul 27 20:36:20.488774 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:36:20.488747    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad6387c6_23e0_498b_9766_08cd4df7780e.slice/crio-4a6f8a73fc98f6bdd89e6c947dd5f5cbd0221b7a4c544c328590e54aea2e7b12 WatchSource:0}: Error finding container 4a6f8a73fc98f6bdd89e6c947dd5f5cbd0221b7a4c544c328590e54aea2e7b12: Status 404 returned error can't find the container with id 4a6f8a73fc98f6bdd89e6c947dd5f5cbd0221b7a4c544c328590e54aea2e7b12
Jul 27 20:36:20.665562 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:20.665506    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-35ff59c0-9fb99bc4b-p4s6t" event={"ID":"ad6387c6-23e0-498b-9766-08cd4df7780e","Type":"ContainerStarted","Data":"dfc70d3097567512801f0375b1ce87cd83a73288fca8abbc46fa20a3cf0d9079"}
Jul 27 20:36:20.665753 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:20.665577    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-35ff59c0-9fb99bc4b-p4s6t" event={"ID":"ad6387c6-23e0-498b-9766-08cd4df7780e","Type":"ContainerStarted","Data":"4a6f8a73fc98f6bdd89e6c947dd5f5cbd0221b7a4c544c328590e54aea2e7b12"}
Jul 27 20:36:20.665753 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:20.665613    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-35ff59c0-9fb99bc4b-p4s6t"
Jul 27 20:36:20.667085 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:20.667048    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-35ff59c0-78b9984c9b-8px2t" event={"ID":"9cda8193-0747-48f5-ba15-0c9c90dc295c","Type":"ContainerStarted","Data":"1b6cf3375a9ed7d89e4bcc530052851972a431358a6f837e8f62f23f44b91636"}
Jul 27 20:36:20.667186 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:20.667098    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-35ff59c0-78b9984c9b-8px2t" event={"ID":"9cda8193-0747-48f5-ba15-0c9c90dc295c","Type":"ContainerStarted","Data":"281af6bbff39bf8dee75a524778d058a419c3aaf5556a48a8793a67e1f5aebdd"}
Jul 27 20:36:20.667186 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:20.667147    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-35ff59c0-78b9984c9b-8px2t"
Jul 27 20:36:20.681977 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:20.681931    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-35ff59c0-9fb99bc4b-p4s6t" podStartSLOduration=1.681916176 podStartE2EDuration="1.681916176s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:36:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:36:20.680949932 +0000 UTC m=+1929.255676321" watchObservedRunningTime="2026-07-27 20:36:20.681916176 +0000 UTC m=+1929.256642563"
Jul 27 20:36:20.700297 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:20.700242    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-35ff59c0-78b9984c9b-8px2t" podStartSLOduration=1.700223601 podStartE2EDuration="1.700223601s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:36:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:36:20.699395383 +0000 UTC m=+1929.274121770" watchObservedRunningTime="2026-07-27 20:36:20.700223601 +0000 UTC m=+1929.274950011"
Jul 27 20:36:26.699058 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:26.699013    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:36:31.674819 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:31.674791    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-35ff59c0-9fb99bc4b-p4s6t"
Jul 27 20:36:31.675287 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:31.674902    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-35ff59c0-78b9984c9b-8px2t"
Jul 27 20:36:40.535515 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:40.535473    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:40.562374 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:40.562339    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-35ff59c0-9fb99bc4b-p4s6t"]
Jul 27 20:36:40.562616 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:40.562558    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-35ff59c0-9fb99bc4b-p4s6t" podUID="ad6387c6-23e0-498b-9766-08cd4df7780e" containerName="payload-processing" containerID="cri-o://dfc70d3097567512801f0375b1ce87cd83a73288fca8abbc46fa20a3cf0d9079" gracePeriod=30
Jul 27 20:36:40.570225 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:40.570194    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-35ff59c0-78b9984c9b-8px2t"]
Jul 27 20:36:40.570495 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:40.570431    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-35ff59c0-78b9984c9b-8px2t" podUID="9cda8193-0747-48f5-ba15-0c9c90dc295c" containerName="payload-pre-processing" containerID="cri-o://1b6cf3375a9ed7d89e4bcc530052851972a431358a6f837e8f62f23f44b91636" gracePeriod=30
Jul 27 20:36:40.602349 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:40.602305    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:40.661683 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:40.661650    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:40.776624 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:40.776592    2557 generic.go:356] "Generic (PLEG): container finished" podID="ad6387c6-23e0-498b-9766-08cd4df7780e" containerID="dfc70d3097567512801f0375b1ce87cd83a73288fca8abbc46fa20a3cf0d9079" exitCode=0
Jul 27 20:36:40.776770 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:40.776676    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-35ff59c0-9fb99bc4b-p4s6t" event={"ID":"ad6387c6-23e0-498b-9766-08cd4df7780e","Type":"ContainerDied","Data":"dfc70d3097567512801f0375b1ce87cd83a73288fca8abbc46fa20a3cf0d9079"}
Jul 27 20:36:40.779482 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:40.779430    2557 generic.go:356] "Generic (PLEG): container finished" podID="9cda8193-0747-48f5-ba15-0c9c90dc295c" containerID="1b6cf3375a9ed7d89e4bcc530052851972a431358a6f837e8f62f23f44b91636" exitCode=0
Jul 27 20:36:40.779580 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:40.779523    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-35ff59c0-78b9984c9b-8px2t" event={"ID":"9cda8193-0747-48f5-ba15-0c9c90dc295c","Type":"ContainerDied","Data":"1b6cf3375a9ed7d89e4bcc530052851972a431358a6f837e8f62f23f44b91636"}
Jul 27 20:36:40.826551 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:40.826526    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-35ff59c0-9fb99bc4b-p4s6t"
Jul 27 20:36:40.847515 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:40.847490    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-35ff59c0-78b9984c9b-8px2t"
Jul 27 20:36:40.909526 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:40.909493    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5mb49\" (UniqueName: \"kubernetes.io/projected/ad6387c6-23e0-498b-9766-08cd4df7780e-kube-api-access-5mb49\") pod \"ad6387c6-23e0-498b-9766-08cd4df7780e\" (UID: \"ad6387c6-23e0-498b-9766-08cd4df7780e\") "
Jul 27 20:36:40.909706 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:40.909573    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad6387c6-23e0-498b-9766-08cd4df7780e-plugins-config-volume\") pod \"ad6387c6-23e0-498b-9766-08cd4df7780e\" (UID: \"ad6387c6-23e0-498b-9766-08cd4df7780e\") "
Jul 27 20:36:40.909971 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:40.909945    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad6387c6-23e0-498b-9766-08cd4df7780e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ad6387c6-23e0-498b-9766-08cd4df7780e" (UID: "ad6387c6-23e0-498b-9766-08cd4df7780e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:36:40.911643 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:40.911620    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad6387c6-23e0-498b-9766-08cd4df7780e-kube-api-access-5mb49" (OuterVolumeSpecName: "kube-api-access-5mb49") pod "ad6387c6-23e0-498b-9766-08cd4df7780e" (UID: "ad6387c6-23e0-498b-9766-08cd4df7780e"). InnerVolumeSpecName "kube-api-access-5mb49". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:36:41.010700 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:41.010660    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nnr2d\" (UniqueName: \"kubernetes.io/projected/9cda8193-0747-48f5-ba15-0c9c90dc295c-kube-api-access-nnr2d\") pod \"9cda8193-0747-48f5-ba15-0c9c90dc295c\" (UID: \"9cda8193-0747-48f5-ba15-0c9c90dc295c\") "
Jul 27 20:36:41.010868 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:41.010754    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9cda8193-0747-48f5-ba15-0c9c90dc295c-plugins-config-volume\") pod \"9cda8193-0747-48f5-ba15-0c9c90dc295c\" (UID: \"9cda8193-0747-48f5-ba15-0c9c90dc295c\") "
Jul 27 20:36:41.010916 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:41.010893    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5mb49\" (UniqueName: \"kubernetes.io/projected/ad6387c6-23e0-498b-9766-08cd4df7780e-kube-api-access-5mb49\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:36:41.010916 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:41.010904    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad6387c6-23e0-498b-9766-08cd4df7780e-plugins-config-volume\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:36:41.011119 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:41.011091    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9cda8193-0747-48f5-ba15-0c9c90dc295c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9cda8193-0747-48f5-ba15-0c9c90dc295c" (UID: "9cda8193-0747-48f5-ba15-0c9c90dc295c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:36:41.012805 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:41.012779    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cda8193-0747-48f5-ba15-0c9c90dc295c-kube-api-access-nnr2d" (OuterVolumeSpecName: "kube-api-access-nnr2d") pod "9cda8193-0747-48f5-ba15-0c9c90dc295c" (UID: "9cda8193-0747-48f5-ba15-0c9c90dc295c"). InnerVolumeSpecName "kube-api-access-nnr2d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:36:41.111833 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:41.111731    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nnr2d\" (UniqueName: \"kubernetes.io/projected/9cda8193-0747-48f5-ba15-0c9c90dc295c-kube-api-access-nnr2d\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:36:41.111833 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:41.111774    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9cda8193-0747-48f5-ba15-0c9c90dc295c-plugins-config-volume\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:36:41.786282 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:41.786249    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-35ff59c0-9fb99bc4b-p4s6t"
Jul 27 20:36:41.786755 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:41.786255    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-35ff59c0-9fb99bc4b-p4s6t" event={"ID":"ad6387c6-23e0-498b-9766-08cd4df7780e","Type":"ContainerDied","Data":"4a6f8a73fc98f6bdd89e6c947dd5f5cbd0221b7a4c544c328590e54aea2e7b12"}
Jul 27 20:36:41.786755 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:41.786390    2557 scope.go:117] "RemoveContainer" containerID="dfc70d3097567512801f0375b1ce87cd83a73288fca8abbc46fa20a3cf0d9079"
Jul 27 20:36:41.787852 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:41.787662    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-35ff59c0-78b9984c9b-8px2t"
Jul 27 20:36:41.787852 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:41.787666    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-35ff59c0-78b9984c9b-8px2t" event={"ID":"9cda8193-0747-48f5-ba15-0c9c90dc295c","Type":"ContainerDied","Data":"281af6bbff39bf8dee75a524778d058a419c3aaf5556a48a8793a67e1f5aebdd"}
Jul 27 20:36:41.796827 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:41.796804    2557 scope.go:117] "RemoveContainer" containerID="1b6cf3375a9ed7d89e4bcc530052851972a431358a6f837e8f62f23f44b91636"
Jul 27 20:36:41.812045 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:41.811996    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-35ff59c0-9fb99bc4b-p4s6t"]
Jul 27 20:36:41.815515 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:41.815491    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-35ff59c0-9fb99bc4b-p4s6t"]
Jul 27 20:36:41.823801 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:41.823778    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-35ff59c0-78b9984c9b-8px2t"]
Jul 27 20:36:41.827375 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:41.827351    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-35ff59c0-78b9984c9b-8px2t"]
Jul 27 20:36:41.910768 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:41.910694    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9cda8193-0747-48f5-ba15-0c9c90dc295c" path="/var/lib/kubelet/pods/9cda8193-0747-48f5-ba15-0c9c90dc295c/volumes"
Jul 27 20:36:41.911031 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:41.911018    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad6387c6-23e0-498b-9766-08cd4df7780e" path="/var/lib/kubelet/pods/ad6387c6-23e0-498b-9766-08cd4df7780e/volumes"
Jul 27 20:36:43.195476 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:43.195423    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:36:44.332526 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:44.332492    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:45.511555 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:45.511518    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:45.738768 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:45.738724    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:45.966684 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:45.966593    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:46.289745 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:46.289711    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:46.391106 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:46.391069    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:48.909999 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:48.909957    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:49.012990 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:49.012950    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:49.141346 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:49.141309    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:49.565705 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:49.565669    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:49.712182 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:49.712149    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:49.810176 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:49.810134    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:49.818848 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:49.818772    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-0d589065-78d6859776-gpjlq"]
Jul 27 20:36:49.819110 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:49.819099    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cda8193-0747-48f5-ba15-0c9c90dc295c" containerName="payload-pre-processing"
Jul 27 20:36:49.819158 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:49.819112    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cda8193-0747-48f5-ba15-0c9c90dc295c" containerName="payload-pre-processing"
Jul 27 20:36:49.819158 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:49.819123    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad6387c6-23e0-498b-9766-08cd4df7780e" containerName="payload-processing"
Jul 27 20:36:49.819158 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:49.819129    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad6387c6-23e0-498b-9766-08cd4df7780e" containerName="payload-processing"
Jul 27 20:36:49.819251 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:49.819194    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="9cda8193-0747-48f5-ba15-0c9c90dc295c" containerName="payload-pre-processing"
Jul 27 20:36:49.819251 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:49.819205    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad6387c6-23e0-498b-9766-08cd4df7780e" containerName="payload-processing"
Jul 27 20:36:49.827020 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:49.826988    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-0d589065-78d6859776-gpjlq"
Jul 27 20:36:49.830568 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:49.830543    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-0d589065\""
Jul 27 20:36:49.830829 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:49.830531    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-0d589065-dockercfg-b6mmh\""
Jul 27 20:36:49.833782 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:49.833519    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-0d589065-78d6859776-gpjlq"]
Jul 27 20:36:49.852175 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:49.852140    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-0d589065-9c58d6db-l8ss9"]
Jul 27 20:36:49.855569 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:49.855548    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-0d589065-9c58d6db-l8ss9"
Jul 27 20:36:49.864274 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:49.864246    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-0d589065-9c58d6db-l8ss9"]
Jul 27 20:36:49.992302 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:49.992260    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6t99\" (UniqueName: \"kubernetes.io/projected/1fb94956-e387-429e-9dab-ccd389130fd9-kube-api-access-t6t99\") pod \"payload-processing-e2e-derive-0d589065-9c58d6db-l8ss9\" (UID: \"1fb94956-e387-429e-9dab-ccd389130fd9\") " pod="openshift-ingress/payload-processing-e2e-derive-0d589065-9c58d6db-l8ss9"
Jul 27 20:36:49.992734 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:49.992308    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hx59v\" (UniqueName: \"kubernetes.io/projected/78ab4bc3-cd60-44fd-8f7c-681c8c1c0758-kube-api-access-hx59v\") pod \"payload-pre-processing-e2e-derive-0d589065-78d6859776-gpjlq\" (UID: \"78ab4bc3-cd60-44fd-8f7c-681c8c1c0758\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-0d589065-78d6859776-gpjlq"
Jul 27 20:36:49.992734 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:49.992377    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1fb94956-e387-429e-9dab-ccd389130fd9-plugins-config-volume\") pod \"payload-processing-e2e-derive-0d589065-9c58d6db-l8ss9\" (UID: \"1fb94956-e387-429e-9dab-ccd389130fd9\") " pod="openshift-ingress/payload-processing-e2e-derive-0d589065-9c58d6db-l8ss9"
Jul 27 20:36:49.992734 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:49.992463    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/78ab4bc3-cd60-44fd-8f7c-681c8c1c0758-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-0d589065-78d6859776-gpjlq\" (UID: \"78ab4bc3-cd60-44fd-8f7c-681c8c1c0758\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-0d589065-78d6859776-gpjlq"
Jul 27 20:36:50.093432 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:50.093338    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/78ab4bc3-cd60-44fd-8f7c-681c8c1c0758-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-0d589065-78d6859776-gpjlq\" (UID: \"78ab4bc3-cd60-44fd-8f7c-681c8c1c0758\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-0d589065-78d6859776-gpjlq"
Jul 27 20:36:50.093432 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:50.093429    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6t99\" (UniqueName: \"kubernetes.io/projected/1fb94956-e387-429e-9dab-ccd389130fd9-kube-api-access-t6t99\") pod \"payload-processing-e2e-derive-0d589065-9c58d6db-l8ss9\" (UID: \"1fb94956-e387-429e-9dab-ccd389130fd9\") " pod="openshift-ingress/payload-processing-e2e-derive-0d589065-9c58d6db-l8ss9"
Jul 27 20:36:50.093649 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:50.093478    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hx59v\" (UniqueName: \"kubernetes.io/projected/78ab4bc3-cd60-44fd-8f7c-681c8c1c0758-kube-api-access-hx59v\") pod \"payload-pre-processing-e2e-derive-0d589065-78d6859776-gpjlq\" (UID: \"78ab4bc3-cd60-44fd-8f7c-681c8c1c0758\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-0d589065-78d6859776-gpjlq"
Jul 27 20:36:50.093649 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:50.093513    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1fb94956-e387-429e-9dab-ccd389130fd9-plugins-config-volume\") pod \"payload-processing-e2e-derive-0d589065-9c58d6db-l8ss9\" (UID: \"1fb94956-e387-429e-9dab-ccd389130fd9\") " pod="openshift-ingress/payload-processing-e2e-derive-0d589065-9c58d6db-l8ss9"
Jul 27 20:36:50.094346 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:50.094323    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/78ab4bc3-cd60-44fd-8f7c-681c8c1c0758-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-0d589065-78d6859776-gpjlq\" (UID: \"78ab4bc3-cd60-44fd-8f7c-681c8c1c0758\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-0d589065-78d6859776-gpjlq"
Jul 27 20:36:50.094384 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:50.094323    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1fb94956-e387-429e-9dab-ccd389130fd9-plugins-config-volume\") pod \"payload-processing-e2e-derive-0d589065-9c58d6db-l8ss9\" (UID: \"1fb94956-e387-429e-9dab-ccd389130fd9\") " pod="openshift-ingress/payload-processing-e2e-derive-0d589065-9c58d6db-l8ss9"
Jul 27 20:36:50.108576 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:50.108550    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6t99\" (UniqueName: \"kubernetes.io/projected/1fb94956-e387-429e-9dab-ccd389130fd9-kube-api-access-t6t99\") pod \"payload-processing-e2e-derive-0d589065-9c58d6db-l8ss9\" (UID: \"1fb94956-e387-429e-9dab-ccd389130fd9\") " pod="openshift-ingress/payload-processing-e2e-derive-0d589065-9c58d6db-l8ss9"
Jul 27 20:36:50.113040 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:50.113017    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hx59v\" (UniqueName: \"kubernetes.io/projected/78ab4bc3-cd60-44fd-8f7c-681c8c1c0758-kube-api-access-hx59v\") pod \"payload-pre-processing-e2e-derive-0d589065-78d6859776-gpjlq\" (UID: \"78ab4bc3-cd60-44fd-8f7c-681c8c1c0758\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-0d589065-78d6859776-gpjlq"
Jul 27 20:36:50.140501 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:50.140441    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-0d589065-78d6859776-gpjlq"
Jul 27 20:36:50.166301 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:50.166262    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-0d589065-9c58d6db-l8ss9"
Jul 27 20:36:50.294146 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:50.294108    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-0d589065-78d6859776-gpjlq"]
Jul 27 20:36:50.298081 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:36:50.298048    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78ab4bc3_cd60_44fd_8f7c_681c8c1c0758.slice/crio-81dac3e24809339554971b95f6f9b0c757f4261d0fb4a361b70ebfb47e47a7ed WatchSource:0}: Error finding container 81dac3e24809339554971b95f6f9b0c757f4261d0fb4a361b70ebfb47e47a7ed: Status 404 returned error can't find the container with id 81dac3e24809339554971b95f6f9b0c757f4261d0fb4a361b70ebfb47e47a7ed
Jul 27 20:36:50.322288 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:50.322263    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-0d589065-9c58d6db-l8ss9"]
Jul 27 20:36:50.331551 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:36:50.331520    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fb94956_e387_429e_9dab_ccd389130fd9.slice/crio-7927acee4c7c52ae436a4a9d0b4833940196bece46e3c2028e44ac23271b938c WatchSource:0}: Error finding container 7927acee4c7c52ae436a4a9d0b4833940196bece46e3c2028e44ac23271b938c: Status 404 returned error can't find the container with id 7927acee4c7c52ae436a4a9d0b4833940196bece46e3c2028e44ac23271b938c
Jul 27 20:36:50.845259 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:50.845221    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-0d589065-9c58d6db-l8ss9" event={"ID":"1fb94956-e387-429e-9dab-ccd389130fd9","Type":"ContainerStarted","Data":"9fb0cae56ea53b9d522a95da5a17b44ba05519ac25e1530b499dbf7c81151c65"}
Jul 27 20:36:50.845594 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:50.845294    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-0d589065-9c58d6db-l8ss9"
Jul 27 20:36:50.845594 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:50.845325    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-0d589065-9c58d6db-l8ss9" event={"ID":"1fb94956-e387-429e-9dab-ccd389130fd9","Type":"ContainerStarted","Data":"7927acee4c7c52ae436a4a9d0b4833940196bece46e3c2028e44ac23271b938c"}
Jul 27 20:36:50.846926 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:50.846900    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-0d589065-78d6859776-gpjlq" event={"ID":"78ab4bc3-cd60-44fd-8f7c-681c8c1c0758","Type":"ContainerStarted","Data":"71b122f2855295330fd3ca9d1bcb0b1dbb43514c41a97ce8c3e7e103a3c1773d"}
Jul 27 20:36:50.847072 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:50.846942    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-0d589065-78d6859776-gpjlq" event={"ID":"78ab4bc3-cd60-44fd-8f7c-681c8c1c0758","Type":"ContainerStarted","Data":"81dac3e24809339554971b95f6f9b0c757f4261d0fb4a361b70ebfb47e47a7ed"}
Jul 27 20:36:50.847072 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:50.846984    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-0d589065-78d6859776-gpjlq"
Jul 27 20:36:50.861435 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:50.861382    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-0d589065-9c58d6db-l8ss9" podStartSLOduration=1.8613653000000001 podStartE2EDuration="1.8613653s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:36:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:36:50.861080093 +0000 UTC m=+1959.435806482" watchObservedRunningTime="2026-07-27 20:36:50.8613653 +0000 UTC m=+1959.436091688"
Jul 27 20:36:50.878043 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:50.877990    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-0d589065-78d6859776-gpjlq" podStartSLOduration=1.8779747439999999 podStartE2EDuration="1.877974744s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:36:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:36:50.875834558 +0000 UTC m=+1959.450560947" watchObservedRunningTime="2026-07-27 20:36:50.877974744 +0000 UTC m=+1959.452701131"
Jul 27 20:36:54.900522 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:36:54.900485    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:37:01.853652 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:37:01.853617    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-0d589065-9c58d6db-l8ss9"
Jul 27 20:37:01.854154 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:37:01.853938    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-0d589065-78d6859776-gpjlq"
Jul 27 20:37:24.240894 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:37:24.240860    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:37:24.291569 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:37:24.291532    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-0d589065-9c58d6db-l8ss9"]
Jul 27 20:37:24.291791 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:37:24.291744    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-0d589065-9c58d6db-l8ss9" podUID="1fb94956-e387-429e-9dab-ccd389130fd9" containerName="payload-processing" containerID="cri-o://9fb0cae56ea53b9d522a95da5a17b44ba05519ac25e1530b499dbf7c81151c65" gracePeriod=30
Jul 27 20:37:24.294203 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:37:24.294178    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-0d589065-78d6859776-gpjlq"]
Jul 27 20:37:24.294447 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:37:24.294408    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-0d589065-78d6859776-gpjlq" podUID="78ab4bc3-cd60-44fd-8f7c-681c8c1c0758" containerName="payload-pre-processing" containerID="cri-o://71b122f2855295330fd3ca9d1bcb0b1dbb43514c41a97ce8c3e7e103a3c1773d" gracePeriod=30
Jul 27 20:37:24.577228 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:37:24.577196    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-0d589065-78d6859776-gpjlq"
Jul 27 20:37:24.580163 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:37:24.580141    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-0d589065-9c58d6db-l8ss9"
Jul 27 20:37:24.700319 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:37:24.700280    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/78ab4bc3-cd60-44fd-8f7c-681c8c1c0758-plugins-config-volume\") pod \"78ab4bc3-cd60-44fd-8f7c-681c8c1c0758\" (UID: \"78ab4bc3-cd60-44fd-8f7c-681c8c1c0758\") "
Jul 27 20:37:24.700544 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:37:24.700333    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t6t99\" (UniqueName: \"kubernetes.io/projected/1fb94956-e387-429e-9dab-ccd389130fd9-kube-api-access-t6t99\") pod \"1fb94956-e387-429e-9dab-ccd389130fd9\" (UID: \"1fb94956-e387-429e-9dab-ccd389130fd9\") "
Jul 27 20:37:24.700544 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:37:24.700368    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hx59v\" (UniqueName: \"kubernetes.io/projected/78ab4bc3-cd60-44fd-8f7c-681c8c1c0758-kube-api-access-hx59v\") pod \"78ab4bc3-cd60-44fd-8f7c-681c8c1c0758\" (UID: \"78ab4bc3-cd60-44fd-8f7c-681c8c1c0758\") "
Jul 27 20:37:24.700544 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:37:24.700476    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1fb94956-e387-429e-9dab-ccd389130fd9-plugins-config-volume\") pod \"1fb94956-e387-429e-9dab-ccd389130fd9\" (UID: \"1fb94956-e387-429e-9dab-ccd389130fd9\") "
Jul 27 20:37:24.700760 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:37:24.700727    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78ab4bc3-cd60-44fd-8f7c-681c8c1c0758-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "78ab4bc3-cd60-44fd-8f7c-681c8c1c0758" (UID: "78ab4bc3-cd60-44fd-8f7c-681c8c1c0758"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:37:24.700883 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:37:24.700828    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fb94956-e387-429e-9dab-ccd389130fd9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1fb94956-e387-429e-9dab-ccd389130fd9" (UID: "1fb94956-e387-429e-9dab-ccd389130fd9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:37:24.702593 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:37:24.702565    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fb94956-e387-429e-9dab-ccd389130fd9-kube-api-access-t6t99" (OuterVolumeSpecName: "kube-api-access-t6t99") pod "1fb94956-e387-429e-9dab-ccd389130fd9" (UID: "1fb94956-e387-429e-9dab-ccd389130fd9"). InnerVolumeSpecName "kube-api-access-t6t99". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:37:24.702593 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:37:24.702581    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78ab4bc3-cd60-44fd-8f7c-681c8c1c0758-kube-api-access-hx59v" (OuterVolumeSpecName: "kube-api-access-hx59v") pod "78ab4bc3-cd60-44fd-8f7c-681c8c1c0758" (UID: "78ab4bc3-cd60-44fd-8f7c-681c8c1c0758"). InnerVolumeSpecName "kube-api-access-hx59v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:37:24.801381 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:37:24.801293    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1fb94956-e387-429e-9dab-ccd389130fd9-plugins-config-volume\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:37:24.801381 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:37:24.801321    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/78ab4bc3-cd60-44fd-8f7c-681c8c1c0758-plugins-config-volume\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:37:24.801381 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:37:24.801332    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t6t99\" (UniqueName: \"kubernetes.io/projected/1fb94956-e387-429e-9dab-ccd389130fd9-kube-api-access-t6t99\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:37:24.801381 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:37:24.801342    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hx59v\" (UniqueName: \"kubernetes.io/projected/78ab4bc3-cd60-44fd-8f7c-681c8c1c0758-kube-api-access-hx59v\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:37:25.030688 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:37:25.030646    2557 generic.go:356] "Generic (PLEG): container finished" podID="1fb94956-e387-429e-9dab-ccd389130fd9" containerID="9fb0cae56ea53b9d522a95da5a17b44ba05519ac25e1530b499dbf7c81151c65" exitCode=0
Jul 27 20:37:25.030862 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:37:25.030706    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-0d589065-9c58d6db-l8ss9"
Jul 27 20:37:25.030862 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:37:25.030728    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-0d589065-9c58d6db-l8ss9" event={"ID":"1fb94956-e387-429e-9dab-ccd389130fd9","Type":"ContainerDied","Data":"9fb0cae56ea53b9d522a95da5a17b44ba05519ac25e1530b499dbf7c81151c65"}
Jul 27 20:37:25.030862 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:37:25.030802    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-0d589065-9c58d6db-l8ss9" event={"ID":"1fb94956-e387-429e-9dab-ccd389130fd9","Type":"ContainerDied","Data":"7927acee4c7c52ae436a4a9d0b4833940196bece46e3c2028e44ac23271b938c"}
Jul 27 20:37:25.030862 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:37:25.030824    2557 scope.go:117] "RemoveContainer" containerID="9fb0cae56ea53b9d522a95da5a17b44ba05519ac25e1530b499dbf7c81151c65"
Jul 27 20:37:25.032252 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:37:25.032223    2557 generic.go:356] "Generic (PLEG): container finished" podID="78ab4bc3-cd60-44fd-8f7c-681c8c1c0758" containerID="71b122f2855295330fd3ca9d1bcb0b1dbb43514c41a97ce8c3e7e103a3c1773d" exitCode=0
Jul 27 20:37:25.032378 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:37:25.032266    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-0d589065-78d6859776-gpjlq"
Jul 27 20:37:25.032378 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:37:25.032319    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-0d589065-78d6859776-gpjlq" event={"ID":"78ab4bc3-cd60-44fd-8f7c-681c8c1c0758","Type":"ContainerDied","Data":"71b122f2855295330fd3ca9d1bcb0b1dbb43514c41a97ce8c3e7e103a3c1773d"}
Jul 27 20:37:25.032378 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:37:25.032373    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-0d589065-78d6859776-gpjlq" event={"ID":"78ab4bc3-cd60-44fd-8f7c-681c8c1c0758","Type":"ContainerDied","Data":"81dac3e24809339554971b95f6f9b0c757f4261d0fb4a361b70ebfb47e47a7ed"}
Jul 27 20:37:25.040760 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:37:25.040742    2557 scope.go:117] "RemoveContainer" containerID="9fb0cae56ea53b9d522a95da5a17b44ba05519ac25e1530b499dbf7c81151c65"
Jul 27 20:37:25.041041 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:37:25.041022    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9fb0cae56ea53b9d522a95da5a17b44ba05519ac25e1530b499dbf7c81151c65\": container with ID starting with 9fb0cae56ea53b9d522a95da5a17b44ba05519ac25e1530b499dbf7c81151c65 not found: ID does not exist" containerID="9fb0cae56ea53b9d522a95da5a17b44ba05519ac25e1530b499dbf7c81151c65"
Jul 27 20:37:25.041139 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:37:25.041053    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9fb0cae56ea53b9d522a95da5a17b44ba05519ac25e1530b499dbf7c81151c65"} err="failed to get container status \"9fb0cae56ea53b9d522a95da5a17b44ba05519ac25e1530b499dbf7c81151c65\": rpc error: code = NotFound desc = could not find container \"9fb0cae56ea53b9d522a95da5a17b44ba05519ac25e1530b499dbf7c81151c65\": container with ID starting with 9fb0cae56ea53b9d522a95da5a17b44ba05519ac25e1530b499dbf7c81151c65 not found: ID does not exist"
Jul 27 20:37:25.041139 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:37:25.041075    2557 scope.go:117] "RemoveContainer" containerID="71b122f2855295330fd3ca9d1bcb0b1dbb43514c41a97ce8c3e7e103a3c1773d"
Jul 27 20:37:25.049209 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:37:25.049185    2557 scope.go:117] "RemoveContainer" containerID="71b122f2855295330fd3ca9d1bcb0b1dbb43514c41a97ce8c3e7e103a3c1773d"
Jul 27 20:37:25.049483 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:37:25.049462    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71b122f2855295330fd3ca9d1bcb0b1dbb43514c41a97ce8c3e7e103a3c1773d\": container with ID starting with 71b122f2855295330fd3ca9d1bcb0b1dbb43514c41a97ce8c3e7e103a3c1773d not found: ID does not exist" containerID="71b122f2855295330fd3ca9d1bcb0b1dbb43514c41a97ce8c3e7e103a3c1773d"
Jul 27 20:37:25.049528 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:37:25.049491    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71b122f2855295330fd3ca9d1bcb0b1dbb43514c41a97ce8c3e7e103a3c1773d"} err="failed to get container status \"71b122f2855295330fd3ca9d1bcb0b1dbb43514c41a97ce8c3e7e103a3c1773d\": rpc error: code = NotFound desc = could not find container \"71b122f2855295330fd3ca9d1bcb0b1dbb43514c41a97ce8c3e7e103a3c1773d\": container with ID starting with 71b122f2855295330fd3ca9d1bcb0b1dbb43514c41a97ce8c3e7e103a3c1773d not found: ID does not exist"
Jul 27 20:37:25.054384 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:37:25.054331    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-0d589065-9c58d6db-l8ss9"]
Jul 27 20:37:25.059636 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:37:25.059613    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-0d589065-9c58d6db-l8ss9"]
Jul 27 20:37:25.069232 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:37:25.069212    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-0d589065-78d6859776-gpjlq"]
Jul 27 20:37:25.072925 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:37:25.072901    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-0d589065-78d6859776-gpjlq"]
Jul 27 20:37:25.433633 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:37:25.433593    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:37:25.910536 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:37:25.910497    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1fb94956-e387-429e-9dab-ccd389130fd9" path="/var/lib/kubelet/pods/1fb94956-e387-429e-9dab-ccd389130fd9/volumes"
Jul 27 20:37:25.910876 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:37:25.910863    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78ab4bc3-cd60-44fd-8f7c-681c8c1c0758" path="/var/lib/kubelet/pods/78ab4bc3-cd60-44fd-8f7c-681c8c1c0758/volumes"
Jul 27 20:37:26.889717 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:37:26.889686    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:37:28.893183 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:37:28.893155    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:37:29.056779 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:37:29.056750    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:37:29.301981 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:37:29.301941    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:37:29.819108 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:37:29.819065    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:37:29.948203 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:37:29.948171    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:37:30.067946 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:37:30.067909    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:37:31.500539 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:37:31.500503    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:37:37.391638 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:37:37.391595    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:37:37.499056 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:37:37.499011    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:37:37.597828 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:37:37.597776    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:37:37.691892 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:37:37.691802    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:37:38.130994 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:37:38.130956    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:38:04.097586 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:38:04.097544    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:38:06.121628 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:38:06.121584    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:38:10.404727 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:38:10.404692    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:38:10.514520 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:38:10.514482    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:38:10.607511 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:38:10.607472    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:38:11.661272 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:38:11.661235    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:38:26.520028 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:38:26.519991    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:38:32.435763 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:38:32.435704    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:38:32.548141 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:38:32.548099    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:38:32.657029 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:38:32.656996    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:38:43.200106 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:38:43.200021    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:38:44.026026 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:38:44.025987    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:38:49.109062 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:38:49.109014    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:38:51.137529 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:38:51.137489    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:38:51.247813 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:38:51.247774    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:38:51.365122 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:38:51.365079    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:38:51.465013 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:38:51.464928    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:38:54.299904 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:38:54.299869    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:39:03.047265 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:03.047224    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:39:03.139393 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:03.139352    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:39:03.238919 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:03.238888    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:39:05.126289 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:05.126249    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:39:07.210060 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:07.210022    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:39:11.326742 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:11.326700    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:39:11.430046 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:11.430009    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:39:12.051725 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:12.051684    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:39:17.396785 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:17.396742    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:39:19.113496 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:19.113445    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:39:19.247597 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:19.247554    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:39:19.371162 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:19.371048    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:39:19.702873 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:19.702781    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:39:19.826732 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:19.826699    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:39:23.206840 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:23.206800    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:39:23.316635 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:23.316602    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:39:23.417123 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:23.417080    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:39:23.583024 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:23.582982    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:39:23.930090 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:23.929998    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:39:24.029882 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:24.029851    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:39:24.046902 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:24.046864    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-5b6e45fe-6c94dc76f6-z76l7"]
Jul 27 20:39:24.047306 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:24.047287    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fb94956-e387-429e-9dab-ccd389130fd9" containerName="payload-processing"
Jul 27 20:39:24.047398 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:24.047308    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fb94956-e387-429e-9dab-ccd389130fd9" containerName="payload-processing"
Jul 27 20:39:24.047398 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:24.047326    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78ab4bc3-cd60-44fd-8f7c-681c8c1c0758" containerName="payload-pre-processing"
Jul 27 20:39:24.047398 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:24.047335    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="78ab4bc3-cd60-44fd-8f7c-681c8c1c0758" containerName="payload-pre-processing"
Jul 27 20:39:24.047579 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:24.047417    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="78ab4bc3-cd60-44fd-8f7c-681c8c1c0758" containerName="payload-pre-processing"
Jul 27 20:39:24.047579 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:24.047436    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="1fb94956-e387-429e-9dab-ccd389130fd9" containerName="payload-processing"
Jul 27 20:39:24.050642 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:24.050611    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-5b6e45fe-6c94dc76f6-z76l7"
Jul 27 20:39:24.051437 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:24.051412    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-5b6e45fe-54bb65d8db-s9k4v"]
Jul 27 20:39:24.053242 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:24.053219    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-5b6e45fe-dockercfg-crrzn\""
Jul 27 20:39:24.053792 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:24.053773    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-5b6e45fe\""
Jul 27 20:39:24.058679 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:24.058658    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-5b6e45fe-54bb65d8db-s9k4v"
Jul 27 20:39:24.064192 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:24.063809    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-5b6e45fe-6c94dc76f6-z76l7"]
Jul 27 20:39:24.073490 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:24.068169    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-5b6e45fe-54bb65d8db-s9k4v"]
Jul 27 20:39:24.134331 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:24.134291    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48c5cb15-f9fe-478a-8e0e-8ebe1fe2649a-plugins-config-volume\") pod \"payload-processing-e2e-mt-5b6e45fe-54bb65d8db-s9k4v\" (UID: \"48c5cb15-f9fe-478a-8e0e-8ebe1fe2649a\") " pod="openshift-ingress/payload-processing-e2e-mt-5b6e45fe-54bb65d8db-s9k4v"
Jul 27 20:39:24.134528 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:24.134349    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wp2ch\" (UniqueName: \"kubernetes.io/projected/48c5cb15-f9fe-478a-8e0e-8ebe1fe2649a-kube-api-access-wp2ch\") pod \"payload-processing-e2e-mt-5b6e45fe-54bb65d8db-s9k4v\" (UID: \"48c5cb15-f9fe-478a-8e0e-8ebe1fe2649a\") " pod="openshift-ingress/payload-processing-e2e-mt-5b6e45fe-54bb65d8db-s9k4v"
Jul 27 20:39:24.134528 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:24.134438    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d7e20a4d-ee5c-45e2-ba98-4d649ee670e9-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-5b6e45fe-6c94dc76f6-z76l7\" (UID: \"d7e20a4d-ee5c-45e2-ba98-4d649ee670e9\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-5b6e45fe-6c94dc76f6-z76l7"
Jul 27 20:39:24.134528 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:24.134481    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mndl\" (UniqueName: \"kubernetes.io/projected/d7e20a4d-ee5c-45e2-ba98-4d649ee670e9-kube-api-access-6mndl\") pod \"payload-pre-processing-e2e-mt-5b6e45fe-6c94dc76f6-z76l7\" (UID: \"d7e20a4d-ee5c-45e2-ba98-4d649ee670e9\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-5b6e45fe-6c94dc76f6-z76l7"
Jul 27 20:39:24.235903 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:24.235860    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48c5cb15-f9fe-478a-8e0e-8ebe1fe2649a-plugins-config-volume\") pod \"payload-processing-e2e-mt-5b6e45fe-54bb65d8db-s9k4v\" (UID: \"48c5cb15-f9fe-478a-8e0e-8ebe1fe2649a\") " pod="openshift-ingress/payload-processing-e2e-mt-5b6e45fe-54bb65d8db-s9k4v"
Jul 27 20:39:24.236336 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:24.235927    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wp2ch\" (UniqueName: \"kubernetes.io/projected/48c5cb15-f9fe-478a-8e0e-8ebe1fe2649a-kube-api-access-wp2ch\") pod \"payload-processing-e2e-mt-5b6e45fe-54bb65d8db-s9k4v\" (UID: \"48c5cb15-f9fe-478a-8e0e-8ebe1fe2649a\") " pod="openshift-ingress/payload-processing-e2e-mt-5b6e45fe-54bb65d8db-s9k4v"
Jul 27 20:39:24.236336 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:24.235967    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d7e20a4d-ee5c-45e2-ba98-4d649ee670e9-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-5b6e45fe-6c94dc76f6-z76l7\" (UID: \"d7e20a4d-ee5c-45e2-ba98-4d649ee670e9\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-5b6e45fe-6c94dc76f6-z76l7"
Jul 27 20:39:24.236336 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:24.235991    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mndl\" (UniqueName: \"kubernetes.io/projected/d7e20a4d-ee5c-45e2-ba98-4d649ee670e9-kube-api-access-6mndl\") pod \"payload-pre-processing-e2e-mt-5b6e45fe-6c94dc76f6-z76l7\" (UID: \"d7e20a4d-ee5c-45e2-ba98-4d649ee670e9\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-5b6e45fe-6c94dc76f6-z76l7"
Jul 27 20:39:24.236717 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:24.236697    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48c5cb15-f9fe-478a-8e0e-8ebe1fe2649a-plugins-config-volume\") pod \"payload-processing-e2e-mt-5b6e45fe-54bb65d8db-s9k4v\" (UID: \"48c5cb15-f9fe-478a-8e0e-8ebe1fe2649a\") " pod="openshift-ingress/payload-processing-e2e-mt-5b6e45fe-54bb65d8db-s9k4v"
Jul 27 20:39:24.236820 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:24.236724    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d7e20a4d-ee5c-45e2-ba98-4d649ee670e9-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-5b6e45fe-6c94dc76f6-z76l7\" (UID: \"d7e20a4d-ee5c-45e2-ba98-4d649ee670e9\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-5b6e45fe-6c94dc76f6-z76l7"
Jul 27 20:39:24.247769 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:24.247742    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wp2ch\" (UniqueName: \"kubernetes.io/projected/48c5cb15-f9fe-478a-8e0e-8ebe1fe2649a-kube-api-access-wp2ch\") pod \"payload-processing-e2e-mt-5b6e45fe-54bb65d8db-s9k4v\" (UID: \"48c5cb15-f9fe-478a-8e0e-8ebe1fe2649a\") " pod="openshift-ingress/payload-processing-e2e-mt-5b6e45fe-54bb65d8db-s9k4v"
Jul 27 20:39:24.247903 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:24.247806    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mndl\" (UniqueName: \"kubernetes.io/projected/d7e20a4d-ee5c-45e2-ba98-4d649ee670e9-kube-api-access-6mndl\") pod \"payload-pre-processing-e2e-mt-5b6e45fe-6c94dc76f6-z76l7\" (UID: \"d7e20a4d-ee5c-45e2-ba98-4d649ee670e9\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-5b6e45fe-6c94dc76f6-z76l7"
Jul 27 20:39:24.378665 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:24.378615    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-5b6e45fe-54bb65d8db-s9k4v"
Jul 27 20:39:24.383249 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:24.383226    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-5b6e45fe-6c94dc76f6-z76l7"
Jul 27 20:39:24.545206 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:24.545141    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-5b6e45fe-54bb65d8db-s9k4v"]
Jul 27 20:39:24.547696 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:39:24.547660    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48c5cb15_f9fe_478a_8e0e_8ebe1fe2649a.slice/crio-29e3ac7d4cef536e81c5eafa647b5b5eac642a160bcd0f7074df27743572db57 WatchSource:0}: Error finding container 29e3ac7d4cef536e81c5eafa647b5b5eac642a160bcd0f7074df27743572db57: Status 404 returned error can't find the container with id 29e3ac7d4cef536e81c5eafa647b5b5eac642a160bcd0f7074df27743572db57
Jul 27 20:39:24.570815 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:24.570778    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-5b6e45fe-6c94dc76f6-z76l7"]
Jul 27 20:39:24.573875 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:39:24.573842    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7e20a4d_ee5c_45e2_ba98_4d649ee670e9.slice/crio-f4ec550149d57d5b1abc1f1396af01d3cee68a7803d9e32409ebae44da6485e8 WatchSource:0}: Error finding container f4ec550149d57d5b1abc1f1396af01d3cee68a7803d9e32409ebae44da6485e8: Status 404 returned error can't find the container with id f4ec550149d57d5b1abc1f1396af01d3cee68a7803d9e32409ebae44da6485e8
Jul 27 20:39:24.662384 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:24.662341    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-5b6e45fe-6c94dc76f6-z76l7" event={"ID":"d7e20a4d-ee5c-45e2-ba98-4d649ee670e9","Type":"ContainerStarted","Data":"d44fe25cde7a70a1b361f95b6eac7b0fbb6498b1951584a66e92b5ca230e14c6"}
Jul 27 20:39:24.662605 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:24.662421    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-5b6e45fe-6c94dc76f6-z76l7"
Jul 27 20:39:24.662605 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:24.662478    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-5b6e45fe-6c94dc76f6-z76l7" event={"ID":"d7e20a4d-ee5c-45e2-ba98-4d649ee670e9","Type":"ContainerStarted","Data":"f4ec550149d57d5b1abc1f1396af01d3cee68a7803d9e32409ebae44da6485e8"}
Jul 27 20:39:24.664284 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:24.664257    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-5b6e45fe-54bb65d8db-s9k4v" event={"ID":"48c5cb15-f9fe-478a-8e0e-8ebe1fe2649a","Type":"ContainerStarted","Data":"c8cdcda97685a3d9d68faf56a53a7d3cd1ed31e1012b1c17b8e52673227a0caf"}
Jul 27 20:39:24.664420 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:24.664308    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-5b6e45fe-54bb65d8db-s9k4v" event={"ID":"48c5cb15-f9fe-478a-8e0e-8ebe1fe2649a","Type":"ContainerStarted","Data":"29e3ac7d4cef536e81c5eafa647b5b5eac642a160bcd0f7074df27743572db57"}
Jul 27 20:39:24.664420 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:24.664336    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-5b6e45fe-54bb65d8db-s9k4v"
Jul 27 20:39:24.680538 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:24.680472    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-5b6e45fe-6c94dc76f6-z76l7" podStartSLOduration=0.680434629 podStartE2EDuration="680.434629ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:39:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:39:24.678329221 +0000 UTC m=+2113.253055635" watchObservedRunningTime="2026-07-27 20:39:24.680434629 +0000 UTC m=+2113.255161022"
Jul 27 20:39:24.696964 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:24.696901    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-5b6e45fe-54bb65d8db-s9k4v" podStartSLOduration=0.696884333 podStartE2EDuration="696.884333ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:39:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:39:24.694439652 +0000 UTC m=+2113.269166041" watchObservedRunningTime="2026-07-27 20:39:24.696884333 +0000 UTC m=+2113.271610721"
Jul 27 20:39:27.497034 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:27.496989    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:39:27.706370 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:27.706331    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:39:28.395847 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:28.395806    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:39:28.494880 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:28.494846    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:39:28.860819 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:28.860786    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:39:34.917548 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:34.917507    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:39:34.997660 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:34.997625    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:39:35.673253 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:35.673221    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-5b6e45fe-54bb65d8db-s9k4v"
Jul 27 20:39:35.673435 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:35.673297    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-5b6e45fe-6c94dc76f6-z76l7"
Jul 27 20:39:45.811513 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:45.811479    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:39:45.827057 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:45.826935    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-5b6e45fe-54bb65d8db-s9k4v"]
Jul 27 20:39:45.830234 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:45.827142    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-5b6e45fe-54bb65d8db-s9k4v" podUID="48c5cb15-f9fe-478a-8e0e-8ebe1fe2649a" containerName="payload-processing" containerID="cri-o://c8cdcda97685a3d9d68faf56a53a7d3cd1ed31e1012b1c17b8e52673227a0caf" gracePeriod=30
Jul 27 20:39:45.835742 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:45.835715    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-5b6e45fe-6c94dc76f6-z76l7"]
Jul 27 20:39:45.835990 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:45.835956    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-5b6e45fe-6c94dc76f6-z76l7" podUID="d7e20a4d-ee5c-45e2-ba98-4d649ee670e9" containerName="payload-pre-processing" containerID="cri-o://d44fe25cde7a70a1b361f95b6eac7b0fbb6498b1951584a66e92b5ca230e14c6" gracePeriod=30
Jul 27 20:39:45.913040 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:45.912990    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:39:46.110589 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:46.110561    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-5b6e45fe-54bb65d8db-s9k4v"
Jul 27 20:39:46.113302 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:46.113278    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-5b6e45fe-6c94dc76f6-z76l7"
Jul 27 20:39:46.123933 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:46.123910    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48c5cb15-f9fe-478a-8e0e-8ebe1fe2649a-plugins-config-volume\") pod \"48c5cb15-f9fe-478a-8e0e-8ebe1fe2649a\" (UID: \"48c5cb15-f9fe-478a-8e0e-8ebe1fe2649a\") "
Jul 27 20:39:46.124037 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:46.123957    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d7e20a4d-ee5c-45e2-ba98-4d649ee670e9-plugins-config-volume\") pod \"d7e20a4d-ee5c-45e2-ba98-4d649ee670e9\" (UID: \"d7e20a4d-ee5c-45e2-ba98-4d649ee670e9\") "
Jul 27 20:39:46.124037 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:46.123988    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6mndl\" (UniqueName: \"kubernetes.io/projected/d7e20a4d-ee5c-45e2-ba98-4d649ee670e9-kube-api-access-6mndl\") pod \"d7e20a4d-ee5c-45e2-ba98-4d649ee670e9\" (UID: \"d7e20a4d-ee5c-45e2-ba98-4d649ee670e9\") "
Jul 27 20:39:46.124037 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:46.124022    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wp2ch\" (UniqueName: \"kubernetes.io/projected/48c5cb15-f9fe-478a-8e0e-8ebe1fe2649a-kube-api-access-wp2ch\") pod \"48c5cb15-f9fe-478a-8e0e-8ebe1fe2649a\" (UID: \"48c5cb15-f9fe-478a-8e0e-8ebe1fe2649a\") "
Jul 27 20:39:46.124317 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:46.124290    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48c5cb15-f9fe-478a-8e0e-8ebe1fe2649a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "48c5cb15-f9fe-478a-8e0e-8ebe1fe2649a" (UID: "48c5cb15-f9fe-478a-8e0e-8ebe1fe2649a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:39:46.124397 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:46.124374    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7e20a4d-ee5c-45e2-ba98-4d649ee670e9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d7e20a4d-ee5c-45e2-ba98-4d649ee670e9" (UID: "d7e20a4d-ee5c-45e2-ba98-4d649ee670e9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:39:46.126113 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:46.126089    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48c5cb15-f9fe-478a-8e0e-8ebe1fe2649a-kube-api-access-wp2ch" (OuterVolumeSpecName: "kube-api-access-wp2ch") pod "48c5cb15-f9fe-478a-8e0e-8ebe1fe2649a" (UID: "48c5cb15-f9fe-478a-8e0e-8ebe1fe2649a"). InnerVolumeSpecName "kube-api-access-wp2ch". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:39:46.126181 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:46.126109    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7e20a4d-ee5c-45e2-ba98-4d649ee670e9-kube-api-access-6mndl" (OuterVolumeSpecName: "kube-api-access-6mndl") pod "d7e20a4d-ee5c-45e2-ba98-4d649ee670e9" (UID: "d7e20a4d-ee5c-45e2-ba98-4d649ee670e9"). InnerVolumeSpecName "kube-api-access-6mndl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:39:46.225352 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:46.225315    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48c5cb15-f9fe-478a-8e0e-8ebe1fe2649a-plugins-config-volume\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:39:46.225352 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:46.225347    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d7e20a4d-ee5c-45e2-ba98-4d649ee670e9-plugins-config-volume\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:39:46.225352 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:46.225356    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6mndl\" (UniqueName: \"kubernetes.io/projected/d7e20a4d-ee5c-45e2-ba98-4d649ee670e9-kube-api-access-6mndl\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:39:46.225639 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:46.225367    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wp2ch\" (UniqueName: \"kubernetes.io/projected/48c5cb15-f9fe-478a-8e0e-8ebe1fe2649a-kube-api-access-wp2ch\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:39:46.781663 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:46.781621    2557 generic.go:356] "Generic (PLEG): container finished" podID="48c5cb15-f9fe-478a-8e0e-8ebe1fe2649a" containerID="c8cdcda97685a3d9d68faf56a53a7d3cd1ed31e1012b1c17b8e52673227a0caf" exitCode=0
Jul 27 20:39:46.781877 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:46.781666    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-5b6e45fe-54bb65d8db-s9k4v"
Jul 27 20:39:46.781877 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:46.781715    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-5b6e45fe-54bb65d8db-s9k4v" event={"ID":"48c5cb15-f9fe-478a-8e0e-8ebe1fe2649a","Type":"ContainerDied","Data":"c8cdcda97685a3d9d68faf56a53a7d3cd1ed31e1012b1c17b8e52673227a0caf"}
Jul 27 20:39:46.781877 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:46.781766    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-5b6e45fe-54bb65d8db-s9k4v" event={"ID":"48c5cb15-f9fe-478a-8e0e-8ebe1fe2649a","Type":"ContainerDied","Data":"29e3ac7d4cef536e81c5eafa647b5b5eac642a160bcd0f7074df27743572db57"}
Jul 27 20:39:46.781877 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:46.781791    2557 scope.go:117] "RemoveContainer" containerID="c8cdcda97685a3d9d68faf56a53a7d3cd1ed31e1012b1c17b8e52673227a0caf"
Jul 27 20:39:46.782958 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:46.782938    2557 generic.go:356] "Generic (PLEG): container finished" podID="d7e20a4d-ee5c-45e2-ba98-4d649ee670e9" containerID="d44fe25cde7a70a1b361f95b6eac7b0fbb6498b1951584a66e92b5ca230e14c6" exitCode=0
Jul 27 20:39:46.783027 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:46.782977    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-5b6e45fe-6c94dc76f6-z76l7"
Jul 27 20:39:46.783027 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:46.783004    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-5b6e45fe-6c94dc76f6-z76l7" event={"ID":"d7e20a4d-ee5c-45e2-ba98-4d649ee670e9","Type":"ContainerDied","Data":"d44fe25cde7a70a1b361f95b6eac7b0fbb6498b1951584a66e92b5ca230e14c6"}
Jul 27 20:39:46.783180 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:46.783047    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-5b6e45fe-6c94dc76f6-z76l7" event={"ID":"d7e20a4d-ee5c-45e2-ba98-4d649ee670e9","Type":"ContainerDied","Data":"f4ec550149d57d5b1abc1f1396af01d3cee68a7803d9e32409ebae44da6485e8"}
Jul 27 20:39:46.791519 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:46.791502    2557 scope.go:117] "RemoveContainer" containerID="c8cdcda97685a3d9d68faf56a53a7d3cd1ed31e1012b1c17b8e52673227a0caf"
Jul 27 20:39:46.791800 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:39:46.791774    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8cdcda97685a3d9d68faf56a53a7d3cd1ed31e1012b1c17b8e52673227a0caf\": container with ID starting with c8cdcda97685a3d9d68faf56a53a7d3cd1ed31e1012b1c17b8e52673227a0caf not found: ID does not exist" containerID="c8cdcda97685a3d9d68faf56a53a7d3cd1ed31e1012b1c17b8e52673227a0caf"
Jul 27 20:39:46.791857 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:46.791810    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8cdcda97685a3d9d68faf56a53a7d3cd1ed31e1012b1c17b8e52673227a0caf"} err="failed to get container status \"c8cdcda97685a3d9d68faf56a53a7d3cd1ed31e1012b1c17b8e52673227a0caf\": rpc error: code = NotFound desc = could not find container \"c8cdcda97685a3d9d68faf56a53a7d3cd1ed31e1012b1c17b8e52673227a0caf\": container with ID starting with c8cdcda97685a3d9d68faf56a53a7d3cd1ed31e1012b1c17b8e52673227a0caf not found: ID does not exist"
Jul 27 20:39:46.791857 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:46.791832    2557 scope.go:117] "RemoveContainer" containerID="d44fe25cde7a70a1b361f95b6eac7b0fbb6498b1951584a66e92b5ca230e14c6"
Jul 27 20:39:46.800703 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:46.800611    2557 scope.go:117] "RemoveContainer" containerID="d44fe25cde7a70a1b361f95b6eac7b0fbb6498b1951584a66e92b5ca230e14c6"
Jul 27 20:39:46.800938 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:39:46.800921    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d44fe25cde7a70a1b361f95b6eac7b0fbb6498b1951584a66e92b5ca230e14c6\": container with ID starting with d44fe25cde7a70a1b361f95b6eac7b0fbb6498b1951584a66e92b5ca230e14c6 not found: ID does not exist" containerID="d44fe25cde7a70a1b361f95b6eac7b0fbb6498b1951584a66e92b5ca230e14c6"
Jul 27 20:39:46.801019 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:46.800945    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d44fe25cde7a70a1b361f95b6eac7b0fbb6498b1951584a66e92b5ca230e14c6"} err="failed to get container status \"d44fe25cde7a70a1b361f95b6eac7b0fbb6498b1951584a66e92b5ca230e14c6\": rpc error: code = NotFound desc = could not find container \"d44fe25cde7a70a1b361f95b6eac7b0fbb6498b1951584a66e92b5ca230e14c6\": container with ID starting with d44fe25cde7a70a1b361f95b6eac7b0fbb6498b1951584a66e92b5ca230e14c6 not found: ID does not exist"
Jul 27 20:39:46.803104 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:46.803085    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-5b6e45fe-54bb65d8db-s9k4v"]
Jul 27 20:39:46.807327 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:46.807308    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-5b6e45fe-54bb65d8db-s9k4v"]
Jul 27 20:39:46.815770 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:46.815751    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-5b6e45fe-6c94dc76f6-z76l7"]
Jul 27 20:39:46.819441 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:46.819422    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-5b6e45fe-6c94dc76f6-z76l7"]
Jul 27 20:39:47.510832 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:47.510791    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:39:47.910576 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:47.910480    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48c5cb15-f9fe-478a-8e0e-8ebe1fe2649a" path="/var/lib/kubelet/pods/48c5cb15-f9fe-478a-8e0e-8ebe1fe2649a/volumes"
Jul 27 20:39:47.911062 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:47.911006    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7e20a4d-ee5c-45e2-ba98-4d649ee670e9" path="/var/lib/kubelet/pods/d7e20a4d-ee5c-45e2-ba98-4d649ee670e9/volumes"
Jul 27 20:39:50.468378 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:50.468330    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:39:50.889916 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:50.889885    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:39:54.657943 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:54.657894    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:39:54.759488 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:54.759434    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:39:57.386877 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:57.386836    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:39:57.484565 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:57.484535    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:39:57.725942 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:57.725892    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:39:58.036363 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:58.036277    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:39:58.205813 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:58.205775    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:39:58.306579 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:58.306488    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:39:58.409754 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:39:58.409721    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:40:04.841135 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:04.841037    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:40:04.957434 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:04.957397    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:40:05.067011 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:05.066976    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:40:05.247745 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:05.247714    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:40:12.149492 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:12.149445    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:40:12.502063 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:12.502019    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:40:19.335956 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:19.335915    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:40:19.839489 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:19.839431    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:40:19.991762 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:19.991729    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:40:22.659931 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:22.659896    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:40:23.017106 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:23.017070    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:40:23.378518 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:23.378423    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:40:23.587275 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:23.587242    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:40:24.354446 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:24.354407    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:40:24.556135 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:24.556100    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:40:24.786575 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:24.786541    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-030d0aef-7d5965d668-r6dkc"]
Jul 27 20:40:24.786975 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:24.786955    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48c5cb15-f9fe-478a-8e0e-8ebe1fe2649a" containerName="payload-processing"
Jul 27 20:40:24.787068 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:24.786977    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="48c5cb15-f9fe-478a-8e0e-8ebe1fe2649a" containerName="payload-processing"
Jul 27 20:40:24.787068 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:24.786992    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7e20a4d-ee5c-45e2-ba98-4d649ee670e9" containerName="payload-pre-processing"
Jul 27 20:40:24.787068 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:24.787000    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7e20a4d-ee5c-45e2-ba98-4d649ee670e9" containerName="payload-pre-processing"
Jul 27 20:40:24.787235 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:24.787094    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7e20a4d-ee5c-45e2-ba98-4d649ee670e9" containerName="payload-pre-processing"
Jul 27 20:40:24.787235 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:24.787106    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="48c5cb15-f9fe-478a-8e0e-8ebe1fe2649a" containerName="payload-processing"
Jul 27 20:40:24.790270 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:24.790250    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-030d0aef-7d5965d668-r6dkc"
Jul 27 20:40:24.796821 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:24.796791    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-030d0aef-dockercfg-mxt5h\""
Jul 27 20:40:24.796931 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:24.796908    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-030d0aef\""
Jul 27 20:40:24.815866 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:24.815841    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-030d0aef-7d5965d668-r6dkc"]
Jul 27 20:40:24.952443 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:24.952414    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-030d0aef-55bb6cd47d-rwtdl"]
Jul 27 20:40:24.955537 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:24.955515    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vn2zx\" (UniqueName: \"kubernetes.io/projected/fade70a9-144a-4e3a-b756-a7e3035cfbc1-kube-api-access-vn2zx\") pod \"payload-pre-processing-e2e-mt-030d0aef-7d5965d668-r6dkc\" (UID: \"fade70a9-144a-4e3a-b756-a7e3035cfbc1\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-030d0aef-7d5965d668-r6dkc"
Jul 27 20:40:24.955623 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:24.955555    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fade70a9-144a-4e3a-b756-a7e3035cfbc1-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-030d0aef-7d5965d668-r6dkc\" (UID: \"fade70a9-144a-4e3a-b756-a7e3035cfbc1\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-030d0aef-7d5965d668-r6dkc"
Jul 27 20:40:24.955843 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:24.955829    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-030d0aef-55bb6cd47d-rwtdl"
Jul 27 20:40:24.986060 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:24.986033    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-030d0aef-55bb6cd47d-rwtdl"]
Jul 27 20:40:25.056559 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:25.056428    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vn2zx\" (UniqueName: \"kubernetes.io/projected/fade70a9-144a-4e3a-b756-a7e3035cfbc1-kube-api-access-vn2zx\") pod \"payload-pre-processing-e2e-mt-030d0aef-7d5965d668-r6dkc\" (UID: \"fade70a9-144a-4e3a-b756-a7e3035cfbc1\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-030d0aef-7d5965d668-r6dkc"
Jul 27 20:40:25.056559 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:25.056509    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fade70a9-144a-4e3a-b756-a7e3035cfbc1-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-030d0aef-7d5965d668-r6dkc\" (UID: \"fade70a9-144a-4e3a-b756-a7e3035cfbc1\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-030d0aef-7d5965d668-r6dkc"
Jul 27 20:40:25.056559 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:25.056540    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fe9d541d-b7f5-489f-a7f9-3dc6d82cf597-plugins-config-volume\") pod \"payload-processing-e2e-mt-030d0aef-55bb6cd47d-rwtdl\" (UID: \"fe9d541d-b7f5-489f-a7f9-3dc6d82cf597\") " pod="openshift-ingress/payload-processing-e2e-mt-030d0aef-55bb6cd47d-rwtdl"
Jul 27 20:40:25.056854 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:25.056562    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqbws\" (UniqueName: \"kubernetes.io/projected/fe9d541d-b7f5-489f-a7f9-3dc6d82cf597-kube-api-access-wqbws\") pod \"payload-processing-e2e-mt-030d0aef-55bb6cd47d-rwtdl\" (UID: \"fe9d541d-b7f5-489f-a7f9-3dc6d82cf597\") " pod="openshift-ingress/payload-processing-e2e-mt-030d0aef-55bb6cd47d-rwtdl"
Jul 27 20:40:25.057204 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:25.057183    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fade70a9-144a-4e3a-b756-a7e3035cfbc1-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-030d0aef-7d5965d668-r6dkc\" (UID: \"fade70a9-144a-4e3a-b756-a7e3035cfbc1\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-030d0aef-7d5965d668-r6dkc"
Jul 27 20:40:25.074951 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:25.074913    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vn2zx\" (UniqueName: \"kubernetes.io/projected/fade70a9-144a-4e3a-b756-a7e3035cfbc1-kube-api-access-vn2zx\") pod \"payload-pre-processing-e2e-mt-030d0aef-7d5965d668-r6dkc\" (UID: \"fade70a9-144a-4e3a-b756-a7e3035cfbc1\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-030d0aef-7d5965d668-r6dkc"
Jul 27 20:40:25.100850 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:25.100803    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-030d0aef-7d5965d668-r6dkc"
Jul 27 20:40:25.157105 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:25.157065    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fe9d541d-b7f5-489f-a7f9-3dc6d82cf597-plugins-config-volume\") pod \"payload-processing-e2e-mt-030d0aef-55bb6cd47d-rwtdl\" (UID: \"fe9d541d-b7f5-489f-a7f9-3dc6d82cf597\") " pod="openshift-ingress/payload-processing-e2e-mt-030d0aef-55bb6cd47d-rwtdl"
Jul 27 20:40:25.157253 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:25.157113    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqbws\" (UniqueName: \"kubernetes.io/projected/fe9d541d-b7f5-489f-a7f9-3dc6d82cf597-kube-api-access-wqbws\") pod \"payload-processing-e2e-mt-030d0aef-55bb6cd47d-rwtdl\" (UID: \"fe9d541d-b7f5-489f-a7f9-3dc6d82cf597\") " pod="openshift-ingress/payload-processing-e2e-mt-030d0aef-55bb6cd47d-rwtdl"
Jul 27 20:40:25.157996 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:25.157966    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fe9d541d-b7f5-489f-a7f9-3dc6d82cf597-plugins-config-volume\") pod \"payload-processing-e2e-mt-030d0aef-55bb6cd47d-rwtdl\" (UID: \"fe9d541d-b7f5-489f-a7f9-3dc6d82cf597\") " pod="openshift-ingress/payload-processing-e2e-mt-030d0aef-55bb6cd47d-rwtdl"
Jul 27 20:40:25.180423 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:25.180390    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqbws\" (UniqueName: \"kubernetes.io/projected/fe9d541d-b7f5-489f-a7f9-3dc6d82cf597-kube-api-access-wqbws\") pod \"payload-processing-e2e-mt-030d0aef-55bb6cd47d-rwtdl\" (UID: \"fe9d541d-b7f5-489f-a7f9-3dc6d82cf597\") " pod="openshift-ingress/payload-processing-e2e-mt-030d0aef-55bb6cd47d-rwtdl"
Jul 27 20:40:25.251207 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:25.251185    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-030d0aef-7d5965d668-r6dkc"]
Jul 27 20:40:25.253094 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:40:25.253055    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfade70a9_144a_4e3a_b756_a7e3035cfbc1.slice/crio-998de3f0c90b03996e34d1bfa97dc77b0e792f60f50a416aa9ee53abd6fca8c4 WatchSource:0}: Error finding container 998de3f0c90b03996e34d1bfa97dc77b0e792f60f50a416aa9ee53abd6fca8c4: Status 404 returned error can't find the container with id 998de3f0c90b03996e34d1bfa97dc77b0e792f60f50a416aa9ee53abd6fca8c4
Jul 27 20:40:25.265515 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:25.265496    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-030d0aef-55bb6cd47d-rwtdl"
Jul 27 20:40:25.410597 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:25.410562    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-030d0aef-55bb6cd47d-rwtdl"]
Jul 27 20:40:25.413767 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:40:25.413726    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe9d541d_b7f5_489f_a7f9_3dc6d82cf597.slice/crio-8ab8c9d94d105e8ddfdb512195121fad131729b9c5dfc60baff28366e159656d WatchSource:0}: Error finding container 8ab8c9d94d105e8ddfdb512195121fad131729b9c5dfc60baff28366e159656d: Status 404 returned error can't find the container with id 8ab8c9d94d105e8ddfdb512195121fad131729b9c5dfc60baff28366e159656d
Jul 27 20:40:25.987250 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:25.987211    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-030d0aef-7d5965d668-r6dkc" event={"ID":"fade70a9-144a-4e3a-b756-a7e3035cfbc1","Type":"ContainerStarted","Data":"fb94a74424f19e1a1f55cad9e47a4971b4874ba9ae39f28ff7a5f4378d7d8353"}
Jul 27 20:40:25.987490 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:25.987269    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-030d0aef-7d5965d668-r6dkc" event={"ID":"fade70a9-144a-4e3a-b756-a7e3035cfbc1","Type":"ContainerStarted","Data":"998de3f0c90b03996e34d1bfa97dc77b0e792f60f50a416aa9ee53abd6fca8c4"}
Jul 27 20:40:25.987490 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:25.987295    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-030d0aef-7d5965d668-r6dkc"
Jul 27 20:40:25.988796 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:25.988774    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-030d0aef-55bb6cd47d-rwtdl" event={"ID":"fe9d541d-b7f5-489f-a7f9-3dc6d82cf597","Type":"ContainerStarted","Data":"34df3e79ab7df6fdc16ed71d800e69ccaa4352637acb1f8941ddeca11406a377"}
Jul 27 20:40:25.988873 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:25.988814    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-030d0aef-55bb6cd47d-rwtdl" event={"ID":"fe9d541d-b7f5-489f-a7f9-3dc6d82cf597","Type":"ContainerStarted","Data":"8ab8c9d94d105e8ddfdb512195121fad131729b9c5dfc60baff28366e159656d"}
Jul 27 20:40:25.988873 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:25.988862    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-030d0aef-55bb6cd47d-rwtdl"
Jul 27 20:40:26.031971 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:26.031915    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-030d0aef-7d5965d668-r6dkc" podStartSLOduration=2.031897943 podStartE2EDuration="2.031897943s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:40:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:40:26.030238989 +0000 UTC m=+2174.604965380" watchObservedRunningTime="2026-07-27 20:40:26.031897943 +0000 UTC m=+2174.606624330"
Jul 27 20:40:26.089034 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:26.088979    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-030d0aef-55bb6cd47d-rwtdl" podStartSLOduration=2.088963399 podStartE2EDuration="2.088963399s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:40:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:40:26.087318522 +0000 UTC m=+2174.662044911" watchObservedRunningTime="2026-07-27 20:40:26.088963399 +0000 UTC m=+2174.663689787"
Jul 27 20:40:27.100912 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:27.100870    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:40:27.564318 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:27.564277    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:40:33.425133 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:33.425092    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-030d0aef/e2e-lifecycle-model-030d0aef-kserve-55bc46ddc9-zdszm"]
Jul 27 20:40:33.429880 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:33.429859    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-030d0aef/e2e-lifecycle-model-030d0aef-kserve-55bc46ddc9-zdszm"
Jul 27 20:40:33.433337 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:33.433300    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-030d0aef\"/\"default-dockercfg-mc4q7\""
Jul 27 20:40:33.433492 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:33.433338    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-030d0aef\"/\"e2e-lifecycle-model-030d0aef-kserve-self-signed-certs\""
Jul 27 20:40:33.433492 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:33.433379    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-030d0aef\"/\"openshift-service-ca.crt\""
Jul 27 20:40:33.433492 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:33.433339    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-030d0aef\"/\"kube-root-ca.crt\""
Jul 27 20:40:33.443823 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:33.443798    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-030d0aef/e2e-lifecycle-model-030d0aef-kserve-55bc46ddc9-zdszm"]
Jul 27 20:40:33.483701 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:33.483664    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:40:33.526114 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:33.526080    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/234c31ed-9173-499e-a9d8-d9ca45fd2ffb-tmp-dir\") pod \"e2e-lifecycle-model-030d0aef-kserve-55bc46ddc9-zdszm\" (UID: \"234c31ed-9173-499e-a9d8-d9ca45fd2ffb\") " pod="ai-tenant-e2e-mt-030d0aef/e2e-lifecycle-model-030d0aef-kserve-55bc46ddc9-zdszm"
Jul 27 20:40:33.526284 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:33.526117    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/234c31ed-9173-499e-a9d8-d9ca45fd2ffb-tls-certs\") pod \"e2e-lifecycle-model-030d0aef-kserve-55bc46ddc9-zdszm\" (UID: \"234c31ed-9173-499e-a9d8-d9ca45fd2ffb\") " pod="ai-tenant-e2e-mt-030d0aef/e2e-lifecycle-model-030d0aef-kserve-55bc46ddc9-zdszm"
Jul 27 20:40:33.526284 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:33.526191    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/234c31ed-9173-499e-a9d8-d9ca45fd2ffb-dshm\") pod \"e2e-lifecycle-model-030d0aef-kserve-55bc46ddc9-zdszm\" (UID: \"234c31ed-9173-499e-a9d8-d9ca45fd2ffb\") " pod="ai-tenant-e2e-mt-030d0aef/e2e-lifecycle-model-030d0aef-kserve-55bc46ddc9-zdszm"
Jul 27 20:40:33.526284 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:33.526241    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/234c31ed-9173-499e-a9d8-d9ca45fd2ffb-model-cache\") pod \"e2e-lifecycle-model-030d0aef-kserve-55bc46ddc9-zdszm\" (UID: \"234c31ed-9173-499e-a9d8-d9ca45fd2ffb\") " pod="ai-tenant-e2e-mt-030d0aef/e2e-lifecycle-model-030d0aef-kserve-55bc46ddc9-zdszm"
Jul 27 20:40:33.526284 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:33.526276    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/234c31ed-9173-499e-a9d8-d9ca45fd2ffb-home\") pod \"e2e-lifecycle-model-030d0aef-kserve-55bc46ddc9-zdszm\" (UID: \"234c31ed-9173-499e-a9d8-d9ca45fd2ffb\") " pod="ai-tenant-e2e-mt-030d0aef/e2e-lifecycle-model-030d0aef-kserve-55bc46ddc9-zdszm"
Jul 27 20:40:33.526435 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:33.526294    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kkx4\" (UniqueName: \"kubernetes.io/projected/234c31ed-9173-499e-a9d8-d9ca45fd2ffb-kube-api-access-5kkx4\") pod \"e2e-lifecycle-model-030d0aef-kserve-55bc46ddc9-zdszm\" (UID: \"234c31ed-9173-499e-a9d8-d9ca45fd2ffb\") " pod="ai-tenant-e2e-mt-030d0aef/e2e-lifecycle-model-030d0aef-kserve-55bc46ddc9-zdszm"
Jul 27 20:40:33.627304 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:33.627261    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/234c31ed-9173-499e-a9d8-d9ca45fd2ffb-home\") pod \"e2e-lifecycle-model-030d0aef-kserve-55bc46ddc9-zdszm\" (UID: \"234c31ed-9173-499e-a9d8-d9ca45fd2ffb\") " pod="ai-tenant-e2e-mt-030d0aef/e2e-lifecycle-model-030d0aef-kserve-55bc46ddc9-zdszm"
Jul 27 20:40:33.627304 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:33.627304    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kkx4\" (UniqueName: \"kubernetes.io/projected/234c31ed-9173-499e-a9d8-d9ca45fd2ffb-kube-api-access-5kkx4\") pod \"e2e-lifecycle-model-030d0aef-kserve-55bc46ddc9-zdszm\" (UID: \"234c31ed-9173-499e-a9d8-d9ca45fd2ffb\") " pod="ai-tenant-e2e-mt-030d0aef/e2e-lifecycle-model-030d0aef-kserve-55bc46ddc9-zdszm"
Jul 27 20:40:33.627567 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:33.627333    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/234c31ed-9173-499e-a9d8-d9ca45fd2ffb-tmp-dir\") pod \"e2e-lifecycle-model-030d0aef-kserve-55bc46ddc9-zdszm\" (UID: \"234c31ed-9173-499e-a9d8-d9ca45fd2ffb\") " pod="ai-tenant-e2e-mt-030d0aef/e2e-lifecycle-model-030d0aef-kserve-55bc46ddc9-zdszm"
Jul 27 20:40:33.627567 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:33.627360    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/234c31ed-9173-499e-a9d8-d9ca45fd2ffb-tls-certs\") pod \"e2e-lifecycle-model-030d0aef-kserve-55bc46ddc9-zdszm\" (UID: \"234c31ed-9173-499e-a9d8-d9ca45fd2ffb\") " pod="ai-tenant-e2e-mt-030d0aef/e2e-lifecycle-model-030d0aef-kserve-55bc46ddc9-zdszm"
Jul 27 20:40:33.627567 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:33.627417    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/234c31ed-9173-499e-a9d8-d9ca45fd2ffb-dshm\") pod \"e2e-lifecycle-model-030d0aef-kserve-55bc46ddc9-zdszm\" (UID: \"234c31ed-9173-499e-a9d8-d9ca45fd2ffb\") " pod="ai-tenant-e2e-mt-030d0aef/e2e-lifecycle-model-030d0aef-kserve-55bc46ddc9-zdszm"
Jul 27 20:40:33.627567 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:33.627487    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/234c31ed-9173-499e-a9d8-d9ca45fd2ffb-model-cache\") pod \"e2e-lifecycle-model-030d0aef-kserve-55bc46ddc9-zdszm\" (UID: \"234c31ed-9173-499e-a9d8-d9ca45fd2ffb\") " pod="ai-tenant-e2e-mt-030d0aef/e2e-lifecycle-model-030d0aef-kserve-55bc46ddc9-zdszm"
Jul 27 20:40:33.627796 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:33.627763    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/234c31ed-9173-499e-a9d8-d9ca45fd2ffb-home\") pod \"e2e-lifecycle-model-030d0aef-kserve-55bc46ddc9-zdszm\" (UID: \"234c31ed-9173-499e-a9d8-d9ca45fd2ffb\") " pod="ai-tenant-e2e-mt-030d0aef/e2e-lifecycle-model-030d0aef-kserve-55bc46ddc9-zdszm"
Jul 27 20:40:33.627880 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:33.627861    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/234c31ed-9173-499e-a9d8-d9ca45fd2ffb-model-cache\") pod \"e2e-lifecycle-model-030d0aef-kserve-55bc46ddc9-zdszm\" (UID: \"234c31ed-9173-499e-a9d8-d9ca45fd2ffb\") " pod="ai-tenant-e2e-mt-030d0aef/e2e-lifecycle-model-030d0aef-kserve-55bc46ddc9-zdszm"
Jul 27 20:40:33.627919 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:33.627887    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/234c31ed-9173-499e-a9d8-d9ca45fd2ffb-tmp-dir\") pod \"e2e-lifecycle-model-030d0aef-kserve-55bc46ddc9-zdszm\" (UID: \"234c31ed-9173-499e-a9d8-d9ca45fd2ffb\") " pod="ai-tenant-e2e-mt-030d0aef/e2e-lifecycle-model-030d0aef-kserve-55bc46ddc9-zdszm"
Jul 27 20:40:33.629713 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:33.629690    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/234c31ed-9173-499e-a9d8-d9ca45fd2ffb-dshm\") pod \"e2e-lifecycle-model-030d0aef-kserve-55bc46ddc9-zdszm\" (UID: \"234c31ed-9173-499e-a9d8-d9ca45fd2ffb\") " pod="ai-tenant-e2e-mt-030d0aef/e2e-lifecycle-model-030d0aef-kserve-55bc46ddc9-zdszm"
Jul 27 20:40:33.630013 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:33.629995    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/234c31ed-9173-499e-a9d8-d9ca45fd2ffb-tls-certs\") pod \"e2e-lifecycle-model-030d0aef-kserve-55bc46ddc9-zdszm\" (UID: \"234c31ed-9173-499e-a9d8-d9ca45fd2ffb\") " pod="ai-tenant-e2e-mt-030d0aef/e2e-lifecycle-model-030d0aef-kserve-55bc46ddc9-zdszm"
Jul 27 20:40:33.636118 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:33.636092    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kkx4\" (UniqueName: \"kubernetes.io/projected/234c31ed-9173-499e-a9d8-d9ca45fd2ffb-kube-api-access-5kkx4\") pod \"e2e-lifecycle-model-030d0aef-kserve-55bc46ddc9-zdszm\" (UID: \"234c31ed-9173-499e-a9d8-d9ca45fd2ffb\") " pod="ai-tenant-e2e-mt-030d0aef/e2e-lifecycle-model-030d0aef-kserve-55bc46ddc9-zdszm"
Jul 27 20:40:33.739504 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:33.739422    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-030d0aef/e2e-lifecycle-model-030d0aef-kserve-55bc46ddc9-zdszm"
Jul 27 20:40:33.878399 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:33.878348    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-030d0aef/e2e-lifecycle-model-030d0aef-kserve-55bc46ddc9-zdszm"]
Jul 27 20:40:33.879548 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:40:33.879512    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod234c31ed_9173_499e_a9d8_d9ca45fd2ffb.slice/crio-c2b7a5680988c3ca8972a254194567421fb59dc55cfb302012169fbfa5e7f310 WatchSource:0}: Error finding container c2b7a5680988c3ca8972a254194567421fb59dc55cfb302012169fbfa5e7f310: Status 404 returned error can't find the container with id c2b7a5680988c3ca8972a254194567421fb59dc55cfb302012169fbfa5e7f310
Jul 27 20:40:34.036062 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:34.035958    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-030d0aef/e2e-lifecycle-model-030d0aef-kserve-55bc46ddc9-zdszm" event={"ID":"234c31ed-9173-499e-a9d8-d9ca45fd2ffb","Type":"ContainerStarted","Data":"7823d24fca32c107f859f4796e599d96f549a87a151acd35ff4b6e41517b4990"}
Jul 27 20:40:34.036062 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:34.036012    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-030d0aef/e2e-lifecycle-model-030d0aef-kserve-55bc46ddc9-zdszm" event={"ID":"234c31ed-9173-499e-a9d8-d9ca45fd2ffb","Type":"ContainerStarted","Data":"c2b7a5680988c3ca8972a254194567421fb59dc55cfb302012169fbfa5e7f310"}
Jul 27 20:40:34.097677 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:34.097620    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-030d0aef/e2e-lifecycle-model-030d0aef-kserve-55bc46ddc9-zdszm" podStartSLOduration=1.097602456 podStartE2EDuration="1.097602456s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:40:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:40:34.095237173 +0000 UTC m=+2182.669963562" watchObservedRunningTime="2026-07-27 20:40:34.097602456 +0000 UTC m=+2182.672328892"
Jul 27 20:40:36.996332 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:36.996303    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-030d0aef-7d5965d668-r6dkc"
Jul 27 20:40:36.996792 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:36.996378    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-030d0aef-55bb6cd47d-rwtdl"
Jul 27 20:40:38.549623 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:38.549587    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:40:41.766580 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:41.766549    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:40:41.867324 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:41.867285    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:40:43.739888 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:43.739824    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-030d0aef/e2e-lifecycle-model-030d0aef-kserve-55bc46ddc9-zdszm"
Jul 27 20:40:43.740376 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:43.739967    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-030d0aef/e2e-lifecycle-model-030d0aef-kserve-55bc46ddc9-zdszm"
Jul 27 20:40:43.752618 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:43.752592    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-030d0aef/e2e-lifecycle-model-030d0aef-kserve-55bc46ddc9-zdszm"
Jul 27 20:40:44.100693 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:44.100614    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-030d0aef/e2e-lifecycle-model-030d0aef-kserve-55bc46ddc9-zdszm"
Jul 27 20:40:54.595077 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:40:54.595033    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:41:01.833708 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:01.833666    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:41:15.795479 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:15.795426    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:41:17.167875 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:17.167838    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:41:17.192166 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:17.192126    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-030d0aef-55bb6cd47d-rwtdl"]
Jul 27 20:41:17.192653 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:17.192617    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-030d0aef-55bb6cd47d-rwtdl" podUID="fe9d541d-b7f5-489f-a7f9-3dc6d82cf597" containerName="payload-processing" containerID="cri-o://34df3e79ab7df6fdc16ed71d800e69ccaa4352637acb1f8941ddeca11406a377" gracePeriod=30
Jul 27 20:41:17.200146 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:17.200119    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-030d0aef-7d5965d668-r6dkc"]
Jul 27 20:41:17.200739 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:17.200333    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-030d0aef-7d5965d668-r6dkc" podUID="fade70a9-144a-4e3a-b756-a7e3035cfbc1" containerName="payload-pre-processing" containerID="cri-o://fb94a74424f19e1a1f55cad9e47a4971b4874ba9ae39f28ff7a5f4378d7d8353" gracePeriod=30
Jul 27 20:41:17.278761 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:17.278724    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:41:17.339040 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:17.338771    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:41:17.467232 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:17.467193    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-030d0aef-55bb6cd47d-rwtdl"
Jul 27 20:41:17.492559 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:17.492532    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-030d0aef-7d5965d668-r6dkc"
Jul 27 20:41:17.621554 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:17.621517    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fade70a9-144a-4e3a-b756-a7e3035cfbc1-plugins-config-volume\") pod \"fade70a9-144a-4e3a-b756-a7e3035cfbc1\" (UID: \"fade70a9-144a-4e3a-b756-a7e3035cfbc1\") "
Jul 27 20:41:17.621762 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:17.621575    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wqbws\" (UniqueName: \"kubernetes.io/projected/fe9d541d-b7f5-489f-a7f9-3dc6d82cf597-kube-api-access-wqbws\") pod \"fe9d541d-b7f5-489f-a7f9-3dc6d82cf597\" (UID: \"fe9d541d-b7f5-489f-a7f9-3dc6d82cf597\") "
Jul 27 20:41:17.621762 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:17.621610    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fe9d541d-b7f5-489f-a7f9-3dc6d82cf597-plugins-config-volume\") pod \"fe9d541d-b7f5-489f-a7f9-3dc6d82cf597\" (UID: \"fe9d541d-b7f5-489f-a7f9-3dc6d82cf597\") "
Jul 27 20:41:17.621762 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:17.621716    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vn2zx\" (UniqueName: \"kubernetes.io/projected/fade70a9-144a-4e3a-b756-a7e3035cfbc1-kube-api-access-vn2zx\") pod \"fade70a9-144a-4e3a-b756-a7e3035cfbc1\" (UID: \"fade70a9-144a-4e3a-b756-a7e3035cfbc1\") "
Jul 27 20:41:17.621958 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:17.621939    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe9d541d-b7f5-489f-a7f9-3dc6d82cf597-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fe9d541d-b7f5-489f-a7f9-3dc6d82cf597" (UID: "fe9d541d-b7f5-489f-a7f9-3dc6d82cf597"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:41:17.622018 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:17.621993    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fe9d541d-b7f5-489f-a7f9-3dc6d82cf597-plugins-config-volume\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:41:17.622018 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:17.621991    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fade70a9-144a-4e3a-b756-a7e3035cfbc1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fade70a9-144a-4e3a-b756-a7e3035cfbc1" (UID: "fade70a9-144a-4e3a-b756-a7e3035cfbc1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:41:17.623812 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:17.623791    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe9d541d-b7f5-489f-a7f9-3dc6d82cf597-kube-api-access-wqbws" (OuterVolumeSpecName: "kube-api-access-wqbws") pod "fe9d541d-b7f5-489f-a7f9-3dc6d82cf597" (UID: "fe9d541d-b7f5-489f-a7f9-3dc6d82cf597"). InnerVolumeSpecName "kube-api-access-wqbws". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:41:17.623866 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:17.623797    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fade70a9-144a-4e3a-b756-a7e3035cfbc1-kube-api-access-vn2zx" (OuterVolumeSpecName: "kube-api-access-vn2zx") pod "fade70a9-144a-4e3a-b756-a7e3035cfbc1" (UID: "fade70a9-144a-4e3a-b756-a7e3035cfbc1"). InnerVolumeSpecName "kube-api-access-vn2zx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:41:17.723332 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:17.723238    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fade70a9-144a-4e3a-b756-a7e3035cfbc1-plugins-config-volume\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:41:17.723332 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:17.723276    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wqbws\" (UniqueName: \"kubernetes.io/projected/fe9d541d-b7f5-489f-a7f9-3dc6d82cf597-kube-api-access-wqbws\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:41:17.723332 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:17.723285    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vn2zx\" (UniqueName: \"kubernetes.io/projected/fade70a9-144a-4e3a-b756-a7e3035cfbc1-kube-api-access-vn2zx\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:41:18.266704 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:18.266666    2557 generic.go:356] "Generic (PLEG): container finished" podID="fe9d541d-b7f5-489f-a7f9-3dc6d82cf597" containerID="34df3e79ab7df6fdc16ed71d800e69ccaa4352637acb1f8941ddeca11406a377" exitCode=0
Jul 27 20:41:18.267133 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:18.266713    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-030d0aef-55bb6cd47d-rwtdl"
Jul 27 20:41:18.267133 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:18.266758    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-030d0aef-55bb6cd47d-rwtdl" event={"ID":"fe9d541d-b7f5-489f-a7f9-3dc6d82cf597","Type":"ContainerDied","Data":"34df3e79ab7df6fdc16ed71d800e69ccaa4352637acb1f8941ddeca11406a377"}
Jul 27 20:41:18.267133 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:18.266817    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-030d0aef-55bb6cd47d-rwtdl" event={"ID":"fe9d541d-b7f5-489f-a7f9-3dc6d82cf597","Type":"ContainerDied","Data":"8ab8c9d94d105e8ddfdb512195121fad131729b9c5dfc60baff28366e159656d"}
Jul 27 20:41:18.267133 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:18.266847    2557 scope.go:117] "RemoveContainer" containerID="34df3e79ab7df6fdc16ed71d800e69ccaa4352637acb1f8941ddeca11406a377"
Jul 27 20:41:18.268206 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:18.268175    2557 generic.go:356] "Generic (PLEG): container finished" podID="fade70a9-144a-4e3a-b756-a7e3035cfbc1" containerID="fb94a74424f19e1a1f55cad9e47a4971b4874ba9ae39f28ff7a5f4378d7d8353" exitCode=0
Jul 27 20:41:18.268274 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:18.268218    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-030d0aef-7d5965d668-r6dkc"
Jul 27 20:41:18.268315 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:18.268220    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-030d0aef-7d5965d668-r6dkc" event={"ID":"fade70a9-144a-4e3a-b756-a7e3035cfbc1","Type":"ContainerDied","Data":"fb94a74424f19e1a1f55cad9e47a4971b4874ba9ae39f28ff7a5f4378d7d8353"}
Jul 27 20:41:18.268385 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:18.268353    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-030d0aef-7d5965d668-r6dkc" event={"ID":"fade70a9-144a-4e3a-b756-a7e3035cfbc1","Type":"ContainerDied","Data":"998de3f0c90b03996e34d1bfa97dc77b0e792f60f50a416aa9ee53abd6fca8c4"}
Jul 27 20:41:18.276000 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:18.275980    2557 scope.go:117] "RemoveContainer" containerID="34df3e79ab7df6fdc16ed71d800e69ccaa4352637acb1f8941ddeca11406a377"
Jul 27 20:41:18.276265 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:41:18.276247    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34df3e79ab7df6fdc16ed71d800e69ccaa4352637acb1f8941ddeca11406a377\": container with ID starting with 34df3e79ab7df6fdc16ed71d800e69ccaa4352637acb1f8941ddeca11406a377 not found: ID does not exist" containerID="34df3e79ab7df6fdc16ed71d800e69ccaa4352637acb1f8941ddeca11406a377"
Jul 27 20:41:18.276312 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:18.276271    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34df3e79ab7df6fdc16ed71d800e69ccaa4352637acb1f8941ddeca11406a377"} err="failed to get container status \"34df3e79ab7df6fdc16ed71d800e69ccaa4352637acb1f8941ddeca11406a377\": rpc error: code = NotFound desc = could not find container \"34df3e79ab7df6fdc16ed71d800e69ccaa4352637acb1f8941ddeca11406a377\": container with ID starting with 34df3e79ab7df6fdc16ed71d800e69ccaa4352637acb1f8941ddeca11406a377 not found: ID does not exist"
Jul 27 20:41:18.276312 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:18.276285    2557 scope.go:117] "RemoveContainer" containerID="fb94a74424f19e1a1f55cad9e47a4971b4874ba9ae39f28ff7a5f4378d7d8353"
Jul 27 20:41:18.284578 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:18.284555    2557 scope.go:117] "RemoveContainer" containerID="fb94a74424f19e1a1f55cad9e47a4971b4874ba9ae39f28ff7a5f4378d7d8353"
Jul 27 20:41:18.284870 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:41:18.284849    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb94a74424f19e1a1f55cad9e47a4971b4874ba9ae39f28ff7a5f4378d7d8353\": container with ID starting with fb94a74424f19e1a1f55cad9e47a4971b4874ba9ae39f28ff7a5f4378d7d8353 not found: ID does not exist" containerID="fb94a74424f19e1a1f55cad9e47a4971b4874ba9ae39f28ff7a5f4378d7d8353"
Jul 27 20:41:18.284949 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:18.284880    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb94a74424f19e1a1f55cad9e47a4971b4874ba9ae39f28ff7a5f4378d7d8353"} err="failed to get container status \"fb94a74424f19e1a1f55cad9e47a4971b4874ba9ae39f28ff7a5f4378d7d8353\": rpc error: code = NotFound desc = could not find container \"fb94a74424f19e1a1f55cad9e47a4971b4874ba9ae39f28ff7a5f4378d7d8353\": container with ID starting with fb94a74424f19e1a1f55cad9e47a4971b4874ba9ae39f28ff7a5f4378d7d8353 not found: ID does not exist"
Jul 27 20:41:18.285235 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:18.285216    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-030d0aef-55bb6cd47d-rwtdl"]
Jul 27 20:41:18.289547 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:18.289522    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-030d0aef-55bb6cd47d-rwtdl"]
Jul 27 20:41:18.299846 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:18.299814    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-030d0aef-7d5965d668-r6dkc"]
Jul 27 20:41:18.303011 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:18.302988    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-030d0aef-7d5965d668-r6dkc"]
Jul 27 20:41:19.910905 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:19.910871    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fade70a9-144a-4e3a-b756-a7e3035cfbc1" path="/var/lib/kubelet/pods/fade70a9-144a-4e3a-b756-a7e3035cfbc1/volumes"
Jul 27 20:41:19.911296 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:19.911243    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe9d541d-b7f5-489f-a7f9-3dc6d82cf597" path="/var/lib/kubelet/pods/fe9d541d-b7f5-489f-a7f9-3dc6d82cf597/volumes"
Jul 27 20:41:21.809863 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:21.809826    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:41:24.594607 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:24.594565    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:41:25.026858 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:25.026827    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:41:30.007817 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:30.007778    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-030d0aef/e2e-lifecycle-model-030d0aef-kserve-55bc46ddc9-zdszm"]
Jul 27 20:41:30.073022 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:30.072988    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:41:45.027369 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:45.027302    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-030d0aef/e2e-lifecycle-model-030d0aef-kserve-55bc46ddc9-zdszm" podUID="234c31ed-9173-499e-a9d8-d9ca45fd2ffb" containerName="main" containerID="cri-o://7823d24fca32c107f859f4796e599d96f549a87a151acd35ff4b6e41517b4990" gracePeriod=45
Jul 27 20:41:45.284106 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:45.284042    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-030d0aef/e2e-lifecycle-model-030d0aef-kserve-55bc46ddc9-zdszm"
Jul 27 20:41:45.370085 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:45.370047    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/234c31ed-9173-499e-a9d8-d9ca45fd2ffb-dshm\") pod \"234c31ed-9173-499e-a9d8-d9ca45fd2ffb\" (UID: \"234c31ed-9173-499e-a9d8-d9ca45fd2ffb\") "
Jul 27 20:41:45.370277 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:45.370104    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/234c31ed-9173-499e-a9d8-d9ca45fd2ffb-model-cache\") pod \"234c31ed-9173-499e-a9d8-d9ca45fd2ffb\" (UID: \"234c31ed-9173-499e-a9d8-d9ca45fd2ffb\") "
Jul 27 20:41:45.370277 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:45.370140    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/234c31ed-9173-499e-a9d8-d9ca45fd2ffb-home\") pod \"234c31ed-9173-499e-a9d8-d9ca45fd2ffb\" (UID: \"234c31ed-9173-499e-a9d8-d9ca45fd2ffb\") "
Jul 27 20:41:45.370277 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:45.370182    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/234c31ed-9173-499e-a9d8-d9ca45fd2ffb-tmp-dir\") pod \"234c31ed-9173-499e-a9d8-d9ca45fd2ffb\" (UID: \"234c31ed-9173-499e-a9d8-d9ca45fd2ffb\") "
Jul 27 20:41:45.370277 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:45.370200    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/234c31ed-9173-499e-a9d8-d9ca45fd2ffb-tls-certs\") pod \"234c31ed-9173-499e-a9d8-d9ca45fd2ffb\" (UID: \"234c31ed-9173-499e-a9d8-d9ca45fd2ffb\") "
Jul 27 20:41:45.370277 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:45.370222    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5kkx4\" (UniqueName: \"kubernetes.io/projected/234c31ed-9173-499e-a9d8-d9ca45fd2ffb-kube-api-access-5kkx4\") pod \"234c31ed-9173-499e-a9d8-d9ca45fd2ffb\" (UID: \"234c31ed-9173-499e-a9d8-d9ca45fd2ffb\") "
Jul 27 20:41:45.370561 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:45.370465    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/234c31ed-9173-499e-a9d8-d9ca45fd2ffb-model-cache" (OuterVolumeSpecName: "model-cache") pod "234c31ed-9173-499e-a9d8-d9ca45fd2ffb" (UID: "234c31ed-9173-499e-a9d8-d9ca45fd2ffb"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:41:45.370561 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:45.370491    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/234c31ed-9173-499e-a9d8-d9ca45fd2ffb-home" (OuterVolumeSpecName: "home") pod "234c31ed-9173-499e-a9d8-d9ca45fd2ffb" (UID: "234c31ed-9173-499e-a9d8-d9ca45fd2ffb"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:41:45.370561 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:45.370505    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/234c31ed-9173-499e-a9d8-d9ca45fd2ffb-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "234c31ed-9173-499e-a9d8-d9ca45fd2ffb" (UID: "234c31ed-9173-499e-a9d8-d9ca45fd2ffb"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:41:45.372414 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:45.372385    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/234c31ed-9173-499e-a9d8-d9ca45fd2ffb-dshm" (OuterVolumeSpecName: "dshm") pod "234c31ed-9173-499e-a9d8-d9ca45fd2ffb" (UID: "234c31ed-9173-499e-a9d8-d9ca45fd2ffb"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:41:45.372575 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:45.372417    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/234c31ed-9173-499e-a9d8-d9ca45fd2ffb-kube-api-access-5kkx4" (OuterVolumeSpecName: "kube-api-access-5kkx4") pod "234c31ed-9173-499e-a9d8-d9ca45fd2ffb" (UID: "234c31ed-9173-499e-a9d8-d9ca45fd2ffb"). InnerVolumeSpecName "kube-api-access-5kkx4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:41:45.372575 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:45.372423    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/234c31ed-9173-499e-a9d8-d9ca45fd2ffb-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "234c31ed-9173-499e-a9d8-d9ca45fd2ffb" (UID: "234c31ed-9173-499e-a9d8-d9ca45fd2ffb"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:41:45.419056 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:45.419021    2557 generic.go:356] "Generic (PLEG): container finished" podID="234c31ed-9173-499e-a9d8-d9ca45fd2ffb" containerID="7823d24fca32c107f859f4796e599d96f549a87a151acd35ff4b6e41517b4990" exitCode=0
Jul 27 20:41:45.419200 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:45.419062    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-030d0aef/e2e-lifecycle-model-030d0aef-kserve-55bc46ddc9-zdszm"
Jul 27 20:41:45.419200 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:45.419067    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-030d0aef/e2e-lifecycle-model-030d0aef-kserve-55bc46ddc9-zdszm" event={"ID":"234c31ed-9173-499e-a9d8-d9ca45fd2ffb","Type":"ContainerDied","Data":"7823d24fca32c107f859f4796e599d96f549a87a151acd35ff4b6e41517b4990"}
Jul 27 20:41:45.419200 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:45.419099    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-030d0aef/e2e-lifecycle-model-030d0aef-kserve-55bc46ddc9-zdszm" event={"ID":"234c31ed-9173-499e-a9d8-d9ca45fd2ffb","Type":"ContainerDied","Data":"c2b7a5680988c3ca8972a254194567421fb59dc55cfb302012169fbfa5e7f310"}
Jul 27 20:41:45.419200 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:45.419115    2557 scope.go:117] "RemoveContainer" containerID="7823d24fca32c107f859f4796e599d96f549a87a151acd35ff4b6e41517b4990"
Jul 27 20:41:45.428753 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:45.428735    2557 scope.go:117] "RemoveContainer" containerID="7823d24fca32c107f859f4796e599d96f549a87a151acd35ff4b6e41517b4990"
Jul 27 20:41:45.428995 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:41:45.428978    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7823d24fca32c107f859f4796e599d96f549a87a151acd35ff4b6e41517b4990\": container with ID starting with 7823d24fca32c107f859f4796e599d96f549a87a151acd35ff4b6e41517b4990 not found: ID does not exist" containerID="7823d24fca32c107f859f4796e599d96f549a87a151acd35ff4b6e41517b4990"
Jul 27 20:41:45.429045 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:45.429002    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7823d24fca32c107f859f4796e599d96f549a87a151acd35ff4b6e41517b4990"} err="failed to get container status \"7823d24fca32c107f859f4796e599d96f549a87a151acd35ff4b6e41517b4990\": rpc error: code = NotFound desc = could not find container \"7823d24fca32c107f859f4796e599d96f549a87a151acd35ff4b6e41517b4990\": container with ID starting with 7823d24fca32c107f859f4796e599d96f549a87a151acd35ff4b6e41517b4990 not found: ID does not exist"
Jul 27 20:41:45.440947 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:45.440913    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-030d0aef/e2e-lifecycle-model-030d0aef-kserve-55bc46ddc9-zdszm"]
Jul 27 20:41:45.444553 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:45.444531    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-030d0aef/e2e-lifecycle-model-030d0aef-kserve-55bc46ddc9-zdszm"]
Jul 27 20:41:45.471835 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:45.471808    2557 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/234c31ed-9173-499e-a9d8-d9ca45fd2ffb-home\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:41:45.471835 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:45.471834    2557 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/234c31ed-9173-499e-a9d8-d9ca45fd2ffb-tmp-dir\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:41:45.471971 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:45.471843    2557 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/234c31ed-9173-499e-a9d8-d9ca45fd2ffb-tls-certs\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:41:45.471971 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:45.471852    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5kkx4\" (UniqueName: \"kubernetes.io/projected/234c31ed-9173-499e-a9d8-d9ca45fd2ffb-kube-api-access-5kkx4\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:41:45.471971 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:45.471864    2557 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/234c31ed-9173-499e-a9d8-d9ca45fd2ffb-dshm\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:41:45.471971 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:45.471873    2557 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/234c31ed-9173-499e-a9d8-d9ca45fd2ffb-model-cache\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:41:45.910564 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:41:45.910533    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="234c31ed-9173-499e-a9d8-d9ca45fd2ffb" path="/var/lib/kubelet/pods/234c31ed-9173-499e-a9d8-d9ca45fd2ffb/volumes"
Jul 27 20:42:07.037276 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:42:07.037234    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:42:07.893145 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:42:07.893101    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:42:12.096427 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:42:12.096399    2557 scope.go:117] "RemoveContainer" containerID="282cf3d12a7f2da4f7f05367d077a8d3b71069e57b82e22092f3f03804a17216"
Jul 27 20:42:13.973406 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:42:13.973361    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:42:19.941650 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:42:19.941606    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:42:20.026353 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:42:20.026307    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:42:20.307373 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:42:20.307334    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:42:20.487702 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:42:20.487659    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:42:21.593373 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:42:21.593334    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:42:21.685854 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:42:21.685814    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:42:21.786129 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:42:21.786094    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:42:22.615134 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:42:22.615097    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:42:22.727601 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:42:22.727567    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:42:23.963482 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:42:23.963436    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:42:24.173080 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:42:24.173044    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:42:30.351489 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:42:30.351437    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:42:31.639589 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:42:31.639554    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:42:34.597884 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:42:34.597841    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:42:37.668907 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:42:37.668866    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:42:37.779576 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:42:37.779537    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:42:37.870688 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:42:37.870651    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:42:47.014062 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:42:47.014021    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:42:48.374366 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:42:48.374333    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:42:48.727511 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:42:48.727481    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:43:09.713363 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:09.713277    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:43:15.905926 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:15.905714    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:43:16.014554 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:16.014507    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:43:16.312463 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:16.312410    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:43:16.638727 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:16.638632    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:43:16.834430 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:16.834387    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:43:19.124966 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:19.124929    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:43:19.212877 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:19.212834    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:43:19.292504 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:19.292467    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:43:19.399164 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:19.399052    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:43:19.802250 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:19.802206    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:43:19.892460 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:19.892422    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:43:19.896755 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:19.896730    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-a12508-7847fdfb9b-t8q44"]
Jul 27 20:43:19.897084 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:19.897072    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe9d541d-b7f5-489f-a7f9-3dc6d82cf597" containerName="payload-processing"
Jul 27 20:43:19.897126 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:19.897086    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe9d541d-b7f5-489f-a7f9-3dc6d82cf597" containerName="payload-processing"
Jul 27 20:43:19.897126 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:19.897097    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fade70a9-144a-4e3a-b756-a7e3035cfbc1" containerName="payload-pre-processing"
Jul 27 20:43:19.897126 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:19.897102    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="fade70a9-144a-4e3a-b756-a7e3035cfbc1" containerName="payload-pre-processing"
Jul 27 20:43:19.897126 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:19.897110    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="234c31ed-9173-499e-a9d8-d9ca45fd2ffb" containerName="main"
Jul 27 20:43:19.897126 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:19.897117    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="234c31ed-9173-499e-a9d8-d9ca45fd2ffb" containerName="main"
Jul 27 20:43:19.897298 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:19.897194    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="fade70a9-144a-4e3a-b756-a7e3035cfbc1" containerName="payload-pre-processing"
Jul 27 20:43:19.897298 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:19.897204    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="234c31ed-9173-499e-a9d8-d9ca45fd2ffb" containerName="main"
Jul 27 20:43:19.897298 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:19.897212    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe9d541d-b7f5-489f-a7f9-3dc6d82cf597" containerName="payload-processing"
Jul 27 20:43:19.900165 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:19.900150    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a12508-7847fdfb9b-t8q44"
Jul 27 20:43:19.902440 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:19.902424    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-a12508\""
Jul 27 20:43:19.913007 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:19.912981    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-a12508-7847fdfb9b-t8q44"]
Jul 27 20:43:19.938282 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:19.938255    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-a12508-5f54d8f85b-glnp4"]
Jul 27 20:43:19.941644 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:19.941625    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-a12508-5f54d8f85b-glnp4"
Jul 27 20:43:19.944418 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:19.944401    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-a12508-dockercfg-lnm5z\""
Jul 27 20:43:19.950977 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:19.950952    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-a12508-5f54d8f85b-glnp4"]
Jul 27 20:43:20.017615 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:20.017576    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jplhz\" (UniqueName: \"kubernetes.io/projected/0bc9f808-8cea-4ed9-a551-bd815e52e8ed-kube-api-access-jplhz\") pod \"payload-pre-processing-e2e-inf-a-a12508-7847fdfb9b-t8q44\" (UID: \"0bc9f808-8cea-4ed9-a551-bd815e52e8ed\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a12508-7847fdfb9b-t8q44"
Jul 27 20:43:20.017800 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:20.017659    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8wzj\" (UniqueName: \"kubernetes.io/projected/a04f0e8b-8e5a-4191-8774-303bd0db4f2a-kube-api-access-z8wzj\") pod \"payload-processing-e2e-inf-a-a12508-5f54d8f85b-glnp4\" (UID: \"a04f0e8b-8e5a-4191-8774-303bd0db4f2a\") " pod="openshift-ingress/payload-processing-e2e-inf-a-a12508-5f54d8f85b-glnp4"
Jul 27 20:43:20.017800 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:20.017702    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a04f0e8b-8e5a-4191-8774-303bd0db4f2a-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-a12508-5f54d8f85b-glnp4\" (UID: \"a04f0e8b-8e5a-4191-8774-303bd0db4f2a\") " pod="openshift-ingress/payload-processing-e2e-inf-a-a12508-5f54d8f85b-glnp4"
Jul 27 20:43:20.017800 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:20.017737    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0bc9f808-8cea-4ed9-a551-bd815e52e8ed-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-a12508-7847fdfb9b-t8q44\" (UID: \"0bc9f808-8cea-4ed9-a551-bd815e52e8ed\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a12508-7847fdfb9b-t8q44"
Jul 27 20:43:20.119016 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:20.118938    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jplhz\" (UniqueName: \"kubernetes.io/projected/0bc9f808-8cea-4ed9-a551-bd815e52e8ed-kube-api-access-jplhz\") pod \"payload-pre-processing-e2e-inf-a-a12508-7847fdfb9b-t8q44\" (UID: \"0bc9f808-8cea-4ed9-a551-bd815e52e8ed\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a12508-7847fdfb9b-t8q44"
Jul 27 20:43:20.119016 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:20.118997    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8wzj\" (UniqueName: \"kubernetes.io/projected/a04f0e8b-8e5a-4191-8774-303bd0db4f2a-kube-api-access-z8wzj\") pod \"payload-processing-e2e-inf-a-a12508-5f54d8f85b-glnp4\" (UID: \"a04f0e8b-8e5a-4191-8774-303bd0db4f2a\") " pod="openshift-ingress/payload-processing-e2e-inf-a-a12508-5f54d8f85b-glnp4"
Jul 27 20:43:20.119259 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:20.119027    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a04f0e8b-8e5a-4191-8774-303bd0db4f2a-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-a12508-5f54d8f85b-glnp4\" (UID: \"a04f0e8b-8e5a-4191-8774-303bd0db4f2a\") " pod="openshift-ingress/payload-processing-e2e-inf-a-a12508-5f54d8f85b-glnp4"
Jul 27 20:43:20.119259 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:20.119046    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0bc9f808-8cea-4ed9-a551-bd815e52e8ed-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-a12508-7847fdfb9b-t8q44\" (UID: \"0bc9f808-8cea-4ed9-a551-bd815e52e8ed\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a12508-7847fdfb9b-t8q44"
Jul 27 20:43:20.119792 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:20.119767    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0bc9f808-8cea-4ed9-a551-bd815e52e8ed-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-a12508-7847fdfb9b-t8q44\" (UID: \"0bc9f808-8cea-4ed9-a551-bd815e52e8ed\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a12508-7847fdfb9b-t8q44"
Jul 27 20:43:20.119895 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:20.119788    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a04f0e8b-8e5a-4191-8774-303bd0db4f2a-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-a12508-5f54d8f85b-glnp4\" (UID: \"a04f0e8b-8e5a-4191-8774-303bd0db4f2a\") " pod="openshift-ingress/payload-processing-e2e-inf-a-a12508-5f54d8f85b-glnp4"
Jul 27 20:43:20.127206 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:20.127182    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jplhz\" (UniqueName: \"kubernetes.io/projected/0bc9f808-8cea-4ed9-a551-bd815e52e8ed-kube-api-access-jplhz\") pod \"payload-pre-processing-e2e-inf-a-a12508-7847fdfb9b-t8q44\" (UID: \"0bc9f808-8cea-4ed9-a551-bd815e52e8ed\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a12508-7847fdfb9b-t8q44"
Jul 27 20:43:20.127553 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:20.127333    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8wzj\" (UniqueName: \"kubernetes.io/projected/a04f0e8b-8e5a-4191-8774-303bd0db4f2a-kube-api-access-z8wzj\") pod \"payload-processing-e2e-inf-a-a12508-5f54d8f85b-glnp4\" (UID: \"a04f0e8b-8e5a-4191-8774-303bd0db4f2a\") " pod="openshift-ingress/payload-processing-e2e-inf-a-a12508-5f54d8f85b-glnp4"
Jul 27 20:43:20.212704 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:20.212648    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a12508-7847fdfb9b-t8q44"
Jul 27 20:43:20.252479 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:20.252434    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-a12508-5f54d8f85b-glnp4"
Jul 27 20:43:20.361216 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:20.361181    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-a12508-7847fdfb9b-t8q44"]
Jul 27 20:43:20.361903 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:43:20.361870    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bc9f808_8cea_4ed9_a551_bd815e52e8ed.slice/crio-21bd719052bab0662534651276918f30ac84574bca818567ad1eaa601f822d03 WatchSource:0}: Error finding container 21bd719052bab0662534651276918f30ac84574bca818567ad1eaa601f822d03: Status 404 returned error can't find the container with id 21bd719052bab0662534651276918f30ac84574bca818567ad1eaa601f822d03
Jul 27 20:43:20.401898 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:20.401866    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-a12508-5f54d8f85b-glnp4"]
Jul 27 20:43:20.403530 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:43:20.403501    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda04f0e8b_8e5a_4191_8774_303bd0db4f2a.slice/crio-593331e76047f1013406627e595eedac6ca82f4f066c28588cee6fb70a30f843 WatchSource:0}: Error finding container 593331e76047f1013406627e595eedac6ca82f4f066c28588cee6fb70a30f843: Status 404 returned error can't find the container with id 593331e76047f1013406627e595eedac6ca82f4f066c28588cee6fb70a30f843
Jul 27 20:43:20.921675 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:20.921601    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a12508-7847fdfb9b-t8q44" event={"ID":"0bc9f808-8cea-4ed9-a551-bd815e52e8ed","Type":"ContainerStarted","Data":"2f74a17e6343cfe0a7a324d09725760b8144689e06bf9b8a1f660b077e6883fd"}
Jul 27 20:43:20.921898 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:20.921768    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a12508-7847fdfb9b-t8q44"
Jul 27 20:43:20.921898 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:20.921834    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a12508-7847fdfb9b-t8q44" event={"ID":"0bc9f808-8cea-4ed9-a551-bd815e52e8ed","Type":"ContainerStarted","Data":"21bd719052bab0662534651276918f30ac84574bca818567ad1eaa601f822d03"}
Jul 27 20:43:20.923272 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:20.923243    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-a12508-5f54d8f85b-glnp4" event={"ID":"a04f0e8b-8e5a-4191-8774-303bd0db4f2a","Type":"ContainerStarted","Data":"d5111af0a17ced964d5dbd75c246c61fc8455bb941d4f82208c43294e09c7850"}
Jul 27 20:43:20.923386 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:20.923291    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-a12508-5f54d8f85b-glnp4" event={"ID":"a04f0e8b-8e5a-4191-8774-303bd0db4f2a","Type":"ContainerStarted","Data":"593331e76047f1013406627e595eedac6ca82f4f066c28588cee6fb70a30f843"}
Jul 27 20:43:20.923431 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:20.923385    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-a12508-5f54d8f85b-glnp4"
Jul 27 20:43:20.940441 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:20.940396    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a12508-7847fdfb9b-t8q44" podStartSLOduration=1.9403834199999999 podStartE2EDuration="1.94038342s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:43:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:43:20.938305715 +0000 UTC m=+2349.513032103" watchObservedRunningTime="2026-07-27 20:43:20.94038342 +0000 UTC m=+2349.515109808"
Jul 27 20:43:20.956806 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:20.956762    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-a12508-5f54d8f85b-glnp4" podStartSLOduration=1.9567499210000001 podStartE2EDuration="1.956749921s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:43:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:43:20.954875066 +0000 UTC m=+2349.529601455" watchObservedRunningTime="2026-07-27 20:43:20.956749921 +0000 UTC m=+2349.531476303"
Jul 27 20:43:23.645704 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:23.645661    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:43:24.035617 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:24.035581    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:43:24.429536 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:24.429434    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:43:24.586810 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:24.586772    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:43:26.312728 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:26.312691    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:43:27.119793 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:27.119764    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:43:27.215395 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:27.215365    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:43:27.289844 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:27.289802    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:43:27.532594 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:27.532561    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:43:27.868200 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:27.868109    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:43:27.964407 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:27.964370    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:43:27.965526 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:27.965505    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-eb7a86-847685bccb-mbvv2"]
Jul 27 20:43:27.970074 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:27.970052    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-eb7a86-847685bccb-mbvv2"
Jul 27 20:43:27.972421 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:27.972401    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-eb7a86-dockercfg-6bjnc\""
Jul 27 20:43:27.972529 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:27.972428    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-eb7a86\""
Jul 27 20:43:27.983128 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:27.983107    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-eb7a86-847685bccb-mbvv2"]
Jul 27 20:43:28.006590 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:28.006563    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-eb7a86-659f9b9c94-vrhc4"]
Jul 27 20:43:28.009961 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:28.009943    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-eb7a86-659f9b9c94-vrhc4"
Jul 27 20:43:28.019197 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:28.019170    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-eb7a86-659f9b9c94-vrhc4"]
Jul 27 20:43:28.096515 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:28.096448    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zb6m2\" (UniqueName: \"kubernetes.io/projected/91647bfd-911b-43bb-b402-a443feacce0c-kube-api-access-zb6m2\") pod \"payload-processing-e2e-inf-b-eb7a86-659f9b9c94-vrhc4\" (UID: \"91647bfd-911b-43bb-b402-a443feacce0c\") " pod="openshift-ingress/payload-processing-e2e-inf-b-eb7a86-659f9b9c94-vrhc4"
Jul 27 20:43:28.096515 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:28.096514    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6d401886-d0fc-4f9d-8183-0fc90dfd9c24-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-eb7a86-847685bccb-mbvv2\" (UID: \"6d401886-d0fc-4f9d-8183-0fc90dfd9c24\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-eb7a86-847685bccb-mbvv2"
Jul 27 20:43:28.096729 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:28.096535    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdb5w\" (UniqueName: \"kubernetes.io/projected/6d401886-d0fc-4f9d-8183-0fc90dfd9c24-kube-api-access-hdb5w\") pod \"payload-pre-processing-e2e-inf-b-eb7a86-847685bccb-mbvv2\" (UID: \"6d401886-d0fc-4f9d-8183-0fc90dfd9c24\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-eb7a86-847685bccb-mbvv2"
Jul 27 20:43:28.096729 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:28.096611    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/91647bfd-911b-43bb-b402-a443feacce0c-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-eb7a86-659f9b9c94-vrhc4\" (UID: \"91647bfd-911b-43bb-b402-a443feacce0c\") " pod="openshift-ingress/payload-processing-e2e-inf-b-eb7a86-659f9b9c94-vrhc4"
Jul 27 20:43:28.198073 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:28.197970    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zb6m2\" (UniqueName: \"kubernetes.io/projected/91647bfd-911b-43bb-b402-a443feacce0c-kube-api-access-zb6m2\") pod \"payload-processing-e2e-inf-b-eb7a86-659f9b9c94-vrhc4\" (UID: \"91647bfd-911b-43bb-b402-a443feacce0c\") " pod="openshift-ingress/payload-processing-e2e-inf-b-eb7a86-659f9b9c94-vrhc4"
Jul 27 20:43:28.198073 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:28.198014    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6d401886-d0fc-4f9d-8183-0fc90dfd9c24-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-eb7a86-847685bccb-mbvv2\" (UID: \"6d401886-d0fc-4f9d-8183-0fc90dfd9c24\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-eb7a86-847685bccb-mbvv2"
Jul 27 20:43:28.198073 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:28.198032    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdb5w\" (UniqueName: \"kubernetes.io/projected/6d401886-d0fc-4f9d-8183-0fc90dfd9c24-kube-api-access-hdb5w\") pod \"payload-pre-processing-e2e-inf-b-eb7a86-847685bccb-mbvv2\" (UID: \"6d401886-d0fc-4f9d-8183-0fc90dfd9c24\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-eb7a86-847685bccb-mbvv2"
Jul 27 20:43:28.198073 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:28.198064    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/91647bfd-911b-43bb-b402-a443feacce0c-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-eb7a86-659f9b9c94-vrhc4\" (UID: \"91647bfd-911b-43bb-b402-a443feacce0c\") " pod="openshift-ingress/payload-processing-e2e-inf-b-eb7a86-659f9b9c94-vrhc4"
Jul 27 20:43:28.198772 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:28.198752    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/91647bfd-911b-43bb-b402-a443feacce0c-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-eb7a86-659f9b9c94-vrhc4\" (UID: \"91647bfd-911b-43bb-b402-a443feacce0c\") " pod="openshift-ingress/payload-processing-e2e-inf-b-eb7a86-659f9b9c94-vrhc4"
Jul 27 20:43:28.198838 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:28.198752    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6d401886-d0fc-4f9d-8183-0fc90dfd9c24-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-eb7a86-847685bccb-mbvv2\" (UID: \"6d401886-d0fc-4f9d-8183-0fc90dfd9c24\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-eb7a86-847685bccb-mbvv2"
Jul 27 20:43:28.206183 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:28.206161    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdb5w\" (UniqueName: \"kubernetes.io/projected/6d401886-d0fc-4f9d-8183-0fc90dfd9c24-kube-api-access-hdb5w\") pod \"payload-pre-processing-e2e-inf-b-eb7a86-847685bccb-mbvv2\" (UID: \"6d401886-d0fc-4f9d-8183-0fc90dfd9c24\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-eb7a86-847685bccb-mbvv2"
Jul 27 20:43:28.206319 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:28.206297    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zb6m2\" (UniqueName: \"kubernetes.io/projected/91647bfd-911b-43bb-b402-a443feacce0c-kube-api-access-zb6m2\") pod \"payload-processing-e2e-inf-b-eb7a86-659f9b9c94-vrhc4\" (UID: \"91647bfd-911b-43bb-b402-a443feacce0c\") " pod="openshift-ingress/payload-processing-e2e-inf-b-eb7a86-659f9b9c94-vrhc4"
Jul 27 20:43:28.280957 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:28.280917    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-eb7a86-847685bccb-mbvv2"
Jul 27 20:43:28.322709 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:28.322672    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-eb7a86-659f9b9c94-vrhc4"
Jul 27 20:43:28.452526 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:28.452487    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-eb7a86-847685bccb-mbvv2"]
Jul 27 20:43:28.454120 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:43:28.454091    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d401886_d0fc_4f9d_8183_0fc90dfd9c24.slice/crio-3b364bb5f62ca713d109c92d4335f328992d60e37b34897b6c9571c151966dac WatchSource:0}: Error finding container 3b364bb5f62ca713d109c92d4335f328992d60e37b34897b6c9571c151966dac: Status 404 returned error can't find the container with id 3b364bb5f62ca713d109c92d4335f328992d60e37b34897b6c9571c151966dac
Jul 27 20:43:28.497445 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:28.497421    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-eb7a86-659f9b9c94-vrhc4"]
Jul 27 20:43:28.499643 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:43:28.499616    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91647bfd_911b_43bb_b402_a443feacce0c.slice/crio-ec904e4af7450041fad5eae0afe4b01631a53b2bcf9a300e7df3b7918888f37f WatchSource:0}: Error finding container ec904e4af7450041fad5eae0afe4b01631a53b2bcf9a300e7df3b7918888f37f: Status 404 returned error can't find the container with id ec904e4af7450041fad5eae0afe4b01631a53b2bcf9a300e7df3b7918888f37f
Jul 27 20:43:28.967756 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:28.967717    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-eb7a86-659f9b9c94-vrhc4" event={"ID":"91647bfd-911b-43bb-b402-a443feacce0c","Type":"ContainerStarted","Data":"50b3d81005fb709bac84baf3096ef7561e2903a4d9999cb60145af4101a56e7c"}
Jul 27 20:43:28.968262 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:28.967779    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-eb7a86-659f9b9c94-vrhc4" event={"ID":"91647bfd-911b-43bb-b402-a443feacce0c","Type":"ContainerStarted","Data":"ec904e4af7450041fad5eae0afe4b01631a53b2bcf9a300e7df3b7918888f37f"}
Jul 27 20:43:28.968262 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:28.967810    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-eb7a86-659f9b9c94-vrhc4"
Jul 27 20:43:28.969389 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:28.969362    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-eb7a86-847685bccb-mbvv2" event={"ID":"6d401886-d0fc-4f9d-8183-0fc90dfd9c24","Type":"ContainerStarted","Data":"278397590aecb90317f7c304dbe6e9ab7cfb620bfe5512d37ddaf68522b7b9f2"}
Jul 27 20:43:28.969545 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:28.969405    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-eb7a86-847685bccb-mbvv2" event={"ID":"6d401886-d0fc-4f9d-8183-0fc90dfd9c24","Type":"ContainerStarted","Data":"3b364bb5f62ca713d109c92d4335f328992d60e37b34897b6c9571c151966dac"}
Jul 27 20:43:28.969545 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:28.969427    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-eb7a86-847685bccb-mbvv2"
Jul 27 20:43:28.983861 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:28.983818    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-eb7a86-659f9b9c94-vrhc4" podStartSLOduration=1.983802141 podStartE2EDuration="1.983802141s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:43:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:43:28.981947548 +0000 UTC m=+2357.556673936" watchObservedRunningTime="2026-07-27 20:43:28.983802141 +0000 UTC m=+2357.558528520"
Jul 27 20:43:28.996340 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:28.996297    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-eb7a86-847685bccb-mbvv2" podStartSLOduration=1.996277483 podStartE2EDuration="1.996277483s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:43:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:43:28.99570194 +0000 UTC m=+2357.570428329" watchObservedRunningTime="2026-07-27 20:43:28.996277483 +0000 UTC m=+2357.571003872"
Jul 27 20:43:31.632972 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:31.632932    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:43:31.931527 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:31.931425    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-a12508-5f54d8f85b-glnp4"
Jul 27 20:43:31.931801 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:31.931780    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a12508-7847fdfb9b-t8q44"
Jul 27 20:43:35.696574 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:35.696540    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-a12508/test-model-a12508-kserve-8bd8988b7-mzhtb"]
Jul 27 20:43:35.700173 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:35.700155    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-a12508/test-model-a12508-kserve-8bd8988b7-mzhtb"
Jul 27 20:43:35.703319 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:35.703291    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-a12508\"/\"default-dockercfg-ccn2b\""
Jul 27 20:43:35.703319 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:35.703319    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-a12508\"/\"test-model-a12508-kserve-self-signed-certs\""
Jul 27 20:43:35.703563 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:35.703330    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-a12508\"/\"openshift-service-ca.crt\""
Jul 27 20:43:35.703563 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:35.703437    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-a12508\"/\"kube-root-ca.crt\""
Jul 27 20:43:35.709821 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:35.709793    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-a12508/test-model-a12508-kserve-8bd8988b7-mzhtb"]
Jul 27 20:43:35.783102 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:35.783073    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:43:35.865388 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:35.865346    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/77f89c15-c076-407f-b286-d03b27a3ba11-dshm\") pod \"test-model-a12508-kserve-8bd8988b7-mzhtb\" (UID: \"77f89c15-c076-407f-b286-d03b27a3ba11\") " pod="ai-tenant-e2e-inf-a-a12508/test-model-a12508-kserve-8bd8988b7-mzhtb"
Jul 27 20:43:35.865388 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:35.865388    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77f89c15-c076-407f-b286-d03b27a3ba11-tmp-dir\") pod \"test-model-a12508-kserve-8bd8988b7-mzhtb\" (UID: \"77f89c15-c076-407f-b286-d03b27a3ba11\") " pod="ai-tenant-e2e-inf-a-a12508/test-model-a12508-kserve-8bd8988b7-mzhtb"
Jul 27 20:43:35.865622 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:35.865492    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7b9g\" (UniqueName: \"kubernetes.io/projected/77f89c15-c076-407f-b286-d03b27a3ba11-kube-api-access-r7b9g\") pod \"test-model-a12508-kserve-8bd8988b7-mzhtb\" (UID: \"77f89c15-c076-407f-b286-d03b27a3ba11\") " pod="ai-tenant-e2e-inf-a-a12508/test-model-a12508-kserve-8bd8988b7-mzhtb"
Jul 27 20:43:35.865622 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:35.865534    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77f89c15-c076-407f-b286-d03b27a3ba11-tls-certs\") pod \"test-model-a12508-kserve-8bd8988b7-mzhtb\" (UID: \"77f89c15-c076-407f-b286-d03b27a3ba11\") " pod="ai-tenant-e2e-inf-a-a12508/test-model-a12508-kserve-8bd8988b7-mzhtb"
Jul 27 20:43:35.865622 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:35.865601    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/77f89c15-c076-407f-b286-d03b27a3ba11-home\") pod \"test-model-a12508-kserve-8bd8988b7-mzhtb\" (UID: \"77f89c15-c076-407f-b286-d03b27a3ba11\") " pod="ai-tenant-e2e-inf-a-a12508/test-model-a12508-kserve-8bd8988b7-mzhtb"
Jul 27 20:43:35.865726 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:35.865622    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/77f89c15-c076-407f-b286-d03b27a3ba11-model-cache\") pod \"test-model-a12508-kserve-8bd8988b7-mzhtb\" (UID: \"77f89c15-c076-407f-b286-d03b27a3ba11\") " pod="ai-tenant-e2e-inf-a-a12508/test-model-a12508-kserve-8bd8988b7-mzhtb"
Jul 27 20:43:35.966798 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:35.966697    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7b9g\" (UniqueName: \"kubernetes.io/projected/77f89c15-c076-407f-b286-d03b27a3ba11-kube-api-access-r7b9g\") pod \"test-model-a12508-kserve-8bd8988b7-mzhtb\" (UID: \"77f89c15-c076-407f-b286-d03b27a3ba11\") " pod="ai-tenant-e2e-inf-a-a12508/test-model-a12508-kserve-8bd8988b7-mzhtb"
Jul 27 20:43:35.966798 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:35.966753    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77f89c15-c076-407f-b286-d03b27a3ba11-tls-certs\") pod \"test-model-a12508-kserve-8bd8988b7-mzhtb\" (UID: \"77f89c15-c076-407f-b286-d03b27a3ba11\") " pod="ai-tenant-e2e-inf-a-a12508/test-model-a12508-kserve-8bd8988b7-mzhtb"
Jul 27 20:43:35.966798 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:35.966791    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/77f89c15-c076-407f-b286-d03b27a3ba11-home\") pod \"test-model-a12508-kserve-8bd8988b7-mzhtb\" (UID: \"77f89c15-c076-407f-b286-d03b27a3ba11\") " pod="ai-tenant-e2e-inf-a-a12508/test-model-a12508-kserve-8bd8988b7-mzhtb"
Jul 27 20:43:35.967092 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:35.966810    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/77f89c15-c076-407f-b286-d03b27a3ba11-model-cache\") pod \"test-model-a12508-kserve-8bd8988b7-mzhtb\" (UID: \"77f89c15-c076-407f-b286-d03b27a3ba11\") " pod="ai-tenant-e2e-inf-a-a12508/test-model-a12508-kserve-8bd8988b7-mzhtb"
Jul 27 20:43:35.967092 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:35.966853    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/77f89c15-c076-407f-b286-d03b27a3ba11-dshm\") pod \"test-model-a12508-kserve-8bd8988b7-mzhtb\" (UID: \"77f89c15-c076-407f-b286-d03b27a3ba11\") " pod="ai-tenant-e2e-inf-a-a12508/test-model-a12508-kserve-8bd8988b7-mzhtb"
Jul 27 20:43:35.967092 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:35.966868    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77f89c15-c076-407f-b286-d03b27a3ba11-tmp-dir\") pod \"test-model-a12508-kserve-8bd8988b7-mzhtb\" (UID: \"77f89c15-c076-407f-b286-d03b27a3ba11\") " pod="ai-tenant-e2e-inf-a-a12508/test-model-a12508-kserve-8bd8988b7-mzhtb"
Jul 27 20:43:35.967279 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:35.967250    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/77f89c15-c076-407f-b286-d03b27a3ba11-home\") pod \"test-model-a12508-kserve-8bd8988b7-mzhtb\" (UID: \"77f89c15-c076-407f-b286-d03b27a3ba11\") " pod="ai-tenant-e2e-inf-a-a12508/test-model-a12508-kserve-8bd8988b7-mzhtb"
Jul 27 20:43:35.967347 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:35.967260    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/77f89c15-c076-407f-b286-d03b27a3ba11-model-cache\") pod \"test-model-a12508-kserve-8bd8988b7-mzhtb\" (UID: \"77f89c15-c076-407f-b286-d03b27a3ba11\") " pod="ai-tenant-e2e-inf-a-a12508/test-model-a12508-kserve-8bd8988b7-mzhtb"
Jul 27 20:43:35.967347 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:35.967298    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77f89c15-c076-407f-b286-d03b27a3ba11-tmp-dir\") pod \"test-model-a12508-kserve-8bd8988b7-mzhtb\" (UID: \"77f89c15-c076-407f-b286-d03b27a3ba11\") " pod="ai-tenant-e2e-inf-a-a12508/test-model-a12508-kserve-8bd8988b7-mzhtb"
Jul 27 20:43:35.969204 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:35.969181    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/77f89c15-c076-407f-b286-d03b27a3ba11-dshm\") pod \"test-model-a12508-kserve-8bd8988b7-mzhtb\" (UID: \"77f89c15-c076-407f-b286-d03b27a3ba11\") " pod="ai-tenant-e2e-inf-a-a12508/test-model-a12508-kserve-8bd8988b7-mzhtb"
Jul 27 20:43:35.969550 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:35.969534    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77f89c15-c076-407f-b286-d03b27a3ba11-tls-certs\") pod \"test-model-a12508-kserve-8bd8988b7-mzhtb\" (UID: \"77f89c15-c076-407f-b286-d03b27a3ba11\") " pod="ai-tenant-e2e-inf-a-a12508/test-model-a12508-kserve-8bd8988b7-mzhtb"
Jul 27 20:43:35.974005 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:35.973982    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7b9g\" (UniqueName: \"kubernetes.io/projected/77f89c15-c076-407f-b286-d03b27a3ba11-kube-api-access-r7b9g\") pod \"test-model-a12508-kserve-8bd8988b7-mzhtb\" (UID: \"77f89c15-c076-407f-b286-d03b27a3ba11\") " pod="ai-tenant-e2e-inf-a-a12508/test-model-a12508-kserve-8bd8988b7-mzhtb"
Jul 27 20:43:36.011068 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:36.011037    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-a12508/test-model-a12508-kserve-8bd8988b7-mzhtb"
Jul 27 20:43:36.152583 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:36.152494    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-a12508/test-model-a12508-kserve-8bd8988b7-mzhtb"]
Jul 27 20:43:36.154801 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:43:36.154775    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod77f89c15_c076_407f_b286_d03b27a3ba11.slice/crio-bcf013840aa731f145400659893c162eeb7af22501cb8157db8533595bf7fee7 WatchSource:0}: Error finding container bcf013840aa731f145400659893c162eeb7af22501cb8157db8533595bf7fee7: Status 404 returned error can't find the container with id bcf013840aa731f145400659893c162eeb7af22501cb8157db8533595bf7fee7
Jul 27 20:43:37.014833 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:37.014780    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-a12508/test-model-a12508-kserve-8bd8988b7-mzhtb" event={"ID":"77f89c15-c076-407f-b286-d03b27a3ba11","Type":"ContainerStarted","Data":"79a7bd793a3d4199fe7dce91e0c825e5270900cfd0fd9ee3757e46c33d0c6ee4"}
Jul 27 20:43:37.014833 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:37.014837    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-a12508/test-model-a12508-kserve-8bd8988b7-mzhtb" event={"ID":"77f89c15-c076-407f-b286-d03b27a3ba11","Type":"ContainerStarted","Data":"bcf013840aa731f145400659893c162eeb7af22501cb8157db8533595bf7fee7"}
Jul 27 20:43:37.031247 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:37.031187    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-a12508/test-model-a12508-kserve-8bd8988b7-mzhtb" podStartSLOduration=2.031166656 podStartE2EDuration="2.031166656s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:43:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:43:37.030766861 +0000 UTC m=+2365.605493250" watchObservedRunningTime="2026-07-27 20:43:37.031166656 +0000 UTC m=+2365.605893046"
Jul 27 20:43:38.597394 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:38.597349    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:43:39.976176 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:39.976131    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-eb7a86-847685bccb-mbvv2" podUID="6d401886-d0fc-4f9d-8183-0fc90dfd9c24" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.134.0.66:9004: connect: connection refused"
Jul 27 20:43:39.976733 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:39.976610    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-eb7a86-659f9b9c94-vrhc4"
Jul 27 20:43:46.011266 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:46.011230    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-a12508/test-model-a12508-kserve-8bd8988b7-mzhtb"
Jul 27 20:43:46.011691 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:46.011368    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-a12508/test-model-a12508-kserve-8bd8988b7-mzhtb"
Jul 27 20:43:46.023928 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:46.023894    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-a12508/test-model-a12508-kserve-8bd8988b7-mzhtb"
Jul 27 20:43:46.072286 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:46.072248    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-a12508/test-model-a12508-kserve-8bd8988b7-mzhtb"
Jul 27 20:43:49.975607 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:49.975576    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-eb7a86-847685bccb-mbvv2"
Jul 27 20:43:53.487651 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:53.487611    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:43:54.895782 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:54.895747    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-eb7a86/test-model-eb7a86-kserve-7495f5f4dc-6rf9v"]
Jul 27 20:43:54.900474 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:54.900432    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-eb7a86/test-model-eb7a86-kserve-7495f5f4dc-6rf9v"
Jul 27 20:43:54.903729 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:54.903706    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-eb7a86\"/\"default-dockercfg-g5gpg\""
Jul 27 20:43:54.903729 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:54.903717    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-eb7a86\"/\"test-model-eb7a86-kserve-self-signed-certs\""
Jul 27 20:43:54.903920 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:54.903751    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-eb7a86\"/\"openshift-service-ca.crt\""
Jul 27 20:43:54.903920 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:54.903726    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-eb7a86\"/\"kube-root-ca.crt\""
Jul 27 20:43:54.907974 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:54.907940    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-eb7a86/test-model-eb7a86-kserve-7495f5f4dc-6rf9v"]
Jul 27 20:43:54.922442 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:54.922415    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:43:54.937618 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:54.937584    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e0b3efe0-2f2c-4476-aead-b2b601a85ec0-home\") pod \"test-model-eb7a86-kserve-7495f5f4dc-6rf9v\" (UID: \"e0b3efe0-2f2c-4476-aead-b2b601a85ec0\") " pod="ai-tenant-e2e-inf-b-eb7a86/test-model-eb7a86-kserve-7495f5f4dc-6rf9v"
Jul 27 20:43:54.937727 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:54.937632    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e0b3efe0-2f2c-4476-aead-b2b601a85ec0-tmp-dir\") pod \"test-model-eb7a86-kserve-7495f5f4dc-6rf9v\" (UID: \"e0b3efe0-2f2c-4476-aead-b2b601a85ec0\") " pod="ai-tenant-e2e-inf-b-eb7a86/test-model-eb7a86-kserve-7495f5f4dc-6rf9v"
Jul 27 20:43:54.937727 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:54.937706    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e0b3efe0-2f2c-4476-aead-b2b601a85ec0-dshm\") pod \"test-model-eb7a86-kserve-7495f5f4dc-6rf9v\" (UID: \"e0b3efe0-2f2c-4476-aead-b2b601a85ec0\") " pod="ai-tenant-e2e-inf-b-eb7a86/test-model-eb7a86-kserve-7495f5f4dc-6rf9v"
Jul 27 20:43:54.937851 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:54.937748    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e0b3efe0-2f2c-4476-aead-b2b601a85ec0-tls-certs\") pod \"test-model-eb7a86-kserve-7495f5f4dc-6rf9v\" (UID: \"e0b3efe0-2f2c-4476-aead-b2b601a85ec0\") " pod="ai-tenant-e2e-inf-b-eb7a86/test-model-eb7a86-kserve-7495f5f4dc-6rf9v"
Jul 27 20:43:54.937913 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:54.937887    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxln6\" (UniqueName: \"kubernetes.io/projected/e0b3efe0-2f2c-4476-aead-b2b601a85ec0-kube-api-access-gxln6\") pod \"test-model-eb7a86-kserve-7495f5f4dc-6rf9v\" (UID: \"e0b3efe0-2f2c-4476-aead-b2b601a85ec0\") " pod="ai-tenant-e2e-inf-b-eb7a86/test-model-eb7a86-kserve-7495f5f4dc-6rf9v"
Jul 27 20:43:54.937973 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:54.937931    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e0b3efe0-2f2c-4476-aead-b2b601a85ec0-model-cache\") pod \"test-model-eb7a86-kserve-7495f5f4dc-6rf9v\" (UID: \"e0b3efe0-2f2c-4476-aead-b2b601a85ec0\") " pod="ai-tenant-e2e-inf-b-eb7a86/test-model-eb7a86-kserve-7495f5f4dc-6rf9v"
Jul 27 20:43:55.038615 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:55.038580    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e0b3efe0-2f2c-4476-aead-b2b601a85ec0-model-cache\") pod \"test-model-eb7a86-kserve-7495f5f4dc-6rf9v\" (UID: \"e0b3efe0-2f2c-4476-aead-b2b601a85ec0\") " pod="ai-tenant-e2e-inf-b-eb7a86/test-model-eb7a86-kserve-7495f5f4dc-6rf9v"
Jul 27 20:43:55.038833 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:55.038632    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e0b3efe0-2f2c-4476-aead-b2b601a85ec0-home\") pod \"test-model-eb7a86-kserve-7495f5f4dc-6rf9v\" (UID: \"e0b3efe0-2f2c-4476-aead-b2b601a85ec0\") " pod="ai-tenant-e2e-inf-b-eb7a86/test-model-eb7a86-kserve-7495f5f4dc-6rf9v"
Jul 27 20:43:55.038833 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:55.038767    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e0b3efe0-2f2c-4476-aead-b2b601a85ec0-tmp-dir\") pod \"test-model-eb7a86-kserve-7495f5f4dc-6rf9v\" (UID: \"e0b3efe0-2f2c-4476-aead-b2b601a85ec0\") " pod="ai-tenant-e2e-inf-b-eb7a86/test-model-eb7a86-kserve-7495f5f4dc-6rf9v"
Jul 27 20:43:55.038833 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:55.038831    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e0b3efe0-2f2c-4476-aead-b2b601a85ec0-dshm\") pod \"test-model-eb7a86-kserve-7495f5f4dc-6rf9v\" (UID: \"e0b3efe0-2f2c-4476-aead-b2b601a85ec0\") " pod="ai-tenant-e2e-inf-b-eb7a86/test-model-eb7a86-kserve-7495f5f4dc-6rf9v"
Jul 27 20:43:55.039013 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:55.038861    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e0b3efe0-2f2c-4476-aead-b2b601a85ec0-tls-certs\") pod \"test-model-eb7a86-kserve-7495f5f4dc-6rf9v\" (UID: \"e0b3efe0-2f2c-4476-aead-b2b601a85ec0\") " pod="ai-tenant-e2e-inf-b-eb7a86/test-model-eb7a86-kserve-7495f5f4dc-6rf9v"
Jul 27 20:43:55.039013 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:55.038914    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxln6\" (UniqueName: \"kubernetes.io/projected/e0b3efe0-2f2c-4476-aead-b2b601a85ec0-kube-api-access-gxln6\") pod \"test-model-eb7a86-kserve-7495f5f4dc-6rf9v\" (UID: \"e0b3efe0-2f2c-4476-aead-b2b601a85ec0\") " pod="ai-tenant-e2e-inf-b-eb7a86/test-model-eb7a86-kserve-7495f5f4dc-6rf9v"
Jul 27 20:43:55.039126 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:55.039065    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e0b3efe0-2f2c-4476-aead-b2b601a85ec0-model-cache\") pod \"test-model-eb7a86-kserve-7495f5f4dc-6rf9v\" (UID: \"e0b3efe0-2f2c-4476-aead-b2b601a85ec0\") " pod="ai-tenant-e2e-inf-b-eb7a86/test-model-eb7a86-kserve-7495f5f4dc-6rf9v"
Jul 27 20:43:55.039165 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:55.039128    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e0b3efe0-2f2c-4476-aead-b2b601a85ec0-home\") pod \"test-model-eb7a86-kserve-7495f5f4dc-6rf9v\" (UID: \"e0b3efe0-2f2c-4476-aead-b2b601a85ec0\") " pod="ai-tenant-e2e-inf-b-eb7a86/test-model-eb7a86-kserve-7495f5f4dc-6rf9v"
Jul 27 20:43:55.039165 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:55.039145    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e0b3efe0-2f2c-4476-aead-b2b601a85ec0-tmp-dir\") pod \"test-model-eb7a86-kserve-7495f5f4dc-6rf9v\" (UID: \"e0b3efe0-2f2c-4476-aead-b2b601a85ec0\") " pod="ai-tenant-e2e-inf-b-eb7a86/test-model-eb7a86-kserve-7495f5f4dc-6rf9v"
Jul 27 20:43:55.041083 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:55.041063    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e0b3efe0-2f2c-4476-aead-b2b601a85ec0-dshm\") pod \"test-model-eb7a86-kserve-7495f5f4dc-6rf9v\" (UID: \"e0b3efe0-2f2c-4476-aead-b2b601a85ec0\") " pod="ai-tenant-e2e-inf-b-eb7a86/test-model-eb7a86-kserve-7495f5f4dc-6rf9v"
Jul 27 20:43:55.041362 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:55.041346    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e0b3efe0-2f2c-4476-aead-b2b601a85ec0-tls-certs\") pod \"test-model-eb7a86-kserve-7495f5f4dc-6rf9v\" (UID: \"e0b3efe0-2f2c-4476-aead-b2b601a85ec0\") " pod="ai-tenant-e2e-inf-b-eb7a86/test-model-eb7a86-kserve-7495f5f4dc-6rf9v"
Jul 27 20:43:55.047097 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:55.047072    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxln6\" (UniqueName: \"kubernetes.io/projected/e0b3efe0-2f2c-4476-aead-b2b601a85ec0-kube-api-access-gxln6\") pod \"test-model-eb7a86-kserve-7495f5f4dc-6rf9v\" (UID: \"e0b3efe0-2f2c-4476-aead-b2b601a85ec0\") " pod="ai-tenant-e2e-inf-b-eb7a86/test-model-eb7a86-kserve-7495f5f4dc-6rf9v"
Jul 27 20:43:55.210976 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:55.210872    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-eb7a86/test-model-eb7a86-kserve-7495f5f4dc-6rf9v"
Jul 27 20:43:55.349991 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:55.349964    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-eb7a86/test-model-eb7a86-kserve-7495f5f4dc-6rf9v"]
Jul 27 20:43:55.351513 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:43:55.351487    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode0b3efe0_2f2c_4476_aead_b2b601a85ec0.slice/crio-8a1040854e6f901f99be9aaecd77ba90ecebaf69f4f0acdc69316a2da96bbccc WatchSource:0}: Error finding container 8a1040854e6f901f99be9aaecd77ba90ecebaf69f4f0acdc69316a2da96bbccc: Status 404 returned error can't find the container with id 8a1040854e6f901f99be9aaecd77ba90ecebaf69f4f0acdc69316a2da96bbccc
Jul 27 20:43:56.121296 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:56.121251    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-eb7a86/test-model-eb7a86-kserve-7495f5f4dc-6rf9v" event={"ID":"e0b3efe0-2f2c-4476-aead-b2b601a85ec0","Type":"ContainerStarted","Data":"73521d164aa0cd8ed4e9d43a28f7b3cec0d4d35932c68d515f34a103673389a4"}
Jul 27 20:43:56.121773 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:56.121305    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-eb7a86/test-model-eb7a86-kserve-7495f5f4dc-6rf9v" event={"ID":"e0b3efe0-2f2c-4476-aead-b2b601a85ec0","Type":"ContainerStarted","Data":"8a1040854e6f901f99be9aaecd77ba90ecebaf69f4f0acdc69316a2da96bbccc"}
Jul 27 20:43:56.138988 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:43:56.138862    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-eb7a86/test-model-eb7a86-kserve-7495f5f4dc-6rf9v" podStartSLOduration=2.138845839 podStartE2EDuration="2.138845839s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:43:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:43:56.138278057 +0000 UTC m=+2384.713004445" watchObservedRunningTime="2026-07-27 20:43:56.138845839 +0000 UTC m=+2384.713572227"
Jul 27 20:44:05.211386 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:05.211350    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-eb7a86/test-model-eb7a86-kserve-7495f5f4dc-6rf9v"
Jul 27 20:44:05.211965 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:05.211433    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-eb7a86/test-model-eb7a86-kserve-7495f5f4dc-6rf9v"
Jul 27 20:44:05.224151 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:05.224117    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-eb7a86/test-model-eb7a86-kserve-7495f5f4dc-6rf9v"
Jul 27 20:44:06.184724 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:06.184682    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-eb7a86/test-model-eb7a86-kserve-7495f5f4dc-6rf9v"
Jul 27 20:44:09.107940 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:09.107907    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:44:32.340396 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:32.340352    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:44:35.888833 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:35.888754    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-a12508/test-model-a12508-kserve-8bd8988b7-mzhtb"]
Jul 27 20:44:35.913826 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:35.913794    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:44:36.906107 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:36.906073    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-eb7a86/test-model-eb7a86-kserve-7495f5f4dc-6rf9v"]
Jul 27 20:44:36.927815 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:36.927779    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:44:43.396190 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:43.396146    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:44:47.533388 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:47.533345    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:44:47.558324 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:47.558292    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-a12508-5f54d8f85b-glnp4"]
Jul 27 20:44:47.558581 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:47.558556    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-a12508-5f54d8f85b-glnp4" podUID="a04f0e8b-8e5a-4191-8774-303bd0db4f2a" containerName="payload-processing" containerID="cri-o://d5111af0a17ced964d5dbd75c246c61fc8455bb941d4f82208c43294e09c7850" gracePeriod=30
Jul 27 20:44:47.567176 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:47.566488    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-a12508-7847fdfb9b-t8q44"]
Jul 27 20:44:47.567176 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:47.566882    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a12508-7847fdfb9b-t8q44" podUID="0bc9f808-8cea-4ed9-a551-bd815e52e8ed" containerName="payload-pre-processing" containerID="cri-o://2f74a17e6343cfe0a7a324d09725760b8144689e06bf9b8a1f660b077e6883fd" gracePeriod=30
Jul 27 20:44:47.601334 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:47.601303    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:44:47.667625 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:47.667587    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:44:47.841938 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:47.841913    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-a12508-5f54d8f85b-glnp4"
Jul 27 20:44:47.845056 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:47.845022    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a12508-7847fdfb9b-t8q44"
Jul 27 20:44:47.926897 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:47.926864    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0bc9f808-8cea-4ed9-a551-bd815e52e8ed-plugins-config-volume\") pod \"0bc9f808-8cea-4ed9-a551-bd815e52e8ed\" (UID: \"0bc9f808-8cea-4ed9-a551-bd815e52e8ed\") "
Jul 27 20:44:47.927075 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:47.926905    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z8wzj\" (UniqueName: \"kubernetes.io/projected/a04f0e8b-8e5a-4191-8774-303bd0db4f2a-kube-api-access-z8wzj\") pod \"a04f0e8b-8e5a-4191-8774-303bd0db4f2a\" (UID: \"a04f0e8b-8e5a-4191-8774-303bd0db4f2a\") "
Jul 27 20:44:47.927075 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:47.927001    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jplhz\" (UniqueName: \"kubernetes.io/projected/0bc9f808-8cea-4ed9-a551-bd815e52e8ed-kube-api-access-jplhz\") pod \"0bc9f808-8cea-4ed9-a551-bd815e52e8ed\" (UID: \"0bc9f808-8cea-4ed9-a551-bd815e52e8ed\") "
Jul 27 20:44:47.927075 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:47.927024    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a04f0e8b-8e5a-4191-8774-303bd0db4f2a-plugins-config-volume\") pod \"a04f0e8b-8e5a-4191-8774-303bd0db4f2a\" (UID: \"a04f0e8b-8e5a-4191-8774-303bd0db4f2a\") "
Jul 27 20:44:47.927274 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:47.927245    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0bc9f808-8cea-4ed9-a551-bd815e52e8ed-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0bc9f808-8cea-4ed9-a551-bd815e52e8ed" (UID: "0bc9f808-8cea-4ed9-a551-bd815e52e8ed"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:44:47.927402 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:47.927332    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0bc9f808-8cea-4ed9-a551-bd815e52e8ed-plugins-config-volume\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:44:47.927508 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:47.927482    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a04f0e8b-8e5a-4191-8774-303bd0db4f2a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a04f0e8b-8e5a-4191-8774-303bd0db4f2a" (UID: "a04f0e8b-8e5a-4191-8774-303bd0db4f2a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:44:47.929128 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:47.929110    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a04f0e8b-8e5a-4191-8774-303bd0db4f2a-kube-api-access-z8wzj" (OuterVolumeSpecName: "kube-api-access-z8wzj") pod "a04f0e8b-8e5a-4191-8774-303bd0db4f2a" (UID: "a04f0e8b-8e5a-4191-8774-303bd0db4f2a"). InnerVolumeSpecName "kube-api-access-z8wzj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:44:47.929223 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:47.929158    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0bc9f808-8cea-4ed9-a551-bd815e52e8ed-kube-api-access-jplhz" (OuterVolumeSpecName: "kube-api-access-jplhz") pod "0bc9f808-8cea-4ed9-a551-bd815e52e8ed" (UID: "0bc9f808-8cea-4ed9-a551-bd815e52e8ed"). InnerVolumeSpecName "kube-api-access-jplhz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:44:48.028218 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:48.028185    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jplhz\" (UniqueName: \"kubernetes.io/projected/0bc9f808-8cea-4ed9-a551-bd815e52e8ed-kube-api-access-jplhz\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:44:48.028218 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:48.028220    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a04f0e8b-8e5a-4191-8774-303bd0db4f2a-plugins-config-volume\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:44:48.028414 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:48.028231    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z8wzj\" (UniqueName: \"kubernetes.io/projected/a04f0e8b-8e5a-4191-8774-303bd0db4f2a-kube-api-access-z8wzj\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:44:48.403661 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:48.403622    2557 generic.go:356] "Generic (PLEG): container finished" podID="a04f0e8b-8e5a-4191-8774-303bd0db4f2a" containerID="d5111af0a17ced964d5dbd75c246c61fc8455bb941d4f82208c43294e09c7850" exitCode=0
Jul 27 20:44:48.403896 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:48.403671    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-a12508-5f54d8f85b-glnp4"
Jul 27 20:44:48.403896 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:48.403709    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-a12508-5f54d8f85b-glnp4" event={"ID":"a04f0e8b-8e5a-4191-8774-303bd0db4f2a","Type":"ContainerDied","Data":"d5111af0a17ced964d5dbd75c246c61fc8455bb941d4f82208c43294e09c7850"}
Jul 27 20:44:48.403896 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:48.403760    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-a12508-5f54d8f85b-glnp4" event={"ID":"a04f0e8b-8e5a-4191-8774-303bd0db4f2a","Type":"ContainerDied","Data":"593331e76047f1013406627e595eedac6ca82f4f066c28588cee6fb70a30f843"}
Jul 27 20:44:48.403896 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:48.403776    2557 scope.go:117] "RemoveContainer" containerID="d5111af0a17ced964d5dbd75c246c61fc8455bb941d4f82208c43294e09c7850"
Jul 27 20:44:48.405554 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:48.405519    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a12508-7847fdfb9b-t8q44"
Jul 27 20:44:48.405554 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:48.405533    2557 generic.go:356] "Generic (PLEG): container finished" podID="0bc9f808-8cea-4ed9-a551-bd815e52e8ed" containerID="2f74a17e6343cfe0a7a324d09725760b8144689e06bf9b8a1f660b077e6883fd" exitCode=0
Jul 27 20:44:48.405554 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:48.405547    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a12508-7847fdfb9b-t8q44" event={"ID":"0bc9f808-8cea-4ed9-a551-bd815e52e8ed","Type":"ContainerDied","Data":"2f74a17e6343cfe0a7a324d09725760b8144689e06bf9b8a1f660b077e6883fd"}
Jul 27 20:44:48.405743 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:48.405594    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a12508-7847fdfb9b-t8q44" event={"ID":"0bc9f808-8cea-4ed9-a551-bd815e52e8ed","Type":"ContainerDied","Data":"21bd719052bab0662534651276918f30ac84574bca818567ad1eaa601f822d03"}
Jul 27 20:44:48.416338 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:48.416322    2557 scope.go:117] "RemoveContainer" containerID="d5111af0a17ced964d5dbd75c246c61fc8455bb941d4f82208c43294e09c7850"
Jul 27 20:44:48.416669 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:44:48.416645    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5111af0a17ced964d5dbd75c246c61fc8455bb941d4f82208c43294e09c7850\": container with ID starting with d5111af0a17ced964d5dbd75c246c61fc8455bb941d4f82208c43294e09c7850 not found: ID does not exist" containerID="d5111af0a17ced964d5dbd75c246c61fc8455bb941d4f82208c43294e09c7850"
Jul 27 20:44:48.416743 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:48.416682    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5111af0a17ced964d5dbd75c246c61fc8455bb941d4f82208c43294e09c7850"} err="failed to get container status \"d5111af0a17ced964d5dbd75c246c61fc8455bb941d4f82208c43294e09c7850\": rpc error: code = NotFound desc = could not find container \"d5111af0a17ced964d5dbd75c246c61fc8455bb941d4f82208c43294e09c7850\": container with ID starting with d5111af0a17ced964d5dbd75c246c61fc8455bb941d4f82208c43294e09c7850 not found: ID does not exist"
Jul 27 20:44:48.416743 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:48.416708    2557 scope.go:117] "RemoveContainer" containerID="2f74a17e6343cfe0a7a324d09725760b8144689e06bf9b8a1f660b077e6883fd"
Jul 27 20:44:48.425085 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:48.425068    2557 scope.go:117] "RemoveContainer" containerID="2f74a17e6343cfe0a7a324d09725760b8144689e06bf9b8a1f660b077e6883fd"
Jul 27 20:44:48.425334 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:44:48.425316    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f74a17e6343cfe0a7a324d09725760b8144689e06bf9b8a1f660b077e6883fd\": container with ID starting with 2f74a17e6343cfe0a7a324d09725760b8144689e06bf9b8a1f660b077e6883fd not found: ID does not exist" containerID="2f74a17e6343cfe0a7a324d09725760b8144689e06bf9b8a1f660b077e6883fd"
Jul 27 20:44:48.425383 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:48.425340    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f74a17e6343cfe0a7a324d09725760b8144689e06bf9b8a1f660b077e6883fd"} err="failed to get container status \"2f74a17e6343cfe0a7a324d09725760b8144689e06bf9b8a1f660b077e6883fd\": rpc error: code = NotFound desc = could not find container \"2f74a17e6343cfe0a7a324d09725760b8144689e06bf9b8a1f660b077e6883fd\": container with ID starting with 2f74a17e6343cfe0a7a324d09725760b8144689e06bf9b8a1f660b077e6883fd not found: ID does not exist"
Jul 27 20:44:48.431148 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:48.431112    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-a12508-5f54d8f85b-glnp4"]
Jul 27 20:44:48.435284 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:48.435262    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-a12508-5f54d8f85b-glnp4"]
Jul 27 20:44:48.445279 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:48.445257    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-a12508-7847fdfb9b-t8q44"]
Jul 27 20:44:48.447481 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:48.447446    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-a12508-7847fdfb9b-t8q44"]
Jul 27 20:44:49.911432 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:49.911400    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0bc9f808-8cea-4ed9-a551-bd815e52e8ed" path="/var/lib/kubelet/pods/0bc9f808-8cea-4ed9-a551-bd815e52e8ed/volumes"
Jul 27 20:44:49.911819 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:49.911795    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a04f0e8b-8e5a-4191-8774-303bd0db4f2a" path="/var/lib/kubelet/pods/a04f0e8b-8e5a-4191-8774-303bd0db4f2a/volumes"
Jul 27 20:44:50.907913 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:50.907874    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-a12508/test-model-a12508-kserve-8bd8988b7-mzhtb" podUID="77f89c15-c076-407f-b286-d03b27a3ba11" containerName="main" containerID="cri-o://79a7bd793a3d4199fe7dce91e0c825e5270900cfd0fd9ee3757e46c33d0c6ee4" gracePeriod=45
Jul 27 20:44:51.161147 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:51.161087    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-a12508/test-model-a12508-kserve-8bd8988b7-mzhtb"
Jul 27 20:44:51.257077 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:51.257041    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r7b9g\" (UniqueName: \"kubernetes.io/projected/77f89c15-c076-407f-b286-d03b27a3ba11-kube-api-access-r7b9g\") pod \"77f89c15-c076-407f-b286-d03b27a3ba11\" (UID: \"77f89c15-c076-407f-b286-d03b27a3ba11\") "
Jul 27 20:44:51.257275 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:51.257085    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/77f89c15-c076-407f-b286-d03b27a3ba11-home\") pod \"77f89c15-c076-407f-b286-d03b27a3ba11\" (UID: \"77f89c15-c076-407f-b286-d03b27a3ba11\") "
Jul 27 20:44:51.257275 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:51.257108    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77f89c15-c076-407f-b286-d03b27a3ba11-tls-certs\") pod \"77f89c15-c076-407f-b286-d03b27a3ba11\" (UID: \"77f89c15-c076-407f-b286-d03b27a3ba11\") "
Jul 27 20:44:51.257275 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:51.257128    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/77f89c15-c076-407f-b286-d03b27a3ba11-dshm\") pod \"77f89c15-c076-407f-b286-d03b27a3ba11\" (UID: \"77f89c15-c076-407f-b286-d03b27a3ba11\") "
Jul 27 20:44:51.257275 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:51.257147    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/77f89c15-c076-407f-b286-d03b27a3ba11-model-cache\") pod \"77f89c15-c076-407f-b286-d03b27a3ba11\" (UID: \"77f89c15-c076-407f-b286-d03b27a3ba11\") "
Jul 27 20:44:51.257275 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:51.257183    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77f89c15-c076-407f-b286-d03b27a3ba11-tmp-dir\") pod \"77f89c15-c076-407f-b286-d03b27a3ba11\" (UID: \"77f89c15-c076-407f-b286-d03b27a3ba11\") "
Jul 27 20:44:51.257561 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:51.257407    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77f89c15-c076-407f-b286-d03b27a3ba11-home" (OuterVolumeSpecName: "home") pod "77f89c15-c076-407f-b286-d03b27a3ba11" (UID: "77f89c15-c076-407f-b286-d03b27a3ba11"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:44:51.257561 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:51.257432    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77f89c15-c076-407f-b286-d03b27a3ba11-model-cache" (OuterVolumeSpecName: "model-cache") pod "77f89c15-c076-407f-b286-d03b27a3ba11" (UID: "77f89c15-c076-407f-b286-d03b27a3ba11"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:44:51.257634 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:51.257589    2557 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/77f89c15-c076-407f-b286-d03b27a3ba11-home\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:44:51.257634 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:51.257615    2557 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/77f89c15-c076-407f-b286-d03b27a3ba11-model-cache\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:44:51.257634 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:51.257585    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77f89c15-c076-407f-b286-d03b27a3ba11-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "77f89c15-c076-407f-b286-d03b27a3ba11" (UID: "77f89c15-c076-407f-b286-d03b27a3ba11"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:44:51.259494 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:51.259464    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77f89c15-c076-407f-b286-d03b27a3ba11-dshm" (OuterVolumeSpecName: "dshm") pod "77f89c15-c076-407f-b286-d03b27a3ba11" (UID: "77f89c15-c076-407f-b286-d03b27a3ba11"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:44:51.259610 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:51.259522    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77f89c15-c076-407f-b286-d03b27a3ba11-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "77f89c15-c076-407f-b286-d03b27a3ba11" (UID: "77f89c15-c076-407f-b286-d03b27a3ba11"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:44:51.259610 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:51.259562    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77f89c15-c076-407f-b286-d03b27a3ba11-kube-api-access-r7b9g" (OuterVolumeSpecName: "kube-api-access-r7b9g") pod "77f89c15-c076-407f-b286-d03b27a3ba11" (UID: "77f89c15-c076-407f-b286-d03b27a3ba11"). InnerVolumeSpecName "kube-api-access-r7b9g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:44:51.358407 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:51.358372    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r7b9g\" (UniqueName: \"kubernetes.io/projected/77f89c15-c076-407f-b286-d03b27a3ba11-kube-api-access-r7b9g\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:44:51.358407 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:51.358403    2557 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77f89c15-c076-407f-b286-d03b27a3ba11-tls-certs\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:44:51.358407 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:51.358414    2557 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/77f89c15-c076-407f-b286-d03b27a3ba11-dshm\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:44:51.358675 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:51.358421    2557 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77f89c15-c076-407f-b286-d03b27a3ba11-tmp-dir\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:44:51.425401 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:51.425313    2557 generic.go:356] "Generic (PLEG): container finished" podID="77f89c15-c076-407f-b286-d03b27a3ba11" containerID="79a7bd793a3d4199fe7dce91e0c825e5270900cfd0fd9ee3757e46c33d0c6ee4" exitCode=0
Jul 27 20:44:51.425401 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:51.425356    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-a12508/test-model-a12508-kserve-8bd8988b7-mzhtb"
Jul 27 20:44:51.425401 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:51.425360    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-a12508/test-model-a12508-kserve-8bd8988b7-mzhtb" event={"ID":"77f89c15-c076-407f-b286-d03b27a3ba11","Type":"ContainerDied","Data":"79a7bd793a3d4199fe7dce91e0c825e5270900cfd0fd9ee3757e46c33d0c6ee4"}
Jul 27 20:44:51.425401 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:51.425393    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-a12508/test-model-a12508-kserve-8bd8988b7-mzhtb" event={"ID":"77f89c15-c076-407f-b286-d03b27a3ba11","Type":"ContainerDied","Data":"bcf013840aa731f145400659893c162eeb7af22501cb8157db8533595bf7fee7"}
Jul 27 20:44:51.425740 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:51.425410    2557 scope.go:117] "RemoveContainer" containerID="79a7bd793a3d4199fe7dce91e0c825e5270900cfd0fd9ee3757e46c33d0c6ee4"
Jul 27 20:44:51.434881 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:51.434863    2557 scope.go:117] "RemoveContainer" containerID="79a7bd793a3d4199fe7dce91e0c825e5270900cfd0fd9ee3757e46c33d0c6ee4"
Jul 27 20:44:51.435136 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:44:51.435115    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79a7bd793a3d4199fe7dce91e0c825e5270900cfd0fd9ee3757e46c33d0c6ee4\": container with ID starting with 79a7bd793a3d4199fe7dce91e0c825e5270900cfd0fd9ee3757e46c33d0c6ee4 not found: ID does not exist" containerID="79a7bd793a3d4199fe7dce91e0c825e5270900cfd0fd9ee3757e46c33d0c6ee4"
Jul 27 20:44:51.435177 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:51.435145    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79a7bd793a3d4199fe7dce91e0c825e5270900cfd0fd9ee3757e46c33d0c6ee4"} err="failed to get container status \"79a7bd793a3d4199fe7dce91e0c825e5270900cfd0fd9ee3757e46c33d0c6ee4\": rpc error: code = NotFound desc = could not find container \"79a7bd793a3d4199fe7dce91e0c825e5270900cfd0fd9ee3757e46c33d0c6ee4\": container with ID starting with 79a7bd793a3d4199fe7dce91e0c825e5270900cfd0fd9ee3757e46c33d0c6ee4 not found: ID does not exist"
Jul 27 20:44:51.446636 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:51.446596    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-a12508/test-model-a12508-kserve-8bd8988b7-mzhtb"]
Jul 27 20:44:51.449811 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:51.449789    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-a12508/test-model-a12508-kserve-8bd8988b7-mzhtb"]
Jul 27 20:44:51.910887 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:51.910850    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77f89c15-c076-407f-b286-d03b27a3ba11" path="/var/lib/kubelet/pods/77f89c15-c076-407f-b286-d03b27a3ba11/volumes"
Jul 27 20:44:51.925882 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:51.925845    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-eb7a86/test-model-eb7a86-kserve-7495f5f4dc-6rf9v" podUID="e0b3efe0-2f2c-4476-aead-b2b601a85ec0" containerName="main" containerID="cri-o://73521d164aa0cd8ed4e9d43a28f7b3cec0d4d35932c68d515f34a103673389a4" gracePeriod=45
Jul 27 20:44:52.117204 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:52.117170    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:44:52.188196 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:52.188168    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-eb7a86/test-model-eb7a86-kserve-7495f5f4dc-6rf9v"
Jul 27 20:44:52.266853 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:52.266821    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e0b3efe0-2f2c-4476-aead-b2b601a85ec0-tmp-dir\") pod \"e0b3efe0-2f2c-4476-aead-b2b601a85ec0\" (UID: \"e0b3efe0-2f2c-4476-aead-b2b601a85ec0\") "
Jul 27 20:44:52.267025 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:52.266864    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e0b3efe0-2f2c-4476-aead-b2b601a85ec0-model-cache\") pod \"e0b3efe0-2f2c-4476-aead-b2b601a85ec0\" (UID: \"e0b3efe0-2f2c-4476-aead-b2b601a85ec0\") "
Jul 27 20:44:52.267025 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:52.266887    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e0b3efe0-2f2c-4476-aead-b2b601a85ec0-home\") pod \"e0b3efe0-2f2c-4476-aead-b2b601a85ec0\" (UID: \"e0b3efe0-2f2c-4476-aead-b2b601a85ec0\") "
Jul 27 20:44:52.267025 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:52.266906    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e0b3efe0-2f2c-4476-aead-b2b601a85ec0-dshm\") pod \"e0b3efe0-2f2c-4476-aead-b2b601a85ec0\" (UID: \"e0b3efe0-2f2c-4476-aead-b2b601a85ec0\") "
Jul 27 20:44:52.267025 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:52.266936    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gxln6\" (UniqueName: \"kubernetes.io/projected/e0b3efe0-2f2c-4476-aead-b2b601a85ec0-kube-api-access-gxln6\") pod \"e0b3efe0-2f2c-4476-aead-b2b601a85ec0\" (UID: \"e0b3efe0-2f2c-4476-aead-b2b601a85ec0\") "
Jul 27 20:44:52.267025 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:52.266969    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e0b3efe0-2f2c-4476-aead-b2b601a85ec0-tls-certs\") pod \"e0b3efe0-2f2c-4476-aead-b2b601a85ec0\" (UID: \"e0b3efe0-2f2c-4476-aead-b2b601a85ec0\") "
Jul 27 20:44:52.267289 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:52.267088    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0b3efe0-2f2c-4476-aead-b2b601a85ec0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e0b3efe0-2f2c-4476-aead-b2b601a85ec0" (UID: "e0b3efe0-2f2c-4476-aead-b2b601a85ec0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:44:52.267289 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:52.267123    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0b3efe0-2f2c-4476-aead-b2b601a85ec0-model-cache" (OuterVolumeSpecName: "model-cache") pod "e0b3efe0-2f2c-4476-aead-b2b601a85ec0" (UID: "e0b3efe0-2f2c-4476-aead-b2b601a85ec0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:44:52.267289 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:52.267137    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0b3efe0-2f2c-4476-aead-b2b601a85ec0-home" (OuterVolumeSpecName: "home") pod "e0b3efe0-2f2c-4476-aead-b2b601a85ec0" (UID: "e0b3efe0-2f2c-4476-aead-b2b601a85ec0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:44:52.267411 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:52.267290    2557 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e0b3efe0-2f2c-4476-aead-b2b601a85ec0-tmp-dir\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:44:52.267411 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:52.267310    2557 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e0b3efe0-2f2c-4476-aead-b2b601a85ec0-model-cache\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:44:52.267411 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:52.267323    2557 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e0b3efe0-2f2c-4476-aead-b2b601a85ec0-home\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:44:52.269261 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:52.269235    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0b3efe0-2f2c-4476-aead-b2b601a85ec0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e0b3efe0-2f2c-4476-aead-b2b601a85ec0" (UID: "e0b3efe0-2f2c-4476-aead-b2b601a85ec0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:44:52.269568 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:52.269544    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0b3efe0-2f2c-4476-aead-b2b601a85ec0-dshm" (OuterVolumeSpecName: "dshm") pod "e0b3efe0-2f2c-4476-aead-b2b601a85ec0" (UID: "e0b3efe0-2f2c-4476-aead-b2b601a85ec0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:44:52.269650 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:52.269637    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0b3efe0-2f2c-4476-aead-b2b601a85ec0-kube-api-access-gxln6" (OuterVolumeSpecName: "kube-api-access-gxln6") pod "e0b3efe0-2f2c-4476-aead-b2b601a85ec0" (UID: "e0b3efe0-2f2c-4476-aead-b2b601a85ec0"). InnerVolumeSpecName "kube-api-access-gxln6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:44:52.368216 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:52.368176    2557 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e0b3efe0-2f2c-4476-aead-b2b601a85ec0-dshm\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:44:52.368216 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:52.368216    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gxln6\" (UniqueName: \"kubernetes.io/projected/e0b3efe0-2f2c-4476-aead-b2b601a85ec0-kube-api-access-gxln6\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:44:52.368446 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:52.368232    2557 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e0b3efe0-2f2c-4476-aead-b2b601a85ec0-tls-certs\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:44:52.432042 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:52.431940    2557 generic.go:356] "Generic (PLEG): container finished" podID="e0b3efe0-2f2c-4476-aead-b2b601a85ec0" containerID="73521d164aa0cd8ed4e9d43a28f7b3cec0d4d35932c68d515f34a103673389a4" exitCode=0
Jul 27 20:44:52.432042 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:52.431985    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-eb7a86/test-model-eb7a86-kserve-7495f5f4dc-6rf9v"
Jul 27 20:44:52.432042 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:52.432030    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-eb7a86/test-model-eb7a86-kserve-7495f5f4dc-6rf9v" event={"ID":"e0b3efe0-2f2c-4476-aead-b2b601a85ec0","Type":"ContainerDied","Data":"73521d164aa0cd8ed4e9d43a28f7b3cec0d4d35932c68d515f34a103673389a4"}
Jul 27 20:44:52.432289 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:52.432072    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-eb7a86/test-model-eb7a86-kserve-7495f5f4dc-6rf9v" event={"ID":"e0b3efe0-2f2c-4476-aead-b2b601a85ec0","Type":"ContainerDied","Data":"8a1040854e6f901f99be9aaecd77ba90ecebaf69f4f0acdc69316a2da96bbccc"}
Jul 27 20:44:52.432289 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:52.432096    2557 scope.go:117] "RemoveContainer" containerID="73521d164aa0cd8ed4e9d43a28f7b3cec0d4d35932c68d515f34a103673389a4"
Jul 27 20:44:52.441118 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:52.441104    2557 scope.go:117] "RemoveContainer" containerID="73521d164aa0cd8ed4e9d43a28f7b3cec0d4d35932c68d515f34a103673389a4"
Jul 27 20:44:52.441368 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:44:52.441351    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73521d164aa0cd8ed4e9d43a28f7b3cec0d4d35932c68d515f34a103673389a4\": container with ID starting with 73521d164aa0cd8ed4e9d43a28f7b3cec0d4d35932c68d515f34a103673389a4 not found: ID does not exist" containerID="73521d164aa0cd8ed4e9d43a28f7b3cec0d4d35932c68d515f34a103673389a4"
Jul 27 20:44:52.441414 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:52.441374    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73521d164aa0cd8ed4e9d43a28f7b3cec0d4d35932c68d515f34a103673389a4"} err="failed to get container status \"73521d164aa0cd8ed4e9d43a28f7b3cec0d4d35932c68d515f34a103673389a4\": rpc error: code = NotFound desc = could not find container \"73521d164aa0cd8ed4e9d43a28f7b3cec0d4d35932c68d515f34a103673389a4\": container with ID starting with 73521d164aa0cd8ed4e9d43a28f7b3cec0d4d35932c68d515f34a103673389a4 not found: ID does not exist"
Jul 27 20:44:52.456245 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:52.456217    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-eb7a86/test-model-eb7a86-kserve-7495f5f4dc-6rf9v"]
Jul 27 20:44:52.459817 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:52.459792    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-eb7a86/test-model-eb7a86-kserve-7495f5f4dc-6rf9v"]
Jul 27 20:44:52.503488 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:52.503460    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:44:52.899283 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:52.899247    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:44:53.910519 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:53.910477    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0b3efe0-2f2c-4476-aead-b2b601a85ec0" path="/var/lib/kubelet/pods/e0b3efe0-2f2c-4476-aead-b2b601a85ec0/volumes"
Jul 27 20:44:58.503372 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:58.503336    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:44:58.603686 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:58.603656    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:44:58.761850 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:58.761758    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:44:58.980343 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:44:58.980309    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:45:06.111356 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:06.111313    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:45:09.543997 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:09.543956    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:45:09.563917 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:09.563881    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-eb7a86-659f9b9c94-vrhc4"]
Jul 27 20:45:09.564234 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:09.564185    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-eb7a86-659f9b9c94-vrhc4" podUID="91647bfd-911b-43bb-b402-a443feacce0c" containerName="payload-processing" containerID="cri-o://50b3d81005fb709bac84baf3096ef7561e2903a4d9999cb60145af4101a56e7c" gracePeriod=30
Jul 27 20:45:09.570640 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:09.570595    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-eb7a86-847685bccb-mbvv2"]
Jul 27 20:45:09.570856 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:09.570823    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-eb7a86-847685bccb-mbvv2" podUID="6d401886-d0fc-4f9d-8183-0fc90dfd9c24" containerName="payload-pre-processing" containerID="cri-o://278397590aecb90317f7c304dbe6e9ab7cfb620bfe5512d37ddaf68522b7b9f2" gracePeriod=30
Jul 27 20:45:09.612284 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:09.612248    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:45:09.713397 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:09.713355    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:45:09.852895 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:09.852865    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-eb7a86-659f9b9c94-vrhc4"
Jul 27 20:45:09.855710 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:09.855690    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-eb7a86-847685bccb-mbvv2"
Jul 27 20:45:10.031078 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:10.031040    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hdb5w\" (UniqueName: \"kubernetes.io/projected/6d401886-d0fc-4f9d-8183-0fc90dfd9c24-kube-api-access-hdb5w\") pod \"6d401886-d0fc-4f9d-8183-0fc90dfd9c24\" (UID: \"6d401886-d0fc-4f9d-8183-0fc90dfd9c24\") "
Jul 27 20:45:10.031078 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:10.031082    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/91647bfd-911b-43bb-b402-a443feacce0c-plugins-config-volume\") pod \"91647bfd-911b-43bb-b402-a443feacce0c\" (UID: \"91647bfd-911b-43bb-b402-a443feacce0c\") "
Jul 27 20:45:10.031316 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:10.031129    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zb6m2\" (UniqueName: \"kubernetes.io/projected/91647bfd-911b-43bb-b402-a443feacce0c-kube-api-access-zb6m2\") pod \"91647bfd-911b-43bb-b402-a443feacce0c\" (UID: \"91647bfd-911b-43bb-b402-a443feacce0c\") "
Jul 27 20:45:10.031316 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:10.031185    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6d401886-d0fc-4f9d-8183-0fc90dfd9c24-plugins-config-volume\") pod \"6d401886-d0fc-4f9d-8183-0fc90dfd9c24\" (UID: \"6d401886-d0fc-4f9d-8183-0fc90dfd9c24\") "
Jul 27 20:45:10.031611 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:10.031572    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91647bfd-911b-43bb-b402-a443feacce0c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "91647bfd-911b-43bb-b402-a443feacce0c" (UID: "91647bfd-911b-43bb-b402-a443feacce0c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:45:10.031611 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:10.031602    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d401886-d0fc-4f9d-8183-0fc90dfd9c24-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6d401886-d0fc-4f9d-8183-0fc90dfd9c24" (UID: "6d401886-d0fc-4f9d-8183-0fc90dfd9c24"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:45:10.033257 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:10.033235    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d401886-d0fc-4f9d-8183-0fc90dfd9c24-kube-api-access-hdb5w" (OuterVolumeSpecName: "kube-api-access-hdb5w") pod "6d401886-d0fc-4f9d-8183-0fc90dfd9c24" (UID: "6d401886-d0fc-4f9d-8183-0fc90dfd9c24"). InnerVolumeSpecName "kube-api-access-hdb5w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:45:10.033353 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:10.033292    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91647bfd-911b-43bb-b402-a443feacce0c-kube-api-access-zb6m2" (OuterVolumeSpecName: "kube-api-access-zb6m2") pod "91647bfd-911b-43bb-b402-a443feacce0c" (UID: "91647bfd-911b-43bb-b402-a443feacce0c"). InnerVolumeSpecName "kube-api-access-zb6m2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:45:10.132805 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:10.132719    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6d401886-d0fc-4f9d-8183-0fc90dfd9c24-plugins-config-volume\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:45:10.132805 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:10.132750    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hdb5w\" (UniqueName: \"kubernetes.io/projected/6d401886-d0fc-4f9d-8183-0fc90dfd9c24-kube-api-access-hdb5w\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:45:10.132805 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:10.132760    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/91647bfd-911b-43bb-b402-a443feacce0c-plugins-config-volume\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:45:10.132805 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:10.132769    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zb6m2\" (UniqueName: \"kubernetes.io/projected/91647bfd-911b-43bb-b402-a443feacce0c-kube-api-access-zb6m2\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:45:10.534580 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:10.534545    2557 generic.go:356] "Generic (PLEG): container finished" podID="91647bfd-911b-43bb-b402-a443feacce0c" containerID="50b3d81005fb709bac84baf3096ef7561e2903a4d9999cb60145af4101a56e7c" exitCode=0
Jul 27 20:45:10.534763 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:10.534593    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-eb7a86-659f9b9c94-vrhc4"
Jul 27 20:45:10.534763 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:10.534633    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-eb7a86-659f9b9c94-vrhc4" event={"ID":"91647bfd-911b-43bb-b402-a443feacce0c","Type":"ContainerDied","Data":"50b3d81005fb709bac84baf3096ef7561e2903a4d9999cb60145af4101a56e7c"}
Jul 27 20:45:10.534763 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:10.534690    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-eb7a86-659f9b9c94-vrhc4" event={"ID":"91647bfd-911b-43bb-b402-a443feacce0c","Type":"ContainerDied","Data":"ec904e4af7450041fad5eae0afe4b01631a53b2bcf9a300e7df3b7918888f37f"}
Jul 27 20:45:10.534763 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:10.534721    2557 scope.go:117] "RemoveContainer" containerID="50b3d81005fb709bac84baf3096ef7561e2903a4d9999cb60145af4101a56e7c"
Jul 27 20:45:10.539414 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:10.539385    2557 generic.go:356] "Generic (PLEG): container finished" podID="6d401886-d0fc-4f9d-8183-0fc90dfd9c24" containerID="278397590aecb90317f7c304dbe6e9ab7cfb620bfe5512d37ddaf68522b7b9f2" exitCode=0
Jul 27 20:45:10.539565 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:10.539431    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-eb7a86-847685bccb-mbvv2" event={"ID":"6d401886-d0fc-4f9d-8183-0fc90dfd9c24","Type":"ContainerDied","Data":"278397590aecb90317f7c304dbe6e9ab7cfb620bfe5512d37ddaf68522b7b9f2"}
Jul 27 20:45:10.539565 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:10.539474    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-eb7a86-847685bccb-mbvv2"
Jul 27 20:45:10.539565 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:10.539496    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-eb7a86-847685bccb-mbvv2" event={"ID":"6d401886-d0fc-4f9d-8183-0fc90dfd9c24","Type":"ContainerDied","Data":"3b364bb5f62ca713d109c92d4335f328992d60e37b34897b6c9571c151966dac"}
Jul 27 20:45:10.546220 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:10.546200    2557 scope.go:117] "RemoveContainer" containerID="50b3d81005fb709bac84baf3096ef7561e2903a4d9999cb60145af4101a56e7c"
Jul 27 20:45:10.546684 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:45:10.546521    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50b3d81005fb709bac84baf3096ef7561e2903a4d9999cb60145af4101a56e7c\": container with ID starting with 50b3d81005fb709bac84baf3096ef7561e2903a4d9999cb60145af4101a56e7c not found: ID does not exist" containerID="50b3d81005fb709bac84baf3096ef7561e2903a4d9999cb60145af4101a56e7c"
Jul 27 20:45:10.546684 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:10.546550    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50b3d81005fb709bac84baf3096ef7561e2903a4d9999cb60145af4101a56e7c"} err="failed to get container status \"50b3d81005fb709bac84baf3096ef7561e2903a4d9999cb60145af4101a56e7c\": rpc error: code = NotFound desc = could not find container \"50b3d81005fb709bac84baf3096ef7561e2903a4d9999cb60145af4101a56e7c\": container with ID starting with 50b3d81005fb709bac84baf3096ef7561e2903a4d9999cb60145af4101a56e7c not found: ID does not exist"
Jul 27 20:45:10.546684 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:10.546574    2557 scope.go:117] "RemoveContainer" containerID="278397590aecb90317f7c304dbe6e9ab7cfb620bfe5512d37ddaf68522b7b9f2"
Jul 27 20:45:10.554789 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:10.554771    2557 scope.go:117] "RemoveContainer" containerID="278397590aecb90317f7c304dbe6e9ab7cfb620bfe5512d37ddaf68522b7b9f2"
Jul 27 20:45:10.555056 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:45:10.555037    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"278397590aecb90317f7c304dbe6e9ab7cfb620bfe5512d37ddaf68522b7b9f2\": container with ID starting with 278397590aecb90317f7c304dbe6e9ab7cfb620bfe5512d37ddaf68522b7b9f2 not found: ID does not exist" containerID="278397590aecb90317f7c304dbe6e9ab7cfb620bfe5512d37ddaf68522b7b9f2"
Jul 27 20:45:10.555108 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:10.555063    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"278397590aecb90317f7c304dbe6e9ab7cfb620bfe5512d37ddaf68522b7b9f2"} err="failed to get container status \"278397590aecb90317f7c304dbe6e9ab7cfb620bfe5512d37ddaf68522b7b9f2\": rpc error: code = NotFound desc = could not find container \"278397590aecb90317f7c304dbe6e9ab7cfb620bfe5512d37ddaf68522b7b9f2\": container with ID starting with 278397590aecb90317f7c304dbe6e9ab7cfb620bfe5512d37ddaf68522b7b9f2 not found: ID does not exist"
Jul 27 20:45:10.558310 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:10.558287    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-eb7a86-659f9b9c94-vrhc4"]
Jul 27 20:45:10.563705 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:10.563679    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-eb7a86-659f9b9c94-vrhc4"]
Jul 27 20:45:10.575069 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:10.575045    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-eb7a86-847685bccb-mbvv2"]
Jul 27 20:45:10.578695 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:10.578670    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-eb7a86-847685bccb-mbvv2"]
Jul 27 20:45:11.911712 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:11.911681    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d401886-d0fc-4f9d-8183-0fc90dfd9c24" path="/var/lib/kubelet/pods/6d401886-d0fc-4f9d-8183-0fc90dfd9c24/volumes"
Jul 27 20:45:11.912068 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:11.912050    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91647bfd-911b-43bb-b402-a443feacce0c" path="/var/lib/kubelet/pods/91647bfd-911b-43bb-b402-a443feacce0c/volumes"
Jul 27 20:45:12.403157 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:12.399855    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:45:14.177180 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:14.177143    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:45:14.565978 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:14.565946    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:45:20.388684 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:20.388647    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:45:20.461986 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:20.461930    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:45:20.666232 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:20.666139    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:45:20.896416 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:20.896377    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:45:21.245547 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:21.245507    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:45:21.572939 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:21.572855    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:45:21.974994 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:21.974966    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:45:24.602748 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:24.602712    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:45:24.690146 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:24.690109    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:45:24.846781 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:24.846749    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:45:25.101174 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:25.101124    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:45:25.365502 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:25.365393    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:45:25.465216 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:25.465182    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:45:25.469281 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:25.469252    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-3f4799-bbdd9ddfb-lp2sb"]
Jul 27 20:45:25.469598 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:25.469585    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91647bfd-911b-43bb-b402-a443feacce0c" containerName="payload-processing"
Jul 27 20:45:25.469662 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:25.469599    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="91647bfd-911b-43bb-b402-a443feacce0c" containerName="payload-processing"
Jul 27 20:45:25.469662 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:25.469610    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77f89c15-c076-407f-b286-d03b27a3ba11" containerName="main"
Jul 27 20:45:25.469662 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:25.469615    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="77f89c15-c076-407f-b286-d03b27a3ba11" containerName="main"
Jul 27 20:45:25.469662 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:25.469624    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a04f0e8b-8e5a-4191-8774-303bd0db4f2a" containerName="payload-processing"
Jul 27 20:45:25.469662 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:25.469630    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a04f0e8b-8e5a-4191-8774-303bd0db4f2a" containerName="payload-processing"
Jul 27 20:45:25.469662 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:25.469640    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bc9f808-8cea-4ed9-a551-bd815e52e8ed" containerName="payload-pre-processing"
Jul 27 20:45:25.469662 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:25.469645    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bc9f808-8cea-4ed9-a551-bd815e52e8ed" containerName="payload-pre-processing"
Jul 27 20:45:25.469662 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:25.469663    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d401886-d0fc-4f9d-8183-0fc90dfd9c24" containerName="payload-pre-processing"
Jul 27 20:45:25.469904 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:25.469670    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d401886-d0fc-4f9d-8183-0fc90dfd9c24" containerName="payload-pre-processing"
Jul 27 20:45:25.469904 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:25.469676    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0b3efe0-2f2c-4476-aead-b2b601a85ec0" containerName="main"
Jul 27 20:45:25.469904 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:25.469683    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0b3efe0-2f2c-4476-aead-b2b601a85ec0" containerName="main"
Jul 27 20:45:25.469904 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:25.469734    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="0bc9f808-8cea-4ed9-a551-bd815e52e8ed" containerName="payload-pre-processing"
Jul 27 20:45:25.469904 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:25.469741    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="91647bfd-911b-43bb-b402-a443feacce0c" containerName="payload-processing"
Jul 27 20:45:25.469904 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:25.469748    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0b3efe0-2f2c-4476-aead-b2b601a85ec0" containerName="main"
Jul 27 20:45:25.469904 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:25.469754    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="77f89c15-c076-407f-b286-d03b27a3ba11" containerName="main"
Jul 27 20:45:25.469904 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:25.469761    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="a04f0e8b-8e5a-4191-8774-303bd0db4f2a" containerName="payload-processing"
Jul 27 20:45:25.469904 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:25.469767    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d401886-d0fc-4f9d-8183-0fc90dfd9c24" containerName="payload-pre-processing"
Jul 27 20:45:25.472778 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:25.472761    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-3f4799-bbdd9ddfb-lp2sb"
Jul 27 20:45:25.475103 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:25.475081    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-3f4799\""
Jul 27 20:45:25.475233 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:25.475166    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-3f4799-dockercfg-xcfnz\""
Jul 27 20:45:25.482632 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:25.482606    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-3f4799-bbdd9ddfb-lp2sb"]
Jul 27 20:45:25.496785 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:25.496755    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-3f4799-576cccbf76-srl8l"]
Jul 27 20:45:25.500188 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:25.500165    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-3f4799-576cccbf76-srl8l"
Jul 27 20:45:25.509964 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:25.509939    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-3f4799-576cccbf76-srl8l"]
Jul 27 20:45:25.567796 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:25.567757    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7w6b9\" (UniqueName: \"kubernetes.io/projected/51e12c16-f3c2-4b71-b466-9e700fba73a7-kube-api-access-7w6b9\") pod \"payload-processing-e2e-api-a-3f4799-576cccbf76-srl8l\" (UID: \"51e12c16-f3c2-4b71-b466-9e700fba73a7\") " pod="openshift-ingress/payload-processing-e2e-api-a-3f4799-576cccbf76-srl8l"
Jul 27 20:45:25.567796 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:25.567795    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxbfw\" (UniqueName: \"kubernetes.io/projected/7965c3fb-041b-4be7-b930-ef58c38d1b07-kube-api-access-fxbfw\") pod \"payload-pre-processing-e2e-api-a-3f4799-bbdd9ddfb-lp2sb\" (UID: \"7965c3fb-041b-4be7-b930-ef58c38d1b07\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-3f4799-bbdd9ddfb-lp2sb"
Jul 27 20:45:25.568005 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:25.567887    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7965c3fb-041b-4be7-b930-ef58c38d1b07-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-3f4799-bbdd9ddfb-lp2sb\" (UID: \"7965c3fb-041b-4be7-b930-ef58c38d1b07\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-3f4799-bbdd9ddfb-lp2sb"
Jul 27 20:45:25.568005 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:25.567944    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/51e12c16-f3c2-4b71-b466-9e700fba73a7-plugins-config-volume\") pod \"payload-processing-e2e-api-a-3f4799-576cccbf76-srl8l\" (UID: \"51e12c16-f3c2-4b71-b466-9e700fba73a7\") " pod="openshift-ingress/payload-processing-e2e-api-a-3f4799-576cccbf76-srl8l"
Jul 27 20:45:25.668768 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:25.668680    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7w6b9\" (UniqueName: \"kubernetes.io/projected/51e12c16-f3c2-4b71-b466-9e700fba73a7-kube-api-access-7w6b9\") pod \"payload-processing-e2e-api-a-3f4799-576cccbf76-srl8l\" (UID: \"51e12c16-f3c2-4b71-b466-9e700fba73a7\") " pod="openshift-ingress/payload-processing-e2e-api-a-3f4799-576cccbf76-srl8l"
Jul 27 20:45:25.668768 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:25.668717    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxbfw\" (UniqueName: \"kubernetes.io/projected/7965c3fb-041b-4be7-b930-ef58c38d1b07-kube-api-access-fxbfw\") pod \"payload-pre-processing-e2e-api-a-3f4799-bbdd9ddfb-lp2sb\" (UID: \"7965c3fb-041b-4be7-b930-ef58c38d1b07\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-3f4799-bbdd9ddfb-lp2sb"
Jul 27 20:45:25.668768 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:25.668763    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7965c3fb-041b-4be7-b930-ef58c38d1b07-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-3f4799-bbdd9ddfb-lp2sb\" (UID: \"7965c3fb-041b-4be7-b930-ef58c38d1b07\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-3f4799-bbdd9ddfb-lp2sb"
Jul 27 20:45:25.669252 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:25.668802    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/51e12c16-f3c2-4b71-b466-9e700fba73a7-plugins-config-volume\") pod \"payload-processing-e2e-api-a-3f4799-576cccbf76-srl8l\" (UID: \"51e12c16-f3c2-4b71-b466-9e700fba73a7\") " pod="openshift-ingress/payload-processing-e2e-api-a-3f4799-576cccbf76-srl8l"
Jul 27 20:45:25.669554 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:25.669532    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7965c3fb-041b-4be7-b930-ef58c38d1b07-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-3f4799-bbdd9ddfb-lp2sb\" (UID: \"7965c3fb-041b-4be7-b930-ef58c38d1b07\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-3f4799-bbdd9ddfb-lp2sb"
Jul 27 20:45:25.669554 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:25.669545    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/51e12c16-f3c2-4b71-b466-9e700fba73a7-plugins-config-volume\") pod \"payload-processing-e2e-api-a-3f4799-576cccbf76-srl8l\" (UID: \"51e12c16-f3c2-4b71-b466-9e700fba73a7\") " pod="openshift-ingress/payload-processing-e2e-api-a-3f4799-576cccbf76-srl8l"
Jul 27 20:45:25.677595 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:25.677569    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7w6b9\" (UniqueName: \"kubernetes.io/projected/51e12c16-f3c2-4b71-b466-9e700fba73a7-kube-api-access-7w6b9\") pod \"payload-processing-e2e-api-a-3f4799-576cccbf76-srl8l\" (UID: \"51e12c16-f3c2-4b71-b466-9e700fba73a7\") " pod="openshift-ingress/payload-processing-e2e-api-a-3f4799-576cccbf76-srl8l"
Jul 27 20:45:25.677759 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:25.677743    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxbfw\" (UniqueName: \"kubernetes.io/projected/7965c3fb-041b-4be7-b930-ef58c38d1b07-kube-api-access-fxbfw\") pod \"payload-pre-processing-e2e-api-a-3f4799-bbdd9ddfb-lp2sb\" (UID: \"7965c3fb-041b-4be7-b930-ef58c38d1b07\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-3f4799-bbdd9ddfb-lp2sb"
Jul 27 20:45:25.784587 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:25.784546    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-3f4799-bbdd9ddfb-lp2sb"
Jul 27 20:45:25.811755 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:25.811724    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-3f4799-576cccbf76-srl8l"
Jul 27 20:45:25.942121 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:25.942081    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-3f4799-bbdd9ddfb-lp2sb"]
Jul 27 20:45:25.943892 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:45:25.943862    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7965c3fb_041b_4be7_b930_ef58c38d1b07.slice/crio-0178943cacb063999da3aa636fca182b92c8b9c10750b87cc163e4d64ce06366 WatchSource:0}: Error finding container 0178943cacb063999da3aa636fca182b92c8b9c10750b87cc163e4d64ce06366: Status 404 returned error can't find the container with id 0178943cacb063999da3aa636fca182b92c8b9c10750b87cc163e4d64ce06366
Jul 27 20:45:25.974296 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:25.974272    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-3f4799-576cccbf76-srl8l"]
Jul 27 20:45:25.978647 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:45:25.978614    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51e12c16_f3c2_4b71_b466_9e700fba73a7.slice/crio-e34d63b5d11283967352168bb77b2177ea13be7947f744621a581bc7017ad760 WatchSource:0}: Error finding container e34d63b5d11283967352168bb77b2177ea13be7947f744621a581bc7017ad760: Status 404 returned error can't find the container with id e34d63b5d11283967352168bb77b2177ea13be7947f744621a581bc7017ad760
Jul 27 20:45:26.624163 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:26.624118    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-3f4799-576cccbf76-srl8l" event={"ID":"51e12c16-f3c2-4b71-b466-9e700fba73a7","Type":"ContainerStarted","Data":"1ca1ddb97547342a85ffc02f04513ef0d9109f942b26f165930f674a2271addc"}
Jul 27 20:45:26.624382 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:26.624194    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-3f4799-576cccbf76-srl8l" event={"ID":"51e12c16-f3c2-4b71-b466-9e700fba73a7","Type":"ContainerStarted","Data":"e34d63b5d11283967352168bb77b2177ea13be7947f744621a581bc7017ad760"}
Jul 27 20:45:26.624382 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:26.624224    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-3f4799-576cccbf76-srl8l"
Jul 27 20:45:26.625763 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:26.625730    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-3f4799-bbdd9ddfb-lp2sb" event={"ID":"7965c3fb-041b-4be7-b930-ef58c38d1b07","Type":"ContainerStarted","Data":"c06992e07da398411b10323c96d65222dffde7a9d62e11f61ff0cd72a5ace355"}
Jul 27 20:45:26.625889 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:26.625780    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-3f4799-bbdd9ddfb-lp2sb" event={"ID":"7965c3fb-041b-4be7-b930-ef58c38d1b07","Type":"ContainerStarted","Data":"0178943cacb063999da3aa636fca182b92c8b9c10750b87cc163e4d64ce06366"}
Jul 27 20:45:26.625889 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:26.625807    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-3f4799-bbdd9ddfb-lp2sb"
Jul 27 20:45:26.639974 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:26.639925    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-3f4799-576cccbf76-srl8l" podStartSLOduration=1.639909584 podStartE2EDuration="1.639909584s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:45:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:45:26.638711075 +0000 UTC m=+2475.213437462" watchObservedRunningTime="2026-07-27 20:45:26.639909584 +0000 UTC m=+2475.214635971"
Jul 27 20:45:26.655317 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:26.655266    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-3f4799-bbdd9ddfb-lp2sb" podStartSLOduration=1.6552488090000002 podStartE2EDuration="1.655248809s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:45:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:45:26.653092112 +0000 UTC m=+2475.227818501" watchObservedRunningTime="2026-07-27 20:45:26.655248809 +0000 UTC m=+2475.229975194"
Jul 27 20:45:29.111708 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:29.111674    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:45:29.577494 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:29.577447    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:45:29.882085 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:29.881997    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:45:30.653848 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:30.653807    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:45:32.200268 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:32.200227    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:45:32.714201 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:32.714156    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:45:32.803197 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:32.803161    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:45:32.883391 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:32.883355    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:45:33.264505 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:33.264470    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:45:33.481104 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:33.481067    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:45:33.573981 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:33.573890    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:45:33.578907 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:33.578880    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-5a7e30-699c767ff6-frv7t"]
Jul 27 20:45:33.583385 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:33.583370    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5a7e30-699c767ff6-frv7t"
Jul 27 20:45:33.585868 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:33.585847    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-5a7e30\""
Jul 27 20:45:33.585980 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:33.585960    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-5a7e30-dockercfg-wvxfm\""
Jul 27 20:45:33.592740 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:33.592712    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-5a7e30-699c767ff6-frv7t"]
Jul 27 20:45:33.613600 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:33.613560    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-5a7e30-6cf65c9b88-nf95l"]
Jul 27 20:45:33.617083 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:33.617059    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-5a7e30-6cf65c9b88-nf95l"
Jul 27 20:45:33.628683 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:33.628658    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-5a7e30-6cf65c9b88-nf95l"]
Jul 27 20:45:33.639533 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:33.639490    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ec98f50-2dd9-4090-9ae7-a096000c09a3-plugins-config-volume\") pod \"payload-processing-e2e-api-b-5a7e30-6cf65c9b88-nf95l\" (UID: \"9ec98f50-2dd9-4090-9ae7-a096000c09a3\") " pod="openshift-ingress/payload-processing-e2e-api-b-5a7e30-6cf65c9b88-nf95l"
Jul 27 20:45:33.639757 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:33.639663    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sk6h\" (UniqueName: \"kubernetes.io/projected/efbf72b0-f4f9-4906-ae19-611f70be0837-kube-api-access-8sk6h\") pod \"payload-pre-processing-e2e-api-b-5a7e30-699c767ff6-frv7t\" (UID: \"efbf72b0-f4f9-4906-ae19-611f70be0837\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-5a7e30-699c767ff6-frv7t"
Jul 27 20:45:33.639757 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:33.639707    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzlv8\" (UniqueName: \"kubernetes.io/projected/9ec98f50-2dd9-4090-9ae7-a096000c09a3-kube-api-access-wzlv8\") pod \"payload-processing-e2e-api-b-5a7e30-6cf65c9b88-nf95l\" (UID: \"9ec98f50-2dd9-4090-9ae7-a096000c09a3\") " pod="openshift-ingress/payload-processing-e2e-api-b-5a7e30-6cf65c9b88-nf95l"
Jul 27 20:45:33.639757 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:33.639742    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/efbf72b0-f4f9-4906-ae19-611f70be0837-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-5a7e30-699c767ff6-frv7t\" (UID: \"efbf72b0-f4f9-4906-ae19-611f70be0837\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-5a7e30-699c767ff6-frv7t"
Jul 27 20:45:33.740260 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:33.740219    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ec98f50-2dd9-4090-9ae7-a096000c09a3-plugins-config-volume\") pod \"payload-processing-e2e-api-b-5a7e30-6cf65c9b88-nf95l\" (UID: \"9ec98f50-2dd9-4090-9ae7-a096000c09a3\") " pod="openshift-ingress/payload-processing-e2e-api-b-5a7e30-6cf65c9b88-nf95l"
Jul 27 20:45:33.740494 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:33.740283    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sk6h\" (UniqueName: \"kubernetes.io/projected/efbf72b0-f4f9-4906-ae19-611f70be0837-kube-api-access-8sk6h\") pod \"payload-pre-processing-e2e-api-b-5a7e30-699c767ff6-frv7t\" (UID: \"efbf72b0-f4f9-4906-ae19-611f70be0837\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-5a7e30-699c767ff6-frv7t"
Jul 27 20:45:33.740494 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:33.740386    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzlv8\" (UniqueName: \"kubernetes.io/projected/9ec98f50-2dd9-4090-9ae7-a096000c09a3-kube-api-access-wzlv8\") pod \"payload-processing-e2e-api-b-5a7e30-6cf65c9b88-nf95l\" (UID: \"9ec98f50-2dd9-4090-9ae7-a096000c09a3\") " pod="openshift-ingress/payload-processing-e2e-api-b-5a7e30-6cf65c9b88-nf95l"
Jul 27 20:45:33.740494 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:33.740427    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/efbf72b0-f4f9-4906-ae19-611f70be0837-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-5a7e30-699c767ff6-frv7t\" (UID: \"efbf72b0-f4f9-4906-ae19-611f70be0837\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-5a7e30-699c767ff6-frv7t"
Jul 27 20:45:33.741110 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:33.741085    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ec98f50-2dd9-4090-9ae7-a096000c09a3-plugins-config-volume\") pod \"payload-processing-e2e-api-b-5a7e30-6cf65c9b88-nf95l\" (UID: \"9ec98f50-2dd9-4090-9ae7-a096000c09a3\") " pod="openshift-ingress/payload-processing-e2e-api-b-5a7e30-6cf65c9b88-nf95l"
Jul 27 20:45:33.741110 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:33.741106    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/efbf72b0-f4f9-4906-ae19-611f70be0837-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-5a7e30-699c767ff6-frv7t\" (UID: \"efbf72b0-f4f9-4906-ae19-611f70be0837\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-5a7e30-699c767ff6-frv7t"
Jul 27 20:45:33.749225 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:33.749195    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sk6h\" (UniqueName: \"kubernetes.io/projected/efbf72b0-f4f9-4906-ae19-611f70be0837-kube-api-access-8sk6h\") pod \"payload-pre-processing-e2e-api-b-5a7e30-699c767ff6-frv7t\" (UID: \"efbf72b0-f4f9-4906-ae19-611f70be0837\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-5a7e30-699c767ff6-frv7t"
Jul 27 20:45:33.749328 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:33.749283    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzlv8\" (UniqueName: \"kubernetes.io/projected/9ec98f50-2dd9-4090-9ae7-a096000c09a3-kube-api-access-wzlv8\") pod \"payload-processing-e2e-api-b-5a7e30-6cf65c9b88-nf95l\" (UID: \"9ec98f50-2dd9-4090-9ae7-a096000c09a3\") " pod="openshift-ingress/payload-processing-e2e-api-b-5a7e30-6cf65c9b88-nf95l"
Jul 27 20:45:33.895920 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:33.895826    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5a7e30-699c767ff6-frv7t"
Jul 27 20:45:33.927764 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:33.927732    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-5a7e30-6cf65c9b88-nf95l"
Jul 27 20:45:34.044084 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:45:34.044046    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefbf72b0_f4f9_4906_ae19_611f70be0837.slice/crio-6661fdfa2c5f345538c7753268bea79d307e4a164a1d245645d2035416d66082 WatchSource:0}: Error finding container 6661fdfa2c5f345538c7753268bea79d307e4a164a1d245645d2035416d66082: Status 404 returned error can't find the container with id 6661fdfa2c5f345538c7753268bea79d307e4a164a1d245645d2035416d66082
Jul 27 20:45:34.044084 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:34.044070    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-5a7e30-699c767ff6-frv7t"]
Jul 27 20:45:34.078118 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:34.078095    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-5a7e30-6cf65c9b88-nf95l"]
Jul 27 20:45:34.088582 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:45:34.088557    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ec98f50_2dd9_4090_9ae7_a096000c09a3.slice/crio-bf377a6d74bd32a5b9db35c13a0fc4e67304a38afe70dbfa6e8cbafd3319b49b WatchSource:0}: Error finding container bf377a6d74bd32a5b9db35c13a0fc4e67304a38afe70dbfa6e8cbafd3319b49b: Status 404 returned error can't find the container with id bf377a6d74bd32a5b9db35c13a0fc4e67304a38afe70dbfa6e8cbafd3319b49b
Jul 27 20:45:34.675917 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:34.675880    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-5a7e30-6cf65c9b88-nf95l" event={"ID":"9ec98f50-2dd9-4090-9ae7-a096000c09a3","Type":"ContainerStarted","Data":"9099fa9fb64fd3d5bd4696e5f31e4b99bdc00df51fdb1e94feb307b37456196d"}
Jul 27 20:45:34.676361 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:34.675945    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-5a7e30-6cf65c9b88-nf95l" event={"ID":"9ec98f50-2dd9-4090-9ae7-a096000c09a3","Type":"ContainerStarted","Data":"bf377a6d74bd32a5b9db35c13a0fc4e67304a38afe70dbfa6e8cbafd3319b49b"}
Jul 27 20:45:34.676361 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:34.675977    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-5a7e30-6cf65c9b88-nf95l"
Jul 27 20:45:34.677447 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:34.677423    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5a7e30-699c767ff6-frv7t" event={"ID":"efbf72b0-f4f9-4906-ae19-611f70be0837","Type":"ContainerStarted","Data":"21087e67dacef8eba58a2cb8b146e074dec936e88980189ed4548605534f6557"}
Jul 27 20:45:34.677581 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:34.677487    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5a7e30-699c767ff6-frv7t" event={"ID":"efbf72b0-f4f9-4906-ae19-611f70be0837","Type":"ContainerStarted","Data":"6661fdfa2c5f345538c7753268bea79d307e4a164a1d245645d2035416d66082"}
Jul 27 20:45:34.677581 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:34.677564    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5a7e30-699c767ff6-frv7t"
Jul 27 20:45:34.694052 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:34.693999    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-5a7e30-6cf65c9b88-nf95l" podStartSLOduration=1.6939850079999998 podStartE2EDuration="1.693985008s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:45:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:45:34.691950835 +0000 UTC m=+2483.266677223" watchObservedRunningTime="2026-07-27 20:45:34.693985008 +0000 UTC m=+2483.268711397"
Jul 27 20:45:34.709669 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:34.709613    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5a7e30-699c767ff6-frv7t" podStartSLOduration=1.709597167 podStartE2EDuration="1.709597167s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:45:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:45:34.708577182 +0000 UTC m=+2483.283303573" watchObservedRunningTime="2026-07-27 20:45:34.709597167 +0000 UTC m=+2483.284323554"
Jul 27 20:45:37.132255 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:37.132206    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:45:37.633949 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:37.633912    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-3f4799-bbdd9ddfb-lp2sb"
Jul 27 20:45:37.634132 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:37.633988    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-3f4799-576cccbf76-srl8l"
Jul 27 20:45:45.685841 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:45.685808    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-5a7e30-6cf65c9b88-nf95l"
Jul 27 20:45:45.686322 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:45.685980    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5a7e30-699c767ff6-frv7t"
Jul 27 20:45:48.292870 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:45:48.292829    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:46:00.976818 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:00.976764    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:46:01.003483 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:01.003432    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-3f4799-576cccbf76-srl8l"]
Jul 27 20:46:01.003738 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:01.003711    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-3f4799-576cccbf76-srl8l" podUID="51e12c16-f3c2-4b71-b466-9e700fba73a7" containerName="payload-processing" containerID="cri-o://1ca1ddb97547342a85ffc02f04513ef0d9109f942b26f165930f674a2271addc" gracePeriod=30
Jul 27 20:46:01.009757 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:01.009726    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-3f4799-bbdd9ddfb-lp2sb"]
Jul 27 20:46:01.010065 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:01.009965    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-3f4799-bbdd9ddfb-lp2sb" podUID="7965c3fb-041b-4be7-b930-ef58c38d1b07" containerName="payload-pre-processing" containerID="cri-o://c06992e07da398411b10323c96d65222dffde7a9d62e11f61ff0cd72a5ace355" gracePeriod=30
Jul 27 20:46:01.076998 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:01.076967    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:46:01.178512 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:01.178429    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:46:01.285033 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:01.285005    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-3f4799-576cccbf76-srl8l"
Jul 27 20:46:01.287797 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:01.287775    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-3f4799-bbdd9ddfb-lp2sb"
Jul 27 20:46:01.398423 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:01.398388    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7965c3fb-041b-4be7-b930-ef58c38d1b07-plugins-config-volume\") pod \"7965c3fb-041b-4be7-b930-ef58c38d1b07\" (UID: \"7965c3fb-041b-4be7-b930-ef58c38d1b07\") "
Jul 27 20:46:01.398637 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:01.398473    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/51e12c16-f3c2-4b71-b466-9e700fba73a7-plugins-config-volume\") pod \"51e12c16-f3c2-4b71-b466-9e700fba73a7\" (UID: \"51e12c16-f3c2-4b71-b466-9e700fba73a7\") "
Jul 27 20:46:01.398637 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:01.398508    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fxbfw\" (UniqueName: \"kubernetes.io/projected/7965c3fb-041b-4be7-b930-ef58c38d1b07-kube-api-access-fxbfw\") pod \"7965c3fb-041b-4be7-b930-ef58c38d1b07\" (UID: \"7965c3fb-041b-4be7-b930-ef58c38d1b07\") "
Jul 27 20:46:01.398637 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:01.398579    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7w6b9\" (UniqueName: \"kubernetes.io/projected/51e12c16-f3c2-4b71-b466-9e700fba73a7-kube-api-access-7w6b9\") pod \"51e12c16-f3c2-4b71-b466-9e700fba73a7\" (UID: \"51e12c16-f3c2-4b71-b466-9e700fba73a7\") "
Jul 27 20:46:01.398901 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:01.398873    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7965c3fb-041b-4be7-b930-ef58c38d1b07-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7965c3fb-041b-4be7-b930-ef58c38d1b07" (UID: "7965c3fb-041b-4be7-b930-ef58c38d1b07"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:46:01.398938 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:01.398873    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51e12c16-f3c2-4b71-b466-9e700fba73a7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "51e12c16-f3c2-4b71-b466-9e700fba73a7" (UID: "51e12c16-f3c2-4b71-b466-9e700fba73a7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:46:01.400709 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:01.400678    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7965c3fb-041b-4be7-b930-ef58c38d1b07-kube-api-access-fxbfw" (OuterVolumeSpecName: "kube-api-access-fxbfw") pod "7965c3fb-041b-4be7-b930-ef58c38d1b07" (UID: "7965c3fb-041b-4be7-b930-ef58c38d1b07"). InnerVolumeSpecName "kube-api-access-fxbfw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:46:01.400824 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:01.400740    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51e12c16-f3c2-4b71-b466-9e700fba73a7-kube-api-access-7w6b9" (OuterVolumeSpecName: "kube-api-access-7w6b9") pod "51e12c16-f3c2-4b71-b466-9e700fba73a7" (UID: "51e12c16-f3c2-4b71-b466-9e700fba73a7"). InnerVolumeSpecName "kube-api-access-7w6b9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:46:01.499315 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:01.499283    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7w6b9\" (UniqueName: \"kubernetes.io/projected/51e12c16-f3c2-4b71-b466-9e700fba73a7-kube-api-access-7w6b9\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:46:01.499315 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:01.499308    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7965c3fb-041b-4be7-b930-ef58c38d1b07-plugins-config-volume\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:46:01.499315 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:01.499318    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/51e12c16-f3c2-4b71-b466-9e700fba73a7-plugins-config-volume\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:46:01.499580 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:01.499327    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fxbfw\" (UniqueName: \"kubernetes.io/projected/7965c3fb-041b-4be7-b930-ef58c38d1b07-kube-api-access-fxbfw\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:46:01.828848 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:01.828809    2557 generic.go:356] "Generic (PLEG): container finished" podID="51e12c16-f3c2-4b71-b466-9e700fba73a7" containerID="1ca1ddb97547342a85ffc02f04513ef0d9109f942b26f165930f674a2271addc" exitCode=0
Jul 27 20:46:01.829062 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:01.828854    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-3f4799-576cccbf76-srl8l"
Jul 27 20:46:01.829062 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:01.828905    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-3f4799-576cccbf76-srl8l" event={"ID":"51e12c16-f3c2-4b71-b466-9e700fba73a7","Type":"ContainerDied","Data":"1ca1ddb97547342a85ffc02f04513ef0d9109f942b26f165930f674a2271addc"}
Jul 27 20:46:01.829062 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:01.828971    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-3f4799-576cccbf76-srl8l" event={"ID":"51e12c16-f3c2-4b71-b466-9e700fba73a7","Type":"ContainerDied","Data":"e34d63b5d11283967352168bb77b2177ea13be7947f744621a581bc7017ad760"}
Jul 27 20:46:01.829062 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:01.829006    2557 scope.go:117] "RemoveContainer" containerID="1ca1ddb97547342a85ffc02f04513ef0d9109f942b26f165930f674a2271addc"
Jul 27 20:46:01.830198 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:01.830174    2557 generic.go:356] "Generic (PLEG): container finished" podID="7965c3fb-041b-4be7-b930-ef58c38d1b07" containerID="c06992e07da398411b10323c96d65222dffde7a9d62e11f61ff0cd72a5ace355" exitCode=0
Jul 27 20:46:01.830274 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:01.830218    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-3f4799-bbdd9ddfb-lp2sb"
Jul 27 20:46:01.830274 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:01.830238    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-3f4799-bbdd9ddfb-lp2sb" event={"ID":"7965c3fb-041b-4be7-b930-ef58c38d1b07","Type":"ContainerDied","Data":"c06992e07da398411b10323c96d65222dffde7a9d62e11f61ff0cd72a5ace355"}
Jul 27 20:46:01.830358 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:01.830280    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-3f4799-bbdd9ddfb-lp2sb" event={"ID":"7965c3fb-041b-4be7-b930-ef58c38d1b07","Type":"ContainerDied","Data":"0178943cacb063999da3aa636fca182b92c8b9c10750b87cc163e4d64ce06366"}
Jul 27 20:46:01.839707 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:01.839688    2557 scope.go:117] "RemoveContainer" containerID="1ca1ddb97547342a85ffc02f04513ef0d9109f942b26f165930f674a2271addc"
Jul 27 20:46:01.839974 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:46:01.839951    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ca1ddb97547342a85ffc02f04513ef0d9109f942b26f165930f674a2271addc\": container with ID starting with 1ca1ddb97547342a85ffc02f04513ef0d9109f942b26f165930f674a2271addc not found: ID does not exist" containerID="1ca1ddb97547342a85ffc02f04513ef0d9109f942b26f165930f674a2271addc"
Jul 27 20:46:01.840065 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:01.839984    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ca1ddb97547342a85ffc02f04513ef0d9109f942b26f165930f674a2271addc"} err="failed to get container status \"1ca1ddb97547342a85ffc02f04513ef0d9109f942b26f165930f674a2271addc\": rpc error: code = NotFound desc = could not find container \"1ca1ddb97547342a85ffc02f04513ef0d9109f942b26f165930f674a2271addc\": container with ID starting with 1ca1ddb97547342a85ffc02f04513ef0d9109f942b26f165930f674a2271addc not found: ID does not exist"
Jul 27 20:46:01.840065 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:01.840007    2557 scope.go:117] "RemoveContainer" containerID="c06992e07da398411b10323c96d65222dffde7a9d62e11f61ff0cd72a5ace355"
Jul 27 20:46:01.848137 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:01.848109    2557 scope.go:117] "RemoveContainer" containerID="c06992e07da398411b10323c96d65222dffde7a9d62e11f61ff0cd72a5ace355"
Jul 27 20:46:01.848377 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:46:01.848358    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c06992e07da398411b10323c96d65222dffde7a9d62e11f61ff0cd72a5ace355\": container with ID starting with c06992e07da398411b10323c96d65222dffde7a9d62e11f61ff0cd72a5ace355 not found: ID does not exist" containerID="c06992e07da398411b10323c96d65222dffde7a9d62e11f61ff0cd72a5ace355"
Jul 27 20:46:01.848433 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:01.848384    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c06992e07da398411b10323c96d65222dffde7a9d62e11f61ff0cd72a5ace355"} err="failed to get container status \"c06992e07da398411b10323c96d65222dffde7a9d62e11f61ff0cd72a5ace355\": rpc error: code = NotFound desc = could not find container \"c06992e07da398411b10323c96d65222dffde7a9d62e11f61ff0cd72a5ace355\": container with ID starting with c06992e07da398411b10323c96d65222dffde7a9d62e11f61ff0cd72a5ace355 not found: ID does not exist"
Jul 27 20:46:01.853687 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:01.853656    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-3f4799-576cccbf76-srl8l"]
Jul 27 20:46:01.860469 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:01.860429    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-3f4799-576cccbf76-srl8l"]
Jul 27 20:46:01.870289 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:01.870263    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-3f4799-bbdd9ddfb-lp2sb"]
Jul 27 20:46:01.873927 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:01.873907    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-3f4799-bbdd9ddfb-lp2sb"]
Jul 27 20:46:01.910622 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:01.910588    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51e12c16-f3c2-4b71-b466-9e700fba73a7" path="/var/lib/kubelet/pods/51e12c16-f3c2-4b71-b466-9e700fba73a7/volumes"
Jul 27 20:46:01.910950 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:01.910938    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7965c3fb-041b-4be7-b930-ef58c38d1b07" path="/var/lib/kubelet/pods/7965c3fb-041b-4be7-b930-ef58c38d1b07/volumes"
Jul 27 20:46:03.889779 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:03.889693    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:46:05.234170 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:05.234135    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:46:05.659733 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:05.659649    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:46:11.638710 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:11.638673    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:46:11.737300 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:11.737238    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:46:11.910236 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:11.910124    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:46:12.130861 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:12.130817    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:46:16.210171 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:16.210136    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:46:28.078011 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:28.077974    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:46:28.098530 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:28.098495    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-5a7e30-6cf65c9b88-nf95l"]
Jul 27 20:46:28.098789 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:28.098755    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-5a7e30-6cf65c9b88-nf95l" podUID="9ec98f50-2dd9-4090-9ae7-a096000c09a3" containerName="payload-processing" containerID="cri-o://9099fa9fb64fd3d5bd4696e5f31e4b99bdc00df51fdb1e94feb307b37456196d" gracePeriod=30
Jul 27 20:46:28.106527 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:28.106500    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-5a7e30-699c767ff6-frv7t"]
Jul 27 20:46:28.106927 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:28.106740    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5a7e30-699c767ff6-frv7t" podUID="efbf72b0-f4f9-4906-ae19-611f70be0837" containerName="payload-pre-processing" containerID="cri-o://21087e67dacef8eba58a2cb8b146e074dec936e88980189ed4548605534f6557" gracePeriod=30
Jul 27 20:46:28.181762 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:28.181730    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:46:28.236610 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:28.236577    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:46:28.369206 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:28.369181    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-5a7e30-6cf65c9b88-nf95l"
Jul 27 20:46:28.386737 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:28.386641    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5a7e30-699c767ff6-frv7t"
Jul 27 20:46:28.444802 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:28.444769    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ec98f50-2dd9-4090-9ae7-a096000c09a3-plugins-config-volume\") pod \"9ec98f50-2dd9-4090-9ae7-a096000c09a3\" (UID: \"9ec98f50-2dd9-4090-9ae7-a096000c09a3\") "
Jul 27 20:46:28.444988 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:28.444926    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wzlv8\" (UniqueName: \"kubernetes.io/projected/9ec98f50-2dd9-4090-9ae7-a096000c09a3-kube-api-access-wzlv8\") pod \"9ec98f50-2dd9-4090-9ae7-a096000c09a3\" (UID: \"9ec98f50-2dd9-4090-9ae7-a096000c09a3\") "
Jul 27 20:46:28.444988 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:28.444974    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/efbf72b0-f4f9-4906-ae19-611f70be0837-plugins-config-volume\") pod \"efbf72b0-f4f9-4906-ae19-611f70be0837\" (UID: \"efbf72b0-f4f9-4906-ae19-611f70be0837\") "
Jul 27 20:46:28.445065 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:28.445008    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8sk6h\" (UniqueName: \"kubernetes.io/projected/efbf72b0-f4f9-4906-ae19-611f70be0837-kube-api-access-8sk6h\") pod \"efbf72b0-f4f9-4906-ae19-611f70be0837\" (UID: \"efbf72b0-f4f9-4906-ae19-611f70be0837\") "
Jul 27 20:46:28.445241 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:28.445217    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ec98f50-2dd9-4090-9ae7-a096000c09a3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9ec98f50-2dd9-4090-9ae7-a096000c09a3" (UID: "9ec98f50-2dd9-4090-9ae7-a096000c09a3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:46:28.445499 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:28.445439    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efbf72b0-f4f9-4906-ae19-611f70be0837-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "efbf72b0-f4f9-4906-ae19-611f70be0837" (UID: "efbf72b0-f4f9-4906-ae19-611f70be0837"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:46:28.447146 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:28.447120    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efbf72b0-f4f9-4906-ae19-611f70be0837-kube-api-access-8sk6h" (OuterVolumeSpecName: "kube-api-access-8sk6h") pod "efbf72b0-f4f9-4906-ae19-611f70be0837" (UID: "efbf72b0-f4f9-4906-ae19-611f70be0837"). InnerVolumeSpecName "kube-api-access-8sk6h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:46:28.447256 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:28.447147    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ec98f50-2dd9-4090-9ae7-a096000c09a3-kube-api-access-wzlv8" (OuterVolumeSpecName: "kube-api-access-wzlv8") pod "9ec98f50-2dd9-4090-9ae7-a096000c09a3" (UID: "9ec98f50-2dd9-4090-9ae7-a096000c09a3"). InnerVolumeSpecName "kube-api-access-wzlv8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:46:28.546363 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:28.546320    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wzlv8\" (UniqueName: \"kubernetes.io/projected/9ec98f50-2dd9-4090-9ae7-a096000c09a3-kube-api-access-wzlv8\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:46:28.546363 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:28.546352    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/efbf72b0-f4f9-4906-ae19-611f70be0837-plugins-config-volume\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:46:28.546363 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:28.546361    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8sk6h\" (UniqueName: \"kubernetes.io/projected/efbf72b0-f4f9-4906-ae19-611f70be0837-kube-api-access-8sk6h\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:46:28.546363 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:28.546370    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ec98f50-2dd9-4090-9ae7-a096000c09a3-plugins-config-volume\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:46:28.972742 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:28.972706    2557 generic.go:356] "Generic (PLEG): container finished" podID="efbf72b0-f4f9-4906-ae19-611f70be0837" containerID="21087e67dacef8eba58a2cb8b146e074dec936e88980189ed4548605534f6557" exitCode=0
Jul 27 20:46:28.972953 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:28.972760    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5a7e30-699c767ff6-frv7t"
Jul 27 20:46:28.972953 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:28.972791    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5a7e30-699c767ff6-frv7t" event={"ID":"efbf72b0-f4f9-4906-ae19-611f70be0837","Type":"ContainerDied","Data":"21087e67dacef8eba58a2cb8b146e074dec936e88980189ed4548605534f6557"}
Jul 27 20:46:28.972953 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:28.972847    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5a7e30-699c767ff6-frv7t" event={"ID":"efbf72b0-f4f9-4906-ae19-611f70be0837","Type":"ContainerDied","Data":"6661fdfa2c5f345538c7753268bea79d307e4a164a1d245645d2035416d66082"}
Jul 27 20:46:28.972953 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:28.972878    2557 scope.go:117] "RemoveContainer" containerID="21087e67dacef8eba58a2cb8b146e074dec936e88980189ed4548605534f6557"
Jul 27 20:46:28.974077 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:28.974055    2557 generic.go:356] "Generic (PLEG): container finished" podID="9ec98f50-2dd9-4090-9ae7-a096000c09a3" containerID="9099fa9fb64fd3d5bd4696e5f31e4b99bdc00df51fdb1e94feb307b37456196d" exitCode=0
Jul 27 20:46:28.974164 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:28.974114    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-5a7e30-6cf65c9b88-nf95l"
Jul 27 20:46:28.974164 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:28.974133    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-5a7e30-6cf65c9b88-nf95l" event={"ID":"9ec98f50-2dd9-4090-9ae7-a096000c09a3","Type":"ContainerDied","Data":"9099fa9fb64fd3d5bd4696e5f31e4b99bdc00df51fdb1e94feb307b37456196d"}
Jul 27 20:46:28.974251 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:28.974190    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-5a7e30-6cf65c9b88-nf95l" event={"ID":"9ec98f50-2dd9-4090-9ae7-a096000c09a3","Type":"ContainerDied","Data":"bf377a6d74bd32a5b9db35c13a0fc4e67304a38afe70dbfa6e8cbafd3319b49b"}
Jul 27 20:46:28.982693 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:28.982671    2557 scope.go:117] "RemoveContainer" containerID="21087e67dacef8eba58a2cb8b146e074dec936e88980189ed4548605534f6557"
Jul 27 20:46:28.982959 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:46:28.982940    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21087e67dacef8eba58a2cb8b146e074dec936e88980189ed4548605534f6557\": container with ID starting with 21087e67dacef8eba58a2cb8b146e074dec936e88980189ed4548605534f6557 not found: ID does not exist" containerID="21087e67dacef8eba58a2cb8b146e074dec936e88980189ed4548605534f6557"
Jul 27 20:46:28.983033 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:28.982972    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21087e67dacef8eba58a2cb8b146e074dec936e88980189ed4548605534f6557"} err="failed to get container status \"21087e67dacef8eba58a2cb8b146e074dec936e88980189ed4548605534f6557\": rpc error: code = NotFound desc = could not find container \"21087e67dacef8eba58a2cb8b146e074dec936e88980189ed4548605534f6557\": container with ID starting with 21087e67dacef8eba58a2cb8b146e074dec936e88980189ed4548605534f6557 not found: ID does not exist"
Jul 27 20:46:28.983033 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:28.983000    2557 scope.go:117] "RemoveContainer" containerID="9099fa9fb64fd3d5bd4696e5f31e4b99bdc00df51fdb1e94feb307b37456196d"
Jul 27 20:46:28.991141 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:28.991115    2557 scope.go:117] "RemoveContainer" containerID="9099fa9fb64fd3d5bd4696e5f31e4b99bdc00df51fdb1e94feb307b37456196d"
Jul 27 20:46:28.991402 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:46:28.991383    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9099fa9fb64fd3d5bd4696e5f31e4b99bdc00df51fdb1e94feb307b37456196d\": container with ID starting with 9099fa9fb64fd3d5bd4696e5f31e4b99bdc00df51fdb1e94feb307b37456196d not found: ID does not exist" containerID="9099fa9fb64fd3d5bd4696e5f31e4b99bdc00df51fdb1e94feb307b37456196d"
Jul 27 20:46:28.991494 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:28.991408    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9099fa9fb64fd3d5bd4696e5f31e4b99bdc00df51fdb1e94feb307b37456196d"} err="failed to get container status \"9099fa9fb64fd3d5bd4696e5f31e4b99bdc00df51fdb1e94feb307b37456196d\": rpc error: code = NotFound desc = could not find container \"9099fa9fb64fd3d5bd4696e5f31e4b99bdc00df51fdb1e94feb307b37456196d\": container with ID starting with 9099fa9fb64fd3d5bd4696e5f31e4b99bdc00df51fdb1e94feb307b37456196d not found: ID does not exist"
Jul 27 20:46:28.998938 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:28.998905    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-5a7e30-699c767ff6-frv7t"]
Jul 27 20:46:29.002806 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:29.002784    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-5a7e30-699c767ff6-frv7t"]
Jul 27 20:46:29.013422 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:29.013399    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-5a7e30-6cf65c9b88-nf95l"]
Jul 27 20:46:29.018172 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:29.018149    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-5a7e30-6cf65c9b88-nf95l"]
Jul 27 20:46:29.912171 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:29.912136    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ec98f50-2dd9-4090-9ae7-a096000c09a3" path="/var/lib/kubelet/pods/9ec98f50-2dd9-4090-9ae7-a096000c09a3/volumes"
Jul 27 20:46:29.912572 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:29.912533    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="efbf72b0-f4f9-4906-ae19-611f70be0837" path="/var/lib/kubelet/pods/efbf72b0-f4f9-4906-ae19-611f70be0837/volumes"
Jul 27 20:46:32.325817 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:32.325778    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:46:32.713609 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:32.713514    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:46:32.897936 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:32.897893    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:46:38.532973 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:38.532932    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:46:38.594543 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:38.594502    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:46:38.817063 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:38.816974    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:46:39.046282 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:39.046247    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:46:39.390644 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:39.390605    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:46:39.713286 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:39.713184    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:46:39.986817 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:39.986785    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:46:42.929503 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:42.929466    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:46:43.030785 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:43.030748    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:46:43.117806 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:43.117778    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:46:43.318797 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:43.318764    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:46:43.708312 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:43.708227    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:46:43.814885 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:43.814845    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:46:43.819073 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:43.819045    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-4af3f5-6cb6c499d4-bvntj"]
Jul 27 20:46:43.819465 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:43.819432    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efbf72b0-f4f9-4906-ae19-611f70be0837" containerName="payload-pre-processing"
Jul 27 20:46:43.819559 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:43.819467    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="efbf72b0-f4f9-4906-ae19-611f70be0837" containerName="payload-pre-processing"
Jul 27 20:46:43.819559 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:43.819486    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51e12c16-f3c2-4b71-b466-9e700fba73a7" containerName="payload-processing"
Jul 27 20:46:43.819559 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:43.819495    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="51e12c16-f3c2-4b71-b466-9e700fba73a7" containerName="payload-processing"
Jul 27 20:46:43.819559 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:43.819511    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7965c3fb-041b-4be7-b930-ef58c38d1b07" containerName="payload-pre-processing"
Jul 27 20:46:43.819559 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:43.819520    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="7965c3fb-041b-4be7-b930-ef58c38d1b07" containerName="payload-pre-processing"
Jul 27 20:46:43.819559 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:43.819530    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ec98f50-2dd9-4090-9ae7-a096000c09a3" containerName="payload-processing"
Jul 27 20:46:43.819559 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:43.819538    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ec98f50-2dd9-4090-9ae7-a096000c09a3" containerName="payload-processing"
Jul 27 20:46:43.819896 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:43.819643    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="51e12c16-f3c2-4b71-b466-9e700fba73a7" containerName="payload-processing"
Jul 27 20:46:43.819896 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:43.819657    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="efbf72b0-f4f9-4906-ae19-611f70be0837" containerName="payload-pre-processing"
Jul 27 20:46:43.819896 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:43.819669    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ec98f50-2dd9-4090-9ae7-a096000c09a3" containerName="payload-processing"
Jul 27 20:46:43.819896 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:43.819681    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="7965c3fb-041b-4be7-b930-ef58c38d1b07" containerName="payload-pre-processing"
Jul 27 20:46:43.824225 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:43.824205    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-4af3f5-6cb6c499d4-bvntj"
Jul 27 20:46:43.826573 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:43.826550    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-4af3f5\""
Jul 27 20:46:43.826573 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:43.826549    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-4af3f5-dockercfg-p274s\""
Jul 27 20:46:43.831359 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:43.831335    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-4af3f5-6cb6c499d4-bvntj"]
Jul 27 20:46:43.848022 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:43.847985    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-4af3f5-6b9c5786cd-gmhn9"]
Jul 27 20:46:43.851547 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:43.851521    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-4af3f5-6b9c5786cd-gmhn9"
Jul 27 20:46:43.859445 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:43.859417    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-4af3f5-6b9c5786cd-gmhn9"]
Jul 27 20:46:43.982160 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:43.982121    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc0c5ad1-b976-44eb-b8dd-7cfaaf65c032-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-4af3f5-6b9c5786cd-gmhn9\" (UID: \"cc0c5ad1-b976-44eb-b8dd-7cfaaf65c032\") " pod="openshift-ingress/payload-processing-e2e-shared-a-4af3f5-6b9c5786cd-gmhn9"
Jul 27 20:46:43.982618 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:43.982187    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4wrw\" (UniqueName: \"kubernetes.io/projected/cc0c5ad1-b976-44eb-b8dd-7cfaaf65c032-kube-api-access-v4wrw\") pod \"payload-processing-e2e-shared-a-4af3f5-6b9c5786cd-gmhn9\" (UID: \"cc0c5ad1-b976-44eb-b8dd-7cfaaf65c032\") " pod="openshift-ingress/payload-processing-e2e-shared-a-4af3f5-6b9c5786cd-gmhn9"
Jul 27 20:46:43.982618 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:43.982298    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnhwv\" (UniqueName: \"kubernetes.io/projected/e29ecfc9-156f-4745-b5d7-008498da4d74-kube-api-access-vnhwv\") pod \"payload-pre-processing-e2e-shared-a-4af3f5-6cb6c499d4-bvntj\" (UID: \"e29ecfc9-156f-4745-b5d7-008498da4d74\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-4af3f5-6cb6c499d4-bvntj"
Jul 27 20:46:43.982618 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:43.982336    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e29ecfc9-156f-4745-b5d7-008498da4d74-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-4af3f5-6cb6c499d4-bvntj\" (UID: \"e29ecfc9-156f-4745-b5d7-008498da4d74\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-4af3f5-6cb6c499d4-bvntj"
Jul 27 20:46:44.083621 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:44.083577    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnhwv\" (UniqueName: \"kubernetes.io/projected/e29ecfc9-156f-4745-b5d7-008498da4d74-kube-api-access-vnhwv\") pod \"payload-pre-processing-e2e-shared-a-4af3f5-6cb6c499d4-bvntj\" (UID: \"e29ecfc9-156f-4745-b5d7-008498da4d74\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-4af3f5-6cb6c499d4-bvntj"
Jul 27 20:46:44.083621 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:44.083630    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e29ecfc9-156f-4745-b5d7-008498da4d74-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-4af3f5-6cb6c499d4-bvntj\" (UID: \"e29ecfc9-156f-4745-b5d7-008498da4d74\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-4af3f5-6cb6c499d4-bvntj"
Jul 27 20:46:44.083937 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:44.083675    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc0c5ad1-b976-44eb-b8dd-7cfaaf65c032-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-4af3f5-6b9c5786cd-gmhn9\" (UID: \"cc0c5ad1-b976-44eb-b8dd-7cfaaf65c032\") " pod="openshift-ingress/payload-processing-e2e-shared-a-4af3f5-6b9c5786cd-gmhn9"
Jul 27 20:46:44.083937 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:44.083701    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4wrw\" (UniqueName: \"kubernetes.io/projected/cc0c5ad1-b976-44eb-b8dd-7cfaaf65c032-kube-api-access-v4wrw\") pod \"payload-processing-e2e-shared-a-4af3f5-6b9c5786cd-gmhn9\" (UID: \"cc0c5ad1-b976-44eb-b8dd-7cfaaf65c032\") " pod="openshift-ingress/payload-processing-e2e-shared-a-4af3f5-6b9c5786cd-gmhn9"
Jul 27 20:46:44.084442 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:44.084415    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc0c5ad1-b976-44eb-b8dd-7cfaaf65c032-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-4af3f5-6b9c5786cd-gmhn9\" (UID: \"cc0c5ad1-b976-44eb-b8dd-7cfaaf65c032\") " pod="openshift-ingress/payload-processing-e2e-shared-a-4af3f5-6b9c5786cd-gmhn9"
Jul 27 20:46:44.084559 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:44.084422    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e29ecfc9-156f-4745-b5d7-008498da4d74-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-4af3f5-6cb6c499d4-bvntj\" (UID: \"e29ecfc9-156f-4745-b5d7-008498da4d74\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-4af3f5-6cb6c499d4-bvntj"
Jul 27 20:46:44.096511 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:44.096480    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnhwv\" (UniqueName: \"kubernetes.io/projected/e29ecfc9-156f-4745-b5d7-008498da4d74-kube-api-access-vnhwv\") pod \"payload-pre-processing-e2e-shared-a-4af3f5-6cb6c499d4-bvntj\" (UID: \"e29ecfc9-156f-4745-b5d7-008498da4d74\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-4af3f5-6cb6c499d4-bvntj"
Jul 27 20:46:44.096623 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:44.096491    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4wrw\" (UniqueName: \"kubernetes.io/projected/cc0c5ad1-b976-44eb-b8dd-7cfaaf65c032-kube-api-access-v4wrw\") pod \"payload-processing-e2e-shared-a-4af3f5-6b9c5786cd-gmhn9\" (UID: \"cc0c5ad1-b976-44eb-b8dd-7cfaaf65c032\") " pod="openshift-ingress/payload-processing-e2e-shared-a-4af3f5-6b9c5786cd-gmhn9"
Jul 27 20:46:44.135594 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:44.135564    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-4af3f5-6cb6c499d4-bvntj"
Jul 27 20:46:44.162810 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:44.162777    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-4af3f5-6b9c5786cd-gmhn9"
Jul 27 20:46:44.286513 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:44.286431    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-4af3f5-6cb6c499d4-bvntj"]
Jul 27 20:46:44.287039 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:46:44.287002    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode29ecfc9_156f_4745_b5d7_008498da4d74.slice/crio-872ececb26e7b8931bbc43ef0556fb816a758277a546b1e224d274bafc79d00a WatchSource:0}: Error finding container 872ececb26e7b8931bbc43ef0556fb816a758277a546b1e224d274bafc79d00a: Status 404 returned error can't find the container with id 872ececb26e7b8931bbc43ef0556fb816a758277a546b1e224d274bafc79d00a
Jul 27 20:46:44.312712 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:44.312688    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-4af3f5-6b9c5786cd-gmhn9"]
Jul 27 20:46:44.322583 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:46:44.322551    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc0c5ad1_b976_44eb_b8dd_7cfaaf65c032.slice/crio-6f39b1c8d7752ddfffb16cb6f9ef4dbf818809478747ed53b47892c527fe9ec6 WatchSource:0}: Error finding container 6f39b1c8d7752ddfffb16cb6f9ef4dbf818809478747ed53b47892c527fe9ec6: Status 404 returned error can't find the container with id 6f39b1c8d7752ddfffb16cb6f9ef4dbf818809478747ed53b47892c527fe9ec6
Jul 27 20:46:45.057834 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:45.057790    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-4af3f5-6cb6c499d4-bvntj" event={"ID":"e29ecfc9-156f-4745-b5d7-008498da4d74","Type":"ContainerStarted","Data":"59ac1295f5403be90f504967e04e2dec1b9cb1e78d06020cd3d4faca67997c33"}
Jul 27 20:46:45.058288 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:45.057855    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-4af3f5-6cb6c499d4-bvntj" event={"ID":"e29ecfc9-156f-4745-b5d7-008498da4d74","Type":"ContainerStarted","Data":"872ececb26e7b8931bbc43ef0556fb816a758277a546b1e224d274bafc79d00a"}
Jul 27 20:46:45.058288 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:45.057882    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-4af3f5-6cb6c499d4-bvntj"
Jul 27 20:46:45.059322 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:45.059294    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-4af3f5-6b9c5786cd-gmhn9" event={"ID":"cc0c5ad1-b976-44eb-b8dd-7cfaaf65c032","Type":"ContainerStarted","Data":"2af5f140999a888d837fa29536067157cb2892d05137243f39fdb664594bd794"}
Jul 27 20:46:45.059406 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:45.059347    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-4af3f5-6b9c5786cd-gmhn9" event={"ID":"cc0c5ad1-b976-44eb-b8dd-7cfaaf65c032","Type":"ContainerStarted","Data":"6f39b1c8d7752ddfffb16cb6f9ef4dbf818809478747ed53b47892c527fe9ec6"}
Jul 27 20:46:45.059406 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:45.059386    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-4af3f5-6b9c5786cd-gmhn9"
Jul 27 20:46:45.075677 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:45.075633    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-4af3f5-6cb6c499d4-bvntj" podStartSLOduration=2.075616668 podStartE2EDuration="2.075616668s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:46:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:46:45.073224149 +0000 UTC m=+2553.647950554" watchObservedRunningTime="2026-07-27 20:46:45.075616668 +0000 UTC m=+2553.650343055"
Jul 27 20:46:45.090264 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:45.090216    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-4af3f5-6b9c5786cd-gmhn9" podStartSLOduration=2.09020163 podStartE2EDuration="2.09020163s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:46:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:46:45.088011067 +0000 UTC m=+2553.662737456" watchObservedRunningTime="2026-07-27 20:46:45.09020163 +0000 UTC m=+2553.664928029"
Jul 27 20:46:47.098129 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:47.098094    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:46:47.461271 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:47.461175    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:46:47.812032 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:47.811996    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:46:48.124367 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:48.124266    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:46:48.397591 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:48.397499    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:46:51.029368 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:51.029336    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:46:51.138590 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:51.138550    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:46:51.281642 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:51.281547    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:46:51.517889 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:51.517858    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:46:51.822158 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:51.822122    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:46:51.919911 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:51.919881    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:46:51.925191 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:51.925159    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-21ded0-6d7f96d4b4-vhbkb"]
Jul 27 20:46:51.928731 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:51.928709    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-21ded0-6d7f96d4b4-vhbkb"
Jul 27 20:46:51.933378 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:51.933342    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-21ded0\""
Jul 27 20:46:51.933536 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:51.933518    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-21ded0-dockercfg-8mfrz\""
Jul 27 20:46:51.941650 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:51.941626    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-21ded0-6d7f96d4b4-vhbkb"]
Jul 27 20:46:51.955904 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:51.955877    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-21ded0-f657f9dcd-pjjds"]
Jul 27 20:46:51.959364 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:51.959345    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-21ded0-f657f9dcd-pjjds"
Jul 27 20:46:51.973907 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:51.973882    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-21ded0-f657f9dcd-pjjds"]
Jul 27 20:46:52.053872 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:52.053838    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxrn7\" (UniqueName: \"kubernetes.io/projected/8cacc492-0f74-4105-8e34-0b9a69f43610-kube-api-access-hxrn7\") pod \"payload-processing-e2e-shared-b-21ded0-f657f9dcd-pjjds\" (UID: \"8cacc492-0f74-4105-8e34-0b9a69f43610\") " pod="openshift-ingress/payload-processing-e2e-shared-b-21ded0-f657f9dcd-pjjds"
Jul 27 20:46:52.054274 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:52.053886    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zqhl\" (UniqueName: \"kubernetes.io/projected/d28fb7dc-288a-4c90-97a7-e24ceccd6434-kube-api-access-5zqhl\") pod \"payload-pre-processing-e2e-shared-b-21ded0-6d7f96d4b4-vhbkb\" (UID: \"d28fb7dc-288a-4c90-97a7-e24ceccd6434\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-21ded0-6d7f96d4b4-vhbkb"
Jul 27 20:46:52.054274 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:52.053910    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d28fb7dc-288a-4c90-97a7-e24ceccd6434-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-21ded0-6d7f96d4b4-vhbkb\" (UID: \"d28fb7dc-288a-4c90-97a7-e24ceccd6434\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-21ded0-6d7f96d4b4-vhbkb"
Jul 27 20:46:52.054274 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:52.053980    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8cacc492-0f74-4105-8e34-0b9a69f43610-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-21ded0-f657f9dcd-pjjds\" (UID: \"8cacc492-0f74-4105-8e34-0b9a69f43610\") " pod="openshift-ingress/payload-processing-e2e-shared-b-21ded0-f657f9dcd-pjjds"
Jul 27 20:46:52.155308 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:52.155209    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxrn7\" (UniqueName: \"kubernetes.io/projected/8cacc492-0f74-4105-8e34-0b9a69f43610-kube-api-access-hxrn7\") pod \"payload-processing-e2e-shared-b-21ded0-f657f9dcd-pjjds\" (UID: \"8cacc492-0f74-4105-8e34-0b9a69f43610\") " pod="openshift-ingress/payload-processing-e2e-shared-b-21ded0-f657f9dcd-pjjds"
Jul 27 20:46:52.155308 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:52.155264    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zqhl\" (UniqueName: \"kubernetes.io/projected/d28fb7dc-288a-4c90-97a7-e24ceccd6434-kube-api-access-5zqhl\") pod \"payload-pre-processing-e2e-shared-b-21ded0-6d7f96d4b4-vhbkb\" (UID: \"d28fb7dc-288a-4c90-97a7-e24ceccd6434\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-21ded0-6d7f96d4b4-vhbkb"
Jul 27 20:46:52.155308 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:52.155291    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d28fb7dc-288a-4c90-97a7-e24ceccd6434-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-21ded0-6d7f96d4b4-vhbkb\" (UID: \"d28fb7dc-288a-4c90-97a7-e24ceccd6434\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-21ded0-6d7f96d4b4-vhbkb"
Jul 27 20:46:52.155651 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:52.155320    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8cacc492-0f74-4105-8e34-0b9a69f43610-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-21ded0-f657f9dcd-pjjds\" (UID: \"8cacc492-0f74-4105-8e34-0b9a69f43610\") " pod="openshift-ingress/payload-processing-e2e-shared-b-21ded0-f657f9dcd-pjjds"
Jul 27 20:46:52.155991 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:52.155965    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d28fb7dc-288a-4c90-97a7-e24ceccd6434-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-21ded0-6d7f96d4b4-vhbkb\" (UID: \"d28fb7dc-288a-4c90-97a7-e24ceccd6434\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-21ded0-6d7f96d4b4-vhbkb"
Jul 27 20:46:52.156132 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:52.156111    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8cacc492-0f74-4105-8e34-0b9a69f43610-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-21ded0-f657f9dcd-pjjds\" (UID: \"8cacc492-0f74-4105-8e34-0b9a69f43610\") " pod="openshift-ingress/payload-processing-e2e-shared-b-21ded0-f657f9dcd-pjjds"
Jul 27 20:46:52.164894 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:52.164870    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zqhl\" (UniqueName: \"kubernetes.io/projected/d28fb7dc-288a-4c90-97a7-e24ceccd6434-kube-api-access-5zqhl\") pod \"payload-pre-processing-e2e-shared-b-21ded0-6d7f96d4b4-vhbkb\" (UID: \"d28fb7dc-288a-4c90-97a7-e24ceccd6434\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-21ded0-6d7f96d4b4-vhbkb"
Jul 27 20:46:52.165432 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:52.165411    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxrn7\" (UniqueName: \"kubernetes.io/projected/8cacc492-0f74-4105-8e34-0b9a69f43610-kube-api-access-hxrn7\") pod \"payload-processing-e2e-shared-b-21ded0-f657f9dcd-pjjds\" (UID: \"8cacc492-0f74-4105-8e34-0b9a69f43610\") " pod="openshift-ingress/payload-processing-e2e-shared-b-21ded0-f657f9dcd-pjjds"
Jul 27 20:46:52.239734 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:52.239701    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-21ded0-6d7f96d4b4-vhbkb"
Jul 27 20:46:52.269188 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:52.269152    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-21ded0-f657f9dcd-pjjds"
Jul 27 20:46:52.400368 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:52.400338    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-21ded0-6d7f96d4b4-vhbkb"]
Jul 27 20:46:52.401041 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:46:52.401017    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd28fb7dc_288a_4c90_97a7_e24ceccd6434.slice/crio-3370503ed86d2dfe28b82efd816fd85dfc984b295b08a7a6a52bfaadf079f86f WatchSource:0}: Error finding container 3370503ed86d2dfe28b82efd816fd85dfc984b295b08a7a6a52bfaadf079f86f: Status 404 returned error can't find the container with id 3370503ed86d2dfe28b82efd816fd85dfc984b295b08a7a6a52bfaadf079f86f
Jul 27 20:46:52.422415 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:52.422390    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-21ded0-f657f9dcd-pjjds"]
Jul 27 20:46:52.423591 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:46:52.423564    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cacc492_0f74_4105_8e34_0b9a69f43610.slice/crio-98a44f54243beaf629e625ffa490b8cf144bb2c216ac12b6736062ae9aa40a30 WatchSource:0}: Error finding container 98a44f54243beaf629e625ffa490b8cf144bb2c216ac12b6736062ae9aa40a30: Status 404 returned error can't find the container with id 98a44f54243beaf629e625ffa490b8cf144bb2c216ac12b6736062ae9aa40a30
Jul 27 20:46:53.105299 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:53.105266    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-21ded0-6d7f96d4b4-vhbkb" event={"ID":"d28fb7dc-288a-4c90-97a7-e24ceccd6434","Type":"ContainerStarted","Data":"7498d56e53d840fcbd810820f91d7ce91024b9894dd35f76126b5994224404e2"}
Jul 27 20:46:53.105821 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:53.105329    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-21ded0-6d7f96d4b4-vhbkb" event={"ID":"d28fb7dc-288a-4c90-97a7-e24ceccd6434","Type":"ContainerStarted","Data":"3370503ed86d2dfe28b82efd816fd85dfc984b295b08a7a6a52bfaadf079f86f"}
Jul 27 20:46:53.105821 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:53.105480    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-21ded0-6d7f96d4b4-vhbkb"
Jul 27 20:46:53.107141 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:53.107118    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-21ded0-f657f9dcd-pjjds" event={"ID":"8cacc492-0f74-4105-8e34-0b9a69f43610","Type":"ContainerStarted","Data":"c755b135dcabcb5f0d5bffd58d0caf1a39bde22c2fc9896c5ed3383ca87c8200"}
Jul 27 20:46:53.107269 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:53.107161    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-21ded0-f657f9dcd-pjjds" event={"ID":"8cacc492-0f74-4105-8e34-0b9a69f43610","Type":"ContainerStarted","Data":"98a44f54243beaf629e625ffa490b8cf144bb2c216ac12b6736062ae9aa40a30"}
Jul 27 20:46:53.107269 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:53.107189    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-21ded0-f657f9dcd-pjjds"
Jul 27 20:46:53.123340 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:53.123292    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-21ded0-6d7f96d4b4-vhbkb" podStartSLOduration=2.123279597 podStartE2EDuration="2.123279597s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:46:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:46:53.121760698 +0000 UTC m=+2561.696487087" watchObservedRunningTime="2026-07-27 20:46:53.123279597 +0000 UTC m=+2561.698005989"
Jul 27 20:46:53.140677 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:53.140639    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-21ded0-f657f9dcd-pjjds" podStartSLOduration=2.140625544 podStartE2EDuration="2.140625544s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:46:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:46:53.138667224 +0000 UTC m=+2561.713393614" watchObservedRunningTime="2026-07-27 20:46:53.140625544 +0000 UTC m=+2561.715351931"
Jul 27 20:46:55.484777 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:55.484743    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:46:56.067395 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:56.067363    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-4af3f5-6b9c5786cd-gmhn9"
Jul 27 20:46:56.067629 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:56.067446    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-4af3f5-6cb6c499d4-bvntj"
Jul 27 20:46:58.502026 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:46:58.501989    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:47:04.116643 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:47:04.116612    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-21ded0-f657f9dcd-pjjds"
Jul 27 20:47:04.117035 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:47:04.116688    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-21ded0-6d7f96d4b4-vhbkb"
Jul 27 20:47:09.688953 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:47:09.688922    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-4af3f5/auth-test-model-4af3f5-kserve-59cd9544dc-4jkmg"]
Jul 27 20:47:09.693656 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:47:09.693630    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4af3f5/auth-test-model-4af3f5-kserve-59cd9544dc-4jkmg"
Jul 27 20:47:09.696270 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:47:09.696248    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-4af3f5\"/\"openshift-service-ca.crt\""
Jul 27 20:47:09.697149 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:47:09.697118    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-4af3f5\"/\"auth-test-model-4af3f5-kserve-self-signed-certs\""
Jul 27 20:47:09.697260 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:47:09.697235    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-4af3f5\"/\"kube-root-ca.crt\""
Jul 27 20:47:09.697404 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:47:09.697386    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-4af3f5\"/\"default-dockercfg-6qd9f\""
Jul 27 20:47:09.703526 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:47:09.703501    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-4af3f5/auth-test-model-4af3f5-kserve-59cd9544dc-4jkmg"]
Jul 27 20:47:09.728920 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:47:09.728886    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:47:09.814653 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:47:09.814616    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ef90e0f-c8fa-488d-a601-b08466999347-home\") pod \"auth-test-model-4af3f5-kserve-59cd9544dc-4jkmg\" (UID: \"6ef90e0f-c8fa-488d-a601-b08466999347\") " pod="ai-tenant-e2e-shared-a-4af3f5/auth-test-model-4af3f5-kserve-59cd9544dc-4jkmg"
Jul 27 20:47:09.814824 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:47:09.814660    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ef90e0f-c8fa-488d-a601-b08466999347-model-cache\") pod \"auth-test-model-4af3f5-kserve-59cd9544dc-4jkmg\" (UID: \"6ef90e0f-c8fa-488d-a601-b08466999347\") " pod="ai-tenant-e2e-shared-a-4af3f5/auth-test-model-4af3f5-kserve-59cd9544dc-4jkmg"
Jul 27 20:47:09.814824 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:47:09.814738    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ef90e0f-c8fa-488d-a601-b08466999347-tmp-dir\") pod \"auth-test-model-4af3f5-kserve-59cd9544dc-4jkmg\" (UID: \"6ef90e0f-c8fa-488d-a601-b08466999347\") " pod="ai-tenant-e2e-shared-a-4af3f5/auth-test-model-4af3f5-kserve-59cd9544dc-4jkmg"
Jul 27 20:47:09.814824 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:47:09.814774    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfkr9\" (UniqueName: \"kubernetes.io/projected/6ef90e0f-c8fa-488d-a601-b08466999347-kube-api-access-cfkr9\") pod \"auth-test-model-4af3f5-kserve-59cd9544dc-4jkmg\" (UID: \"6ef90e0f-c8fa-488d-a601-b08466999347\") " pod="ai-tenant-e2e-shared-a-4af3f5/auth-test-model-4af3f5-kserve-59cd9544dc-4jkmg"
Jul 27 20:47:09.814824 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:47:09.814821    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ef90e0f-c8fa-488d-a601-b08466999347-dshm\") pod \"auth-test-model-4af3f5-kserve-59cd9544dc-4jkmg\" (UID: \"6ef90e0f-c8fa-488d-a601-b08466999347\") " pod="ai-tenant-e2e-shared-a-4af3f5/auth-test-model-4af3f5-kserve-59cd9544dc-4jkmg"
Jul 27 20:47:09.814966 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:47:09.814843    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ef90e0f-c8fa-488d-a601-b08466999347-tls-certs\") pod \"auth-test-model-4af3f5-kserve-59cd9544dc-4jkmg\" (UID: \"6ef90e0f-c8fa-488d-a601-b08466999347\") " pod="ai-tenant-e2e-shared-a-4af3f5/auth-test-model-4af3f5-kserve-59cd9544dc-4jkmg"
Jul 27 20:47:09.915483 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:47:09.915433    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ef90e0f-c8fa-488d-a601-b08466999347-model-cache\") pod \"auth-test-model-4af3f5-kserve-59cd9544dc-4jkmg\" (UID: \"6ef90e0f-c8fa-488d-a601-b08466999347\") " pod="ai-tenant-e2e-shared-a-4af3f5/auth-test-model-4af3f5-kserve-59cd9544dc-4jkmg"
Jul 27 20:47:09.915679 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:47:09.915514    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ef90e0f-c8fa-488d-a601-b08466999347-tmp-dir\") pod \"auth-test-model-4af3f5-kserve-59cd9544dc-4jkmg\" (UID: \"6ef90e0f-c8fa-488d-a601-b08466999347\") " pod="ai-tenant-e2e-shared-a-4af3f5/auth-test-model-4af3f5-kserve-59cd9544dc-4jkmg"
Jul 27 20:47:09.915679 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:47:09.915548    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfkr9\" (UniqueName: \"kubernetes.io/projected/6ef90e0f-c8fa-488d-a601-b08466999347-kube-api-access-cfkr9\") pod \"auth-test-model-4af3f5-kserve-59cd9544dc-4jkmg\" (UID: \"6ef90e0f-c8fa-488d-a601-b08466999347\") " pod="ai-tenant-e2e-shared-a-4af3f5/auth-test-model-4af3f5-kserve-59cd9544dc-4jkmg"
Jul 27 20:47:09.915679 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:47:09.915608    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ef90e0f-c8fa-488d-a601-b08466999347-dshm\") pod \"auth-test-model-4af3f5-kserve-59cd9544dc-4jkmg\" (UID: \"6ef90e0f-c8fa-488d-a601-b08466999347\") " pod="ai-tenant-e2e-shared-a-4af3f5/auth-test-model-4af3f5-kserve-59cd9544dc-4jkmg"
Jul 27 20:47:09.915679 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:47:09.915638    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ef90e0f-c8fa-488d-a601-b08466999347-tls-certs\") pod \"auth-test-model-4af3f5-kserve-59cd9544dc-4jkmg\" (UID: \"6ef90e0f-c8fa-488d-a601-b08466999347\") " pod="ai-tenant-e2e-shared-a-4af3f5/auth-test-model-4af3f5-kserve-59cd9544dc-4jkmg"
Jul 27 20:47:09.915679 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:47:09.915674    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ef90e0f-c8fa-488d-a601-b08466999347-home\") pod \"auth-test-model-4af3f5-kserve-59cd9544dc-4jkmg\" (UID: \"6ef90e0f-c8fa-488d-a601-b08466999347\") " pod="ai-tenant-e2e-shared-a-4af3f5/auth-test-model-4af3f5-kserve-59cd9544dc-4jkmg"
Jul 27 20:47:09.915943 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:47:09.915791    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ef90e0f-c8fa-488d-a601-b08466999347-model-cache\") pod \"auth-test-model-4af3f5-kserve-59cd9544dc-4jkmg\" (UID: \"6ef90e0f-c8fa-488d-a601-b08466999347\") " pod="ai-tenant-e2e-shared-a-4af3f5/auth-test-model-4af3f5-kserve-59cd9544dc-4jkmg"
Jul 27 20:47:09.915943 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:47:09.915858    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ef90e0f-c8fa-488d-a601-b08466999347-tmp-dir\") pod \"auth-test-model-4af3f5-kserve-59cd9544dc-4jkmg\" (UID: \"6ef90e0f-c8fa-488d-a601-b08466999347\") " pod="ai-tenant-e2e-shared-a-4af3f5/auth-test-model-4af3f5-kserve-59cd9544dc-4jkmg"
Jul 27 20:47:09.916056 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:47:09.916029    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ef90e0f-c8fa-488d-a601-b08466999347-home\") pod \"auth-test-model-4af3f5-kserve-59cd9544dc-4jkmg\" (UID: \"6ef90e0f-c8fa-488d-a601-b08466999347\") " pod="ai-tenant-e2e-shared-a-4af3f5/auth-test-model-4af3f5-kserve-59cd9544dc-4jkmg"
Jul 27 20:47:09.917895 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:47:09.917870    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ef90e0f-c8fa-488d-a601-b08466999347-dshm\") pod \"auth-test-model-4af3f5-kserve-59cd9544dc-4jkmg\" (UID: \"6ef90e0f-c8fa-488d-a601-b08466999347\") " pod="ai-tenant-e2e-shared-a-4af3f5/auth-test-model-4af3f5-kserve-59cd9544dc-4jkmg"
Jul 27 20:47:09.918165 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:47:09.918146    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ef90e0f-c8fa-488d-a601-b08466999347-tls-certs\") pod \"auth-test-model-4af3f5-kserve-59cd9544dc-4jkmg\" (UID: \"6ef90e0f-c8fa-488d-a601-b08466999347\") " pod="ai-tenant-e2e-shared-a-4af3f5/auth-test-model-4af3f5-kserve-59cd9544dc-4jkmg"
Jul 27 20:47:09.923418 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:47:09.923396    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfkr9\" (UniqueName: \"kubernetes.io/projected/6ef90e0f-c8fa-488d-a601-b08466999347-kube-api-access-cfkr9\") pod \"auth-test-model-4af3f5-kserve-59cd9544dc-4jkmg\" (UID: \"6ef90e0f-c8fa-488d-a601-b08466999347\") " pod="ai-tenant-e2e-shared-a-4af3f5/auth-test-model-4af3f5-kserve-59cd9544dc-4jkmg"
Jul 27 20:47:10.006141 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:47:10.006112    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4af3f5/auth-test-model-4af3f5-kserve-59cd9544dc-4jkmg"
Jul 27 20:47:10.140111 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:47:10.140082    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-4af3f5/auth-test-model-4af3f5-kserve-59cd9544dc-4jkmg"]
Jul 27 20:47:10.142010 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:47:10.141980    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6ef90e0f_c8fa_488d_a601_b08466999347.slice/crio-48ff6df625c3152e20b0b113a273ab69832d16e7e720df3e26dec189f2ce2f84 WatchSource:0}: Error finding container 48ff6df625c3152e20b0b113a273ab69832d16e7e720df3e26dec189f2ce2f84: Status 404 returned error can't find the container with id 48ff6df625c3152e20b0b113a273ab69832d16e7e720df3e26dec189f2ce2f84
Jul 27 20:47:10.207269 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:47:10.207233    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4af3f5/auth-test-model-4af3f5-kserve-59cd9544dc-4jkmg" event={"ID":"6ef90e0f-c8fa-488d-a601-b08466999347","Type":"ContainerStarted","Data":"437e526a720638178f78563c95d861e5d9f4873e32ee2cb0e4b1f007b4be51d2"}
Jul 27 20:47:10.207385 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:47:10.207286    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4af3f5/auth-test-model-4af3f5-kserve-59cd9544dc-4jkmg" event={"ID":"6ef90e0f-c8fa-488d-a601-b08466999347","Type":"ContainerStarted","Data":"48ff6df625c3152e20b0b113a273ab69832d16e7e720df3e26dec189f2ce2f84"}
Jul 27 20:47:10.223409 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:47:10.223353    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-4af3f5/auth-test-model-4af3f5-kserve-59cd9544dc-4jkmg" podStartSLOduration=1.223334885 podStartE2EDuration="1.223334885s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:47:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:47:10.22199904 +0000 UTC m=+2578.796725430" watchObservedRunningTime="2026-07-27 20:47:10.223334885 +0000 UTC m=+2578.798061273"
Jul 27 20:47:13.289482 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:47:13.289435    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:47:20.006855 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:47:20.006819    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-4af3f5/auth-test-model-4af3f5-kserve-59cd9544dc-4jkmg"
Jul 27 20:47:20.007337 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:47:20.006900    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-4af3f5/auth-test-model-4af3f5-kserve-59cd9544dc-4jkmg"
Jul 27 20:47:20.019599 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:47:20.019567    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-4af3f5/auth-test-model-4af3f5-kserve-59cd9544dc-4jkmg"
Jul 27 20:47:20.272592 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:47:20.272503    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-4af3f5/auth-test-model-4af3f5-kserve-59cd9544dc-4jkmg"
Jul 27 20:47:47.136762 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:47:47.136725    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:47:51.006034 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:47:51.005996    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:48:06.851872 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:48:06.851835    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:48:17.292466 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:48:17.292416    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:48:38.092817 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:48:38.092780    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:48:54.696231 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:48:54.696193    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:49:16.602571 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:49:16.602492    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:49:18.301717 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:49:18.301676    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:49:18.403683 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:49:18.403643    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:49:35.793067 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:49:35.793026    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:49:57.686860 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:49:57.686824    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:50:13.298032 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:50:13.297998    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:50:35.886810 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:50:35.886726    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:50:49.142681 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:50:49.142631    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:50:49.230984 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:50:49.230948    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:50:49.394116 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:50:49.394030    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:51:01.206933 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:51:01.206892    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:51:18.889416 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:51:18.889374    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:51:32.623506 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:51:32.623467    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:51:40.336891 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:51:40.336859    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:51:40.398109 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:51:40.398080    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:51:44.898248 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:51:44.898197    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:52:03.490069 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:03.489985    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:52:07.006937 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:07.006901    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-4af3f5/auth-test-model-4af3f5-kserve-59cd9544dc-4jkmg"]
Jul 27 20:52:07.049691 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:07.049658    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:52:07.794529 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:07.794485    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:52:17.432097 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:17.432011    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:52:20.239089 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:20.239050    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:52:22.025871 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:22.025831    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-4af3f5/auth-test-model-4af3f5-kserve-59cd9544dc-4jkmg" podUID="6ef90e0f-c8fa-488d-a601-b08466999347" containerName="main" containerID="cri-o://437e526a720638178f78563c95d861e5d9f4873e32ee2cb0e4b1f007b4be51d2" gracePeriod=45
Jul 27 20:52:22.288158 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:22.288092    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4af3f5/auth-test-model-4af3f5-kserve-59cd9544dc-4jkmg"
Jul 27 20:52:22.401785 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:22.401750    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cfkr9\" (UniqueName: \"kubernetes.io/projected/6ef90e0f-c8fa-488d-a601-b08466999347-kube-api-access-cfkr9\") pod \"6ef90e0f-c8fa-488d-a601-b08466999347\" (UID: \"6ef90e0f-c8fa-488d-a601-b08466999347\") "
Jul 27 20:52:22.401977 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:22.401818    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ef90e0f-c8fa-488d-a601-b08466999347-tls-certs\") pod \"6ef90e0f-c8fa-488d-a601-b08466999347\" (UID: \"6ef90e0f-c8fa-488d-a601-b08466999347\") "
Jul 27 20:52:22.401977 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:22.401850    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ef90e0f-c8fa-488d-a601-b08466999347-tmp-dir\") pod \"6ef90e0f-c8fa-488d-a601-b08466999347\" (UID: \"6ef90e0f-c8fa-488d-a601-b08466999347\") "
Jul 27 20:52:22.401977 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:22.401866    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ef90e0f-c8fa-488d-a601-b08466999347-model-cache\") pod \"6ef90e0f-c8fa-488d-a601-b08466999347\" (UID: \"6ef90e0f-c8fa-488d-a601-b08466999347\") "
Jul 27 20:52:22.401977 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:22.401896    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ef90e0f-c8fa-488d-a601-b08466999347-home\") pod \"6ef90e0f-c8fa-488d-a601-b08466999347\" (UID: \"6ef90e0f-c8fa-488d-a601-b08466999347\") "
Jul 27 20:52:22.401977 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:22.401918    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ef90e0f-c8fa-488d-a601-b08466999347-dshm\") pod \"6ef90e0f-c8fa-488d-a601-b08466999347\" (UID: \"6ef90e0f-c8fa-488d-a601-b08466999347\") "
Jul 27 20:52:22.402231 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:22.402154    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ef90e0f-c8fa-488d-a601-b08466999347-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6ef90e0f-c8fa-488d-a601-b08466999347" (UID: "6ef90e0f-c8fa-488d-a601-b08466999347"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:52:22.402231 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:22.402172    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ef90e0f-c8fa-488d-a601-b08466999347-home" (OuterVolumeSpecName: "home") pod "6ef90e0f-c8fa-488d-a601-b08466999347" (UID: "6ef90e0f-c8fa-488d-a601-b08466999347"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:52:22.402231 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:22.402220    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ef90e0f-c8fa-488d-a601-b08466999347-model-cache" (OuterVolumeSpecName: "model-cache") pod "6ef90e0f-c8fa-488d-a601-b08466999347" (UID: "6ef90e0f-c8fa-488d-a601-b08466999347"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:52:22.404150 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:22.404128    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ef90e0f-c8fa-488d-a601-b08466999347-dshm" (OuterVolumeSpecName: "dshm") pod "6ef90e0f-c8fa-488d-a601-b08466999347" (UID: "6ef90e0f-c8fa-488d-a601-b08466999347"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:52:22.404236 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:22.404176    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ef90e0f-c8fa-488d-a601-b08466999347-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6ef90e0f-c8fa-488d-a601-b08466999347" (UID: "6ef90e0f-c8fa-488d-a601-b08466999347"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:52:22.404277 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:22.404260    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ef90e0f-c8fa-488d-a601-b08466999347-kube-api-access-cfkr9" (OuterVolumeSpecName: "kube-api-access-cfkr9") pod "6ef90e0f-c8fa-488d-a601-b08466999347" (UID: "6ef90e0f-c8fa-488d-a601-b08466999347"). InnerVolumeSpecName "kube-api-access-cfkr9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:52:22.502943 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:22.502898    2557 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ef90e0f-c8fa-488d-a601-b08466999347-tmp-dir\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:52:22.502943 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:22.502930    2557 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ef90e0f-c8fa-488d-a601-b08466999347-model-cache\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:52:22.502943 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:22.502943    2557 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ef90e0f-c8fa-488d-a601-b08466999347-home\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:52:22.502943 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:22.502953    2557 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ef90e0f-c8fa-488d-a601-b08466999347-dshm\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:52:22.503213 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:22.502964    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cfkr9\" (UniqueName: \"kubernetes.io/projected/6ef90e0f-c8fa-488d-a601-b08466999347-kube-api-access-cfkr9\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:52:22.503213 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:22.502976    2557 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ef90e0f-c8fa-488d-a601-b08466999347-tls-certs\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:52:22.895545 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:22.895509    2557 generic.go:356] "Generic (PLEG): container finished" podID="6ef90e0f-c8fa-488d-a601-b08466999347" containerID="437e526a720638178f78563c95d861e5d9f4873e32ee2cb0e4b1f007b4be51d2" exitCode=0
Jul 27 20:52:22.895752 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:22.895561    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4af3f5/auth-test-model-4af3f5-kserve-59cd9544dc-4jkmg"
Jul 27 20:52:22.895752 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:22.895565    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4af3f5/auth-test-model-4af3f5-kserve-59cd9544dc-4jkmg" event={"ID":"6ef90e0f-c8fa-488d-a601-b08466999347","Type":"ContainerDied","Data":"437e526a720638178f78563c95d861e5d9f4873e32ee2cb0e4b1f007b4be51d2"}
Jul 27 20:52:22.895752 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:22.895685    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4af3f5/auth-test-model-4af3f5-kserve-59cd9544dc-4jkmg" event={"ID":"6ef90e0f-c8fa-488d-a601-b08466999347","Type":"ContainerDied","Data":"48ff6df625c3152e20b0b113a273ab69832d16e7e720df3e26dec189f2ce2f84"}
Jul 27 20:52:22.895752 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:22.895717    2557 scope.go:117] "RemoveContainer" containerID="437e526a720638178f78563c95d861e5d9f4873e32ee2cb0e4b1f007b4be51d2"
Jul 27 20:52:22.905361 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:22.905342    2557 scope.go:117] "RemoveContainer" containerID="437e526a720638178f78563c95d861e5d9f4873e32ee2cb0e4b1f007b4be51d2"
Jul 27 20:52:22.905679 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:52:22.905658    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"437e526a720638178f78563c95d861e5d9f4873e32ee2cb0e4b1f007b4be51d2\": container with ID starting with 437e526a720638178f78563c95d861e5d9f4873e32ee2cb0e4b1f007b4be51d2 not found: ID does not exist" containerID="437e526a720638178f78563c95d861e5d9f4873e32ee2cb0e4b1f007b4be51d2"
Jul 27 20:52:22.905764 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:22.905687    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"437e526a720638178f78563c95d861e5d9f4873e32ee2cb0e4b1f007b4be51d2"} err="failed to get container status \"437e526a720638178f78563c95d861e5d9f4873e32ee2cb0e4b1f007b4be51d2\": rpc error: code = NotFound desc = could not find container \"437e526a720638178f78563c95d861e5d9f4873e32ee2cb0e4b1f007b4be51d2\": container with ID starting with 437e526a720638178f78563c95d861e5d9f4873e32ee2cb0e4b1f007b4be51d2 not found: ID does not exist"
Jul 27 20:52:22.917253 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:22.917218    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-4af3f5/auth-test-model-4af3f5-kserve-59cd9544dc-4jkmg"]
Jul 27 20:52:22.920669 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:22.920644    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-4af3f5/auth-test-model-4af3f5-kserve-59cd9544dc-4jkmg"]
Jul 27 20:52:23.401557 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:23.401522    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-4af3f5/sub-test-model-4af3f5-kserve-fdf6ccc97-8lkb9"]
Jul 27 20:52:23.402026 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:23.402007    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ef90e0f-c8fa-488d-a601-b08466999347" containerName="main"
Jul 27 20:52:23.402127 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:23.402029    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ef90e0f-c8fa-488d-a601-b08466999347" containerName="main"
Jul 27 20:52:23.402127 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:23.402101    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ef90e0f-c8fa-488d-a601-b08466999347" containerName="main"
Jul 27 20:52:23.406373 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:23.406357    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4af3f5/sub-test-model-4af3f5-kserve-fdf6ccc97-8lkb9"
Jul 27 20:52:23.409719 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:23.409698    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-4af3f5\"/\"default-dockercfg-6qd9f\""
Jul 27 20:52:23.409844 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:23.409731    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-4af3f5\"/\"openshift-service-ca.crt\""
Jul 27 20:52:23.409844 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:23.409733    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-4af3f5\"/\"sub-test-model-4af3f5-kserve-self-signed-certs\""
Jul 27 20:52:23.409844 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:23.409697    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-4af3f5\"/\"kube-root-ca.crt\""
Jul 27 20:52:23.415946 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:23.415925    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-4af3f5/sub-test-model-4af3f5-kserve-fdf6ccc97-8lkb9"]
Jul 27 20:52:23.428360 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:23.428336    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:52:23.513131 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:23.513092    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f117d4e-c8c2-4dd3-92aa-312d079e4fcf-home\") pod \"sub-test-model-4af3f5-kserve-fdf6ccc97-8lkb9\" (UID: \"8f117d4e-c8c2-4dd3-92aa-312d079e4fcf\") " pod="ai-tenant-e2e-shared-a-4af3f5/sub-test-model-4af3f5-kserve-fdf6ccc97-8lkb9"
Jul 27 20:52:23.513356 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:23.513138    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f117d4e-c8c2-4dd3-92aa-312d079e4fcf-tls-certs\") pod \"sub-test-model-4af3f5-kserve-fdf6ccc97-8lkb9\" (UID: \"8f117d4e-c8c2-4dd3-92aa-312d079e4fcf\") " pod="ai-tenant-e2e-shared-a-4af3f5/sub-test-model-4af3f5-kserve-fdf6ccc97-8lkb9"
Jul 27 20:52:23.513356 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:23.513162    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f117d4e-c8c2-4dd3-92aa-312d079e4fcf-tmp-dir\") pod \"sub-test-model-4af3f5-kserve-fdf6ccc97-8lkb9\" (UID: \"8f117d4e-c8c2-4dd3-92aa-312d079e4fcf\") " pod="ai-tenant-e2e-shared-a-4af3f5/sub-test-model-4af3f5-kserve-fdf6ccc97-8lkb9"
Jul 27 20:52:23.513356 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:23.513270    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhp65\" (UniqueName: \"kubernetes.io/projected/8f117d4e-c8c2-4dd3-92aa-312d079e4fcf-kube-api-access-nhp65\") pod \"sub-test-model-4af3f5-kserve-fdf6ccc97-8lkb9\" (UID: \"8f117d4e-c8c2-4dd3-92aa-312d079e4fcf\") " pod="ai-tenant-e2e-shared-a-4af3f5/sub-test-model-4af3f5-kserve-fdf6ccc97-8lkb9"
Jul 27 20:52:23.513356 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:23.513327    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f117d4e-c8c2-4dd3-92aa-312d079e4fcf-model-cache\") pod \"sub-test-model-4af3f5-kserve-fdf6ccc97-8lkb9\" (UID: \"8f117d4e-c8c2-4dd3-92aa-312d079e4fcf\") " pod="ai-tenant-e2e-shared-a-4af3f5/sub-test-model-4af3f5-kserve-fdf6ccc97-8lkb9"
Jul 27 20:52:23.513565 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:23.513366    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f117d4e-c8c2-4dd3-92aa-312d079e4fcf-dshm\") pod \"sub-test-model-4af3f5-kserve-fdf6ccc97-8lkb9\" (UID: \"8f117d4e-c8c2-4dd3-92aa-312d079e4fcf\") " pod="ai-tenant-e2e-shared-a-4af3f5/sub-test-model-4af3f5-kserve-fdf6ccc97-8lkb9"
Jul 27 20:52:23.614743 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:23.614703    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f117d4e-c8c2-4dd3-92aa-312d079e4fcf-model-cache\") pod \"sub-test-model-4af3f5-kserve-fdf6ccc97-8lkb9\" (UID: \"8f117d4e-c8c2-4dd3-92aa-312d079e4fcf\") " pod="ai-tenant-e2e-shared-a-4af3f5/sub-test-model-4af3f5-kserve-fdf6ccc97-8lkb9"
Jul 27 20:52:23.614743 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:23.614749    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f117d4e-c8c2-4dd3-92aa-312d079e4fcf-dshm\") pod \"sub-test-model-4af3f5-kserve-fdf6ccc97-8lkb9\" (UID: \"8f117d4e-c8c2-4dd3-92aa-312d079e4fcf\") " pod="ai-tenant-e2e-shared-a-4af3f5/sub-test-model-4af3f5-kserve-fdf6ccc97-8lkb9"
Jul 27 20:52:23.615002 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:23.614799    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f117d4e-c8c2-4dd3-92aa-312d079e4fcf-home\") pod \"sub-test-model-4af3f5-kserve-fdf6ccc97-8lkb9\" (UID: \"8f117d4e-c8c2-4dd3-92aa-312d079e4fcf\") " pod="ai-tenant-e2e-shared-a-4af3f5/sub-test-model-4af3f5-kserve-fdf6ccc97-8lkb9"
Jul 27 20:52:23.615002 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:23.614817    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f117d4e-c8c2-4dd3-92aa-312d079e4fcf-tls-certs\") pod \"sub-test-model-4af3f5-kserve-fdf6ccc97-8lkb9\" (UID: \"8f117d4e-c8c2-4dd3-92aa-312d079e4fcf\") " pod="ai-tenant-e2e-shared-a-4af3f5/sub-test-model-4af3f5-kserve-fdf6ccc97-8lkb9"
Jul 27 20:52:23.615002 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:23.614832    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f117d4e-c8c2-4dd3-92aa-312d079e4fcf-tmp-dir\") pod \"sub-test-model-4af3f5-kserve-fdf6ccc97-8lkb9\" (UID: \"8f117d4e-c8c2-4dd3-92aa-312d079e4fcf\") " pod="ai-tenant-e2e-shared-a-4af3f5/sub-test-model-4af3f5-kserve-fdf6ccc97-8lkb9"
Jul 27 20:52:23.615002 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:23.614862    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhp65\" (UniqueName: \"kubernetes.io/projected/8f117d4e-c8c2-4dd3-92aa-312d079e4fcf-kube-api-access-nhp65\") pod \"sub-test-model-4af3f5-kserve-fdf6ccc97-8lkb9\" (UID: \"8f117d4e-c8c2-4dd3-92aa-312d079e4fcf\") " pod="ai-tenant-e2e-shared-a-4af3f5/sub-test-model-4af3f5-kserve-fdf6ccc97-8lkb9"
Jul 27 20:52:23.615227 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:23.615176    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f117d4e-c8c2-4dd3-92aa-312d079e4fcf-model-cache\") pod \"sub-test-model-4af3f5-kserve-fdf6ccc97-8lkb9\" (UID: \"8f117d4e-c8c2-4dd3-92aa-312d079e4fcf\") " pod="ai-tenant-e2e-shared-a-4af3f5/sub-test-model-4af3f5-kserve-fdf6ccc97-8lkb9"
Jul 27 20:52:23.615279 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:23.615223    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f117d4e-c8c2-4dd3-92aa-312d079e4fcf-home\") pod \"sub-test-model-4af3f5-kserve-fdf6ccc97-8lkb9\" (UID: \"8f117d4e-c8c2-4dd3-92aa-312d079e4fcf\") " pod="ai-tenant-e2e-shared-a-4af3f5/sub-test-model-4af3f5-kserve-fdf6ccc97-8lkb9"
Jul 27 20:52:23.615377 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:23.615357    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f117d4e-c8c2-4dd3-92aa-312d079e4fcf-tmp-dir\") pod \"sub-test-model-4af3f5-kserve-fdf6ccc97-8lkb9\" (UID: \"8f117d4e-c8c2-4dd3-92aa-312d079e4fcf\") " pod="ai-tenant-e2e-shared-a-4af3f5/sub-test-model-4af3f5-kserve-fdf6ccc97-8lkb9"
Jul 27 20:52:23.617170 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:23.617148    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f117d4e-c8c2-4dd3-92aa-312d079e4fcf-dshm\") pod \"sub-test-model-4af3f5-kserve-fdf6ccc97-8lkb9\" (UID: \"8f117d4e-c8c2-4dd3-92aa-312d079e4fcf\") " pod="ai-tenant-e2e-shared-a-4af3f5/sub-test-model-4af3f5-kserve-fdf6ccc97-8lkb9"
Jul 27 20:52:23.617479 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:23.617437    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f117d4e-c8c2-4dd3-92aa-312d079e4fcf-tls-certs\") pod \"sub-test-model-4af3f5-kserve-fdf6ccc97-8lkb9\" (UID: \"8f117d4e-c8c2-4dd3-92aa-312d079e4fcf\") " pod="ai-tenant-e2e-shared-a-4af3f5/sub-test-model-4af3f5-kserve-fdf6ccc97-8lkb9"
Jul 27 20:52:23.623852 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:23.623831    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhp65\" (UniqueName: \"kubernetes.io/projected/8f117d4e-c8c2-4dd3-92aa-312d079e4fcf-kube-api-access-nhp65\") pod \"sub-test-model-4af3f5-kserve-fdf6ccc97-8lkb9\" (UID: \"8f117d4e-c8c2-4dd3-92aa-312d079e4fcf\") " pod="ai-tenant-e2e-shared-a-4af3f5/sub-test-model-4af3f5-kserve-fdf6ccc97-8lkb9"
Jul 27 20:52:23.715955 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:23.715864    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4af3f5/sub-test-model-4af3f5-kserve-fdf6ccc97-8lkb9"
Jul 27 20:52:23.878238 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:23.878209    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-4af3f5/sub-test-model-4af3f5-kserve-fdf6ccc97-8lkb9"]
Jul 27 20:52:23.880690 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:52:23.880660    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8f117d4e_c8c2_4dd3_92aa_312d079e4fcf.slice/crio-efc092668e727fa9e627d555d4454c7aa17c6adfce4dc114161fe828a406121d WatchSource:0}: Error finding container efc092668e727fa9e627d555d4454c7aa17c6adfce4dc114161fe828a406121d: Status 404 returned error can't find the container with id efc092668e727fa9e627d555d4454c7aa17c6adfce4dc114161fe828a406121d
Jul 27 20:52:23.903403 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:23.903376    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4af3f5/sub-test-model-4af3f5-kserve-fdf6ccc97-8lkb9" event={"ID":"8f117d4e-c8c2-4dd3-92aa-312d079e4fcf","Type":"ContainerStarted","Data":"efc092668e727fa9e627d555d4454c7aa17c6adfce4dc114161fe828a406121d"}
Jul 27 20:52:23.910441 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:23.910417    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ef90e0f-c8fa-488d-a601-b08466999347" path="/var/lib/kubelet/pods/6ef90e0f-c8fa-488d-a601-b08466999347/volumes"
Jul 27 20:52:24.910397 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:24.910353    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4af3f5/sub-test-model-4af3f5-kserve-fdf6ccc97-8lkb9" event={"ID":"8f117d4e-c8c2-4dd3-92aa-312d079e4fcf","Type":"ContainerStarted","Data":"739aa235911682f6e056fb9f198f49c2c8e74870abc9abcae65edfde8ffae3b7"}
Jul 27 20:52:24.931065 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:24.931017    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-4af3f5/sub-test-model-4af3f5-kserve-fdf6ccc97-8lkb9" podStartSLOduration=1.9310017400000001 podStartE2EDuration="1.93100174s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:52:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:52:24.928247789 +0000 UTC m=+2893.502974178" watchObservedRunningTime="2026-07-27 20:52:24.93100174 +0000 UTC m=+2893.505728155"
Jul 27 20:52:33.716326 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:33.716284    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-4af3f5/sub-test-model-4af3f5-kserve-fdf6ccc97-8lkb9"
Jul 27 20:52:33.716796 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:33.716583    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-4af3f5/sub-test-model-4af3f5-kserve-fdf6ccc97-8lkb9"
Jul 27 20:52:33.729207 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:33.729178    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-4af3f5/sub-test-model-4af3f5-kserve-fdf6ccc97-8lkb9"
Jul 27 20:52:33.968038 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:33.967939    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-4af3f5/sub-test-model-4af3f5-kserve-fdf6ccc97-8lkb9"
Jul 27 20:52:34.014816 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:34.014784    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:52:41.834400 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:41.834362    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:52:45.497306 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:52:45.497270    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:53:27.049196 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:53:27.049160    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:53:44.095995 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:53:44.095955    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:53:55.514171 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:53:55.514133    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-4af3f5/sub-test-model-4af3f5-kserve-fdf6ccc97-8lkb9"]
Jul 27 20:53:55.541523 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:53:55.541487    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:53:56.899839 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:53:56.899806    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:54:00.718923 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:54:00.718889    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-4af3f5/rate-test-model-4af3f5-kserve-5c95bfd547-xq5rk"]
Jul 27 20:54:00.722733 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:54:00.722713    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4af3f5/rate-test-model-4af3f5-kserve-5c95bfd547-xq5rk"
Jul 27 20:54:00.726336 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:54:00.726314    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-4af3f5\"/\"rate-test-model-4af3f5-kserve-self-signed-certs\""
Jul 27 20:54:00.748225 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:54:00.748198    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-4af3f5/rate-test-model-4af3f5-kserve-5c95bfd547-xq5rk"]
Jul 27 20:54:00.758601 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:54:00.758572    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:54:00.855518 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:54:00.855481    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2dlw\" (UniqueName: \"kubernetes.io/projected/254e7c23-2397-458b-943e-3b00882e0557-kube-api-access-q2dlw\") pod \"rate-test-model-4af3f5-kserve-5c95bfd547-xq5rk\" (UID: \"254e7c23-2397-458b-943e-3b00882e0557\") " pod="ai-tenant-e2e-shared-a-4af3f5/rate-test-model-4af3f5-kserve-5c95bfd547-xq5rk"
Jul 27 20:54:00.855692 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:54:00.855563    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/254e7c23-2397-458b-943e-3b00882e0557-tls-certs\") pod \"rate-test-model-4af3f5-kserve-5c95bfd547-xq5rk\" (UID: \"254e7c23-2397-458b-943e-3b00882e0557\") " pod="ai-tenant-e2e-shared-a-4af3f5/rate-test-model-4af3f5-kserve-5c95bfd547-xq5rk"
Jul 27 20:54:00.855692 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:54:00.855656    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/254e7c23-2397-458b-943e-3b00882e0557-dshm\") pod \"rate-test-model-4af3f5-kserve-5c95bfd547-xq5rk\" (UID: \"254e7c23-2397-458b-943e-3b00882e0557\") " pod="ai-tenant-e2e-shared-a-4af3f5/rate-test-model-4af3f5-kserve-5c95bfd547-xq5rk"
Jul 27 20:54:00.855692 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:54:00.855672    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/254e7c23-2397-458b-943e-3b00882e0557-model-cache\") pod \"rate-test-model-4af3f5-kserve-5c95bfd547-xq5rk\" (UID: \"254e7c23-2397-458b-943e-3b00882e0557\") " pod="ai-tenant-e2e-shared-a-4af3f5/rate-test-model-4af3f5-kserve-5c95bfd547-xq5rk"
Jul 27 20:54:00.855798 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:54:00.855712    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/254e7c23-2397-458b-943e-3b00882e0557-home\") pod \"rate-test-model-4af3f5-kserve-5c95bfd547-xq5rk\" (UID: \"254e7c23-2397-458b-943e-3b00882e0557\") " pod="ai-tenant-e2e-shared-a-4af3f5/rate-test-model-4af3f5-kserve-5c95bfd547-xq5rk"
Jul 27 20:54:00.855798 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:54:00.855766    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/254e7c23-2397-458b-943e-3b00882e0557-tmp-dir\") pod \"rate-test-model-4af3f5-kserve-5c95bfd547-xq5rk\" (UID: \"254e7c23-2397-458b-943e-3b00882e0557\") " pod="ai-tenant-e2e-shared-a-4af3f5/rate-test-model-4af3f5-kserve-5c95bfd547-xq5rk"
Jul 27 20:54:00.957239 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:54:00.957200    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/254e7c23-2397-458b-943e-3b00882e0557-home\") pod \"rate-test-model-4af3f5-kserve-5c95bfd547-xq5rk\" (UID: \"254e7c23-2397-458b-943e-3b00882e0557\") " pod="ai-tenant-e2e-shared-a-4af3f5/rate-test-model-4af3f5-kserve-5c95bfd547-xq5rk"
Jul 27 20:54:00.957413 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:54:00.957247    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/254e7c23-2397-458b-943e-3b00882e0557-tmp-dir\") pod \"rate-test-model-4af3f5-kserve-5c95bfd547-xq5rk\" (UID: \"254e7c23-2397-458b-943e-3b00882e0557\") " pod="ai-tenant-e2e-shared-a-4af3f5/rate-test-model-4af3f5-kserve-5c95bfd547-xq5rk"
Jul 27 20:54:00.957413 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:54:00.957282    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2dlw\" (UniqueName: \"kubernetes.io/projected/254e7c23-2397-458b-943e-3b00882e0557-kube-api-access-q2dlw\") pod \"rate-test-model-4af3f5-kserve-5c95bfd547-xq5rk\" (UID: \"254e7c23-2397-458b-943e-3b00882e0557\") " pod="ai-tenant-e2e-shared-a-4af3f5/rate-test-model-4af3f5-kserve-5c95bfd547-xq5rk"
Jul 27 20:54:00.957413 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:54:00.957322    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/254e7c23-2397-458b-943e-3b00882e0557-tls-certs\") pod \"rate-test-model-4af3f5-kserve-5c95bfd547-xq5rk\" (UID: \"254e7c23-2397-458b-943e-3b00882e0557\") " pod="ai-tenant-e2e-shared-a-4af3f5/rate-test-model-4af3f5-kserve-5c95bfd547-xq5rk"
Jul 27 20:54:00.957413 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:54:00.957375    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/254e7c23-2397-458b-943e-3b00882e0557-dshm\") pod \"rate-test-model-4af3f5-kserve-5c95bfd547-xq5rk\" (UID: \"254e7c23-2397-458b-943e-3b00882e0557\") " pod="ai-tenant-e2e-shared-a-4af3f5/rate-test-model-4af3f5-kserve-5c95bfd547-xq5rk"
Jul 27 20:54:00.957413 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:54:00.957398    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/254e7c23-2397-458b-943e-3b00882e0557-model-cache\") pod \"rate-test-model-4af3f5-kserve-5c95bfd547-xq5rk\" (UID: \"254e7c23-2397-458b-943e-3b00882e0557\") " pod="ai-tenant-e2e-shared-a-4af3f5/rate-test-model-4af3f5-kserve-5c95bfd547-xq5rk"
Jul 27 20:54:00.957725 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:54:00.957697    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/254e7c23-2397-458b-943e-3b00882e0557-home\") pod \"rate-test-model-4af3f5-kserve-5c95bfd547-xq5rk\" (UID: \"254e7c23-2397-458b-943e-3b00882e0557\") " pod="ai-tenant-e2e-shared-a-4af3f5/rate-test-model-4af3f5-kserve-5c95bfd547-xq5rk"
Jul 27 20:54:00.957778 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:54:00.957752    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/254e7c23-2397-458b-943e-3b00882e0557-tmp-dir\") pod \"rate-test-model-4af3f5-kserve-5c95bfd547-xq5rk\" (UID: \"254e7c23-2397-458b-943e-3b00882e0557\") " pod="ai-tenant-e2e-shared-a-4af3f5/rate-test-model-4af3f5-kserve-5c95bfd547-xq5rk"
Jul 27 20:54:00.957824 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:54:00.957802    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/254e7c23-2397-458b-943e-3b00882e0557-model-cache\") pod \"rate-test-model-4af3f5-kserve-5c95bfd547-xq5rk\" (UID: \"254e7c23-2397-458b-943e-3b00882e0557\") " pod="ai-tenant-e2e-shared-a-4af3f5/rate-test-model-4af3f5-kserve-5c95bfd547-xq5rk"
Jul 27 20:54:00.959696 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:54:00.959675    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/254e7c23-2397-458b-943e-3b00882e0557-dshm\") pod \"rate-test-model-4af3f5-kserve-5c95bfd547-xq5rk\" (UID: \"254e7c23-2397-458b-943e-3b00882e0557\") " pod="ai-tenant-e2e-shared-a-4af3f5/rate-test-model-4af3f5-kserve-5c95bfd547-xq5rk"
Jul 27 20:54:00.959963 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:54:00.959946    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/254e7c23-2397-458b-943e-3b00882e0557-tls-certs\") pod \"rate-test-model-4af3f5-kserve-5c95bfd547-xq5rk\" (UID: \"254e7c23-2397-458b-943e-3b00882e0557\") " pod="ai-tenant-e2e-shared-a-4af3f5/rate-test-model-4af3f5-kserve-5c95bfd547-xq5rk"
Jul 27 20:54:00.966474 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:54:00.966421    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2dlw\" (UniqueName: \"kubernetes.io/projected/254e7c23-2397-458b-943e-3b00882e0557-kube-api-access-q2dlw\") pod \"rate-test-model-4af3f5-kserve-5c95bfd547-xq5rk\" (UID: \"254e7c23-2397-458b-943e-3b00882e0557\") " pod="ai-tenant-e2e-shared-a-4af3f5/rate-test-model-4af3f5-kserve-5c95bfd547-xq5rk"
Jul 27 20:54:01.032634 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:54:01.032604    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4af3f5/rate-test-model-4af3f5-kserve-5c95bfd547-xq5rk"
Jul 27 20:54:01.177938 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:54:01.177915    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-4af3f5/rate-test-model-4af3f5-kserve-5c95bfd547-xq5rk"]
Jul 27 20:54:01.179863 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:54:01.179833    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod254e7c23_2397_458b_943e_3b00882e0557.slice/crio-b0823bd1e32d7b4f8adf4afd07fcff74b920c444edfa0fa5766be600435a3482 WatchSource:0}: Error finding container b0823bd1e32d7b4f8adf4afd07fcff74b920c444edfa0fa5766be600435a3482: Status 404 returned error can't find the container with id b0823bd1e32d7b4f8adf4afd07fcff74b920c444edfa0fa5766be600435a3482
Jul 27 20:54:01.415429 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:54:01.415330    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4af3f5/rate-test-model-4af3f5-kserve-5c95bfd547-xq5rk" event={"ID":"254e7c23-2397-458b-943e-3b00882e0557","Type":"ContainerStarted","Data":"ce030964b86f3e726999e481df434f3cc4fcf6109f5642d2e2c22bc5e177e79c"}
Jul 27 20:54:01.415429 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:54:01.415379    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4af3f5/rate-test-model-4af3f5-kserve-5c95bfd547-xq5rk" event={"ID":"254e7c23-2397-458b-943e-3b00882e0557","Type":"ContainerStarted","Data":"b0823bd1e32d7b4f8adf4afd07fcff74b920c444edfa0fa5766be600435a3482"}
Jul 27 20:54:01.437864 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:54:01.437809    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-4af3f5/rate-test-model-4af3f5-kserve-5c95bfd547-xq5rk" podStartSLOduration=1.437793279 podStartE2EDuration="1.437793279s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:54:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:54:01.434882901 +0000 UTC m=+2990.009609289" watchObservedRunningTime="2026-07-27 20:54:01.437793279 +0000 UTC m=+2990.012519666"
Jul 27 20:54:02.004793 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:54:02.004758    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:54:08.599539 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:54:08.599500    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:54:10.532891 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:54:10.532844    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-4af3f5/sub-test-model-4af3f5-kserve-fdf6ccc97-8lkb9" podUID="8f117d4e-c8c2-4dd3-92aa-312d079e4fcf" containerName="main" containerID="cri-o://739aa235911682f6e056fb9f198f49c2c8e74870abc9abcae65edfde8ffae3b7" gracePeriod=45
Jul 27 20:54:10.793035 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:54:10.792972    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4af3f5/sub-test-model-4af3f5-kserve-fdf6ccc97-8lkb9"
Jul 27 20:54:10.848445 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:54:10.848406    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f117d4e-c8c2-4dd3-92aa-312d079e4fcf-dshm\") pod \"8f117d4e-c8c2-4dd3-92aa-312d079e4fcf\" (UID: \"8f117d4e-c8c2-4dd3-92aa-312d079e4fcf\") "
Jul 27 20:54:10.848634 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:54:10.848507    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nhp65\" (UniqueName: \"kubernetes.io/projected/8f117d4e-c8c2-4dd3-92aa-312d079e4fcf-kube-api-access-nhp65\") pod \"8f117d4e-c8c2-4dd3-92aa-312d079e4fcf\" (UID: \"8f117d4e-c8c2-4dd3-92aa-312d079e4fcf\") "
Jul 27 20:54:10.848634 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:54:10.848547    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f117d4e-c8c2-4dd3-92aa-312d079e4fcf-home\") pod \"8f117d4e-c8c2-4dd3-92aa-312d079e4fcf\" (UID: \"8f117d4e-c8c2-4dd3-92aa-312d079e4fcf\") "
Jul 27 20:54:10.848634 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:54:10.848601    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f117d4e-c8c2-4dd3-92aa-312d079e4fcf-tls-certs\") pod \"8f117d4e-c8c2-4dd3-92aa-312d079e4fcf\" (UID: \"8f117d4e-c8c2-4dd3-92aa-312d079e4fcf\") "
Jul 27 20:54:10.848793 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:54:10.848633    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f117d4e-c8c2-4dd3-92aa-312d079e4fcf-tmp-dir\") pod \"8f117d4e-c8c2-4dd3-92aa-312d079e4fcf\" (UID: \"8f117d4e-c8c2-4dd3-92aa-312d079e4fcf\") "
Jul 27 20:54:10.848793 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:54:10.848663    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f117d4e-c8c2-4dd3-92aa-312d079e4fcf-model-cache\") pod \"8f117d4e-c8c2-4dd3-92aa-312d079e4fcf\" (UID: \"8f117d4e-c8c2-4dd3-92aa-312d079e4fcf\") "
Jul 27 20:54:10.848965 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:54:10.848918    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f117d4e-c8c2-4dd3-92aa-312d079e4fcf-home" (OuterVolumeSpecName: "home") pod "8f117d4e-c8c2-4dd3-92aa-312d079e4fcf" (UID: "8f117d4e-c8c2-4dd3-92aa-312d079e4fcf"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:54:10.849090 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:54:10.848957    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f117d4e-c8c2-4dd3-92aa-312d079e4fcf-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8f117d4e-c8c2-4dd3-92aa-312d079e4fcf" (UID: "8f117d4e-c8c2-4dd3-92aa-312d079e4fcf"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:54:10.849090 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:54:10.848997    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f117d4e-c8c2-4dd3-92aa-312d079e4fcf-model-cache" (OuterVolumeSpecName: "model-cache") pod "8f117d4e-c8c2-4dd3-92aa-312d079e4fcf" (UID: "8f117d4e-c8c2-4dd3-92aa-312d079e4fcf"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:54:10.850790 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:54:10.850770    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f117d4e-c8c2-4dd3-92aa-312d079e4fcf-kube-api-access-nhp65" (OuterVolumeSpecName: "kube-api-access-nhp65") pod "8f117d4e-c8c2-4dd3-92aa-312d079e4fcf" (UID: "8f117d4e-c8c2-4dd3-92aa-312d079e4fcf"). InnerVolumeSpecName "kube-api-access-nhp65". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:54:10.850790 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:54:10.850777    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f117d4e-c8c2-4dd3-92aa-312d079e4fcf-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8f117d4e-c8c2-4dd3-92aa-312d079e4fcf" (UID: "8f117d4e-c8c2-4dd3-92aa-312d079e4fcf"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:54:10.850941 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:54:10.850818    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f117d4e-c8c2-4dd3-92aa-312d079e4fcf-dshm" (OuterVolumeSpecName: "dshm") pod "8f117d4e-c8c2-4dd3-92aa-312d079e4fcf" (UID: "8f117d4e-c8c2-4dd3-92aa-312d079e4fcf"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:54:10.950014 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:54:10.949978    2557 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f117d4e-c8c2-4dd3-92aa-312d079e4fcf-dshm\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:54:10.950014 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:54:10.950007    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nhp65\" (UniqueName: \"kubernetes.io/projected/8f117d4e-c8c2-4dd3-92aa-312d079e4fcf-kube-api-access-nhp65\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:54:10.950014 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:54:10.950018    2557 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f117d4e-c8c2-4dd3-92aa-312d079e4fcf-home\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:54:10.950244 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:54:10.950027    2557 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f117d4e-c8c2-4dd3-92aa-312d079e4fcf-tls-certs\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:54:10.950244 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:54:10.950036    2557 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f117d4e-c8c2-4dd3-92aa-312d079e4fcf-tmp-dir\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:54:10.950244 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:54:10.950045    2557 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f117d4e-c8c2-4dd3-92aa-312d079e4fcf-model-cache\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:54:11.032981 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:54:11.032934    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-4af3f5/rate-test-model-4af3f5-kserve-5c95bfd547-xq5rk"
Jul 27 20:54:11.033165 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:54:11.032996    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-4af3f5/rate-test-model-4af3f5-kserve-5c95bfd547-xq5rk"
Jul 27 20:54:11.045683 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:54:11.045597    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-4af3f5/rate-test-model-4af3f5-kserve-5c95bfd547-xq5rk"
Jul 27 20:54:11.470661 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:54:11.470571    2557 generic.go:356] "Generic (PLEG): container finished" podID="8f117d4e-c8c2-4dd3-92aa-312d079e4fcf" containerID="739aa235911682f6e056fb9f198f49c2c8e74870abc9abcae65edfde8ffae3b7" exitCode=0
Jul 27 20:54:11.470661 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:54:11.470612    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4af3f5/sub-test-model-4af3f5-kserve-fdf6ccc97-8lkb9"
Jul 27 20:54:11.470900 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:54:11.470662    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4af3f5/sub-test-model-4af3f5-kserve-fdf6ccc97-8lkb9" event={"ID":"8f117d4e-c8c2-4dd3-92aa-312d079e4fcf","Type":"ContainerDied","Data":"739aa235911682f6e056fb9f198f49c2c8e74870abc9abcae65edfde8ffae3b7"}
Jul 27 20:54:11.470900 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:54:11.470696    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4af3f5/sub-test-model-4af3f5-kserve-fdf6ccc97-8lkb9" event={"ID":"8f117d4e-c8c2-4dd3-92aa-312d079e4fcf","Type":"ContainerDied","Data":"efc092668e727fa9e627d555d4454c7aa17c6adfce4dc114161fe828a406121d"}
Jul 27 20:54:11.470900 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:54:11.470715    2557 scope.go:117] "RemoveContainer" containerID="739aa235911682f6e056fb9f198f49c2c8e74870abc9abcae65edfde8ffae3b7"
Jul 27 20:54:11.481445 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:54:11.481425    2557 scope.go:117] "RemoveContainer" containerID="739aa235911682f6e056fb9f198f49c2c8e74870abc9abcae65edfde8ffae3b7"
Jul 27 20:54:11.482109 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:54:11.482087    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"739aa235911682f6e056fb9f198f49c2c8e74870abc9abcae65edfde8ffae3b7\": container with ID starting with 739aa235911682f6e056fb9f198f49c2c8e74870abc9abcae65edfde8ffae3b7 not found: ID does not exist" containerID="739aa235911682f6e056fb9f198f49c2c8e74870abc9abcae65edfde8ffae3b7"
Jul 27 20:54:11.482191 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:54:11.482116    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"739aa235911682f6e056fb9f198f49c2c8e74870abc9abcae65edfde8ffae3b7"} err="failed to get container status \"739aa235911682f6e056fb9f198f49c2c8e74870abc9abcae65edfde8ffae3b7\": rpc error: code = NotFound desc = could not find container \"739aa235911682f6e056fb9f198f49c2c8e74870abc9abcae65edfde8ffae3b7\": container with ID starting with 739aa235911682f6e056fb9f198f49c2c8e74870abc9abcae65edfde8ffae3b7 not found: ID does not exist"
Jul 27 20:54:11.484296 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:54:11.484277    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-4af3f5/rate-test-model-4af3f5-kserve-5c95bfd547-xq5rk"
Jul 27 20:54:11.492929 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:54:11.492906    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-4af3f5/sub-test-model-4af3f5-kserve-fdf6ccc97-8lkb9"]
Jul 27 20:54:11.497117 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:54:11.497097    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-4af3f5/sub-test-model-4af3f5-kserve-fdf6ccc97-8lkb9"]
Jul 27 20:54:11.912897 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:54:11.912857    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f117d4e-c8c2-4dd3-92aa-312d079e4fcf" path="/var/lib/kubelet/pods/8f117d4e-c8c2-4dd3-92aa-312d079e4fcf/volumes"
Jul 27 20:54:20.222214 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:54:20.222179    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:54:24.387802 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:54:24.387765    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:54:51.715815 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:54:51.715775    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:54:55.003132 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:54:55.003095    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:55:14.204930 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:14.204846    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:55:21.495343 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:21.495305    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-4af3f5/rate-test-model-4af3f5-kserve-5c95bfd547-xq5rk"]
Jul 27 20:55:21.515229 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:21.515192    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:55:22.517953 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:22.517919    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:55:23.465176 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:23.465132    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7247-139727817193776"]
Jul 27 20:55:23.465560 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:23.465546    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f117d4e-c8c2-4dd3-92aa-312d079e4fcf" containerName="main"
Jul 27 20:55:23.465615 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:23.465564    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f117d4e-c8c2-4dd3-92aa-312d079e4fcf" containerName="main"
Jul 27 20:55:23.465656 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:23.465645    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f117d4e-c8c2-4dd3-92aa-312d079e4fcf" containerName="main"
Jul 27 20:55:23.468694 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:23.468676    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7247-139727817193776"
Jul 27 20:55:23.471526 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:23.471500    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-dndv7\""
Jul 27 20:55:23.478676 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:23.478649    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7247-139727817193776"]
Jul 27 20:55:23.615830 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:23.615784    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pg5kq\" (UniqueName: \"kubernetes.io/projected/08d07b7d-b388-4ea2-904a-90f39a9079ef-kube-api-access-pg5kq\") pod \"test-curl-7247-139727817193776\" (UID: \"08d07b7d-b388-4ea2-904a-90f39a9079ef\") " pod="opendatahub/test-curl-7247-139727817193776"
Jul 27 20:55:23.716593 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:23.716493    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pg5kq\" (UniqueName: \"kubernetes.io/projected/08d07b7d-b388-4ea2-904a-90f39a9079ef-kube-api-access-pg5kq\") pod \"test-curl-7247-139727817193776\" (UID: \"08d07b7d-b388-4ea2-904a-90f39a9079ef\") " pod="opendatahub/test-curl-7247-139727817193776"
Jul 27 20:55:23.725775 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:23.725741    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pg5kq\" (UniqueName: \"kubernetes.io/projected/08d07b7d-b388-4ea2-904a-90f39a9079ef-kube-api-access-pg5kq\") pod \"test-curl-7247-139727817193776\" (UID: \"08d07b7d-b388-4ea2-904a-90f39a9079ef\") " pod="opendatahub/test-curl-7247-139727817193776"
Jul 27 20:55:23.778726 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:23.778675    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7247-139727817193776"
Jul 27 20:55:23.913952 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:23.913925    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7247-139727817193776"]
Jul 27 20:55:23.916751 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:55:23.916722    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod08d07b7d_b388_4ea2_904a_90f39a9079ef.slice/crio-b6973967cd957d7f76304eda247a641c86da68484ecd228bf321c8ba4dbe76e8 WatchSource:0}: Error finding container b6973967cd957d7f76304eda247a641c86da68484ecd228bf321c8ba4dbe76e8: Status 404 returned error can't find the container with id b6973967cd957d7f76304eda247a641c86da68484ecd228bf321c8ba4dbe76e8
Jul 27 20:55:23.918589 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:23.918565    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 20:55:24.876249 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:24.876217    2557 generic.go:356] "Generic (PLEG): container finished" podID="08d07b7d-b388-4ea2-904a-90f39a9079ef" containerID="aaac6f4aa59439584708d169dd057481ce36f2ba440eea9665ab7563d38026fd" exitCode=0
Jul 27 20:55:24.876636 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:24.876302    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7247-139727817193776" event={"ID":"08d07b7d-b388-4ea2-904a-90f39a9079ef","Type":"ContainerDied","Data":"aaac6f4aa59439584708d169dd057481ce36f2ba440eea9665ab7563d38026fd"}
Jul 27 20:55:24.876636 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:24.876339    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7247-139727817193776" event={"ID":"08d07b7d-b388-4ea2-904a-90f39a9079ef","Type":"ContainerStarted","Data":"b6973967cd957d7f76304eda247a641c86da68484ecd228bf321c8ba4dbe76e8"}
Jul 27 20:55:26.013511 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:26.013487    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7247-139727817193776"
Jul 27 20:55:26.044126 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:26.044098    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7247-139727817193776_08d07b7d-b388-4ea2-904a-90f39a9079ef/test-curl-7247-139727817193776/0.log"
Jul 27 20:55:26.087390 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:26.087362    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7247-139727817193776"]
Jul 27 20:55:26.113950 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:26.113926    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7247-139727817193776"]
Jul 27 20:55:26.140891 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:26.140835    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pg5kq\" (UniqueName: \"kubernetes.io/projected/08d07b7d-b388-4ea2-904a-90f39a9079ef-kube-api-access-pg5kq\") pod \"08d07b7d-b388-4ea2-904a-90f39a9079ef\" (UID: \"08d07b7d-b388-4ea2-904a-90f39a9079ef\") "
Jul 27 20:55:26.143007 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:26.142979    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08d07b7d-b388-4ea2-904a-90f39a9079ef-kube-api-access-pg5kq" (OuterVolumeSpecName: "kube-api-access-pg5kq") pod "08d07b7d-b388-4ea2-904a-90f39a9079ef" (UID: "08d07b7d-b388-4ea2-904a-90f39a9079ef"). InnerVolumeSpecName "kube-api-access-pg5kq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:55:26.238704 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:26.238669    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7247-139727817193904"]
Jul 27 20:55:26.239044 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:26.239030    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08d07b7d-b388-4ea2-904a-90f39a9079ef" containerName="test-curl-7247-139727817193776"
Jul 27 20:55:26.239090 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:26.239045    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="08d07b7d-b388-4ea2-904a-90f39a9079ef" containerName="test-curl-7247-139727817193776"
Jul 27 20:55:26.239130 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:26.239112    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="08d07b7d-b388-4ea2-904a-90f39a9079ef" containerName="test-curl-7247-139727817193776"
Jul 27 20:55:26.241866 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:26.241844    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pg5kq\" (UniqueName: \"kubernetes.io/projected/08d07b7d-b388-4ea2-904a-90f39a9079ef-kube-api-access-pg5kq\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:55:26.242176 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:26.242161    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7247-139727817193904"
Jul 27 20:55:26.249239 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:26.249184    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7247-139727817193904"]
Jul 27 20:55:26.342376 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:26.342333    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vss87\" (UniqueName: \"kubernetes.io/projected/4d2d8d3b-2f0b-4b04-a7c2-238984fc73f9-kube-api-access-vss87\") pod \"test-curl-7247-139727817193904\" (UID: \"4d2d8d3b-2f0b-4b04-a7c2-238984fc73f9\") " pod="opendatahub/test-curl-7247-139727817193904"
Jul 27 20:55:26.443015 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:26.442914    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vss87\" (UniqueName: \"kubernetes.io/projected/4d2d8d3b-2f0b-4b04-a7c2-238984fc73f9-kube-api-access-vss87\") pod \"test-curl-7247-139727817193904\" (UID: \"4d2d8d3b-2f0b-4b04-a7c2-238984fc73f9\") " pod="opendatahub/test-curl-7247-139727817193904"
Jul 27 20:55:26.451676 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:26.451650    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vss87\" (UniqueName: \"kubernetes.io/projected/4d2d8d3b-2f0b-4b04-a7c2-238984fc73f9-kube-api-access-vss87\") pod \"test-curl-7247-139727817193904\" (UID: \"4d2d8d3b-2f0b-4b04-a7c2-238984fc73f9\") " pod="opendatahub/test-curl-7247-139727817193904"
Jul 27 20:55:26.551909 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:26.551867    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7247-139727817193904"
Jul 27 20:55:26.686938 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:26.686896    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7247-139727817193904"]
Jul 27 20:55:26.689220 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:55:26.689181    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4d2d8d3b_2f0b_4b04_a7c2_238984fc73f9.slice/crio-e956ce13515a5d567078ed6a10d4dd9d949f86b5706428681b16f1a10f5d3ef5 WatchSource:0}: Error finding container e956ce13515a5d567078ed6a10d4dd9d949f86b5706428681b16f1a10f5d3ef5: Status 404 returned error can't find the container with id e956ce13515a5d567078ed6a10d4dd9d949f86b5706428681b16f1a10f5d3ef5
Jul 27 20:55:26.887486 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:26.887440    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7247-139727817193776"
Jul 27 20:55:26.887486 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:26.887446    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b6973967cd957d7f76304eda247a641c86da68484ecd228bf321c8ba4dbe76e8"
Jul 27 20:55:26.888664 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:26.888640    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7247-139727817193904" event={"ID":"4d2d8d3b-2f0b-4b04-a7c2-238984fc73f9","Type":"ContainerStarted","Data":"e956ce13515a5d567078ed6a10d4dd9d949f86b5706428681b16f1a10f5d3ef5"}
Jul 27 20:55:26.898237 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:55:26.898212    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7247-139727817193776\" is forbidden: User \"system:node:ip-10-0-128-149.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-149.ec2.internal' and this object" podUID="08d07b7d-b388-4ea2-904a-90f39a9079ef" pod="opendatahub/test-curl-7247-139727817193776"
Jul 27 20:55:27.895510 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:27.895470    2557 generic.go:356] "Generic (PLEG): container finished" podID="4d2d8d3b-2f0b-4b04-a7c2-238984fc73f9" containerID="b5f75d0a4c61b0fa4e4fb526f5405c7402ba900e9acb14fef73cdbb8bd4efa98" exitCode=0
Jul 27 20:55:27.895991 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:27.895549    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7247-139727817193904" event={"ID":"4d2d8d3b-2f0b-4b04-a7c2-238984fc73f9","Type":"ContainerDied","Data":"b5f75d0a4c61b0fa4e4fb526f5405c7402ba900e9acb14fef73cdbb8bd4efa98"}
Jul 27 20:55:27.897724 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:55:27.897702    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7247-139727817193776\" is forbidden: User \"system:node:ip-10-0-128-149.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-149.ec2.internal' and this object" podUID="08d07b7d-b388-4ea2-904a-90f39a9079ef" pod="opendatahub/test-curl-7247-139727817193776"
Jul 27 20:55:27.910377 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:27.910349    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08d07b7d-b388-4ea2-904a-90f39a9079ef" path="/var/lib/kubelet/pods/08d07b7d-b388-4ea2-904a-90f39a9079ef/volumes"
Jul 27 20:55:29.036923 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:29.036892    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7247-139727817193904"
Jul 27 20:55:29.059773 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:29.059743    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7247-139727817193904_4d2d8d3b-2f0b-4b04-a7c2-238984fc73f9/test-curl-7247-139727817193904/0.log"
Jul 27 20:55:29.087233 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:29.087204    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7247-139727817193904"]
Jul 27 20:55:29.090254 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:29.090234    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7247-139727817193904"]
Jul 27 20:55:29.166412 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:29.166323    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vss87\" (UniqueName: \"kubernetes.io/projected/4d2d8d3b-2f0b-4b04-a7c2-238984fc73f9-kube-api-access-vss87\") pod \"4d2d8d3b-2f0b-4b04-a7c2-238984fc73f9\" (UID: \"4d2d8d3b-2f0b-4b04-a7c2-238984fc73f9\") "
Jul 27 20:55:29.168473 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:29.168425    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d2d8d3b-2f0b-4b04-a7c2-238984fc73f9-kube-api-access-vss87" (OuterVolumeSpecName: "kube-api-access-vss87") pod "4d2d8d3b-2f0b-4b04-a7c2-238984fc73f9" (UID: "4d2d8d3b-2f0b-4b04-a7c2-238984fc73f9"). InnerVolumeSpecName "kube-api-access-vss87". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:55:29.252656 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:29.252617    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7247-139727817291792"]
Jul 27 20:55:29.252999 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:29.252986    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d2d8d3b-2f0b-4b04-a7c2-238984fc73f9" containerName="test-curl-7247-139727817193904"
Jul 27 20:55:29.253051 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:29.253000    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d2d8d3b-2f0b-4b04-a7c2-238984fc73f9" containerName="test-curl-7247-139727817193904"
Jul 27 20:55:29.253093 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:29.253069    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d2d8d3b-2f0b-4b04-a7c2-238984fc73f9" containerName="test-curl-7247-139727817193904"
Jul 27 20:55:29.256136 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:29.256120    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7247-139727817291792"
Jul 27 20:55:29.263756 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:29.263709    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7247-139727817291792"]
Jul 27 20:55:29.267369 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:29.267340    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vss87\" (UniqueName: \"kubernetes.io/projected/4d2d8d3b-2f0b-4b04-a7c2-238984fc73f9-kube-api-access-vss87\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:55:29.368548 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:29.368513    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h566b\" (UniqueName: \"kubernetes.io/projected/cff84acf-7e2e-42e8-92a4-3b7af4f36292-kube-api-access-h566b\") pod \"test-curl-7247-139727817291792\" (UID: \"cff84acf-7e2e-42e8-92a4-3b7af4f36292\") " pod="opendatahub/test-curl-7247-139727817291792"
Jul 27 20:55:29.469860 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:29.469775    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h566b\" (UniqueName: \"kubernetes.io/projected/cff84acf-7e2e-42e8-92a4-3b7af4f36292-kube-api-access-h566b\") pod \"test-curl-7247-139727817291792\" (UID: \"cff84acf-7e2e-42e8-92a4-3b7af4f36292\") " pod="opendatahub/test-curl-7247-139727817291792"
Jul 27 20:55:29.478202 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:29.478179    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h566b\" (UniqueName: \"kubernetes.io/projected/cff84acf-7e2e-42e8-92a4-3b7af4f36292-kube-api-access-h566b\") pod \"test-curl-7247-139727817291792\" (UID: \"cff84acf-7e2e-42e8-92a4-3b7af4f36292\") " pod="opendatahub/test-curl-7247-139727817291792"
Jul 27 20:55:29.567466 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:29.567425    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7247-139727817291792"
Jul 27 20:55:29.699565 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:29.699539    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7247-139727817291792"]
Jul 27 20:55:29.700970 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:55:29.700926    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcff84acf_7e2e_42e8_92a4_3b7af4f36292.slice/crio-4fdb32f6d464b2968a5e2f84a508f374c9e24b808094108ea1cf11992ae615ee WatchSource:0}: Error finding container 4fdb32f6d464b2968a5e2f84a508f374c9e24b808094108ea1cf11992ae615ee: Status 404 returned error can't find the container with id 4fdb32f6d464b2968a5e2f84a508f374c9e24b808094108ea1cf11992ae615ee
Jul 27 20:55:29.901987 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:29.901950    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:55:29.911024 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:29.910998    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7247-139727817193904"
Jul 27 20:55:29.912717 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:29.912693    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d2d8d3b-2f0b-4b04-a7c2-238984fc73f9" path="/var/lib/kubelet/pods/4d2d8d3b-2f0b-4b04-a7c2-238984fc73f9/volumes"
Jul 27 20:55:29.913027 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:29.913012    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7247-139727817291792" event={"ID":"cff84acf-7e2e-42e8-92a4-3b7af4f36292","Type":"ContainerStarted","Data":"4fdb32f6d464b2968a5e2f84a508f374c9e24b808094108ea1cf11992ae615ee"}
Jul 27 20:55:29.913075 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:29.913046    2557 scope.go:117] "RemoveContainer" containerID="b5f75d0a4c61b0fa4e4fb526f5405c7402ba900e9acb14fef73cdbb8bd4efa98"
Jul 27 20:55:30.918332 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:30.918296    2557 generic.go:356] "Generic (PLEG): container finished" podID="cff84acf-7e2e-42e8-92a4-3b7af4f36292" containerID="2ebc1313e6d8c2a58cc217b413653e75831466a600f2a9b6c35d241e572d595e" exitCode=0
Jul 27 20:55:30.918829 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:30.918380    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7247-139727817291792" event={"ID":"cff84acf-7e2e-42e8-92a4-3b7af4f36292","Type":"ContainerDied","Data":"2ebc1313e6d8c2a58cc217b413653e75831466a600f2a9b6c35d241e572d595e"}
Jul 27 20:55:32.049098 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:32.049073    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7247-139727817291792"
Jul 27 20:55:32.069504 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:32.069480    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7247-139727817291792_cff84acf-7e2e-42e8-92a4-3b7af4f36292/test-curl-7247-139727817291792/0.log"
Jul 27 20:55:32.098065 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:32.098038    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7247-139727817291792"]
Jul 27 20:55:32.101164 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:32.101133    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7247-139727817291792"]
Jul 27 20:55:32.193917 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:32.193829    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h566b\" (UniqueName: \"kubernetes.io/projected/cff84acf-7e2e-42e8-92a4-3b7af4f36292-kube-api-access-h566b\") pod \"cff84acf-7e2e-42e8-92a4-3b7af4f36292\" (UID: \"cff84acf-7e2e-42e8-92a4-3b7af4f36292\") "
Jul 27 20:55:32.195862 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:32.195834    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cff84acf-7e2e-42e8-92a4-3b7af4f36292-kube-api-access-h566b" (OuterVolumeSpecName: "kube-api-access-h566b") pod "cff84acf-7e2e-42e8-92a4-3b7af4f36292" (UID: "cff84acf-7e2e-42e8-92a4-3b7af4f36292"). InnerVolumeSpecName "kube-api-access-h566b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:55:32.294853 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:32.294798    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h566b\" (UniqueName: \"kubernetes.io/projected/cff84acf-7e2e-42e8-92a4-3b7af4f36292-kube-api-access-h566b\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:55:32.930869 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:32.930841    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7247-139727817291792"
Jul 27 20:55:32.931050 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:32.930848    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4fdb32f6d464b2968a5e2f84a508f374c9e24b808094108ea1cf11992ae615ee"
Jul 27 20:55:32.940759 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:55:32.940727    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7247-139727817291792\" is forbidden: User \"system:node:ip-10-0-128-149.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-149.ec2.internal' and this object" podUID="cff84acf-7e2e-42e8-92a4-3b7af4f36292" pod="opendatahub/test-curl-7247-139727817291792"
Jul 27 20:55:33.911178 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:33.911145    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cff84acf-7e2e-42e8-92a4-3b7af4f36292" path="/var/lib/kubelet/pods/cff84acf-7e2e-42e8-92a4-3b7af4f36292/volumes"
Jul 27 20:55:36.514899 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:36.514848    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-4af3f5/rate-test-model-4af3f5-kserve-5c95bfd547-xq5rk" podUID="254e7c23-2397-458b-943e-3b00882e0557" containerName="main" containerID="cri-o://ce030964b86f3e726999e481df434f3cc4fcf6109f5642d2e2c22bc5e177e79c" gracePeriod=45
Jul 27 20:55:36.785797 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:36.785771    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4af3f5/rate-test-model-4af3f5-kserve-5c95bfd547-xq5rk"
Jul 27 20:55:36.834740 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:36.834705    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/254e7c23-2397-458b-943e-3b00882e0557-model-cache\") pod \"254e7c23-2397-458b-943e-3b00882e0557\" (UID: \"254e7c23-2397-458b-943e-3b00882e0557\") "
Jul 27 20:55:36.834924 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:36.834752    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/254e7c23-2397-458b-943e-3b00882e0557-home\") pod \"254e7c23-2397-458b-943e-3b00882e0557\" (UID: \"254e7c23-2397-458b-943e-3b00882e0557\") "
Jul 27 20:55:36.834924 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:36.834788    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/254e7c23-2397-458b-943e-3b00882e0557-dshm\") pod \"254e7c23-2397-458b-943e-3b00882e0557\" (UID: \"254e7c23-2397-458b-943e-3b00882e0557\") "
Jul 27 20:55:36.834924 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:36.834807    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/254e7c23-2397-458b-943e-3b00882e0557-tmp-dir\") pod \"254e7c23-2397-458b-943e-3b00882e0557\" (UID: \"254e7c23-2397-458b-943e-3b00882e0557\") "
Jul 27 20:55:36.834924 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:36.834829    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/254e7c23-2397-458b-943e-3b00882e0557-tls-certs\") pod \"254e7c23-2397-458b-943e-3b00882e0557\" (UID: \"254e7c23-2397-458b-943e-3b00882e0557\") "
Jul 27 20:55:36.834924 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:36.834850    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q2dlw\" (UniqueName: \"kubernetes.io/projected/254e7c23-2397-458b-943e-3b00882e0557-kube-api-access-q2dlw\") pod \"254e7c23-2397-458b-943e-3b00882e0557\" (UID: \"254e7c23-2397-458b-943e-3b00882e0557\") "
Jul 27 20:55:36.835178 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:36.835012    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/254e7c23-2397-458b-943e-3b00882e0557-model-cache" (OuterVolumeSpecName: "model-cache") pod "254e7c23-2397-458b-943e-3b00882e0557" (UID: "254e7c23-2397-458b-943e-3b00882e0557"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:55:36.835178 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:36.835091    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/254e7c23-2397-458b-943e-3b00882e0557-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "254e7c23-2397-458b-943e-3b00882e0557" (UID: "254e7c23-2397-458b-943e-3b00882e0557"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:55:36.835178 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:36.835104    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/254e7c23-2397-458b-943e-3b00882e0557-home" (OuterVolumeSpecName: "home") pod "254e7c23-2397-458b-943e-3b00882e0557" (UID: "254e7c23-2397-458b-943e-3b00882e0557"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:55:36.836986 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:36.836962    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/254e7c23-2397-458b-943e-3b00882e0557-dshm" (OuterVolumeSpecName: "dshm") pod "254e7c23-2397-458b-943e-3b00882e0557" (UID: "254e7c23-2397-458b-943e-3b00882e0557"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:55:36.837060 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:36.837014    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/254e7c23-2397-458b-943e-3b00882e0557-kube-api-access-q2dlw" (OuterVolumeSpecName: "kube-api-access-q2dlw") pod "254e7c23-2397-458b-943e-3b00882e0557" (UID: "254e7c23-2397-458b-943e-3b00882e0557"). InnerVolumeSpecName "kube-api-access-q2dlw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:55:36.837106 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:36.837070    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/254e7c23-2397-458b-943e-3b00882e0557-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "254e7c23-2397-458b-943e-3b00882e0557" (UID: "254e7c23-2397-458b-943e-3b00882e0557"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:55:36.935782 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:36.935728    2557 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/254e7c23-2397-458b-943e-3b00882e0557-model-cache\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:55:36.935782 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:36.935773    2557 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/254e7c23-2397-458b-943e-3b00882e0557-home\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:55:36.935782 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:36.935781    2557 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/254e7c23-2397-458b-943e-3b00882e0557-dshm\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:55:36.936040 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:36.935812    2557 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/254e7c23-2397-458b-943e-3b00882e0557-tmp-dir\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:55:36.936040 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:36.935820    2557 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/254e7c23-2397-458b-943e-3b00882e0557-tls-certs\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:55:36.936040 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:36.935829    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q2dlw\" (UniqueName: \"kubernetes.io/projected/254e7c23-2397-458b-943e-3b00882e0557-kube-api-access-q2dlw\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:55:36.953649 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:36.953614    2557 generic.go:356] "Generic (PLEG): container finished" podID="254e7c23-2397-458b-943e-3b00882e0557" containerID="ce030964b86f3e726999e481df434f3cc4fcf6109f5642d2e2c22bc5e177e79c" exitCode=0
Jul 27 20:55:36.953779 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:36.953664    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4af3f5/rate-test-model-4af3f5-kserve-5c95bfd547-xq5rk"
Jul 27 20:55:36.953779 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:36.953691    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4af3f5/rate-test-model-4af3f5-kserve-5c95bfd547-xq5rk" event={"ID":"254e7c23-2397-458b-943e-3b00882e0557","Type":"ContainerDied","Data":"ce030964b86f3e726999e481df434f3cc4fcf6109f5642d2e2c22bc5e177e79c"}
Jul 27 20:55:36.953779 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:36.953739    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4af3f5/rate-test-model-4af3f5-kserve-5c95bfd547-xq5rk" event={"ID":"254e7c23-2397-458b-943e-3b00882e0557","Type":"ContainerDied","Data":"b0823bd1e32d7b4f8adf4afd07fcff74b920c444edfa0fa5766be600435a3482"}
Jul 27 20:55:36.953779 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:36.953759    2557 scope.go:117] "RemoveContainer" containerID="ce030964b86f3e726999e481df434f3cc4fcf6109f5642d2e2c22bc5e177e79c"
Jul 27 20:55:36.963576 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:36.963558    2557 scope.go:117] "RemoveContainer" containerID="ce030964b86f3e726999e481df434f3cc4fcf6109f5642d2e2c22bc5e177e79c"
Jul 27 20:55:36.963823 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:55:36.963806    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce030964b86f3e726999e481df434f3cc4fcf6109f5642d2e2c22bc5e177e79c\": container with ID starting with ce030964b86f3e726999e481df434f3cc4fcf6109f5642d2e2c22bc5e177e79c not found: ID does not exist" containerID="ce030964b86f3e726999e481df434f3cc4fcf6109f5642d2e2c22bc5e177e79c"
Jul 27 20:55:36.963891 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:36.963835    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce030964b86f3e726999e481df434f3cc4fcf6109f5642d2e2c22bc5e177e79c"} err="failed to get container status \"ce030964b86f3e726999e481df434f3cc4fcf6109f5642d2e2c22bc5e177e79c\": rpc error: code = NotFound desc = could not find container \"ce030964b86f3e726999e481df434f3cc4fcf6109f5642d2e2c22bc5e177e79c\": container with ID starting with ce030964b86f3e726999e481df434f3cc4fcf6109f5642d2e2c22bc5e177e79c not found: ID does not exist"
Jul 27 20:55:36.975023 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:36.975000    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-4af3f5/rate-test-model-4af3f5-kserve-5c95bfd547-xq5rk"]
Jul 27 20:55:36.981332 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:36.981307    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-4af3f5/rate-test-model-4af3f5-kserve-5c95bfd547-xq5rk"]
Jul 27 20:55:37.910945 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:37.910901    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="254e7c23-2397-458b-943e-3b00882e0557" path="/var/lib/kubelet/pods/254e7c23-2397-458b-943e-3b00882e0557/volumes"
Jul 27 20:55:38.844545 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:38.844512    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7247-139727817292800"]
Jul 27 20:55:38.844895 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:38.844884    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="254e7c23-2397-458b-943e-3b00882e0557" containerName="main"
Jul 27 20:55:38.845001 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:38.844896    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="254e7c23-2397-458b-943e-3b00882e0557" containerName="main"
Jul 27 20:55:38.845001 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:38.844904    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cff84acf-7e2e-42e8-92a4-3b7af4f36292" containerName="test-curl-7247-139727817291792"
Jul 27 20:55:38.845001 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:38.844910    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="cff84acf-7e2e-42e8-92a4-3b7af4f36292" containerName="test-curl-7247-139727817291792"
Jul 27 20:55:38.845001 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:38.844966    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="254e7c23-2397-458b-943e-3b00882e0557" containerName="main"
Jul 27 20:55:38.845001 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:38.844974    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="cff84acf-7e2e-42e8-92a4-3b7af4f36292" containerName="test-curl-7247-139727817291792"
Jul 27 20:55:38.849372 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:38.849344    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7247-139727817292800"
Jul 27 20:55:38.851808 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:38.851781    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-dndv7\""
Jul 27 20:55:38.852638 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:38.852612    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7247-139727817292800"]
Jul 27 20:55:38.949624 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:38.949596    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9sm6\" (UniqueName: \"kubernetes.io/projected/19890402-5272-4831-aefe-85666ad0febd-kube-api-access-b9sm6\") pod \"test-curl-7247-139727817292800\" (UID: \"19890402-5272-4831-aefe-85666ad0febd\") " pod="opendatahub/test-curl-7247-139727817292800"
Jul 27 20:55:39.050401 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:39.050360    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9sm6\" (UniqueName: \"kubernetes.io/projected/19890402-5272-4831-aefe-85666ad0febd-kube-api-access-b9sm6\") pod \"test-curl-7247-139727817292800\" (UID: \"19890402-5272-4831-aefe-85666ad0febd\") " pod="opendatahub/test-curl-7247-139727817292800"
Jul 27 20:55:39.060964 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:39.060931    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9sm6\" (UniqueName: \"kubernetes.io/projected/19890402-5272-4831-aefe-85666ad0febd-kube-api-access-b9sm6\") pod \"test-curl-7247-139727817292800\" (UID: \"19890402-5272-4831-aefe-85666ad0febd\") " pod="opendatahub/test-curl-7247-139727817292800"
Jul 27 20:55:39.160322 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:39.160229    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7247-139727817292800"
Jul 27 20:55:39.295603 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:39.295578    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7247-139727817292800"]
Jul 27 20:55:39.297924 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:55:39.297890    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod19890402_5272_4831_aefe_85666ad0febd.slice/crio-e1b1c0384baf32b9b774bf35b2b5f263f8cb81ac0f9520af7678a98015d6427f WatchSource:0}: Error finding container e1b1c0384baf32b9b774bf35b2b5f263f8cb81ac0f9520af7678a98015d6427f: Status 404 returned error can't find the container with id e1b1c0384baf32b9b774bf35b2b5f263f8cb81ac0f9520af7678a98015d6427f
Jul 27 20:55:39.974479 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:39.974372    2557 generic.go:356] "Generic (PLEG): container finished" podID="19890402-5272-4831-aefe-85666ad0febd" containerID="b0c784911ff0220aa8a3c3879435ab4f6d670e22395ce775d08a3b58311dc537" exitCode=0
Jul 27 20:55:39.974878 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:39.974474    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7247-139727817292800" event={"ID":"19890402-5272-4831-aefe-85666ad0febd","Type":"ContainerDied","Data":"b0c784911ff0220aa8a3c3879435ab4f6d670e22395ce775d08a3b58311dc537"}
Jul 27 20:55:39.974878 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:39.974515    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7247-139727817292800" event={"ID":"19890402-5272-4831-aefe-85666ad0febd","Type":"ContainerStarted","Data":"e1b1c0384baf32b9b774bf35b2b5f263f8cb81ac0f9520af7678a98015d6427f"}
Jul 27 20:55:41.119737 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:41.119708    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7247-139727817292800"
Jul 27 20:55:41.141733 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:41.141704    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7247-139727817292800_19890402-5272-4831-aefe-85666ad0febd/test-curl-7247-139727817292800/0.log"
Jul 27 20:55:41.163929 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:41.163889    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b9sm6\" (UniqueName: \"kubernetes.io/projected/19890402-5272-4831-aefe-85666ad0febd-kube-api-access-b9sm6\") pod \"19890402-5272-4831-aefe-85666ad0febd\" (UID: \"19890402-5272-4831-aefe-85666ad0febd\") "
Jul 27 20:55:41.165332 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:41.165305    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7247-139727817292800"]
Jul 27 20:55:41.165889 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:41.165866    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19890402-5272-4831-aefe-85666ad0febd-kube-api-access-b9sm6" (OuterVolumeSpecName: "kube-api-access-b9sm6") pod "19890402-5272-4831-aefe-85666ad0febd" (UID: "19890402-5272-4831-aefe-85666ad0febd"). InnerVolumeSpecName "kube-api-access-b9sm6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:55:41.172629 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:41.172601    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7247-139727817292800"]
Jul 27 20:55:41.264668 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:41.264581    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b9sm6\" (UniqueName: \"kubernetes.io/projected/19890402-5272-4831-aefe-85666ad0febd-kube-api-access-b9sm6\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:55:41.669877 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:41.669793    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:55:41.910739 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:41.910706    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19890402-5272-4831-aefe-85666ad0febd" path="/var/lib/kubelet/pods/19890402-5272-4831-aefe-85666ad0febd/volumes"
Jul 27 20:55:41.979526 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:41.979495    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:55:41.988142 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:41.988114    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7247-139727817292800"
Jul 27 20:55:41.988142 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:41.988128    2557 scope.go:117] "RemoveContainer" containerID="b0c784911ff0220aa8a3c3879435ab4f6d670e22395ce775d08a3b58311dc537"
Jul 27 20:55:42.080002 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:42.079957    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:55:44.532966 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:44.532935    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:55:44.633710 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:44.633682    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:55:44.734585 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:44.734555    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:55:44.834260 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:44.834175    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:55:45.185517 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:45.185372    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:55:45.286230 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:45.286185    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:55:45.287749 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:45.287726    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-366a10-567889455b-6vf8q"]
Jul 27 20:55:45.288112 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:45.288096    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19890402-5272-4831-aefe-85666ad0febd" containerName="test-curl-7247-139727817292800"
Jul 27 20:55:45.288157 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:45.288114    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="19890402-5272-4831-aefe-85666ad0febd" containerName="test-curl-7247-139727817292800"
Jul 27 20:55:45.288199 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:45.288192    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="19890402-5272-4831-aefe-85666ad0febd" containerName="test-curl-7247-139727817292800"
Jul 27 20:55:45.292660 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:45.292646    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-366a10-567889455b-6vf8q"
Jul 27 20:55:45.295794 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:45.295665    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-366a10\""
Jul 27 20:55:45.295794 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:45.295774    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-366a10-dockercfg-tcgzb\""
Jul 27 20:55:45.303364 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:45.303339    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-366a10-567889455b-6vf8q"]
Jul 27 20:55:45.322970 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:45.322945    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-366a10-7cfb65599b-qzg27"]
Jul 27 20:55:45.326142 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:45.326126    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-366a10-7cfb65599b-qzg27"
Jul 27 20:55:45.336743 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:45.336720    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-366a10-7cfb65599b-qzg27"]
Jul 27 20:55:45.396853 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:45.396816    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/94a0ba0a-4d58-428c-a073-c619bed27983-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-366a10-7cfb65599b-qzg27\" (UID: \"94a0ba0a-4d58-428c-a073-c619bed27983\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-366a10-7cfb65599b-qzg27"
Jul 27 20:55:45.397034 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:45.396862    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea10604d-0d32-4c48-96bd-e460f921d39c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-366a10-567889455b-6vf8q\" (UID: \"ea10604d-0d32-4c48-96bd-e460f921d39c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-366a10-567889455b-6vf8q"
Jul 27 20:55:45.397034 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:45.396999    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgqjp\" (UniqueName: \"kubernetes.io/projected/ea10604d-0d32-4c48-96bd-e460f921d39c-kube-api-access-kgqjp\") pod \"payload-pre-processing-e2e-ipp-a-366a10-567889455b-6vf8q\" (UID: \"ea10604d-0d32-4c48-96bd-e460f921d39c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-366a10-567889455b-6vf8q"
Jul 27 20:55:45.397034 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:45.397026    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ws6dm\" (UniqueName: \"kubernetes.io/projected/94a0ba0a-4d58-428c-a073-c619bed27983-kube-api-access-ws6dm\") pod \"payload-processing-e2e-ipp-a-366a10-7cfb65599b-qzg27\" (UID: \"94a0ba0a-4d58-428c-a073-c619bed27983\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-366a10-7cfb65599b-qzg27"
Jul 27 20:55:45.498361 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:45.498317    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgqjp\" (UniqueName: \"kubernetes.io/projected/ea10604d-0d32-4c48-96bd-e460f921d39c-kube-api-access-kgqjp\") pod \"payload-pre-processing-e2e-ipp-a-366a10-567889455b-6vf8q\" (UID: \"ea10604d-0d32-4c48-96bd-e460f921d39c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-366a10-567889455b-6vf8q"
Jul 27 20:55:45.498361 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:45.498357    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ws6dm\" (UniqueName: \"kubernetes.io/projected/94a0ba0a-4d58-428c-a073-c619bed27983-kube-api-access-ws6dm\") pod \"payload-processing-e2e-ipp-a-366a10-7cfb65599b-qzg27\" (UID: \"94a0ba0a-4d58-428c-a073-c619bed27983\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-366a10-7cfb65599b-qzg27"
Jul 27 20:55:45.498634 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:45.498506    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/94a0ba0a-4d58-428c-a073-c619bed27983-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-366a10-7cfb65599b-qzg27\" (UID: \"94a0ba0a-4d58-428c-a073-c619bed27983\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-366a10-7cfb65599b-qzg27"
Jul 27 20:55:45.498634 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:45.498566    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea10604d-0d32-4c48-96bd-e460f921d39c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-366a10-567889455b-6vf8q\" (UID: \"ea10604d-0d32-4c48-96bd-e460f921d39c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-366a10-567889455b-6vf8q"
Jul 27 20:55:45.499521 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:45.499496    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/94a0ba0a-4d58-428c-a073-c619bed27983-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-366a10-7cfb65599b-qzg27\" (UID: \"94a0ba0a-4d58-428c-a073-c619bed27983\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-366a10-7cfb65599b-qzg27"
Jul 27 20:55:45.499583 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:45.499496    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea10604d-0d32-4c48-96bd-e460f921d39c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-366a10-567889455b-6vf8q\" (UID: \"ea10604d-0d32-4c48-96bd-e460f921d39c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-366a10-567889455b-6vf8q"
Jul 27 20:55:45.507559 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:45.507530    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgqjp\" (UniqueName: \"kubernetes.io/projected/ea10604d-0d32-4c48-96bd-e460f921d39c-kube-api-access-kgqjp\") pod \"payload-pre-processing-e2e-ipp-a-366a10-567889455b-6vf8q\" (UID: \"ea10604d-0d32-4c48-96bd-e460f921d39c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-366a10-567889455b-6vf8q"
Jul 27 20:55:45.507683 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:45.507602    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ws6dm\" (UniqueName: \"kubernetes.io/projected/94a0ba0a-4d58-428c-a073-c619bed27983-kube-api-access-ws6dm\") pod \"payload-processing-e2e-ipp-a-366a10-7cfb65599b-qzg27\" (UID: \"94a0ba0a-4d58-428c-a073-c619bed27983\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-366a10-7cfb65599b-qzg27"
Jul 27 20:55:45.608646 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:45.608589    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-366a10-567889455b-6vf8q"
Jul 27 20:55:45.636876 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:45.636844    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-366a10-7cfb65599b-qzg27"
Jul 27 20:55:45.823826 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:45.823709    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-366a10-7cfb65599b-qzg27"]
Jul 27 20:55:45.826623 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:55:45.826587    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94a0ba0a_4d58_428c_a073_c619bed27983.slice/crio-a78d7f59935ea5da452c9cc6201eeba9941d90b2b3521745e31cc40d97f36b8b WatchSource:0}: Error finding container a78d7f59935ea5da452c9cc6201eeba9941d90b2b3521745e31cc40d97f36b8b: Status 404 returned error can't find the container with id a78d7f59935ea5da452c9cc6201eeba9941d90b2b3521745e31cc40d97f36b8b
Jul 27 20:55:45.984146 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:45.984119    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-366a10-567889455b-6vf8q"]
Jul 27 20:55:45.986423 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:55:45.986395    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea10604d_0d32_4c48_96bd_e460f921d39c.slice/crio-95f4cc771d78c2c418f4efd1a1f62d57b06d372593f031af72d3bcd7be949bce WatchSource:0}: Error finding container 95f4cc771d78c2c418f4efd1a1f62d57b06d372593f031af72d3bcd7be949bce: Status 404 returned error can't find the container with id 95f4cc771d78c2c418f4efd1a1f62d57b06d372593f031af72d3bcd7be949bce
Jul 27 20:55:46.013076 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:46.013017    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-366a10-567889455b-6vf8q" event={"ID":"ea10604d-0d32-4c48-96bd-e460f921d39c","Type":"ContainerStarted","Data":"95f4cc771d78c2c418f4efd1a1f62d57b06d372593f031af72d3bcd7be949bce"}
Jul 27 20:55:46.014539 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:46.014517    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-366a10-7cfb65599b-qzg27" event={"ID":"94a0ba0a-4d58-428c-a073-c619bed27983","Type":"ContainerStarted","Data":"13baf15879c77226e4ad39dcac5c86382b5f763648117216c4174badd6efb280"}
Jul 27 20:55:46.014620 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:46.014556    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-366a10-7cfb65599b-qzg27" event={"ID":"94a0ba0a-4d58-428c-a073-c619bed27983","Type":"ContainerStarted","Data":"a78d7f59935ea5da452c9cc6201eeba9941d90b2b3521745e31cc40d97f36b8b"}
Jul 27 20:55:46.014666 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:46.014643    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-366a10-7cfb65599b-qzg27"
Jul 27 20:55:46.031591 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:46.031538    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-366a10-7cfb65599b-qzg27" podStartSLOduration=1.031520813 podStartE2EDuration="1.031520813s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:55:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:55:46.031480797 +0000 UTC m=+3094.606207185" watchObservedRunningTime="2026-07-27 20:55:46.031520813 +0000 UTC m=+3094.606247215"
Jul 27 20:55:47.022593 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:47.022565    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-366a10-567889455b-6vf8q" event={"ID":"ea10604d-0d32-4c48-96bd-e460f921d39c","Type":"ContainerStarted","Data":"c5ed8233a97959ca679c6a96f693ebedbc9958be229a02fc4fa7ecaf5b26e586"}
Jul 27 20:55:47.023002 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:47.022636    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-366a10-567889455b-6vf8q"
Jul 27 20:55:47.042682 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:47.042627    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-366a10-567889455b-6vf8q" podStartSLOduration=2.042612054 podStartE2EDuration="2.042612054s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:55:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:55:47.040239559 +0000 UTC m=+3095.614965947" watchObservedRunningTime="2026-07-27 20:55:47.042612054 +0000 UTC m=+3095.617338441"
Jul 27 20:55:49.017092 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:49.017051    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:55:52.802975 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:52.802933    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:55:57.025082 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:57.025044    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-366a10-7cfb65599b-qzg27"
Jul 27 20:55:58.030331 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:58.030297    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-366a10-567889455b-6vf8q"
Jul 27 20:55:59.971731 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:55:59.971690    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:56:00.301440 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:00.301398    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:56:00.672555 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:00.672445    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:56:03.661602 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:03.661568    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:56:03.750271 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:03.750233    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:56:03.821591 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:03.821557    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:56:04.288192 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:04.288157    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:56:04.407112 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:04.407079    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:56:04.504603 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:04.504561    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:56:04.550020 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:04.549947    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-3511f6-6f56c8d5c6-ph2cj"]
Jul 27 20:56:04.554925 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:04.554907    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-3511f6-6f56c8d5c6-ph2cj"
Jul 27 20:56:04.557371 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:04.557350    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-3511f6\""
Jul 27 20:56:04.557371 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:04.557368    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-3511f6-dockercfg-tz46x\""
Jul 27 20:56:04.563897 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:04.563875    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-3511f6-6f56c8d5c6-ph2cj"]
Jul 27 20:56:04.591738 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:04.591711    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-3511f6-65644dc98d-7dfxl"]
Jul 27 20:56:04.595161 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:04.595144    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-3511f6-65644dc98d-7dfxl"
Jul 27 20:56:04.604832 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:04.604810    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-3511f6-65644dc98d-7dfxl"]
Jul 27 20:56:04.668192 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:04.668154    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7d51386-e87b-45e6-82eb-5df4b1036908-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-3511f6-65644dc98d-7dfxl\" (UID: \"b7d51386-e87b-45e6-82eb-5df4b1036908\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-3511f6-65644dc98d-7dfxl"
Jul 27 20:56:04.668591 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:04.668216    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xq795\" (UniqueName: \"kubernetes.io/projected/c354f0d8-cc12-49c9-b924-238773cf86a4-kube-api-access-xq795\") pod \"payload-processing-e2e-ipp-b-3511f6-6f56c8d5c6-ph2cj\" (UID: \"c354f0d8-cc12-49c9-b924-238773cf86a4\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-3511f6-6f56c8d5c6-ph2cj"
Jul 27 20:56:04.668591 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:04.668289    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c354f0d8-cc12-49c9-b924-238773cf86a4-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-3511f6-6f56c8d5c6-ph2cj\" (UID: \"c354f0d8-cc12-49c9-b924-238773cf86a4\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-3511f6-6f56c8d5c6-ph2cj"
Jul 27 20:56:04.668591 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:04.668403    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfk5l\" (UniqueName: \"kubernetes.io/projected/b7d51386-e87b-45e6-82eb-5df4b1036908-kube-api-access-sfk5l\") pod \"payload-pre-processing-e2e-ipp-b-3511f6-65644dc98d-7dfxl\" (UID: \"b7d51386-e87b-45e6-82eb-5df4b1036908\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-3511f6-65644dc98d-7dfxl"
Jul 27 20:56:04.769376 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:04.769337    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7d51386-e87b-45e6-82eb-5df4b1036908-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-3511f6-65644dc98d-7dfxl\" (UID: \"b7d51386-e87b-45e6-82eb-5df4b1036908\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-3511f6-65644dc98d-7dfxl"
Jul 27 20:56:04.769622 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:04.769401    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xq795\" (UniqueName: \"kubernetes.io/projected/c354f0d8-cc12-49c9-b924-238773cf86a4-kube-api-access-xq795\") pod \"payload-processing-e2e-ipp-b-3511f6-6f56c8d5c6-ph2cj\" (UID: \"c354f0d8-cc12-49c9-b924-238773cf86a4\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-3511f6-6f56c8d5c6-ph2cj"
Jul 27 20:56:04.769622 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:04.769439    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c354f0d8-cc12-49c9-b924-238773cf86a4-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-3511f6-6f56c8d5c6-ph2cj\" (UID: \"c354f0d8-cc12-49c9-b924-238773cf86a4\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-3511f6-6f56c8d5c6-ph2cj"
Jul 27 20:56:04.769622 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:04.769556    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfk5l\" (UniqueName: \"kubernetes.io/projected/b7d51386-e87b-45e6-82eb-5df4b1036908-kube-api-access-sfk5l\") pod \"payload-pre-processing-e2e-ipp-b-3511f6-65644dc98d-7dfxl\" (UID: \"b7d51386-e87b-45e6-82eb-5df4b1036908\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-3511f6-65644dc98d-7dfxl"
Jul 27 20:56:04.770351 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:04.770325    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c354f0d8-cc12-49c9-b924-238773cf86a4-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-3511f6-6f56c8d5c6-ph2cj\" (UID: \"c354f0d8-cc12-49c9-b924-238773cf86a4\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-3511f6-6f56c8d5c6-ph2cj"
Jul 27 20:56:04.770434 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:04.770325    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7d51386-e87b-45e6-82eb-5df4b1036908-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-3511f6-65644dc98d-7dfxl\" (UID: \"b7d51386-e87b-45e6-82eb-5df4b1036908\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-3511f6-65644dc98d-7dfxl"
Jul 27 20:56:04.777672 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:04.777647    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xq795\" (UniqueName: \"kubernetes.io/projected/c354f0d8-cc12-49c9-b924-238773cf86a4-kube-api-access-xq795\") pod \"payload-processing-e2e-ipp-b-3511f6-6f56c8d5c6-ph2cj\" (UID: \"c354f0d8-cc12-49c9-b924-238773cf86a4\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-3511f6-6f56c8d5c6-ph2cj"
Jul 27 20:56:04.777792 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:04.777684    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfk5l\" (UniqueName: \"kubernetes.io/projected/b7d51386-e87b-45e6-82eb-5df4b1036908-kube-api-access-sfk5l\") pod \"payload-pre-processing-e2e-ipp-b-3511f6-65644dc98d-7dfxl\" (UID: \"b7d51386-e87b-45e6-82eb-5df4b1036908\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-3511f6-65644dc98d-7dfxl"
Jul 27 20:56:04.867400 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:04.867307    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-3511f6-6f56c8d5c6-ph2cj"
Jul 27 20:56:04.906197 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:04.906169    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-3511f6-65644dc98d-7dfxl"
Jul 27 20:56:05.019396 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:05.018718    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-3511f6-6f56c8d5c6-ph2cj"]
Jul 27 20:56:05.021526 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:56:05.021492    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc354f0d8_cc12_49c9_b924_238773cf86a4.slice/crio-6159716ac64b0de1236e2d877f62b5e83430cb6768de3a36896c62c40f57359d WatchSource:0}: Error finding container 6159716ac64b0de1236e2d877f62b5e83430cb6768de3a36896c62c40f57359d: Status 404 returned error can't find the container with id 6159716ac64b0de1236e2d877f62b5e83430cb6768de3a36896c62c40f57359d
Jul 27 20:56:05.126913 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:05.126815    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-3511f6-6f56c8d5c6-ph2cj" event={"ID":"c354f0d8-cc12-49c9-b924-238773cf86a4","Type":"ContainerStarted","Data":"007749812a542af53779f25a585f8afeb544d7bea6b2b37bbe21c3f934143654"}
Jul 27 20:56:05.126913 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:05.126880    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-3511f6-6f56c8d5c6-ph2cj"
Jul 27 20:56:05.126913 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:05.126903    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-3511f6-6f56c8d5c6-ph2cj" event={"ID":"c354f0d8-cc12-49c9-b924-238773cf86a4","Type":"ContainerStarted","Data":"6159716ac64b0de1236e2d877f62b5e83430cb6768de3a36896c62c40f57359d"}
Jul 27 20:56:05.146404 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:05.146352    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-3511f6-6f56c8d5c6-ph2cj" podStartSLOduration=1.146337365 podStartE2EDuration="1.146337365s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:56:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:56:05.143389512 +0000 UTC m=+3113.718115921" watchObservedRunningTime="2026-07-27 20:56:05.146337365 +0000 UTC m=+3113.721063753"
Jul 27 20:56:05.266680 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:05.266655    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-3511f6-65644dc98d-7dfxl"]
Jul 27 20:56:05.268001 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:56:05.267972    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7d51386_e87b_45e6_82eb_5df4b1036908.slice/crio-dadfd7a9267d8b169deda5b31a71fdceabb665786a7145d590bcf8169d39203d WatchSource:0}: Error finding container dadfd7a9267d8b169deda5b31a71fdceabb665786a7145d590bcf8169d39203d: Status 404 returned error can't find the container with id dadfd7a9267d8b169deda5b31a71fdceabb665786a7145d590bcf8169d39203d
Jul 27 20:56:06.134947 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:06.134905    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-3511f6-65644dc98d-7dfxl" event={"ID":"b7d51386-e87b-45e6-82eb-5df4b1036908","Type":"ContainerStarted","Data":"e2fec0dc815954a32e827645191fd9cf2a04f4acc9d5d05c1b9cbde80a08981e"}
Jul 27 20:56:06.135480 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:06.134965    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-3511f6-65644dc98d-7dfxl" event={"ID":"b7d51386-e87b-45e6-82eb-5df4b1036908","Type":"ContainerStarted","Data":"dadfd7a9267d8b169deda5b31a71fdceabb665786a7145d590bcf8169d39203d"}
Jul 27 20:56:06.152563 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:06.152500    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-3511f6-65644dc98d-7dfxl" podStartSLOduration=2.152482544 podStartE2EDuration="2.152482544s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:56:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:56:06.151615722 +0000 UTC m=+3114.726342113" watchObservedRunningTime="2026-07-27 20:56:06.152482544 +0000 UTC m=+3114.727208943"
Jul 27 20:56:07.140753 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:07.140720    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-3511f6-65644dc98d-7dfxl"
Jul 27 20:56:08.201534 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:08.201501    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:56:13.697957 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:13.697921    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:56:16.137383 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:16.137350    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-3511f6-6f56c8d5c6-ph2cj"
Jul 27 20:56:18.148894 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:18.148865    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-3511f6-65644dc98d-7dfxl"
Jul 27 20:56:24.758509 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:24.758477    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:56:24.860477 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:24.860427    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:56:25.600327 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:25.600296    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-3511f6-6f56c8d5c6-ph2cj_c354f0d8-cc12-49c9-b924-238773cf86a4/payload-processing/0.log"
Jul 27 20:56:31.421913 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:31.421879    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-366a10/ipp-route-366a10-kserve-8886b5d9f-r9flh"]
Jul 27 20:56:31.425578 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:31.425554    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-366a10/ipp-route-366a10-kserve-8886b5d9f-r9flh"
Jul 27 20:56:31.428888 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:31.428867    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-366a10\"/\"default-dockercfg-dtcvs\""
Jul 27 20:56:31.429023 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:31.428976    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-366a10\"/\"ipp-route-366a10-kserve-self-signed-certs\""
Jul 27 20:56:31.429023 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:31.428985    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-366a10\"/\"openshift-service-ca.crt\""
Jul 27 20:56:31.429023 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:31.428986    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-366a10\"/\"kube-root-ca.crt\""
Jul 27 20:56:31.435422 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:31.435402    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-366a10/ipp-route-366a10-kserve-8886b5d9f-r9flh"]
Jul 27 20:56:31.466362 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:31.466330    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:56:31.510016 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:31.509987    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2-model-cache\") pod \"ipp-route-366a10-kserve-8886b5d9f-r9flh\" (UID: \"bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2\") " pod="ai-tenant-e2e-ipp-a-366a10/ipp-route-366a10-kserve-8886b5d9f-r9flh"
Jul 27 20:56:31.510164 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:31.510023    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2-tls-certs\") pod \"ipp-route-366a10-kserve-8886b5d9f-r9flh\" (UID: \"bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2\") " pod="ai-tenant-e2e-ipp-a-366a10/ipp-route-366a10-kserve-8886b5d9f-r9flh"
Jul 27 20:56:31.510164 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:31.510047    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmzxk\" (UniqueName: \"kubernetes.io/projected/bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2-kube-api-access-dmzxk\") pod \"ipp-route-366a10-kserve-8886b5d9f-r9flh\" (UID: \"bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2\") " pod="ai-tenant-e2e-ipp-a-366a10/ipp-route-366a10-kserve-8886b5d9f-r9flh"
Jul 27 20:56:31.510164 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:31.510147    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2-dshm\") pod \"ipp-route-366a10-kserve-8886b5d9f-r9flh\" (UID: \"bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2\") " pod="ai-tenant-e2e-ipp-a-366a10/ipp-route-366a10-kserve-8886b5d9f-r9flh"
Jul 27 20:56:31.510274 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:31.510177    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2-home\") pod \"ipp-route-366a10-kserve-8886b5d9f-r9flh\" (UID: \"bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2\") " pod="ai-tenant-e2e-ipp-a-366a10/ipp-route-366a10-kserve-8886b5d9f-r9flh"
Jul 27 20:56:31.510274 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:31.510265    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2-tmp-dir\") pod \"ipp-route-366a10-kserve-8886b5d9f-r9flh\" (UID: \"bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2\") " pod="ai-tenant-e2e-ipp-a-366a10/ipp-route-366a10-kserve-8886b5d9f-r9flh"
Jul 27 20:56:31.610773 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:31.610732    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2-tmp-dir\") pod \"ipp-route-366a10-kserve-8886b5d9f-r9flh\" (UID: \"bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2\") " pod="ai-tenant-e2e-ipp-a-366a10/ipp-route-366a10-kserve-8886b5d9f-r9flh"
Jul 27 20:56:31.610954 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:31.610784    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2-model-cache\") pod \"ipp-route-366a10-kserve-8886b5d9f-r9flh\" (UID: \"bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2\") " pod="ai-tenant-e2e-ipp-a-366a10/ipp-route-366a10-kserve-8886b5d9f-r9flh"
Jul 27 20:56:31.610954 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:31.610809    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2-tls-certs\") pod \"ipp-route-366a10-kserve-8886b5d9f-r9flh\" (UID: \"bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2\") " pod="ai-tenant-e2e-ipp-a-366a10/ipp-route-366a10-kserve-8886b5d9f-r9flh"
Jul 27 20:56:31.610954 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:31.610839    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmzxk\" (UniqueName: \"kubernetes.io/projected/bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2-kube-api-access-dmzxk\") pod \"ipp-route-366a10-kserve-8886b5d9f-r9flh\" (UID: \"bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2\") " pod="ai-tenant-e2e-ipp-a-366a10/ipp-route-366a10-kserve-8886b5d9f-r9flh"
Jul 27 20:56:31.610954 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:31.610913    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2-dshm\") pod \"ipp-route-366a10-kserve-8886b5d9f-r9flh\" (UID: \"bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2\") " pod="ai-tenant-e2e-ipp-a-366a10/ipp-route-366a10-kserve-8886b5d9f-r9flh"
Jul 27 20:56:31.610954 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:31.610941    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2-home\") pod \"ipp-route-366a10-kserve-8886b5d9f-r9flh\" (UID: \"bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2\") " pod="ai-tenant-e2e-ipp-a-366a10/ipp-route-366a10-kserve-8886b5d9f-r9flh"
Jul 27 20:56:31.611214 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:31.611166    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2-model-cache\") pod \"ipp-route-366a10-kserve-8886b5d9f-r9flh\" (UID: \"bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2\") " pod="ai-tenant-e2e-ipp-a-366a10/ipp-route-366a10-kserve-8886b5d9f-r9flh"
Jul 27 20:56:31.611269 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:31.611217    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2-tmp-dir\") pod \"ipp-route-366a10-kserve-8886b5d9f-r9flh\" (UID: \"bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2\") " pod="ai-tenant-e2e-ipp-a-366a10/ipp-route-366a10-kserve-8886b5d9f-r9flh"
Jul 27 20:56:31.611269 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:31.611238    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2-home\") pod \"ipp-route-366a10-kserve-8886b5d9f-r9flh\" (UID: \"bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2\") " pod="ai-tenant-e2e-ipp-a-366a10/ipp-route-366a10-kserve-8886b5d9f-r9flh"
Jul 27 20:56:31.613024 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:31.613002    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2-dshm\") pod \"ipp-route-366a10-kserve-8886b5d9f-r9flh\" (UID: \"bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2\") " pod="ai-tenant-e2e-ipp-a-366a10/ipp-route-366a10-kserve-8886b5d9f-r9flh"
Jul 27 20:56:31.613310 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:31.613291    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2-tls-certs\") pod \"ipp-route-366a10-kserve-8886b5d9f-r9flh\" (UID: \"bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2\") " pod="ai-tenant-e2e-ipp-a-366a10/ipp-route-366a10-kserve-8886b5d9f-r9flh"
Jul 27 20:56:31.620402 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:31.620377    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmzxk\" (UniqueName: \"kubernetes.io/projected/bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2-kube-api-access-dmzxk\") pod \"ipp-route-366a10-kserve-8886b5d9f-r9flh\" (UID: \"bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2\") " pod="ai-tenant-e2e-ipp-a-366a10/ipp-route-366a10-kserve-8886b5d9f-r9flh"
Jul 27 20:56:31.735852 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:31.735822    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-366a10/ipp-route-366a10-kserve-8886b5d9f-r9flh"
Jul 27 20:56:31.876015 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:31.875977    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-366a10/ipp-route-366a10-kserve-8886b5d9f-r9flh"]
Jul 27 20:56:31.877517 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:56:31.877484    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbae59e7c_3d18_4802_bd22_bd1e5fe0a0c2.slice/crio-b560a4d6f2c64be449d979ebf38009c8335734bc0560b936caa78b6f329589b1 WatchSource:0}: Error finding container b560a4d6f2c64be449d979ebf38009c8335734bc0560b936caa78b6f329589b1: Status 404 returned error can't find the container with id b560a4d6f2c64be449d979ebf38009c8335734bc0560b936caa78b6f329589b1
Jul 27 20:56:32.278056 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:32.278012    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-366a10/ipp-route-366a10-kserve-8886b5d9f-r9flh" event={"ID":"bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2","Type":"ContainerStarted","Data":"68202b1584e5c56d87ddbb5781be2795fe5a1a54f2fdee104711fddd1a7f7cb5"}
Jul 27 20:56:32.278056 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:32.278063    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-366a10/ipp-route-366a10-kserve-8886b5d9f-r9flh" event={"ID":"bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2","Type":"ContainerStarted","Data":"b560a4d6f2c64be449d979ebf38009c8335734bc0560b936caa78b6f329589b1"}
Jul 27 20:56:32.294396 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:32.294339    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-366a10/ipp-route-366a10-kserve-8886b5d9f-r9flh" podStartSLOduration=1.294322475 podStartE2EDuration="1.294322475s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:56:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:56:32.293244003 +0000 UTC m=+3140.867970390" watchObservedRunningTime="2026-07-27 20:56:32.294322475 +0000 UTC m=+3140.869048862"
Jul 27 20:56:35.504298 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:35.504214    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:56:41.737016 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:41.736974    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-366a10/ipp-route-366a10-kserve-8886b5d9f-r9flh"
Jul 27 20:56:41.737485 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:41.737035    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-366a10/ipp-route-366a10-kserve-8886b5d9f-r9flh"
Jul 27 20:56:41.749870 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:41.749835    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-366a10/ipp-route-366a10-kserve-8886b5d9f-r9flh"
Jul 27 20:56:42.347205 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:42.347176    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-366a10/ipp-route-366a10-kserve-8886b5d9f-r9flh"
Jul 27 20:56:46.735779 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:46.735746    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:56:46.835620 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:56:46.835583    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:57:06.199174 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:06.199133    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:57:17.678035 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:17.678004    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-366a10-7cfb65599b-qzg27_94a0ba0a-4d58-428c-a073-c619bed27983/payload-processing/0.log"
Jul 27 20:57:17.920304 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:17.920275    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-3511f6-6f56c8d5c6-ph2cj_c354f0d8-cc12-49c9-b924-238773cf86a4/payload-processing/0.log"
Jul 27 20:57:18.191164 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:18.191130    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:57:18.531891 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:18.531861    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:57:18.900783 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:18.900697    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:57:21.698811 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:21.698776    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:57:21.813111 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:21.813079    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:57:24.125517 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:24.125475    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:57:24.593631 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:24.593588    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:57:24.688030 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:24.687992    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:57:24.695182 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:24.695157    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b060a0-5dff486968-ng75d"]
Jul 27 20:57:24.699051 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:24.699030    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b060a0-5dff486968-ng75d"
Jul 27 20:57:24.701635 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:24.701610    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-b060a0-dockercfg-cfmrp\""
Jul 27 20:57:24.701759 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:24.701734    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-b060a0\""
Jul 27 20:57:24.716066 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:24.716040    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b060a0-5dff486968-ng75d"]
Jul 27 20:57:24.733980 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:24.733945    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-b060a0-76c5b84646-4x6kw"]
Jul 27 20:57:24.737601 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:24.737582    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-b060a0-76c5b84646-4x6kw"
Jul 27 20:57:24.751744 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:24.751714    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-b060a0-76c5b84646-4x6kw"]
Jul 27 20:57:24.793249 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:24.793212    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c69f529-341f-41eb-9937-96245a1fb227-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-b060a0-5dff486968-ng75d\" (UID: \"7c69f529-341f-41eb-9937-96245a1fb227\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b060a0-5dff486968-ng75d"
Jul 27 20:57:24.793423 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:24.793287    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0213946e-5d18-4c21-b08f-e019506dab2b-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-b060a0-76c5b84646-4x6kw\" (UID: \"0213946e-5d18-4c21-b08f-e019506dab2b\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-b060a0-76c5b84646-4x6kw"
Jul 27 20:57:24.793423 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:24.793320    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjr72\" (UniqueName: \"kubernetes.io/projected/7c69f529-341f-41eb-9937-96245a1fb227-kube-api-access-bjr72\") pod \"payload-pre-processing-e2e-ipp-cleanup-b060a0-5dff486968-ng75d\" (UID: \"7c69f529-341f-41eb-9937-96245a1fb227\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b060a0-5dff486968-ng75d"
Jul 27 20:57:24.793423 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:24.793340    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vbvj\" (UniqueName: \"kubernetes.io/projected/0213946e-5d18-4c21-b08f-e019506dab2b-kube-api-access-9vbvj\") pod \"payload-processing-e2e-ipp-cleanup-b060a0-76c5b84646-4x6kw\" (UID: \"0213946e-5d18-4c21-b08f-e019506dab2b\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-b060a0-76c5b84646-4x6kw"
Jul 27 20:57:24.894369 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:24.894265    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0213946e-5d18-4c21-b08f-e019506dab2b-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-b060a0-76c5b84646-4x6kw\" (UID: \"0213946e-5d18-4c21-b08f-e019506dab2b\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-b060a0-76c5b84646-4x6kw"
Jul 27 20:57:24.894369 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:24.894319    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjr72\" (UniqueName: \"kubernetes.io/projected/7c69f529-341f-41eb-9937-96245a1fb227-kube-api-access-bjr72\") pod \"payload-pre-processing-e2e-ipp-cleanup-b060a0-5dff486968-ng75d\" (UID: \"7c69f529-341f-41eb-9937-96245a1fb227\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b060a0-5dff486968-ng75d"
Jul 27 20:57:24.894369 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:24.894366    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vbvj\" (UniqueName: \"kubernetes.io/projected/0213946e-5d18-4c21-b08f-e019506dab2b-kube-api-access-9vbvj\") pod \"payload-processing-e2e-ipp-cleanup-b060a0-76c5b84646-4x6kw\" (UID: \"0213946e-5d18-4c21-b08f-e019506dab2b\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-b060a0-76c5b84646-4x6kw"
Jul 27 20:57:24.894649 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:24.894410    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c69f529-341f-41eb-9937-96245a1fb227-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-b060a0-5dff486968-ng75d\" (UID: \"7c69f529-341f-41eb-9937-96245a1fb227\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b060a0-5dff486968-ng75d"
Jul 27 20:57:24.895116 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:24.895096    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0213946e-5d18-4c21-b08f-e019506dab2b-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-b060a0-76c5b84646-4x6kw\" (UID: \"0213946e-5d18-4c21-b08f-e019506dab2b\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-b060a0-76c5b84646-4x6kw"
Jul 27 20:57:24.895202 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:24.895182    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c69f529-341f-41eb-9937-96245a1fb227-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-b060a0-5dff486968-ng75d\" (UID: \"7c69f529-341f-41eb-9937-96245a1fb227\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b060a0-5dff486968-ng75d"
Jul 27 20:57:24.902778 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:24.902746    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vbvj\" (UniqueName: \"kubernetes.io/projected/0213946e-5d18-4c21-b08f-e019506dab2b-kube-api-access-9vbvj\") pod \"payload-processing-e2e-ipp-cleanup-b060a0-76c5b84646-4x6kw\" (UID: \"0213946e-5d18-4c21-b08f-e019506dab2b\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-b060a0-76c5b84646-4x6kw"
Jul 27 20:57:24.902902 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:24.902795    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjr72\" (UniqueName: \"kubernetes.io/projected/7c69f529-341f-41eb-9937-96245a1fb227-kube-api-access-bjr72\") pod \"payload-pre-processing-e2e-ipp-cleanup-b060a0-5dff486968-ng75d\" (UID: \"7c69f529-341f-41eb-9937-96245a1fb227\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b060a0-5dff486968-ng75d"
Jul 27 20:57:25.008854 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:25.008818    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b060a0-5dff486968-ng75d"
Jul 27 20:57:25.047560 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:25.047523    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-b060a0-76c5b84646-4x6kw"
Jul 27 20:57:25.171359 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:57:25.171324    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c69f529_341f_41eb_9937_96245a1fb227.slice/crio-1c3bd85b8013f210963ce0904cafe7c1867c4c5f405440498c3003da537504bb WatchSource:0}: Error finding container 1c3bd85b8013f210963ce0904cafe7c1867c4c5f405440498c3003da537504bb: Status 404 returned error can't find the container with id 1c3bd85b8013f210963ce0904cafe7c1867c4c5f405440498c3003da537504bb
Jul 27 20:57:25.171983 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:25.171577    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b060a0-5dff486968-ng75d"]
Jul 27 20:57:25.408922 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:25.408895    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-b060a0-76c5b84646-4x6kw"]
Jul 27 20:57:25.410967 ip-10-0-128-149 kubenswrapper[2557]: W0727 20:57:25.410935    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0213946e_5d18_4c21_b08f_e019506dab2b.slice/crio-f0aff329b738067bce9fba50163015d91366888e5024dc7e7ca8dda998a4e25b WatchSource:0}: Error finding container f0aff329b738067bce9fba50163015d91366888e5024dc7e7ca8dda998a4e25b: Status 404 returned error can't find the container with id f0aff329b738067bce9fba50163015d91366888e5024dc7e7ca8dda998a4e25b
Jul 27 20:57:25.590912 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:25.590859    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b060a0-5dff486968-ng75d" event={"ID":"7c69f529-341f-41eb-9937-96245a1fb227","Type":"ContainerStarted","Data":"16803d73c242a4b1f832322c1b527b7777781ec11389d14e2ac1d13f364dd9ba"}
Jul 27 20:57:25.591111 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:25.590961    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b060a0-5dff486968-ng75d"
Jul 27 20:57:25.591111 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:25.590993    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b060a0-5dff486968-ng75d" event={"ID":"7c69f529-341f-41eb-9937-96245a1fb227","Type":"ContainerStarted","Data":"1c3bd85b8013f210963ce0904cafe7c1867c4c5f405440498c3003da537504bb"}
Jul 27 20:57:25.592426 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:25.592396    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-b060a0-76c5b84646-4x6kw" event={"ID":"0213946e-5d18-4c21-b08f-e019506dab2b","Type":"ContainerStarted","Data":"2916f12b8886d5bd8f42d3d110afe1a5193aa187a4b3a30fd5f1155a970e5d52"}
Jul 27 20:57:25.592548 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:25.592479    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-b060a0-76c5b84646-4x6kw"
Jul 27 20:57:25.592548 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:25.592500    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-b060a0-76c5b84646-4x6kw" event={"ID":"0213946e-5d18-4c21-b08f-e019506dab2b","Type":"ContainerStarted","Data":"f0aff329b738067bce9fba50163015d91366888e5024dc7e7ca8dda998a4e25b"}
Jul 27 20:57:25.609092 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:25.609034    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b060a0-5dff486968-ng75d" podStartSLOduration=1.608999418 podStartE2EDuration="1.608999418s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:57:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:57:25.607927806 +0000 UTC m=+3194.182654194" watchObservedRunningTime="2026-07-27 20:57:25.608999418 +0000 UTC m=+3194.183725809"
Jul 27 20:57:25.626137 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:25.626067    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-b060a0-76c5b84646-4x6kw" podStartSLOduration=1.626046413 podStartE2EDuration="1.626046413s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:57:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:57:25.622538459 +0000 UTC m=+3194.197264851" watchObservedRunningTime="2026-07-27 20:57:25.626046413 +0000 UTC m=+3194.200772802"
Jul 27 20:57:26.096822 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:26.096785    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:57:32.502955 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:32.502922    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:57:36.600259 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:36.600224    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-b060a0-76c5b84646-4x6kw"
Jul 27 20:57:36.600747 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:36.600361    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b060a0-5dff486968-ng75d"
Jul 27 20:57:54.933868 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:54.933836    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:57:54.973621 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:54.973578    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-b060a0-76c5b84646-4x6kw"]
Jul 27 20:57:54.973891 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:54.973844    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-b060a0-76c5b84646-4x6kw" podUID="0213946e-5d18-4c21-b08f-e019506dab2b" containerName="payload-processing" containerID="cri-o://2916f12b8886d5bd8f42d3d110afe1a5193aa187a4b3a30fd5f1155a970e5d52" gracePeriod=30
Jul 27 20:57:54.982925 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:54.982899    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b060a0-5dff486968-ng75d"]
Jul 27 20:57:54.983113 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:54.983082    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b060a0-5dff486968-ng75d" podUID="7c69f529-341f-41eb-9937-96245a1fb227" containerName="payload-pre-processing" containerID="cri-o://16803d73c242a4b1f832322c1b527b7777781ec11389d14e2ac1d13f364dd9ba" gracePeriod=30
Jul 27 20:57:55.017064 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:55.017032    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:57:55.093127 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:55.093082    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:57:55.256875 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:55.256850    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-b060a0-76c5b84646-4x6kw"
Jul 27 20:57:55.280980 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:55.280950    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b060a0-5dff486968-ng75d"
Jul 27 20:57:55.385675 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:55.385642    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0213946e-5d18-4c21-b08f-e019506dab2b-plugins-config-volume\") pod \"0213946e-5d18-4c21-b08f-e019506dab2b\" (UID: \"0213946e-5d18-4c21-b08f-e019506dab2b\") "
Jul 27 20:57:55.385848 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:55.385692    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9vbvj\" (UniqueName: \"kubernetes.io/projected/0213946e-5d18-4c21-b08f-e019506dab2b-kube-api-access-9vbvj\") pod \"0213946e-5d18-4c21-b08f-e019506dab2b\" (UID: \"0213946e-5d18-4c21-b08f-e019506dab2b\") "
Jul 27 20:57:55.385848 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:55.385713    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bjr72\" (UniqueName: \"kubernetes.io/projected/7c69f529-341f-41eb-9937-96245a1fb227-kube-api-access-bjr72\") pod \"7c69f529-341f-41eb-9937-96245a1fb227\" (UID: \"7c69f529-341f-41eb-9937-96245a1fb227\") "
Jul 27 20:57:55.385848 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:55.385812    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c69f529-341f-41eb-9937-96245a1fb227-plugins-config-volume\") pod \"7c69f529-341f-41eb-9937-96245a1fb227\" (UID: \"7c69f529-341f-41eb-9937-96245a1fb227\") "
Jul 27 20:57:55.386113 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:55.386084    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0213946e-5d18-4c21-b08f-e019506dab2b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0213946e-5d18-4c21-b08f-e019506dab2b" (UID: "0213946e-5d18-4c21-b08f-e019506dab2b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:57:55.386231 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:55.386209    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c69f529-341f-41eb-9937-96245a1fb227-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7c69f529-341f-41eb-9937-96245a1fb227" (UID: "7c69f529-341f-41eb-9937-96245a1fb227"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:57:55.387827 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:55.387803    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c69f529-341f-41eb-9937-96245a1fb227-kube-api-access-bjr72" (OuterVolumeSpecName: "kube-api-access-bjr72") pod "7c69f529-341f-41eb-9937-96245a1fb227" (UID: "7c69f529-341f-41eb-9937-96245a1fb227"). InnerVolumeSpecName "kube-api-access-bjr72". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:57:55.387935 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:55.387831    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0213946e-5d18-4c21-b08f-e019506dab2b-kube-api-access-9vbvj" (OuterVolumeSpecName: "kube-api-access-9vbvj") pod "0213946e-5d18-4c21-b08f-e019506dab2b" (UID: "0213946e-5d18-4c21-b08f-e019506dab2b"). InnerVolumeSpecName "kube-api-access-9vbvj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:57:55.486584 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:55.486552    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c69f529-341f-41eb-9937-96245a1fb227-plugins-config-volume\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:57:55.486584 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:55.486579    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0213946e-5d18-4c21-b08f-e019506dab2b-plugins-config-volume\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:57:55.486782 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:55.486593    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9vbvj\" (UniqueName: \"kubernetes.io/projected/0213946e-5d18-4c21-b08f-e019506dab2b-kube-api-access-9vbvj\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:57:55.486782 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:55.486607    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bjr72\" (UniqueName: \"kubernetes.io/projected/7c69f529-341f-41eb-9937-96245a1fb227-kube-api-access-bjr72\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:57:55.772602 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:55.772511    2557 generic.go:356] "Generic (PLEG): container finished" podID="7c69f529-341f-41eb-9937-96245a1fb227" containerID="16803d73c242a4b1f832322c1b527b7777781ec11389d14e2ac1d13f364dd9ba" exitCode=0
Jul 27 20:57:55.772602 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:55.772554    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b060a0-5dff486968-ng75d"
Jul 27 20:57:55.772817 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:55.772600    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b060a0-5dff486968-ng75d" event={"ID":"7c69f529-341f-41eb-9937-96245a1fb227","Type":"ContainerDied","Data":"16803d73c242a4b1f832322c1b527b7777781ec11389d14e2ac1d13f364dd9ba"}
Jul 27 20:57:55.772817 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:55.772657    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b060a0-5dff486968-ng75d" event={"ID":"7c69f529-341f-41eb-9937-96245a1fb227","Type":"ContainerDied","Data":"1c3bd85b8013f210963ce0904cafe7c1867c4c5f405440498c3003da537504bb"}
Jul 27 20:57:55.772817 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:55.772686    2557 scope.go:117] "RemoveContainer" containerID="16803d73c242a4b1f832322c1b527b7777781ec11389d14e2ac1d13f364dd9ba"
Jul 27 20:57:55.774051 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:55.774022    2557 generic.go:356] "Generic (PLEG): container finished" podID="0213946e-5d18-4c21-b08f-e019506dab2b" containerID="2916f12b8886d5bd8f42d3d110afe1a5193aa187a4b3a30fd5f1155a970e5d52" exitCode=0
Jul 27 20:57:55.774157 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:55.774065    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-b060a0-76c5b84646-4x6kw"
Jul 27 20:57:55.774157 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:55.774076    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-b060a0-76c5b84646-4x6kw" event={"ID":"0213946e-5d18-4c21-b08f-e019506dab2b","Type":"ContainerDied","Data":"2916f12b8886d5bd8f42d3d110afe1a5193aa187a4b3a30fd5f1155a970e5d52"}
Jul 27 20:57:55.774157 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:55.774136    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-b060a0-76c5b84646-4x6kw" event={"ID":"0213946e-5d18-4c21-b08f-e019506dab2b","Type":"ContainerDied","Data":"f0aff329b738067bce9fba50163015d91366888e5024dc7e7ca8dda998a4e25b"}
Jul 27 20:57:55.782152 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:55.782137    2557 scope.go:117] "RemoveContainer" containerID="16803d73c242a4b1f832322c1b527b7777781ec11389d14e2ac1d13f364dd9ba"
Jul 27 20:57:55.782571 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:57:55.782542    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16803d73c242a4b1f832322c1b527b7777781ec11389d14e2ac1d13f364dd9ba\": container with ID starting with 16803d73c242a4b1f832322c1b527b7777781ec11389d14e2ac1d13f364dd9ba not found: ID does not exist" containerID="16803d73c242a4b1f832322c1b527b7777781ec11389d14e2ac1d13f364dd9ba"
Jul 27 20:57:55.782691 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:55.782580    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16803d73c242a4b1f832322c1b527b7777781ec11389d14e2ac1d13f364dd9ba"} err="failed to get container status \"16803d73c242a4b1f832322c1b527b7777781ec11389d14e2ac1d13f364dd9ba\": rpc error: code = NotFound desc = could not find container \"16803d73c242a4b1f832322c1b527b7777781ec11389d14e2ac1d13f364dd9ba\": container with ID starting with 16803d73c242a4b1f832322c1b527b7777781ec11389d14e2ac1d13f364dd9ba not found: ID does not exist"
Jul 27 20:57:55.782691 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:55.782604    2557 scope.go:117] "RemoveContainer" containerID="2916f12b8886d5bd8f42d3d110afe1a5193aa187a4b3a30fd5f1155a970e5d52"
Jul 27 20:57:55.791750 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:55.791732    2557 scope.go:117] "RemoveContainer" containerID="2916f12b8886d5bd8f42d3d110afe1a5193aa187a4b3a30fd5f1155a970e5d52"
Jul 27 20:57:55.792001 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:57:55.791983    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2916f12b8886d5bd8f42d3d110afe1a5193aa187a4b3a30fd5f1155a970e5d52\": container with ID starting with 2916f12b8886d5bd8f42d3d110afe1a5193aa187a4b3a30fd5f1155a970e5d52 not found: ID does not exist" containerID="2916f12b8886d5bd8f42d3d110afe1a5193aa187a4b3a30fd5f1155a970e5d52"
Jul 27 20:57:55.792053 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:55.792008    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2916f12b8886d5bd8f42d3d110afe1a5193aa187a4b3a30fd5f1155a970e5d52"} err="failed to get container status \"2916f12b8886d5bd8f42d3d110afe1a5193aa187a4b3a30fd5f1155a970e5d52\": rpc error: code = NotFound desc = could not find container \"2916f12b8886d5bd8f42d3d110afe1a5193aa187a4b3a30fd5f1155a970e5d52\": container with ID starting with 2916f12b8886d5bd8f42d3d110afe1a5193aa187a4b3a30fd5f1155a970e5d52 not found: ID does not exist"
Jul 27 20:57:55.798425 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:55.798404    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-b060a0-76c5b84646-4x6kw"]
Jul 27 20:57:55.804960 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:55.804936    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-b060a0-76c5b84646-4x6kw"]
Jul 27 20:57:55.820547 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:55.817052    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b060a0-5dff486968-ng75d"]
Jul 27 20:57:55.825902 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:55.825876    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b060a0-5dff486968-ng75d"]
Jul 27 20:57:55.910918 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:55.910884    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0213946e-5d18-4c21-b08f-e019506dab2b" path="/var/lib/kubelet/pods/0213946e-5d18-4c21-b08f-e019506dab2b/volumes"
Jul 27 20:57:55.911237 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:55.911225    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c69f529-341f-41eb-9937-96245a1fb227" path="/var/lib/kubelet/pods/7c69f529-341f-41eb-9937-96245a1fb227/volumes"
Jul 27 20:57:57.242038 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:57.241992    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:57:57.637510 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:57.637409    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:57:59.113875 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:57:59.113838    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:58:03.851760 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:03.851671    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:58:03.952249 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:03.952213    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:58:04.153691 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:04.153592    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:58:04.456352 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:04.456271    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:58:22.499644 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:22.499609    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:58:26.163776 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:26.163744    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:58:26.189820 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:26.189784    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-366a10-7cfb65599b-qzg27"]
Jul 27 20:58:26.190049 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:26.190026    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-366a10-7cfb65599b-qzg27" podUID="94a0ba0a-4d58-428c-a073-c619bed27983" containerName="payload-processing" containerID="cri-o://13baf15879c77226e4ad39dcac5c86382b5f763648117216c4174badd6efb280" gracePeriod=30
Jul 27 20:58:26.196876 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:26.196843    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-366a10-567889455b-6vf8q"]
Jul 27 20:58:26.197150 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:26.197106    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-366a10-567889455b-6vf8q" podUID="ea10604d-0d32-4c48-96bd-e460f921d39c" containerName="payload-pre-processing" containerID="cri-o://c5ed8233a97959ca679c6a96f693ebedbc9958be229a02fc4fa7ecaf5b26e586" gracePeriod=30
Jul 27 20:58:26.230405 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:26.230367    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:58:26.289518 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:26.289468    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:58:26.487717 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:26.487688    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-366a10-7cfb65599b-qzg27"
Jul 27 20:58:26.490552 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:26.490530    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-366a10-567889455b-6vf8q"
Jul 27 20:58:26.567593 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:26.567557    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kgqjp\" (UniqueName: \"kubernetes.io/projected/ea10604d-0d32-4c48-96bd-e460f921d39c-kube-api-access-kgqjp\") pod \"ea10604d-0d32-4c48-96bd-e460f921d39c\" (UID: \"ea10604d-0d32-4c48-96bd-e460f921d39c\") "
Jul 27 20:58:26.567593 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:26.567599    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ws6dm\" (UniqueName: \"kubernetes.io/projected/94a0ba0a-4d58-428c-a073-c619bed27983-kube-api-access-ws6dm\") pod \"94a0ba0a-4d58-428c-a073-c619bed27983\" (UID: \"94a0ba0a-4d58-428c-a073-c619bed27983\") "
Jul 27 20:58:26.567891 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:26.567635    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea10604d-0d32-4c48-96bd-e460f921d39c-plugins-config-volume\") pod \"ea10604d-0d32-4c48-96bd-e460f921d39c\" (UID: \"ea10604d-0d32-4c48-96bd-e460f921d39c\") "
Jul 27 20:58:26.567891 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:26.567701    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/94a0ba0a-4d58-428c-a073-c619bed27983-plugins-config-volume\") pod \"94a0ba0a-4d58-428c-a073-c619bed27983\" (UID: \"94a0ba0a-4d58-428c-a073-c619bed27983\") "
Jul 27 20:58:26.568075 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:26.568048    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea10604d-0d32-4c48-96bd-e460f921d39c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ea10604d-0d32-4c48-96bd-e460f921d39c" (UID: "ea10604d-0d32-4c48-96bd-e460f921d39c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:58:26.568161 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:26.568134    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94a0ba0a-4d58-428c-a073-c619bed27983-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "94a0ba0a-4d58-428c-a073-c619bed27983" (UID: "94a0ba0a-4d58-428c-a073-c619bed27983"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:58:26.569880 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:26.569855    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea10604d-0d32-4c48-96bd-e460f921d39c-kube-api-access-kgqjp" (OuterVolumeSpecName: "kube-api-access-kgqjp") pod "ea10604d-0d32-4c48-96bd-e460f921d39c" (UID: "ea10604d-0d32-4c48-96bd-e460f921d39c"). InnerVolumeSpecName "kube-api-access-kgqjp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:58:26.569992 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:26.569938    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94a0ba0a-4d58-428c-a073-c619bed27983-kube-api-access-ws6dm" (OuterVolumeSpecName: "kube-api-access-ws6dm") pod "94a0ba0a-4d58-428c-a073-c619bed27983" (UID: "94a0ba0a-4d58-428c-a073-c619bed27983"). InnerVolumeSpecName "kube-api-access-ws6dm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:58:26.669112 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:26.669076    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea10604d-0d32-4c48-96bd-e460f921d39c-plugins-config-volume\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:58:26.669112 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:26.669105    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/94a0ba0a-4d58-428c-a073-c619bed27983-plugins-config-volume\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:58:26.669112 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:26.669115    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kgqjp\" (UniqueName: \"kubernetes.io/projected/ea10604d-0d32-4c48-96bd-e460f921d39c-kube-api-access-kgqjp\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:58:26.669359 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:26.669125    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ws6dm\" (UniqueName: \"kubernetes.io/projected/94a0ba0a-4d58-428c-a073-c619bed27983-kube-api-access-ws6dm\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:58:26.949892 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:26.949854    2557 generic.go:356] "Generic (PLEG): container finished" podID="ea10604d-0d32-4c48-96bd-e460f921d39c" containerID="c5ed8233a97959ca679c6a96f693ebedbc9958be229a02fc4fa7ecaf5b26e586" exitCode=0
Jul 27 20:58:26.950093 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:26.949907    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-366a10-567889455b-6vf8q"
Jul 27 20:58:26.950093 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:26.949942    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-366a10-567889455b-6vf8q" event={"ID":"ea10604d-0d32-4c48-96bd-e460f921d39c","Type":"ContainerDied","Data":"c5ed8233a97959ca679c6a96f693ebedbc9958be229a02fc4fa7ecaf5b26e586"}
Jul 27 20:58:26.950093 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:26.950000    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-366a10-567889455b-6vf8q" event={"ID":"ea10604d-0d32-4c48-96bd-e460f921d39c","Type":"ContainerDied","Data":"95f4cc771d78c2c418f4efd1a1f62d57b06d372593f031af72d3bcd7be949bce"}
Jul 27 20:58:26.950093 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:26.950017    2557 scope.go:117] "RemoveContainer" containerID="c5ed8233a97959ca679c6a96f693ebedbc9958be229a02fc4fa7ecaf5b26e586"
Jul 27 20:58:26.951396 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:26.951370    2557 generic.go:356] "Generic (PLEG): container finished" podID="94a0ba0a-4d58-428c-a073-c619bed27983" containerID="13baf15879c77226e4ad39dcac5c86382b5f763648117216c4174badd6efb280" exitCode=0
Jul 27 20:58:26.951535 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:26.951413    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-366a10-7cfb65599b-qzg27" event={"ID":"94a0ba0a-4d58-428c-a073-c619bed27983","Type":"ContainerDied","Data":"13baf15879c77226e4ad39dcac5c86382b5f763648117216c4174badd6efb280"}
Jul 27 20:58:26.951535 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:26.951471    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-366a10-7cfb65599b-qzg27" event={"ID":"94a0ba0a-4d58-428c-a073-c619bed27983","Type":"ContainerDied","Data":"a78d7f59935ea5da452c9cc6201eeba9941d90b2b3521745e31cc40d97f36b8b"}
Jul 27 20:58:26.951535 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:26.951417    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-366a10-7cfb65599b-qzg27"
Jul 27 20:58:26.959874 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:26.959852    2557 scope.go:117] "RemoveContainer" containerID="c5ed8233a97959ca679c6a96f693ebedbc9958be229a02fc4fa7ecaf5b26e586"
Jul 27 20:58:26.960219 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:58:26.960189    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5ed8233a97959ca679c6a96f693ebedbc9958be229a02fc4fa7ecaf5b26e586\": container with ID starting with c5ed8233a97959ca679c6a96f693ebedbc9958be229a02fc4fa7ecaf5b26e586 not found: ID does not exist" containerID="c5ed8233a97959ca679c6a96f693ebedbc9958be229a02fc4fa7ecaf5b26e586"
Jul 27 20:58:26.960324 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:26.960230    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5ed8233a97959ca679c6a96f693ebedbc9958be229a02fc4fa7ecaf5b26e586"} err="failed to get container status \"c5ed8233a97959ca679c6a96f693ebedbc9958be229a02fc4fa7ecaf5b26e586\": rpc error: code = NotFound desc = could not find container \"c5ed8233a97959ca679c6a96f693ebedbc9958be229a02fc4fa7ecaf5b26e586\": container with ID starting with c5ed8233a97959ca679c6a96f693ebedbc9958be229a02fc4fa7ecaf5b26e586 not found: ID does not exist"
Jul 27 20:58:26.960324 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:26.960252    2557 scope.go:117] "RemoveContainer" containerID="13baf15879c77226e4ad39dcac5c86382b5f763648117216c4174badd6efb280"
Jul 27 20:58:26.971307 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:26.971264    2557 scope.go:117] "RemoveContainer" containerID="13baf15879c77226e4ad39dcac5c86382b5f763648117216c4174badd6efb280"
Jul 27 20:58:26.971799 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:58:26.971777    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13baf15879c77226e4ad39dcac5c86382b5f763648117216c4174badd6efb280\": container with ID starting with 13baf15879c77226e4ad39dcac5c86382b5f763648117216c4174badd6efb280 not found: ID does not exist" containerID="13baf15879c77226e4ad39dcac5c86382b5f763648117216c4174badd6efb280"
Jul 27 20:58:26.971890 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:26.971807    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13baf15879c77226e4ad39dcac5c86382b5f763648117216c4174badd6efb280"} err="failed to get container status \"13baf15879c77226e4ad39dcac5c86382b5f763648117216c4174badd6efb280\": rpc error: code = NotFound desc = could not find container \"13baf15879c77226e4ad39dcac5c86382b5f763648117216c4174badd6efb280\": container with ID starting with 13baf15879c77226e4ad39dcac5c86382b5f763648117216c4174badd6efb280 not found: ID does not exist"
Jul 27 20:58:26.975579 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:26.975552    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-366a10-567889455b-6vf8q"]
Jul 27 20:58:26.981847 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:26.981824    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-366a10-567889455b-6vf8q"]
Jul 27 20:58:26.992568 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:26.992536    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-366a10-7cfb65599b-qzg27"]
Jul 27 20:58:26.994847 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:26.994825    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-366a10-7cfb65599b-qzg27"]
Jul 27 20:58:27.909709 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:27.909675    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:58:27.912701 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:27.912675    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94a0ba0a-4d58-428c-a073-c619bed27983" path="/var/lib/kubelet/pods/94a0ba0a-4d58-428c-a073-c619bed27983/volumes"
Jul 27 20:58:27.913040 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:27.913027    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea10604d-0d32-4c48-96bd-e460f921d39c" path="/var/lib/kubelet/pods/ea10604d-0d32-4c48-96bd-e460f921d39c/volumes"
Jul 27 20:58:28.288615 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:28.288583    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:58:33.265926 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:33.265884    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-366a10/ipp-route-366a10-kserve-8886b5d9f-r9flh"]
Jul 27 20:58:33.361619 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:33.361585    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:58:34.501050 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:34.501014    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:58:34.600802 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:34.600762    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:58:38.200505 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:38.200443    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:58:48.286864 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:48.286800    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-366a10/ipp-route-366a10-kserve-8886b5d9f-r9flh" podUID="bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2" containerName="main" containerID="cri-o://68202b1584e5c56d87ddbb5781be2795fe5a1a54f2fdee104711fddd1a7f7cb5" gracePeriod=45
Jul 27 20:58:48.549934 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:48.549875    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-366a10/ipp-route-366a10-kserve-8886b5d9f-r9flh"
Jul 27 20:58:48.574182 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:48.574154    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2-home\") pod \"bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2\" (UID: \"bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2\") "
Jul 27 20:58:48.574369 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:48.574233    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2-tls-certs\") pod \"bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2\" (UID: \"bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2\") "
Jul 27 20:58:48.574369 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:48.574261    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dmzxk\" (UniqueName: \"kubernetes.io/projected/bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2-kube-api-access-dmzxk\") pod \"bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2\" (UID: \"bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2\") "
Jul 27 20:58:48.574369 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:48.574282    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2-dshm\") pod \"bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2\" (UID: \"bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2\") "
Jul 27 20:58:48.574369 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:48.574320    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2-tmp-dir\") pod \"bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2\" (UID: \"bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2\") "
Jul 27 20:58:48.574369 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:48.574364    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2-model-cache\") pod \"bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2\" (UID: \"bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2\") "
Jul 27 20:58:48.574680 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:48.574479    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2-home" (OuterVolumeSpecName: "home") pod "bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2" (UID: "bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:58:48.574739 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:48.574720    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2-model-cache" (OuterVolumeSpecName: "model-cache") pod "bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2" (UID: "bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:58:48.574801 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:48.574735    2557 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2-home\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:58:48.575318 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:48.575282    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2" (UID: "bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:58:48.577857 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:48.577813    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2-dshm" (OuterVolumeSpecName: "dshm") pod "bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2" (UID: "bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:58:48.582639 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:48.582601    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2-kube-api-access-dmzxk" (OuterVolumeSpecName: "kube-api-access-dmzxk") pod "bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2" (UID: "bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2"). InnerVolumeSpecName "kube-api-access-dmzxk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:58:48.587841 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:48.587818    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2" (UID: "bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:58:48.675109 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:48.675075    2557 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2-tmp-dir\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:58:48.675109 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:48.675103    2557 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2-model-cache\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:58:48.675109 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:48.675113    2557 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2-tls-certs\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:58:48.675332 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:48.675122    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dmzxk\" (UniqueName: \"kubernetes.io/projected/bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2-kube-api-access-dmzxk\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:58:48.675332 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:48.675131    2557 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2-dshm\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:58:49.073994 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:49.073960    2557 generic.go:356] "Generic (PLEG): container finished" podID="bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2" containerID="68202b1584e5c56d87ddbb5781be2795fe5a1a54f2fdee104711fddd1a7f7cb5" exitCode=0
Jul 27 20:58:49.074175 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:49.074015    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-366a10/ipp-route-366a10-kserve-8886b5d9f-r9flh"
Jul 27 20:58:49.074175 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:49.074048    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-366a10/ipp-route-366a10-kserve-8886b5d9f-r9flh" event={"ID":"bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2","Type":"ContainerDied","Data":"68202b1584e5c56d87ddbb5781be2795fe5a1a54f2fdee104711fddd1a7f7cb5"}
Jul 27 20:58:49.074175 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:49.074091    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-366a10/ipp-route-366a10-kserve-8886b5d9f-r9flh" event={"ID":"bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2","Type":"ContainerDied","Data":"b560a4d6f2c64be449d979ebf38009c8335734bc0560b936caa78b6f329589b1"}
Jul 27 20:58:49.074175 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:49.074112    2557 scope.go:117] "RemoveContainer" containerID="68202b1584e5c56d87ddbb5781be2795fe5a1a54f2fdee104711fddd1a7f7cb5"
Jul 27 20:58:49.084095 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:49.084072    2557 scope.go:117] "RemoveContainer" containerID="68202b1584e5c56d87ddbb5781be2795fe5a1a54f2fdee104711fddd1a7f7cb5"
Jul 27 20:58:49.084375 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:58:49.084357    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68202b1584e5c56d87ddbb5781be2795fe5a1a54f2fdee104711fddd1a7f7cb5\": container with ID starting with 68202b1584e5c56d87ddbb5781be2795fe5a1a54f2fdee104711fddd1a7f7cb5 not found: ID does not exist" containerID="68202b1584e5c56d87ddbb5781be2795fe5a1a54f2fdee104711fddd1a7f7cb5"
Jul 27 20:58:49.084422 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:49.084384    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68202b1584e5c56d87ddbb5781be2795fe5a1a54f2fdee104711fddd1a7f7cb5"} err="failed to get container status \"68202b1584e5c56d87ddbb5781be2795fe5a1a54f2fdee104711fddd1a7f7cb5\": rpc error: code = NotFound desc = could not find container \"68202b1584e5c56d87ddbb5781be2795fe5a1a54f2fdee104711fddd1a7f7cb5\": container with ID starting with 68202b1584e5c56d87ddbb5781be2795fe5a1a54f2fdee104711fddd1a7f7cb5 not found: ID does not exist"
Jul 27 20:58:49.095829 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:49.095801    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-366a10/ipp-route-366a10-kserve-8886b5d9f-r9flh"]
Jul 27 20:58:49.099920 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:49.099897    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-366a10/ipp-route-366a10-kserve-8886b5d9f-r9flh"]
Jul 27 20:58:49.911226 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:58:49.911191    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2" path="/var/lib/kubelet/pods/bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2/volumes"
Jul 27 20:59:09.487866 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:09.487830    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:59:10.884871 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:10.884836    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:59:17.399987 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:17.399894    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:59:17.500442 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:17.500411    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:59:17.678636 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:17.678562    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:59:17.916910 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:17.916877    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:59:24.053471 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:24.053415    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:59:30.076287 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:30.076250    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:59:30.092364 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:30.092331    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-3511f6-6f56c8d5c6-ph2cj"]
Jul 27 20:59:30.092613 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:30.092588    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-3511f6-6f56c8d5c6-ph2cj" podUID="c354f0d8-cc12-49c9-b924-238773cf86a4" containerName="payload-processing" containerID="cri-o://007749812a542af53779f25a585f8afeb544d7bea6b2b37bbe21c3f934143654" gracePeriod=30
Jul 27 20:59:30.103074 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:30.103042    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-3511f6-65644dc98d-7dfxl"]
Jul 27 20:59:30.103543 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:30.103309    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-3511f6-65644dc98d-7dfxl" podUID="b7d51386-e87b-45e6-82eb-5df4b1036908" containerName="payload-pre-processing" containerID="cri-o://e2fec0dc815954a32e827645191fd9cf2a04f4acc9d5d05c1b9cbde80a08981e" gracePeriod=30
Jul 27 20:59:30.145118 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:30.145068    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:59:30.245471 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:30.245423    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:59:30.303264 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:30.303150    2557 generic.go:356] "Generic (PLEG): container finished" podID="c354f0d8-cc12-49c9-b924-238773cf86a4" containerID="007749812a542af53779f25a585f8afeb544d7bea6b2b37bbe21c3f934143654" exitCode=0
Jul 27 20:59:30.303264 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:30.303198    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-3511f6-6f56c8d5c6-ph2cj" event={"ID":"c354f0d8-cc12-49c9-b924-238773cf86a4","Type":"ContainerDied","Data":"007749812a542af53779f25a585f8afeb544d7bea6b2b37bbe21c3f934143654"}
Jul 27 20:59:30.305320 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:30.305292    2557 generic.go:356] "Generic (PLEG): container finished" podID="b7d51386-e87b-45e6-82eb-5df4b1036908" containerID="e2fec0dc815954a32e827645191fd9cf2a04f4acc9d5d05c1b9cbde80a08981e" exitCode=0
Jul 27 20:59:30.305444 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:30.305332    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-3511f6-65644dc98d-7dfxl" event={"ID":"b7d51386-e87b-45e6-82eb-5df4b1036908","Type":"ContainerDied","Data":"e2fec0dc815954a32e827645191fd9cf2a04f4acc9d5d05c1b9cbde80a08981e"}
Jul 27 20:59:30.390608 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:30.390578    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-3511f6-6f56c8d5c6-ph2cj"
Jul 27 20:59:30.393496 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:30.393473    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-3511f6-65644dc98d-7dfxl"
Jul 27 20:59:30.463187 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:30.463150    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c354f0d8-cc12-49c9-b924-238773cf86a4-plugins-config-volume\") pod \"c354f0d8-cc12-49c9-b924-238773cf86a4\" (UID: \"c354f0d8-cc12-49c9-b924-238773cf86a4\") "
Jul 27 20:59:30.463364 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:30.463215    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sfk5l\" (UniqueName: \"kubernetes.io/projected/b7d51386-e87b-45e6-82eb-5df4b1036908-kube-api-access-sfk5l\") pod \"b7d51386-e87b-45e6-82eb-5df4b1036908\" (UID: \"b7d51386-e87b-45e6-82eb-5df4b1036908\") "
Jul 27 20:59:30.463364 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:30.463327    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7d51386-e87b-45e6-82eb-5df4b1036908-plugins-config-volume\") pod \"b7d51386-e87b-45e6-82eb-5df4b1036908\" (UID: \"b7d51386-e87b-45e6-82eb-5df4b1036908\") "
Jul 27 20:59:30.463484 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:30.463396    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xq795\" (UniqueName: \"kubernetes.io/projected/c354f0d8-cc12-49c9-b924-238773cf86a4-kube-api-access-xq795\") pod \"c354f0d8-cc12-49c9-b924-238773cf86a4\" (UID: \"c354f0d8-cc12-49c9-b924-238773cf86a4\") "
Jul 27 20:59:30.463651 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:30.463620    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c354f0d8-cc12-49c9-b924-238773cf86a4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c354f0d8-cc12-49c9-b924-238773cf86a4" (UID: "c354f0d8-cc12-49c9-b924-238773cf86a4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:59:30.463740 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:30.463695    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7d51386-e87b-45e6-82eb-5df4b1036908-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b7d51386-e87b-45e6-82eb-5df4b1036908" (UID: "b7d51386-e87b-45e6-82eb-5df4b1036908"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:59:30.465446 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:30.465421    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c354f0d8-cc12-49c9-b924-238773cf86a4-kube-api-access-xq795" (OuterVolumeSpecName: "kube-api-access-xq795") pod "c354f0d8-cc12-49c9-b924-238773cf86a4" (UID: "c354f0d8-cc12-49c9-b924-238773cf86a4"). InnerVolumeSpecName "kube-api-access-xq795". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:59:30.465514 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:30.465494    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7d51386-e87b-45e6-82eb-5df4b1036908-kube-api-access-sfk5l" (OuterVolumeSpecName: "kube-api-access-sfk5l") pod "b7d51386-e87b-45e6-82eb-5df4b1036908" (UID: "b7d51386-e87b-45e6-82eb-5df4b1036908"). InnerVolumeSpecName "kube-api-access-sfk5l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:59:30.564167 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:30.564112    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sfk5l\" (UniqueName: \"kubernetes.io/projected/b7d51386-e87b-45e6-82eb-5df4b1036908-kube-api-access-sfk5l\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:59:30.564167 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:30.564158    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7d51386-e87b-45e6-82eb-5df4b1036908-plugins-config-volume\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:59:30.564167 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:30.564168    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xq795\" (UniqueName: \"kubernetes.io/projected/c354f0d8-cc12-49c9-b924-238773cf86a4-kube-api-access-xq795\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:59:30.564167 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:30.564177    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c354f0d8-cc12-49c9-b924-238773cf86a4-plugins-config-volume\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:59:31.312594 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:31.312564    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-3511f6-65644dc98d-7dfxl"
Jul 27 20:59:31.312594 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:31.312576    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-3511f6-65644dc98d-7dfxl" event={"ID":"b7d51386-e87b-45e6-82eb-5df4b1036908","Type":"ContainerDied","Data":"dadfd7a9267d8b169deda5b31a71fdceabb665786a7145d590bcf8169d39203d"}
Jul 27 20:59:31.313104 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:31.312647    2557 scope.go:117] "RemoveContainer" containerID="e2fec0dc815954a32e827645191fd9cf2a04f4acc9d5d05c1b9cbde80a08981e"
Jul 27 20:59:31.313979 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:31.313960    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-3511f6-6f56c8d5c6-ph2cj"
Jul 27 20:59:31.314058 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:31.314004    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-3511f6-6f56c8d5c6-ph2cj" event={"ID":"c354f0d8-cc12-49c9-b924-238773cf86a4","Type":"ContainerDied","Data":"6159716ac64b0de1236e2d877f62b5e83430cb6768de3a36896c62c40f57359d"}
Jul 27 20:59:31.321761 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:31.321741    2557 scope.go:117] "RemoveContainer" containerID="007749812a542af53779f25a585f8afeb544d7bea6b2b37bbe21c3f934143654"
Jul 27 20:59:31.347504 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:31.347470    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-3511f6-6f56c8d5c6-ph2cj"]
Jul 27 20:59:31.351388 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:31.351360    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-3511f6-6f56c8d5c6-ph2cj"]
Jul 27 20:59:31.370046 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:31.369964    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-3511f6-65644dc98d-7dfxl"]
Jul 27 20:59:31.373440 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:31.373409    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-3511f6-65644dc98d-7dfxl"]
Jul 27 20:59:31.911584 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:31.911547    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7d51386-e87b-45e6-82eb-5df4b1036908" path="/var/lib/kubelet/pods/b7d51386-e87b-45e6-82eb-5df4b1036908/volumes"
Jul 27 20:59:31.911932 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:31.911919    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c354f0d8-cc12-49c9-b924-238773cf86a4" path="/var/lib/kubelet/pods/c354f0d8-cc12-49c9-b924-238773cf86a4/volumes"
Jul 27 20:59:33.099933 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:33.099895    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:59:33.185954 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:33.185924    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:59:33.544504 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:33.544442    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:59:39.818478 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:39.818422    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:59:39.918268 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:39.918238    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:59:40.143233 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:40.143143    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:59:40.346227 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:40.346194    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:59:50.804299 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:50.804259    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:59:50.840371 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:50.840328    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-4af3f5-6b9c5786cd-gmhn9"]
Jul 27 20:59:50.840614 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:50.840592    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-4af3f5-6b9c5786cd-gmhn9" podUID="cc0c5ad1-b976-44eb-b8dd-7cfaaf65c032" containerName="payload-processing" containerID="cri-o://2af5f140999a888d837fa29536067157cb2892d05137243f39fdb664594bd794" gracePeriod=30
Jul 27 20:59:50.850643 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:50.850607    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-4af3f5-6cb6c499d4-bvntj"]
Jul 27 20:59:50.850948 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:50.850888    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-4af3f5-6cb6c499d4-bvntj" podUID="e29ecfc9-156f-4745-b5d7-008498da4d74" containerName="payload-pre-processing" containerID="cri-o://59ac1295f5403be90f504967e04e2dec1b9cb1e78d06020cd3d4faca67997c33" gracePeriod=30
Jul 27 20:59:50.890635 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:50.890606    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:59:50.957427 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:50.957366    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:59:51.128953 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:51.128926    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-4af3f5-6b9c5786cd-gmhn9"
Jul 27 20:59:51.131972 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:51.131937    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-4af3f5-6cb6c499d4-bvntj"
Jul 27 20:59:51.208906 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:51.208870    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc0c5ad1-b976-44eb-b8dd-7cfaaf65c032-plugins-config-volume\") pod \"cc0c5ad1-b976-44eb-b8dd-7cfaaf65c032\" (UID: \"cc0c5ad1-b976-44eb-b8dd-7cfaaf65c032\") "
Jul 27 20:59:51.208906 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:51.208905    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e29ecfc9-156f-4745-b5d7-008498da4d74-plugins-config-volume\") pod \"e29ecfc9-156f-4745-b5d7-008498da4d74\" (UID: \"e29ecfc9-156f-4745-b5d7-008498da4d74\") "
Jul 27 20:59:51.209123 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:51.208961    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vnhwv\" (UniqueName: \"kubernetes.io/projected/e29ecfc9-156f-4745-b5d7-008498da4d74-kube-api-access-vnhwv\") pod \"e29ecfc9-156f-4745-b5d7-008498da4d74\" (UID: \"e29ecfc9-156f-4745-b5d7-008498da4d74\") "
Jul 27 20:59:51.209123 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:51.208997    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v4wrw\" (UniqueName: \"kubernetes.io/projected/cc0c5ad1-b976-44eb-b8dd-7cfaaf65c032-kube-api-access-v4wrw\") pod \"cc0c5ad1-b976-44eb-b8dd-7cfaaf65c032\" (UID: \"cc0c5ad1-b976-44eb-b8dd-7cfaaf65c032\") "
Jul 27 20:59:51.209366 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:51.209336    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc0c5ad1-b976-44eb-b8dd-7cfaaf65c032-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cc0c5ad1-b976-44eb-b8dd-7cfaaf65c032" (UID: "cc0c5ad1-b976-44eb-b8dd-7cfaaf65c032"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:59:51.209408 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:51.209353    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e29ecfc9-156f-4745-b5d7-008498da4d74-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e29ecfc9-156f-4745-b5d7-008498da4d74" (UID: "e29ecfc9-156f-4745-b5d7-008498da4d74"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:59:51.211112 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:51.211088    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e29ecfc9-156f-4745-b5d7-008498da4d74-kube-api-access-vnhwv" (OuterVolumeSpecName: "kube-api-access-vnhwv") pod "e29ecfc9-156f-4745-b5d7-008498da4d74" (UID: "e29ecfc9-156f-4745-b5d7-008498da4d74"). InnerVolumeSpecName "kube-api-access-vnhwv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:59:51.211207 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:51.211135    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc0c5ad1-b976-44eb-b8dd-7cfaaf65c032-kube-api-access-v4wrw" (OuterVolumeSpecName: "kube-api-access-v4wrw") pod "cc0c5ad1-b976-44eb-b8dd-7cfaaf65c032" (UID: "cc0c5ad1-b976-44eb-b8dd-7cfaaf65c032"). InnerVolumeSpecName "kube-api-access-v4wrw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:59:51.309561 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:51.309521    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v4wrw\" (UniqueName: \"kubernetes.io/projected/cc0c5ad1-b976-44eb-b8dd-7cfaaf65c032-kube-api-access-v4wrw\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:59:51.309561 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:51.309555    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc0c5ad1-b976-44eb-b8dd-7cfaaf65c032-plugins-config-volume\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:59:51.309561 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:51.309568    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e29ecfc9-156f-4745-b5d7-008498da4d74-plugins-config-volume\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:59:51.309802 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:51.309579    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vnhwv\" (UniqueName: \"kubernetes.io/projected/e29ecfc9-156f-4745-b5d7-008498da4d74-kube-api-access-vnhwv\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 20:59:51.424626 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:51.424521    2557 generic.go:356] "Generic (PLEG): container finished" podID="e29ecfc9-156f-4745-b5d7-008498da4d74" containerID="59ac1295f5403be90f504967e04e2dec1b9cb1e78d06020cd3d4faca67997c33" exitCode=0
Jul 27 20:59:51.424626 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:51.424576    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-4af3f5-6cb6c499d4-bvntj"
Jul 27 20:59:51.424626 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:51.424610    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-4af3f5-6cb6c499d4-bvntj" event={"ID":"e29ecfc9-156f-4745-b5d7-008498da4d74","Type":"ContainerDied","Data":"59ac1295f5403be90f504967e04e2dec1b9cb1e78d06020cd3d4faca67997c33"}
Jul 27 20:59:51.424901 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:51.424670    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-4af3f5-6cb6c499d4-bvntj" event={"ID":"e29ecfc9-156f-4745-b5d7-008498da4d74","Type":"ContainerDied","Data":"872ececb26e7b8931bbc43ef0556fb816a758277a546b1e224d274bafc79d00a"}
Jul 27 20:59:51.424901 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:51.424697    2557 scope.go:117] "RemoveContainer" containerID="59ac1295f5403be90f504967e04e2dec1b9cb1e78d06020cd3d4faca67997c33"
Jul 27 20:59:51.425947 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:51.425927    2557 generic.go:356] "Generic (PLEG): container finished" podID="cc0c5ad1-b976-44eb-b8dd-7cfaaf65c032" containerID="2af5f140999a888d837fa29536067157cb2892d05137243f39fdb664594bd794" exitCode=0
Jul 27 20:59:51.426032 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:51.425973    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-4af3f5-6b9c5786cd-gmhn9"
Jul 27 20:59:51.426032 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:51.426016    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-4af3f5-6b9c5786cd-gmhn9" event={"ID":"cc0c5ad1-b976-44eb-b8dd-7cfaaf65c032","Type":"ContainerDied","Data":"2af5f140999a888d837fa29536067157cb2892d05137243f39fdb664594bd794"}
Jul 27 20:59:51.426149 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:51.426068    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-4af3f5-6b9c5786cd-gmhn9" event={"ID":"cc0c5ad1-b976-44eb-b8dd-7cfaaf65c032","Type":"ContainerDied","Data":"6f39b1c8d7752ddfffb16cb6f9ef4dbf818809478747ed53b47892c527fe9ec6"}
Jul 27 20:59:51.434950 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:51.434930    2557 scope.go:117] "RemoveContainer" containerID="59ac1295f5403be90f504967e04e2dec1b9cb1e78d06020cd3d4faca67997c33"
Jul 27 20:59:51.435242 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:59:51.435222    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59ac1295f5403be90f504967e04e2dec1b9cb1e78d06020cd3d4faca67997c33\": container with ID starting with 59ac1295f5403be90f504967e04e2dec1b9cb1e78d06020cd3d4faca67997c33 not found: ID does not exist" containerID="59ac1295f5403be90f504967e04e2dec1b9cb1e78d06020cd3d4faca67997c33"
Jul 27 20:59:51.435287 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:51.435253    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59ac1295f5403be90f504967e04e2dec1b9cb1e78d06020cd3d4faca67997c33"} err="failed to get container status \"59ac1295f5403be90f504967e04e2dec1b9cb1e78d06020cd3d4faca67997c33\": rpc error: code = NotFound desc = could not find container \"59ac1295f5403be90f504967e04e2dec1b9cb1e78d06020cd3d4faca67997c33\": container with ID starting with 59ac1295f5403be90f504967e04e2dec1b9cb1e78d06020cd3d4faca67997c33 not found: ID does not exist"
Jul 27 20:59:51.435287 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:51.435271    2557 scope.go:117] "RemoveContainer" containerID="2af5f140999a888d837fa29536067157cb2892d05137243f39fdb664594bd794"
Jul 27 20:59:51.443731 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:51.443710    2557 scope.go:117] "RemoveContainer" containerID="2af5f140999a888d837fa29536067157cb2892d05137243f39fdb664594bd794"
Jul 27 20:59:51.443972 ip-10-0-128-149 kubenswrapper[2557]: E0727 20:59:51.443953    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2af5f140999a888d837fa29536067157cb2892d05137243f39fdb664594bd794\": container with ID starting with 2af5f140999a888d837fa29536067157cb2892d05137243f39fdb664594bd794 not found: ID does not exist" containerID="2af5f140999a888d837fa29536067157cb2892d05137243f39fdb664594bd794"
Jul 27 20:59:51.444035 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:51.443978    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2af5f140999a888d837fa29536067157cb2892d05137243f39fdb664594bd794"} err="failed to get container status \"2af5f140999a888d837fa29536067157cb2892d05137243f39fdb664594bd794\": rpc error: code = NotFound desc = could not find container \"2af5f140999a888d837fa29536067157cb2892d05137243f39fdb664594bd794\": container with ID starting with 2af5f140999a888d837fa29536067157cb2892d05137243f39fdb664594bd794 not found: ID does not exist"
Jul 27 20:59:51.453530 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:51.453505    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-4af3f5-6cb6c499d4-bvntj"]
Jul 27 20:59:51.457600 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:51.457565    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-4af3f5-6cb6c499d4-bvntj"]
Jul 27 20:59:51.468729 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:51.468703    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-4af3f5-6b9c5786cd-gmhn9"]
Jul 27 20:59:51.477481 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:51.475187    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-4af3f5-6b9c5786cd-gmhn9"]
Jul 27 20:59:51.911031 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:51.910997    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc0c5ad1-b976-44eb-b8dd-7cfaaf65c032" path="/var/lib/kubelet/pods/cc0c5ad1-b976-44eb-b8dd-7cfaaf65c032/volumes"
Jul 27 20:59:51.911406 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:51.911391    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e29ecfc9-156f-4745-b5d7-008498da4d74" path="/var/lib/kubelet/pods/e29ecfc9-156f-4745-b5d7-008498da4d74/volumes"
Jul 27 20:59:53.897404 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:53.897361    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 20:59:55.573125 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:55.573091    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 20:59:55.942877 ip-10-0-128-149 kubenswrapper[2557]: I0727 20:59:55.942792    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 21:00:02.754200 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:02.754154    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 21:00:02.914033 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:02.913967    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 21:00:03.013490 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:03.013353    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 21:00:03.271657 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:03.271557    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 21:00:14.027611 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:14.027577    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-21ded0-f657f9dcd-pjjds"]
Jul 27 21:00:14.028088 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:14.027773    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-21ded0-f657f9dcd-pjjds" podUID="8cacc492-0f74-4105-8e34-0b9a69f43610" containerName="payload-processing" containerID="cri-o://c755b135dcabcb5f0d5bffd58d0caf1a39bde22c2fc9896c5ed3383ca87c8200" gracePeriod=30
Jul 27 21:00:14.034781 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:14.034748    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-21ded0-6d7f96d4b4-vhbkb"]
Jul 27 21:00:14.035029 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:14.034981    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-21ded0-6d7f96d4b4-vhbkb" podUID="d28fb7dc-288a-4c90-97a7-e24ceccd6434" containerName="payload-pre-processing" containerID="cri-o://7498d56e53d840fcbd810820f91d7ce91024b9894dd35f76126b5994224404e2" gracePeriod=30
Jul 27 21:00:14.115158 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:14.115111    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-21ded0-6d7f96d4b4-vhbkb" podUID="d28fb7dc-288a-4c90-97a7-e24ceccd6434" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.134.0.76:9004: connect: connection refused"
Jul 27 21:00:14.115314 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:14.115111    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-shared-b-21ded0-f657f9dcd-pjjds" podUID="8cacc492-0f74-4105-8e34-0b9a69f43610" containerName="payload-processing" probeResult="failure" output="dial tcp 10.134.0.77:9004: connect: connection refused"
Jul 27 21:00:14.315000 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:14.314976    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-21ded0-f657f9dcd-pjjds"
Jul 27 21:00:14.317895 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:14.317875    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-21ded0-6d7f96d4b4-vhbkb"
Jul 27 21:00:14.418836 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:14.418802    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d28fb7dc-288a-4c90-97a7-e24ceccd6434-plugins-config-volume\") pod \"d28fb7dc-288a-4c90-97a7-e24ceccd6434\" (UID: \"d28fb7dc-288a-4c90-97a7-e24ceccd6434\") "
Jul 27 21:00:14.419038 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:14.418863    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8cacc492-0f74-4105-8e34-0b9a69f43610-plugins-config-volume\") pod \"8cacc492-0f74-4105-8e34-0b9a69f43610\" (UID: \"8cacc492-0f74-4105-8e34-0b9a69f43610\") "
Jul 27 21:00:14.419038 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:14.418902    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hxrn7\" (UniqueName: \"kubernetes.io/projected/8cacc492-0f74-4105-8e34-0b9a69f43610-kube-api-access-hxrn7\") pod \"8cacc492-0f74-4105-8e34-0b9a69f43610\" (UID: \"8cacc492-0f74-4105-8e34-0b9a69f43610\") "
Jul 27 21:00:14.419038 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:14.419004    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5zqhl\" (UniqueName: \"kubernetes.io/projected/d28fb7dc-288a-4c90-97a7-e24ceccd6434-kube-api-access-5zqhl\") pod \"d28fb7dc-288a-4c90-97a7-e24ceccd6434\" (UID: \"d28fb7dc-288a-4c90-97a7-e24ceccd6434\") "
Jul 27 21:00:14.419297 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:14.419270    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d28fb7dc-288a-4c90-97a7-e24ceccd6434-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d28fb7dc-288a-4c90-97a7-e24ceccd6434" (UID: "d28fb7dc-288a-4c90-97a7-e24ceccd6434"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:00:14.419351 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:14.419332    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8cacc492-0f74-4105-8e34-0b9a69f43610-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8cacc492-0f74-4105-8e34-0b9a69f43610" (UID: "8cacc492-0f74-4105-8e34-0b9a69f43610"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:00:14.421174 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:14.421150    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8cacc492-0f74-4105-8e34-0b9a69f43610-kube-api-access-hxrn7" (OuterVolumeSpecName: "kube-api-access-hxrn7") pod "8cacc492-0f74-4105-8e34-0b9a69f43610" (UID: "8cacc492-0f74-4105-8e34-0b9a69f43610"). InnerVolumeSpecName "kube-api-access-hxrn7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:00:14.421249 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:14.421211    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d28fb7dc-288a-4c90-97a7-e24ceccd6434-kube-api-access-5zqhl" (OuterVolumeSpecName: "kube-api-access-5zqhl") pod "d28fb7dc-288a-4c90-97a7-e24ceccd6434" (UID: "d28fb7dc-288a-4c90-97a7-e24ceccd6434"). InnerVolumeSpecName "kube-api-access-5zqhl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:00:14.520335 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:14.520298    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d28fb7dc-288a-4c90-97a7-e24ceccd6434-plugins-config-volume\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 21:00:14.520335 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:14.520331    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8cacc492-0f74-4105-8e34-0b9a69f43610-plugins-config-volume\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 21:00:14.520335 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:14.520340    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hxrn7\" (UniqueName: \"kubernetes.io/projected/8cacc492-0f74-4105-8e34-0b9a69f43610-kube-api-access-hxrn7\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 21:00:14.520600 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:14.520350    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5zqhl\" (UniqueName: \"kubernetes.io/projected/d28fb7dc-288a-4c90-97a7-e24ceccd6434-kube-api-access-5zqhl\") on node \"ip-10-0-128-149.ec2.internal\" DevicePath \"\""
Jul 27 21:00:14.551301 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:14.551219    2557 generic.go:356] "Generic (PLEG): container finished" podID="8cacc492-0f74-4105-8e34-0b9a69f43610" containerID="c755b135dcabcb5f0d5bffd58d0caf1a39bde22c2fc9896c5ed3383ca87c8200" exitCode=0
Jul 27 21:00:14.551301 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:14.551263    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-21ded0-f657f9dcd-pjjds"
Jul 27 21:00:14.551542 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:14.551300    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-21ded0-f657f9dcd-pjjds" event={"ID":"8cacc492-0f74-4105-8e34-0b9a69f43610","Type":"ContainerDied","Data":"c755b135dcabcb5f0d5bffd58d0caf1a39bde22c2fc9896c5ed3383ca87c8200"}
Jul 27 21:00:14.551542 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:14.551357    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-21ded0-f657f9dcd-pjjds" event={"ID":"8cacc492-0f74-4105-8e34-0b9a69f43610","Type":"ContainerDied","Data":"98a44f54243beaf629e625ffa490b8cf144bb2c216ac12b6736062ae9aa40a30"}
Jul 27 21:00:14.551542 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:14.551383    2557 scope.go:117] "RemoveContainer" containerID="c755b135dcabcb5f0d5bffd58d0caf1a39bde22c2fc9896c5ed3383ca87c8200"
Jul 27 21:00:14.552701 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:14.552675    2557 generic.go:356] "Generic (PLEG): container finished" podID="d28fb7dc-288a-4c90-97a7-e24ceccd6434" containerID="7498d56e53d840fcbd810820f91d7ce91024b9894dd35f76126b5994224404e2" exitCode=0
Jul 27 21:00:14.552795 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:14.552720    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-21ded0-6d7f96d4b4-vhbkb"
Jul 27 21:00:14.552795 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:14.552759    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-21ded0-6d7f96d4b4-vhbkb" event={"ID":"d28fb7dc-288a-4c90-97a7-e24ceccd6434","Type":"ContainerDied","Data":"7498d56e53d840fcbd810820f91d7ce91024b9894dd35f76126b5994224404e2"}
Jul 27 21:00:14.552909 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:14.552804    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-21ded0-6d7f96d4b4-vhbkb" event={"ID":"d28fb7dc-288a-4c90-97a7-e24ceccd6434","Type":"ContainerDied","Data":"3370503ed86d2dfe28b82efd816fd85dfc984b295b08a7a6a52bfaadf079f86f"}
Jul 27 21:00:14.562128 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:14.562108    2557 scope.go:117] "RemoveContainer" containerID="c755b135dcabcb5f0d5bffd58d0caf1a39bde22c2fc9896c5ed3383ca87c8200"
Jul 27 21:00:14.562536 ip-10-0-128-149 kubenswrapper[2557]: E0727 21:00:14.562514    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c755b135dcabcb5f0d5bffd58d0caf1a39bde22c2fc9896c5ed3383ca87c8200\": container with ID starting with c755b135dcabcb5f0d5bffd58d0caf1a39bde22c2fc9896c5ed3383ca87c8200 not found: ID does not exist" containerID="c755b135dcabcb5f0d5bffd58d0caf1a39bde22c2fc9896c5ed3383ca87c8200"
Jul 27 21:00:14.562630 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:14.562545    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c755b135dcabcb5f0d5bffd58d0caf1a39bde22c2fc9896c5ed3383ca87c8200"} err="failed to get container status \"c755b135dcabcb5f0d5bffd58d0caf1a39bde22c2fc9896c5ed3383ca87c8200\": rpc error: code = NotFound desc = could not find container \"c755b135dcabcb5f0d5bffd58d0caf1a39bde22c2fc9896c5ed3383ca87c8200\": container with ID starting with c755b135dcabcb5f0d5bffd58d0caf1a39bde22c2fc9896c5ed3383ca87c8200 not found: ID does not exist"
Jul 27 21:00:14.562630 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:14.562561    2557 scope.go:117] "RemoveContainer" containerID="7498d56e53d840fcbd810820f91d7ce91024b9894dd35f76126b5994224404e2"
Jul 27 21:00:14.570984 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:14.570963    2557 scope.go:117] "RemoveContainer" containerID="7498d56e53d840fcbd810820f91d7ce91024b9894dd35f76126b5994224404e2"
Jul 27 21:00:14.571221 ip-10-0-128-149 kubenswrapper[2557]: E0727 21:00:14.571202    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7498d56e53d840fcbd810820f91d7ce91024b9894dd35f76126b5994224404e2\": container with ID starting with 7498d56e53d840fcbd810820f91d7ce91024b9894dd35f76126b5994224404e2 not found: ID does not exist" containerID="7498d56e53d840fcbd810820f91d7ce91024b9894dd35f76126b5994224404e2"
Jul 27 21:00:14.571271 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:14.571231    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7498d56e53d840fcbd810820f91d7ce91024b9894dd35f76126b5994224404e2"} err="failed to get container status \"7498d56e53d840fcbd810820f91d7ce91024b9894dd35f76126b5994224404e2\": rpc error: code = NotFound desc = could not find container \"7498d56e53d840fcbd810820f91d7ce91024b9894dd35f76126b5994224404e2\": container with ID starting with 7498d56e53d840fcbd810820f91d7ce91024b9894dd35f76126b5994224404e2 not found: ID does not exist"
Jul 27 21:00:14.578064 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:14.578038    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-21ded0-6d7f96d4b4-vhbkb"]
Jul 27 21:00:14.581904 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:14.581873    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-21ded0-6d7f96d4b4-vhbkb"]
Jul 27 21:00:14.592079 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:14.592041    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-21ded0-f657f9dcd-pjjds"]
Jul 27 21:00:14.595003 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:14.594977    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-21ded0-f657f9dcd-pjjds"]
Jul 27 21:00:15.543107 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:15.543064    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 21:00:15.640394 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:15.640351    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 21:00:15.910881 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:15.910798    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8cacc492-0f74-4105-8e34-0b9a69f43610" path="/var/lib/kubelet/pods/8cacc492-0f74-4105-8e34-0b9a69f43610/volumes"
Jul 27 21:00:15.911164 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:15.911151    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d28fb7dc-288a-4c90-97a7-e24ceccd6434" path="/var/lib/kubelet/pods/d28fb7dc-288a-4c90-97a7-e24ceccd6434/volumes"
Jul 27 21:00:16.997091 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:16.997059    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-45lq6"]
Jul 27 21:00:18.353709 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:18.353677    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 21:00:18.733515 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:18.733481    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 21:00:24.735492 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:24.735438    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 21:00:24.800016 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:24.799973    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 21:00:25.027414 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:25.027322    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 21:00:25.272469 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:25.272419    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 21:00:25.745780 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:25.745744    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5778fdbcb6-tm9gt_77e5c699-4ef0-4403-8549-57a760aae76b/authorino/0.log"
Jul 27 21:00:31.850749 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:31.850714    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67944f57b-bl5h9_6bbd94fb-4407-41ac-a3fd-c03150ba8728/manager/0.log"
Jul 27 21:00:31.863475 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:31.863434    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67944f57b-bl5h9_6bbd94fb-4407-41ac-a3fd-c03150ba8728/copy-manifests/0.log"
Jul 27 21:00:33.783470 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:33.783428    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759snwfw_87f1030a-335b-4bfa-b6ad-915a09c7768e/util/0.log"
Jul 27 21:00:33.789880 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:33.789853    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759snwfw_87f1030a-335b-4bfa-b6ad-915a09c7768e/pull/0.log"
Jul 27 21:00:33.795894 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:33.795869    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759snwfw_87f1030a-335b-4bfa-b6ad-915a09c7768e/extract/0.log"
Jul 27 21:00:33.912403 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:33.912370    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x5f9t_1e5cb12b-b83d-4906-b247-e76e13ab5dfb/util/0.log"
Jul 27 21:00:33.919549 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:33.919529    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x5f9t_1e5cb12b-b83d-4906-b247-e76e13ab5dfb/pull/0.log"
Jul 27 21:00:33.925706 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:33.925687    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x5f9t_1e5cb12b-b83d-4906-b247-e76e13ab5dfb/extract/0.log"
Jul 27 21:00:34.036986 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:34.036907    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73224sl_f1f28c73-9a95-401a-aa5c-2014fe34d569/util/0.log"
Jul 27 21:00:34.043331 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:34.043295    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73224sl_f1f28c73-9a95-401a-aa5c-2014fe34d569/pull/0.log"
Jul 27 21:00:34.049400 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:34.049382    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73224sl_f1f28c73-9a95-401a-aa5c-2014fe34d569/extract/0.log"
Jul 27 21:00:34.160513 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:34.160480    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tlh72_a3bbd56f-2091-40e6-92a4-bb2050447750/extract/0.log"
Jul 27 21:00:34.166765 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:34.166734    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tlh72_a3bbd56f-2091-40e6-92a4-bb2050447750/util/0.log"
Jul 27 21:00:34.172774 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:34.172737    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tlh72_a3bbd56f-2091-40e6-92a4-bb2050447750/pull/0.log"
Jul 27 21:00:34.294251 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:34.294168    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5778fdbcb6-tm9gt_77e5c699-4ef0-4403-8549-57a760aae76b/authorino/0.log"
Jul 27 21:00:34.636803 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:34.636727    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-28k56_89ba8ef0-9e77-4890-9df6-b69a4779c3ed/kuadrant-console-plugin/0.log"
Jul 27 21:00:34.990941 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:34.990910    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-45lq6_5d078287-04fe-4f68-b32b-36d3de178562/limitador/0.log"
Jul 27 21:00:35.822830 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:35.822804    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-c9f4f89b5-v6th7_d791007e-8813-475d-8f39-919a47610c39/kube-auth-proxy/0.log"
Jul 27 21:00:36.287834 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:36.287806    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-74566c475c-7w525_966563a5-3031-4e3f-ab52-31e43de5dd1f/router/0.log"
Jul 27 21:00:37.213365 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:37.213335    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-q9plc_96ea0c83-b0af-4039-898d-49f5c9484ecb/main/0.log"
Jul 27 21:00:42.434300 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:42.434259    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jpxkn/must-gather-jfndx"]
Jul 27 21:00:42.434758 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:42.434614    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7d51386-e87b-45e6-82eb-5df4b1036908" containerName="payload-pre-processing"
Jul 27 21:00:42.434758 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:42.434626    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7d51386-e87b-45e6-82eb-5df4b1036908" containerName="payload-pre-processing"
Jul 27 21:00:42.434758 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:42.434634    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e29ecfc9-156f-4745-b5d7-008498da4d74" containerName="payload-pre-processing"
Jul 27 21:00:42.434758 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:42.434640    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e29ecfc9-156f-4745-b5d7-008498da4d74" containerName="payload-pre-processing"
Jul 27 21:00:42.434758 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:42.434649    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94a0ba0a-4d58-428c-a073-c619bed27983" containerName="payload-processing"
Jul 27 21:00:42.434758 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:42.434655    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="94a0ba0a-4d58-428c-a073-c619bed27983" containerName="payload-processing"
Jul 27 21:00:42.434758 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:42.434663    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2" containerName="main"
Jul 27 21:00:42.434758 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:42.434668    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2" containerName="main"
Jul 27 21:00:42.434758 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:42.434675    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c69f529-341f-41eb-9937-96245a1fb227" containerName="payload-pre-processing"
Jul 27 21:00:42.434758 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:42.434681    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c69f529-341f-41eb-9937-96245a1fb227" containerName="payload-pre-processing"
Jul 27 21:00:42.434758 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:42.434691    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0213946e-5d18-4c21-b08f-e019506dab2b" containerName="payload-processing"
Jul 27 21:00:42.434758 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:42.434696    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="0213946e-5d18-4c21-b08f-e019506dab2b" containerName="payload-processing"
Jul 27 21:00:42.434758 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:42.434705    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea10604d-0d32-4c48-96bd-e460f921d39c" containerName="payload-pre-processing"
Jul 27 21:00:42.434758 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:42.434710    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea10604d-0d32-4c48-96bd-e460f921d39c" containerName="payload-pre-processing"
Jul 27 21:00:42.434758 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:42.434724    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc0c5ad1-b976-44eb-b8dd-7cfaaf65c032" containerName="payload-processing"
Jul 27 21:00:42.434758 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:42.434729    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc0c5ad1-b976-44eb-b8dd-7cfaaf65c032" containerName="payload-processing"
Jul 27 21:00:42.434758 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:42.434736    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cacc492-0f74-4105-8e34-0b9a69f43610" containerName="payload-processing"
Jul 27 21:00:42.434758 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:42.434741    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cacc492-0f74-4105-8e34-0b9a69f43610" containerName="payload-processing"
Jul 27 21:00:42.434758 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:42.434747    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c354f0d8-cc12-49c9-b924-238773cf86a4" containerName="payload-processing"
Jul 27 21:00:42.434758 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:42.434752    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c354f0d8-cc12-49c9-b924-238773cf86a4" containerName="payload-processing"
Jul 27 21:00:42.434758 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:42.434759    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d28fb7dc-288a-4c90-97a7-e24ceccd6434" containerName="payload-pre-processing"
Jul 27 21:00:42.434758 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:42.434764    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d28fb7dc-288a-4c90-97a7-e24ceccd6434" containerName="payload-pre-processing"
Jul 27 21:00:42.435430 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:42.434815    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="0213946e-5d18-4c21-b08f-e019506dab2b" containerName="payload-processing"
Jul 27 21:00:42.435430 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:42.434823    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea10604d-0d32-4c48-96bd-e460f921d39c" containerName="payload-pre-processing"
Jul 27 21:00:42.435430 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:42.434829    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="e29ecfc9-156f-4745-b5d7-008498da4d74" containerName="payload-pre-processing"
Jul 27 21:00:42.435430 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:42.434835    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="94a0ba0a-4d58-428c-a073-c619bed27983" containerName="payload-processing"
Jul 27 21:00:42.435430 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:42.434842    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="c354f0d8-cc12-49c9-b924-238773cf86a4" containerName="payload-processing"
Jul 27 21:00:42.435430 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:42.434849    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="d28fb7dc-288a-4c90-97a7-e24ceccd6434" containerName="payload-pre-processing"
Jul 27 21:00:42.435430 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:42.434855    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="8cacc492-0f74-4105-8e34-0b9a69f43610" containerName="payload-processing"
Jul 27 21:00:42.435430 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:42.434862    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc0c5ad1-b976-44eb-b8dd-7cfaaf65c032" containerName="payload-processing"
Jul 27 21:00:42.435430 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:42.434867    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="bae59e7c-3d18-4802-bd22-bd1e5fe0a0c2" containerName="main"
Jul 27 21:00:42.435430 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:42.434872    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c69f529-341f-41eb-9937-96245a1fb227" containerName="payload-pre-processing"
Jul 27 21:00:42.435430 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:42.434877    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7d51386-e87b-45e6-82eb-5df4b1036908" containerName="payload-pre-processing"
Jul 27 21:00:42.437996 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:42.437979    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jpxkn/must-gather-jfndx"
Jul 27 21:00:42.440560 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:42.440530    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jpxkn\"/\"default-dockercfg-z468q\""
Jul 27 21:00:42.440560 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:42.440551    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jpxkn\"/\"openshift-service-ca.crt\""
Jul 27 21:00:42.440560 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:42.440533    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jpxkn\"/\"kube-root-ca.crt\""
Jul 27 21:00:42.447493 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:42.447469    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jpxkn/must-gather-jfndx"]
Jul 27 21:00:42.465009 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:42.464977    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8z92\" (UniqueName: \"kubernetes.io/projected/184e8deb-0743-486d-971b-8048884eaffc-kube-api-access-j8z92\") pod \"must-gather-jfndx\" (UID: \"184e8deb-0743-486d-971b-8048884eaffc\") " pod="openshift-must-gather-jpxkn/must-gather-jfndx"
Jul 27 21:00:42.465189 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:42.465021    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/184e8deb-0743-486d-971b-8048884eaffc-must-gather-output\") pod \"must-gather-jfndx\" (UID: \"184e8deb-0743-486d-971b-8048884eaffc\") " pod="openshift-must-gather-jpxkn/must-gather-jfndx"
Jul 27 21:00:42.566576 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:42.566535    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8z92\" (UniqueName: \"kubernetes.io/projected/184e8deb-0743-486d-971b-8048884eaffc-kube-api-access-j8z92\") pod \"must-gather-jfndx\" (UID: \"184e8deb-0743-486d-971b-8048884eaffc\") " pod="openshift-must-gather-jpxkn/must-gather-jfndx"
Jul 27 21:00:42.566576 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:42.566581    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/184e8deb-0743-486d-971b-8048884eaffc-must-gather-output\") pod \"must-gather-jfndx\" (UID: \"184e8deb-0743-486d-971b-8048884eaffc\") " pod="openshift-must-gather-jpxkn/must-gather-jfndx"
Jul 27 21:00:42.566919 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:42.566901    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/184e8deb-0743-486d-971b-8048884eaffc-must-gather-output\") pod \"must-gather-jfndx\" (UID: \"184e8deb-0743-486d-971b-8048884eaffc\") " pod="openshift-must-gather-jpxkn/must-gather-jfndx"
Jul 27 21:00:42.575225 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:42.575192    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8z92\" (UniqueName: \"kubernetes.io/projected/184e8deb-0743-486d-971b-8048884eaffc-kube-api-access-j8z92\") pod \"must-gather-jfndx\" (UID: \"184e8deb-0743-486d-971b-8048884eaffc\") " pod="openshift-must-gather-jpxkn/must-gather-jfndx"
Jul 27 21:00:42.748422 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:42.748376    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jpxkn/must-gather-jfndx"
Jul 27 21:00:42.887003 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:42.886976    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jpxkn/must-gather-jfndx"]
Jul 27 21:00:42.889199 ip-10-0-128-149 kubenswrapper[2557]: W0727 21:00:42.889173    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod184e8deb_0743_486d_971b_8048884eaffc.slice/crio-075d4713d75a4825046399af94bcf14a6fcefa3a037bc8ee87ce243d0898c8e7 WatchSource:0}: Error finding container 075d4713d75a4825046399af94bcf14a6fcefa3a037bc8ee87ce243d0898c8e7: Status 404 returned error can't find the container with id 075d4713d75a4825046399af94bcf14a6fcefa3a037bc8ee87ce243d0898c8e7
Jul 27 21:00:42.891047 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:42.891029    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 21:00:42.942945 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:42.942909    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 21:00:43.040399 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:43.040314    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 21:00:43.707199 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:43.707164    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jpxkn/must-gather-jfndx" event={"ID":"184e8deb-0743-486d-971b-8048884eaffc","Type":"ContainerStarted","Data":"075d4713d75a4825046399af94bcf14a6fcefa3a037bc8ee87ce243d0898c8e7"}
Jul 27 21:00:44.715157 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:44.715113    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jpxkn/must-gather-jfndx" event={"ID":"184e8deb-0743-486d-971b-8048884eaffc","Type":"ContainerStarted","Data":"f6682b84d38a16c334f07efa280b9d78478f9d999ee3d176807fe0263eebc345"}
Jul 27 21:00:44.715157 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:44.715166    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jpxkn/must-gather-jfndx" event={"ID":"184e8deb-0743-486d-971b-8048884eaffc","Type":"ContainerStarted","Data":"11b8260212e490c5c646512b3c2e07e29bd2c87bb9a132989dc1c5c86ee87d2a"}
Jul 27 21:00:44.736108 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:44.736038    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jpxkn/must-gather-jfndx" podStartSLOduration=1.44984244 podStartE2EDuration="2.736014747s" totalImagesPullingTime="1.286172307s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:00:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:00:44.732208089 +0000 UTC m=+3393.306934477" watchObservedRunningTime="2026-07-27 21:00:44.736014747 +0000 UTC m=+3393.310741133"
Jul 27 21:00:45.781585 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:45.781548    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-77759_8b80d55b-21c2-41bc-9e47-ec1583240fc2/global-pull-secret-syncer/0.log"
Jul 27 21:00:45.918367 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:45.918333    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log"
Jul 27 21:00:46.020038 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:46.020005    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-149.ec2.internal_c1d7f2fc6e91fecc35ff7f75225b4759/haproxy/0.log"
Jul 27 21:00:50.620745 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:50.620680    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759snwfw_87f1030a-335b-4bfa-b6ad-915a09c7768e/extract/0.log"
Jul 27 21:00:50.645285 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:50.645170    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759snwfw_87f1030a-335b-4bfa-b6ad-915a09c7768e/util/0.log"
Jul 27 21:00:50.668446 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:50.668350    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759snwfw_87f1030a-335b-4bfa-b6ad-915a09c7768e/pull/0.log"
Jul 27 21:00:50.699683 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:50.699656    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x5f9t_1e5cb12b-b83d-4906-b247-e76e13ab5dfb/extract/0.log"
Jul 27 21:00:50.726961 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:50.726878    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x5f9t_1e5cb12b-b83d-4906-b247-e76e13ab5dfb/util/0.log"
Jul 27 21:00:50.750239 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:50.750211    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x5f9t_1e5cb12b-b83d-4906-b247-e76e13ab5dfb/pull/0.log"
Jul 27 21:00:50.779432 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:50.779340    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73224sl_f1f28c73-9a95-401a-aa5c-2014fe34d569/extract/0.log"
Jul 27 21:00:50.800985 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:50.800961    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73224sl_f1f28c73-9a95-401a-aa5c-2014fe34d569/util/0.log"
Jul 27 21:00:50.823736 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:50.823706    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73224sl_f1f28c73-9a95-401a-aa5c-2014fe34d569/pull/0.log"
Jul 27 21:00:50.850629 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:50.850600    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tlh72_a3bbd56f-2091-40e6-92a4-bb2050447750/extract/0.log"
Jul 27 21:00:50.872727 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:50.872699    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tlh72_a3bbd56f-2091-40e6-92a4-bb2050447750/util/0.log"
Jul 27 21:00:50.899653 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:50.899621    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tlh72_a3bbd56f-2091-40e6-92a4-bb2050447750/pull/0.log"
Jul 27 21:00:51.436478 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:51.436320    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5778fdbcb6-tm9gt_77e5c699-4ef0-4403-8549-57a760aae76b/authorino/0.log"
Jul 27 21:00:51.523083 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:51.522975    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-28k56_89ba8ef0-9e77-4890-9df6-b69a4779c3ed/kuadrant-console-plugin/0.log"
Jul 27 21:00:51.737079 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:51.737048    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-45lq6_5d078287-04fe-4f68-b32b-36d3de178562/limitador/0.log"
Jul 27 21:00:53.958317 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:53.958287    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-585bb667b6-t88w8_8377262d-5d3b-482c-823a-e65e2e749c8e/metrics-server/0.log"
Jul 27 21:00:53.985101 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:53.985063    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-sdqvc_88658199-cd52-4664-8191-99b2fa784744/monitoring-plugin/0.log"
Jul 27 21:00:54.174113 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:54.174088    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pxl99_1b22393f-e566-4822-a999-3927f0ab9455/node-exporter/0.log"
Jul 27 21:00:54.194822 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:54.194785    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pxl99_1b22393f-e566-4822-a999-3927f0ab9455/kube-rbac-proxy/0.log"
Jul 27 21:00:54.215541 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:54.215447    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pxl99_1b22393f-e566-4822-a999-3927f0ab9455/init-textfile/0.log"
Jul 27 21:00:54.520249 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:54.520218    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-5hdzn_d2311eaa-592a-4a2d-90ec-81ea40058b3e/prometheus-operator/0.log"
Jul 27 21:00:54.538826 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:54.538789    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-5hdzn_d2311eaa-592a-4a2d-90ec-81ea40058b3e/kube-rbac-proxy/0.log"
Jul 27 21:00:54.561204 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:54.561108    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-bgwnm_641a3438-ba1c-4ca3-a8a1-82b033dcafbc/prometheus-operator-admission-webhook/0.log"
Jul 27 21:00:54.591119 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:54.591088    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-85f6df5b45-chj2s_bffc27a7-4b68-4c70-9179-a2d3d987e03e/telemeter-client/0.log"
Jul 27 21:00:54.613645 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:54.613615    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-85f6df5b45-chj2s_bffc27a7-4b68-4c70-9179-a2d3d987e03e/reload/0.log"
Jul 27 21:00:54.634487 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:54.634437    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-85f6df5b45-chj2s_bffc27a7-4b68-4c70-9179-a2d3d987e03e/kube-rbac-proxy/0.log"
Jul 27 21:00:55.973605 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:55.973398    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-2ddz5_f5411457-3ec1-47a1-a64f-4111eb7d2610/networking-console-plugin/0.log"
Jul 27 21:00:56.132354 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:56.132315    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jpxkn/perf-node-gather-daemonset-5924r"]
Jul 27 21:00:56.142546 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:56.142509    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jpxkn/perf-node-gather-daemonset-5924r"
Jul 27 21:00:56.144941 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:56.144911    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jpxkn/perf-node-gather-daemonset-5924r"]
Jul 27 21:00:56.222308 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:56.222261    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mh95c\" (UniqueName: \"kubernetes.io/projected/5fc6a61b-55b1-4ad7-af3c-cb003d14f6cc-kube-api-access-mh95c\") pod \"perf-node-gather-daemonset-5924r\" (UID: \"5fc6a61b-55b1-4ad7-af3c-cb003d14f6cc\") " pod="openshift-must-gather-jpxkn/perf-node-gather-daemonset-5924r"
Jul 27 21:00:56.222513 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:56.222313    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5fc6a61b-55b1-4ad7-af3c-cb003d14f6cc-podres\") pod \"perf-node-gather-daemonset-5924r\" (UID: \"5fc6a61b-55b1-4ad7-af3c-cb003d14f6cc\") " pod="openshift-must-gather-jpxkn/perf-node-gather-daemonset-5924r"
Jul 27 21:00:56.222513 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:56.222391    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5fc6a61b-55b1-4ad7-af3c-cb003d14f6cc-sys\") pod \"perf-node-gather-daemonset-5924r\" (UID: \"5fc6a61b-55b1-4ad7-af3c-cb003d14f6cc\") " pod="openshift-must-gather-jpxkn/perf-node-gather-daemonset-5924r"
Jul 27 21:00:56.222513 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:56.222493    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5fc6a61b-55b1-4ad7-af3c-cb003d14f6cc-proc\") pod \"perf-node-gather-daemonset-5924r\" (UID: \"5fc6a61b-55b1-4ad7-af3c-cb003d14f6cc\") " pod="openshift-must-gather-jpxkn/perf-node-gather-daemonset-5924r"
Jul 27 21:00:56.222658 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:56.222529    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5fc6a61b-55b1-4ad7-af3c-cb003d14f6cc-lib-modules\") pod \"perf-node-gather-daemonset-5924r\" (UID: \"5fc6a61b-55b1-4ad7-af3c-cb003d14f6cc\") " pod="openshift-must-gather-jpxkn/perf-node-gather-daemonset-5924r"
Jul 27 21:00:56.323255 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:56.323216    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mh95c\" (UniqueName: \"kubernetes.io/projected/5fc6a61b-55b1-4ad7-af3c-cb003d14f6cc-kube-api-access-mh95c\") pod \"perf-node-gather-daemonset-5924r\" (UID: \"5fc6a61b-55b1-4ad7-af3c-cb003d14f6cc\") " pod="openshift-must-gather-jpxkn/perf-node-gather-daemonset-5924r"
Jul 27 21:00:56.323556 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:56.323534    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5fc6a61b-55b1-4ad7-af3c-cb003d14f6cc-podres\") pod \"perf-node-gather-daemonset-5924r\" (UID: \"5fc6a61b-55b1-4ad7-af3c-cb003d14f6cc\") " pod="openshift-must-gather-jpxkn/perf-node-gather-daemonset-5924r"
Jul 27 21:00:56.323750 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:56.323728    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5fc6a61b-55b1-4ad7-af3c-cb003d14f6cc-sys\") pod \"perf-node-gather-daemonset-5924r\" (UID: \"5fc6a61b-55b1-4ad7-af3c-cb003d14f6cc\") " pod="openshift-must-gather-jpxkn/perf-node-gather-daemonset-5924r"
Jul 27 21:00:56.323902 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:56.323886    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5fc6a61b-55b1-4ad7-af3c-cb003d14f6cc-proc\") pod \"perf-node-gather-daemonset-5924r\" (UID: \"5fc6a61b-55b1-4ad7-af3c-cb003d14f6cc\") " pod="openshift-must-gather-jpxkn/perf-node-gather-daemonset-5924r"
Jul 27 21:00:56.324643 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:56.324620    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5fc6a61b-55b1-4ad7-af3c-cb003d14f6cc-lib-modules\") pod \"perf-node-gather-daemonset-5924r\" (UID: \"5fc6a61b-55b1-4ad7-af3c-cb003d14f6cc\") " pod="openshift-must-gather-jpxkn/perf-node-gather-daemonset-5924r"
Jul 27 21:00:56.324974 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:56.324510    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5fc6a61b-55b1-4ad7-af3c-cb003d14f6cc-sys\") pod \"perf-node-gather-daemonset-5924r\" (UID: \"5fc6a61b-55b1-4ad7-af3c-cb003d14f6cc\") " pod="openshift-must-gather-jpxkn/perf-node-gather-daemonset-5924r"
Jul 27 21:00:56.325097 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:56.324557    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5fc6a61b-55b1-4ad7-af3c-cb003d14f6cc-proc\") pod \"perf-node-gather-daemonset-5924r\" (UID: \"5fc6a61b-55b1-4ad7-af3c-cb003d14f6cc\") " pod="openshift-must-gather-jpxkn/perf-node-gather-daemonset-5924r"
Jul 27 21:00:56.325199 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:56.324116    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5fc6a61b-55b1-4ad7-af3c-cb003d14f6cc-podres\") pod \"perf-node-gather-daemonset-5924r\" (UID: \"5fc6a61b-55b1-4ad7-af3c-cb003d14f6cc\") " pod="openshift-must-gather-jpxkn/perf-node-gather-daemonset-5924r"
Jul 27 21:00:56.325280 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:56.324868    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5fc6a61b-55b1-4ad7-af3c-cb003d14f6cc-lib-modules\") pod \"perf-node-gather-daemonset-5924r\" (UID: \"5fc6a61b-55b1-4ad7-af3c-cb003d14f6cc\") " pod="openshift-must-gather-jpxkn/perf-node-gather-daemonset-5924r"
Jul 27 21:00:56.333104 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:56.333076    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mh95c\" (UniqueName: \"kubernetes.io/projected/5fc6a61b-55b1-4ad7-af3c-cb003d14f6cc-kube-api-access-mh95c\") pod \"perf-node-gather-daemonset-5924r\" (UID: \"5fc6a61b-55b1-4ad7-af3c-cb003d14f6cc\") " pod="openshift-must-gather-jpxkn/perf-node-gather-daemonset-5924r"
Jul 27 21:00:56.457003 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:56.456750    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jpxkn/perf-node-gather-daemonset-5924r"
Jul 27 21:00:56.642391 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:56.642358    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jpxkn/perf-node-gather-daemonset-5924r"]
Jul 27 21:00:56.644232 ip-10-0-128-149 kubenswrapper[2557]: W0727 21:00:56.644203    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5fc6a61b_55b1_4ad7_af3c_cb003d14f6cc.slice/crio-cd64da66176ef075deb91cead707b92e52a94e530ddad9e92a26aa9e1dd71153 WatchSource:0}: Error finding container cd64da66176ef075deb91cead707b92e52a94e530ddad9e92a26aa9e1dd71153: Status 404 returned error can't find the container with id cd64da66176ef075deb91cead707b92e52a94e530ddad9e92a26aa9e1dd71153
Jul 27 21:00:56.814553 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:56.814517    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jpxkn/perf-node-gather-daemonset-5924r" event={"ID":"5fc6a61b-55b1-4ad7-af3c-cb003d14f6cc","Type":"ContainerStarted","Data":"58b4a498c60bcb89bdc798ca3aa629dd50267804b94110fa7bf5b4f0c979c065"}
Jul 27 21:00:56.814739 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:56.814572    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jpxkn/perf-node-gather-daemonset-5924r" event={"ID":"5fc6a61b-55b1-4ad7-af3c-cb003d14f6cc","Type":"ContainerStarted","Data":"cd64da66176ef075deb91cead707b92e52a94e530ddad9e92a26aa9e1dd71153"}
Jul 27 21:00:56.814739 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:56.814710    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-jpxkn/perf-node-gather-daemonset-5924r"
Jul 27 21:00:56.831199 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:56.831083    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jpxkn/perf-node-gather-daemonset-5924r" podStartSLOduration=0.831064465 podStartE2EDuration="831.064465ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 21:00:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:00:56.830149746 +0000 UTC m=+3405.404876135" watchObservedRunningTime="2026-07-27 21:00:56.831064465 +0000 UTC m=+3405.405790907"
Jul 27 21:00:57.113062 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:57.112983    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-78b888cfff-7zhxk_de773639-8566-4a1b-a844-c7870ed663da/console/0.log"
Jul 27 21:00:57.157132 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:57.157091    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-h5wdd_649d3ae6-5b22-422b-9e2b-2ae5a29ee8dc/download-server/0.log"
Jul 27 21:00:57.743723 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:57.743687    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-rcn59_cd3da7a1-e90c-492f-bb7d-d00f4236e20d/volume-data-source-validator/0.log"
Jul 27 21:00:58.798507 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:58.798473    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cfftn_16dce8d0-44a1-48a6-9626-ca84454d9680/dns/0.log"
Jul 27 21:00:58.819624 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:58.819596    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cfftn_16dce8d0-44a1-48a6-9626-ca84454d9680/kube-rbac-proxy/0.log"
Jul 27 21:00:58.941838 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:58.941812    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rzzr5_1b56de62-a601-4cc1-80c9-5b640c1060fe/dns-node-resolver/0.log"
Jul 27 21:00:59.493506 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:00:59.493480    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4f5vb_97e4eedc-db60-4e33-96d5-a66a5b35ac80/node-ca/0.log"
Jul 27 21:01:00.825463 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:01:00.825422    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-c9f4f89b5-v6th7_d791007e-8813-475d-8f39-919a47610c39/kube-auth-proxy/0.log"
Jul 27 21:01:00.972499 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:01:00.972472    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-74566c475c-7w525_966563a5-3031-4e3f-ab52-31e43de5dd1f/router/0.log"
Jul 27 21:01:01.772529 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:01:01.772501    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cgn8m_fd837541-b858-4d93-8260-bf7c6b040358/serve-healthcheck-canary/0.log"
Jul 27 21:01:02.428203 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:01:02.428174    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kbtmz_be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68/kube-rbac-proxy/0.log"
Jul 27 21:01:02.450465 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:01:02.450420    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kbtmz_be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68/exporter/0.log"
Jul 27 21:01:02.476156 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:01:02.476112    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kbtmz_be3ddbcc-b81d-4f72-a3e0-969fc4c6ec68/extractor/0.log"
Jul 27 21:01:02.836965 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:01:02.836925    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-jpxkn/perf-node-gather-daemonset-5924r"
Jul 27 21:01:03.005006 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:01:03.004974    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lw7mf_30db2eea-f82c-4108-acd3-dafe3c975665/konnectivity-agent/0.log" limit=1024
Jul 27 21:01:05.331969 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:01:05.331866    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67944f57b-bl5h9_6bbd94fb-4407-41ac-a3fd-c03150ba8728/manager/0.log"
Jul 27 21:01:05.350679 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:01:05.350653    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67944f57b-bl5h9_6bbd94fb-4407-41ac-a3fd-c03150ba8728/copy-manifests/0.log"
Jul 27 21:01:06.782736 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:01:06.782702    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7f9b5765bb-c28mp_3df8d979-ae40-4bdc-bd95-5bebeddf80a3/manager/0.log"
Jul 27 21:01:06.914597 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:01:06.914567    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-c9f4f89b5-v6th7_d791007e-8813-475d-8f39-919a47610c39/kube-auth-proxy/0.log"
Jul 27 21:01:07.023279 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:01:07.023232    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-74566c475c-7w525_966563a5-3031-4e3f-ab52-31e43de5dd1f/router/0.log"
Jul 27 21:01:08.774922 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:01:08.774891    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-c9f4f89b5-v6th7_d791007e-8813-475d-8f39-919a47610c39/kube-auth-proxy/0.log"
Jul 27 21:01:08.888952 ip-10-0-128-149 kubenswrapper[2557]: I0727 21:01:08.888921    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-74566c475c-7w525_966563a5-3031-4e3f-ab52-31e43de5dd1f/router/0.log"