Sep 16 12:00:33.244430 ip-10-0-138-251 systemd[1]: Starting Kubernetes Kubelet...
Sep 16 12:00:33.699118 ip-10-0-138-251 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 16 12:00:33.699118 ip-10-0-138-251 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 16 12:00:33.699118 ip-10-0-138-251 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 16 12:00:33.699118 ip-10-0-138-251 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 16 12:00:33.699118 ip-10-0-138-251 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 16 12:00:33.702074 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.701989    2559 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 16 12:00:33.707446 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707430    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 12:00:33.707446 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707446    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 12:00:33.707513 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707450    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 12:00:33.707513 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707453    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 12:00:33.707513 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707456    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 12:00:33.707513 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707460    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 12:00:33.707513 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707463    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 12:00:33.707513 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707466    2559 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 12:00:33.707513 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707471    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 12:00:33.707513 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707476    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 12:00:33.707513 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707479    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 12:00:33.707513 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707482    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 12:00:33.707513 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707485    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 12:00:33.707513 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707488    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 12:00:33.707513 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707491    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 12:00:33.707513 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707493    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 12:00:33.707513 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707497    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 12:00:33.707513 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707503    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 12:00:33.707513 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707506    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 12:00:33.707513 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707509    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 12:00:33.707513 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707511    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 12:00:33.707513 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707514    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 12:00:33.707984 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707516    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 12:00:33.707984 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707519    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 12:00:33.707984 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707522    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 12:00:33.707984 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707525    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 12:00:33.707984 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707528    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 12:00:33.707984 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707530    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 12:00:33.707984 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707533    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 12:00:33.707984 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707535    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 12:00:33.707984 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707538    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 12:00:33.707984 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707540    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 12:00:33.707984 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707543    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 12:00:33.707984 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707546    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 12:00:33.707984 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707548    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 12:00:33.707984 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707551    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 12:00:33.707984 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707553    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 12:00:33.707984 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707556    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 12:00:33.707984 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707558    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 12:00:33.707984 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707561    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 12:00:33.707984 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707563    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 12:00:33.707984 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707567    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 12:00:33.708488 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707569    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 12:00:33.708488 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707572    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 12:00:33.708488 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707574    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 12:00:33.708488 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707577    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 12:00:33.708488 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707579    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 12:00:33.708488 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707582    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 12:00:33.708488 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707585    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 12:00:33.708488 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707587    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 12:00:33.708488 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707592    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 12:00:33.708488 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707594    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 12:00:33.708488 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707596    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 12:00:33.708488 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707599    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 12:00:33.708488 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707602    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 12:00:33.708488 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707605    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 12:00:33.708488 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707609    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 12:00:33.708488 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707613    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 12:00:33.708488 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707616    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 12:00:33.708488 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707619    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 12:00:33.708488 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707622    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 12:00:33.708488 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707625    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 12:00:33.708971 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707628    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 12:00:33.708971 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707630    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 12:00:33.708971 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707633    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 12:00:33.708971 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707636    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 12:00:33.708971 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707638    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 12:00:33.708971 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707641    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 12:00:33.708971 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707643    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 12:00:33.708971 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707646    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 12:00:33.708971 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707649    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 12:00:33.708971 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707651    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 12:00:33.708971 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707654    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 12:00:33.708971 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707657    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 12:00:33.708971 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707660    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 12:00:33.708971 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707662    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 12:00:33.708971 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707665    2559 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 12:00:33.708971 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707667    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 12:00:33.708971 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707670    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 12:00:33.708971 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707672    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 12:00:33.708971 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707676    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 12:00:33.709434 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707678    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 12:00:33.709434 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707681    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 12:00:33.709434 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707684    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 12:00:33.709434 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707686    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 12:00:33.709434 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707689    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 12:00:33.709434 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707693    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 12:00:33.709434 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707697    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 12:00:33.709434 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707700    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 12:00:33.709434 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707703    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 12:00:33.709434 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707706    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 12:00:33.709434 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707709    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 12:00:33.709434 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707711    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 12:00:33.709434 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707714    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 12:00:33.709434 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707716    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 12:00:33.709434 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707719    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 12:00:33.709434 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707721    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 12:00:33.709434 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707724    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 12:00:33.709434 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.707726    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 12:00:33.709434 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708461    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 12:00:33.709899 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708469    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 12:00:33.709899 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708472    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 12:00:33.709899 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708475    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 12:00:33.709899 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708478    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 12:00:33.709899 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708481    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 12:00:33.709899 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708484    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 12:00:33.709899 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708488    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 12:00:33.709899 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708490    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 12:00:33.709899 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708493    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 12:00:33.709899 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708496    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 12:00:33.709899 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708498    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 12:00:33.709899 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708501    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 12:00:33.709899 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708504    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 12:00:33.709899 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708507    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 12:00:33.709899 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708509    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 12:00:33.709899 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708512    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 12:00:33.709899 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708515    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 12:00:33.709899 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708517    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 12:00:33.709899 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708520    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 12:00:33.709899 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708523    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 12:00:33.710472 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708526    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 12:00:33.710472 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708529    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 12:00:33.710472 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708531    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 12:00:33.710472 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708534    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 12:00:33.710472 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708536    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 12:00:33.710472 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708539    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 12:00:33.710472 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708542    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 12:00:33.710472 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708544    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 12:00:33.710472 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708547    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 12:00:33.710472 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708549    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 12:00:33.710472 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708552    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 12:00:33.710472 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708554    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 12:00:33.710472 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708557    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 12:00:33.710472 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708560    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 12:00:33.710472 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708563    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 12:00:33.710472 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708565    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 12:00:33.710472 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708568    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 12:00:33.710472 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708572    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 12:00:33.710472 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708574    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 12:00:33.710472 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708577    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 12:00:33.711290 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708579    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 12:00:33.711290 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708581    2559 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 12:00:33.711290 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708584    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 12:00:33.711290 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708587    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 12:00:33.711290 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708589    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 12:00:33.711290 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708592    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 12:00:33.711290 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708594    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 12:00:33.711290 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708597    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 12:00:33.711290 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708599    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 12:00:33.711290 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708602    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 12:00:33.711290 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708605    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 12:00:33.711290 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708609    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 12:00:33.711290 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708613    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 12:00:33.711290 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708616    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 12:00:33.711290 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708619    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 12:00:33.711290 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708621    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 12:00:33.711290 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708624    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 12:00:33.711290 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708626    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 12:00:33.711290 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708629    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 12:00:33.711290 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708631    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 12:00:33.712025 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708634    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 12:00:33.712025 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708636    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 12:00:33.712025 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708640    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 12:00:33.712025 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708642    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 12:00:33.712025 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708644    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 12:00:33.712025 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708647    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 12:00:33.712025 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708649    2559 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 12:00:33.712025 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708652    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 12:00:33.712025 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708654    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 12:00:33.712025 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708657    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 12:00:33.712025 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708659    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 12:00:33.712025 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708662    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 12:00:33.712025 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708664    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 12:00:33.712025 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708667    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 12:00:33.712025 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708669    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 12:00:33.712025 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708672    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 12:00:33.712025 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708674    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 12:00:33.712025 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708677    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 12:00:33.712025 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708681    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 12:00:33.712529 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708684    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 12:00:33.712529 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708686    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 12:00:33.712529 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708689    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 12:00:33.712529 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708693    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 12:00:33.712529 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708696    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 12:00:33.712529 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708698    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 12:00:33.712529 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708701    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 12:00:33.712529 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708703    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 12:00:33.712529 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708706    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 12:00:33.712529 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708708    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 12:00:33.712529 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708711    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 12:00:33.712529 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708713    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 12:00:33.712529 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708716    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 12:00:33.712529 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708718    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 12:00:33.712529 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708721    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 12:00:33.712529 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708723    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 12:00:33.712529 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708727    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 12:00:33.712529 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708730    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 12:00:33.712529 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.708733    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 12:00:33.712992 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709095    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 12:00:33.712992 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709100    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 12:00:33.712992 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709103    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 12:00:33.712992 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709106    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 12:00:33.712992 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709108    2559 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 12:00:33.712992 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709112    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 12:00:33.712992 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709116    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 12:00:33.712992 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709119    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 12:00:33.712992 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709122    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 12:00:33.712992 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709125    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 12:00:33.712992 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709142    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 12:00:33.712992 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709145    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 12:00:33.712992 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709148    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 12:00:33.712992 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709151    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 12:00:33.712992 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709154    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 12:00:33.712992 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709156    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 12:00:33.712992 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709160    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 12:00:33.712992 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709164    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 12:00:33.712992 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709166    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 12:00:33.713471 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709169    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 12:00:33.713471 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709172    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 12:00:33.713471 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709174    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 12:00:33.713471 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709177    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 12:00:33.713471 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709180    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 12:00:33.713471 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709183    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 12:00:33.713471 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709185    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 12:00:33.713471 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709188    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 12:00:33.713471 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709190    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 12:00:33.713471 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709193    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 12:00:33.713471 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709195    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 12:00:33.713471 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709198    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 12:00:33.713471 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709200    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 12:00:33.713471 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709203    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 12:00:33.713471 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709206    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 12:00:33.713471 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709208    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 12:00:33.713471 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709212    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 12:00:33.713471 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709216    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 12:00:33.713471 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709219    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 12:00:33.713928 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709222    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 12:00:33.713928 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709225    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 12:00:33.713928 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709227    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 12:00:33.713928 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709230    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 12:00:33.713928 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709232    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 12:00:33.713928 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709235    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 12:00:33.713928 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709238    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 12:00:33.713928 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709240    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 12:00:33.713928 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709243    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 12:00:33.713928 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709245    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 12:00:33.713928 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709248    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 12:00:33.713928 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709251    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 12:00:33.713928 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709253    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 12:00:33.713928 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709256    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 12:00:33.713928 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709258    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 12:00:33.713928 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709261    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 12:00:33.713928 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709263    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 12:00:33.713928 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709266    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 12:00:33.713928 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709268    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 12:00:33.713928 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709270    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 12:00:33.714418 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709273    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 12:00:33.714418 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709275    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 12:00:33.714418 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709277    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 12:00:33.714418 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709280    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 12:00:33.714418 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709282    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 12:00:33.714418 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709285    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 12:00:33.714418 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709287    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 12:00:33.714418 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709290    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 12:00:33.714418 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709293    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 12:00:33.714418 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709295    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 12:00:33.714418 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709298    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 12:00:33.714418 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709300    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 12:00:33.714418 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709303    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 12:00:33.714418 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709305    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 12:00:33.714418 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709308    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 12:00:33.714418 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709311    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 12:00:33.714418 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709314    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 12:00:33.714418 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709316    2559 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 12:00:33.714418 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709318    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 12:00:33.714878 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709321    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 12:00:33.714878 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709323    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 12:00:33.714878 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709325    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 12:00:33.714878 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709329    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 12:00:33.714878 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709332    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 12:00:33.714878 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709335    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 12:00:33.714878 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709337    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 12:00:33.714878 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709340    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 12:00:33.714878 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709342    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 12:00:33.714878 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709345    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 12:00:33.714878 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709347    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 12:00:33.714878 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709350    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 12:00:33.714878 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709352    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 12:00:33.714878 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709354    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 12:00:33.714878 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709357    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 12:00:33.714878 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709359    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 12:00:33.714878 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709362    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 12:00:33.714878 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709364    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 12:00:33.714878 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709366    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 12:00:33.714878 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709369    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 12:00:33.715379 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709374    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 12:00:33.715379 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.709377    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 12:00:33.715379 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.709452    2559 flags.go:64] FLAG: --address="0.0.0.0"
Sep 16 12:00:33.715379 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.709489    2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 16 12:00:33.715379 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.709499    2559 flags.go:64] FLAG: --anonymous-auth="true"
Sep 16 12:00:33.715379 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.709503    2559 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 16 12:00:33.715379 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.709507    2559 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 16 12:00:33.715379 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.709510    2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 16 12:00:33.715379 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.709515    2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 16 12:00:33.715379 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.709519    2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 16 12:00:33.715379 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.709522    2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 16 12:00:33.715379 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.709525    2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 16 12:00:33.715379 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.709529    2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 16 12:00:33.715379 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.709532    2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 16 12:00:33.715379 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.709536    2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 16 12:00:33.715379 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.709539    2559 flags.go:64] FLAG: --cgroup-root=""
Sep 16 12:00:33.715379 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.709541    2559 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 16 12:00:33.715379 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.709544    2559 flags.go:64] FLAG: --client-ca-file=""
Sep 16 12:00:33.715379 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.709548    2559 flags.go:64] FLAG: --cloud-provider="external"
Sep 16 12:00:33.715379 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.709551    2559 flags.go:64] FLAG: --cluster-dns="[]"
Sep 16 12:00:33.715379 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.709555    2559 flags.go:64] FLAG: --cluster-domain=""
Sep 16 12:00:33.715379 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.709557    2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 16 12:00:33.715379 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.709560    2559 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 16 12:00:33.715379 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.709563    2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 16 12:00:33.715985 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.709567    2559 flags.go:64] FLAG: --container-log-max-files="5"
Sep 16 12:00:33.715985 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.709570    2559 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 16 12:00:33.715985 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.709574    2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 16 12:00:33.715985 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.709577    2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 16 12:00:33.715985 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.709580    2559 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 16 12:00:33.715985 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.709583    2559 flags.go:64] FLAG: --contention-profiling="false"
Sep 16 12:00:33.715985 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.709586    2559 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 16 12:00:33.715985 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.709589    2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 16 12:00:33.715985 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.709594    2559 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 16 12:00:33.715985 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.709597    2559 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 16 12:00:33.715985 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.709601    2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 16 12:00:33.715985 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.709604    2559 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 16 12:00:33.715985 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.709608    2559 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 16 12:00:33.715985 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.709610    2559 flags.go:64] FLAG: --enable-load-reader="false"
Sep 16 12:00:33.715985 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.709613    2559 flags.go:64] FLAG: --enable-server="true"
Sep 16 12:00:33.715985 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.709616    2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 16 12:00:33.715985 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.709621    2559 flags.go:64] FLAG: --event-burst="100"
Sep 16 12:00:33.715985 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.709624    2559 flags.go:64] FLAG: --event-qps="50"
Sep 16 12:00:33.715985 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.709626    2559 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 16 12:00:33.715985 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.709629    2559 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 16 12:00:33.715985 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.709632    2559 flags.go:64] FLAG: --eviction-hard=""
Sep 16 12:00:33.715985 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.709636    2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 16 12:00:33.715985 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.709639    2559 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 16 12:00:33.715985 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.709642    2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 16 12:00:33.715985 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.709645    2559 flags.go:64] FLAG: --eviction-soft=""
Sep 16 12:00:33.716616 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.709648    2559 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 16 12:00:33.716616 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.709650    2559 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 16 12:00:33.716616 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710007    2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 16 12:00:33.716616 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710011    2559 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 16 12:00:33.716616 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710013    2559 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 16 12:00:33.716616 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710016    2559 flags.go:64] FLAG: --fail-swap-on="true"
Sep 16 12:00:33.716616 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710019    2559 flags.go:64] FLAG: --feature-gates=""
Sep 16 12:00:33.716616 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710023    2559 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 16 12:00:33.716616 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710026    2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 16 12:00:33.716616 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710029    2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 16 12:00:33.716616 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710032    2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 16 12:00:33.716616 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710035    2559 flags.go:64] FLAG: --healthz-port="10248"
Sep 16 12:00:33.716616 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710039    2559 flags.go:64] FLAG: --help="false"
Sep 16 12:00:33.716616 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710041    2559 flags.go:64] FLAG: --hostname-override="ip-10-0-138-251.ec2.internal"
Sep 16 12:00:33.716616 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710044    2559 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 16 12:00:33.716616 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710049    2559 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 16 12:00:33.716616 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710052    2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 16 12:00:33.716616 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710056    2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 16 12:00:33.716616 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710059    2559 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 16 12:00:33.716616 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710062    2559 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 16 12:00:33.716616 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710065    2559 flags.go:64] FLAG: --image-service-endpoint=""
Sep 16 12:00:33.716616 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710068    2559 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 16 12:00:33.716616 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710071    2559 flags.go:64] FLAG: --kube-api-burst="100"
Sep 16 12:00:33.717280 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710073    2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 16 12:00:33.717280 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710076    2559 flags.go:64] FLAG: --kube-api-qps="50"
Sep 16 12:00:33.717280 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710079    2559 flags.go:64] FLAG: --kube-reserved=""
Sep 16 12:00:33.717280 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710082    2559 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 16 12:00:33.717280 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710085    2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 16 12:00:33.717280 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710087    2559 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 16 12:00:33.717280 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710090    2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 16 12:00:33.717280 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710093    2559 flags.go:64] FLAG: --lock-file=""
Sep 16 12:00:33.717280 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710096    2559 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 16 12:00:33.717280 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710098    2559 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 16 12:00:33.717280 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710101    2559 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 16 12:00:33.717280 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710106    2559 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 16 12:00:33.717280 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710110    2559 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 16 12:00:33.717280 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710112    2559 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 16 12:00:33.717280 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710115    2559 flags.go:64] FLAG: --logging-format="text"
Sep 16 12:00:33.717280 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710118    2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 16 12:00:33.717280 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710122    2559 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 16 12:00:33.717280 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710124    2559 flags.go:64] FLAG: --manifest-url=""
Sep 16 12:00:33.717280 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710127    2559 flags.go:64] FLAG: --manifest-url-header=""
Sep 16 12:00:33.717280 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710143    2559 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 16 12:00:33.717280 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710146    2559 flags.go:64] FLAG: --max-open-files="1000000"
Sep 16 12:00:33.717280 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710150    2559 flags.go:64] FLAG: --max-pods="110"
Sep 16 12:00:33.717280 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710153    2559 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 16 12:00:33.717280 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710156    2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 16 12:00:33.717280 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710161    2559 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 16 12:00:33.717889 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710164    2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 16 12:00:33.717889 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710167    2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 16 12:00:33.717889 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710170    2559 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 16 12:00:33.717889 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710173    2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 16 12:00:33.717889 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710180    2559 flags.go:64] FLAG: --node-status-max-images="50"
Sep 16 12:00:33.717889 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710183    2559 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 16 12:00:33.717889 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710186    2559 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 16 12:00:33.717889 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710189    2559 flags.go:64] FLAG: --pod-cidr=""
Sep 16 12:00:33.717889 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710192    2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 16 12:00:33.717889 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710197    2559 flags.go:64] FLAG: --pod-manifest-path=""
Sep 16 12:00:33.717889 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710200    2559 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 16 12:00:33.717889 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710203    2559 flags.go:64] FLAG: --pods-per-core="0"
Sep 16 12:00:33.717889 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710206    2559 flags.go:64] FLAG: --port="10250"
Sep 16 12:00:33.717889 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710209    2559 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 16 12:00:33.717889 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710211    2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-064a9bb5407995b4f"
Sep 16 12:00:33.717889 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710214    2559 flags.go:64] FLAG: --qos-reserved=""
Sep 16 12:00:33.717889 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710217    2559 flags.go:64] FLAG: --read-only-port="10255"
Sep 16 12:00:33.717889 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710220    2559 flags.go:64] FLAG: --register-node="true"
Sep 16 12:00:33.717889 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710223    2559 flags.go:64] FLAG: --register-with-taints=""
Sep 16 12:00:33.717889 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710227    2559 flags.go:64] FLAG: --registry-burst="10"
Sep 16 12:00:33.717889 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710230    2559 flags.go:64] FLAG: --registry-qps="5"
Sep 16 12:00:33.717889 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710233    2559 flags.go:64] FLAG: --reserved-cpus=""
Sep 16 12:00:33.717889 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710236    2559 flags.go:64] FLAG: --reserved-memory=""
Sep 16 12:00:33.717889 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710239    2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 16 12:00:33.717889 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710242    2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 16 12:00:33.718537 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710245    2559 flags.go:64] FLAG: --rotate-certificates="false"
Sep 16 12:00:33.718537 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710249    2559 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 16 12:00:33.718537 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710252    2559 flags.go:64] FLAG: --runonce="false"
Sep 16 12:00:33.718537 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710255    2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 16 12:00:33.718537 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710258    2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 16 12:00:33.718537 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710261    2559 flags.go:64] FLAG: --seccomp-default="false"
Sep 16 12:00:33.718537 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710264    2559 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 16 12:00:33.718537 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710269    2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 16 12:00:33.718537 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710272    2559 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 16 12:00:33.718537 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710275    2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 16 12:00:33.718537 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710278    2559 flags.go:64] FLAG: --storage-driver-password="root"
Sep 16 12:00:33.718537 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710281    2559 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 16 12:00:33.718537 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710283    2559 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 16 12:00:33.718537 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710286    2559 flags.go:64] FLAG: --storage-driver-user="root"
Sep 16 12:00:33.718537 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710289    2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 16 12:00:33.718537 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710292    2559 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 16 12:00:33.718537 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710295    2559 flags.go:64] FLAG: --system-cgroups=""
Sep 16 12:00:33.718537 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710298    2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 16 12:00:33.718537 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710303    2559 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 16 12:00:33.718537 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710306    2559 flags.go:64] FLAG: --tls-cert-file=""
Sep 16 12:00:33.718537 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710308    2559 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 16 12:00:33.718537 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710312    2559 flags.go:64] FLAG: --tls-min-version=""
Sep 16 12:00:33.718537 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710315    2559 flags.go:64] FLAG: --tls-private-key-file=""
Sep 16 12:00:33.718537 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710324    2559 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 16 12:00:33.718537 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710327    2559 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 16 12:00:33.719163 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710330    2559 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 16 12:00:33.719163 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710333    2559 flags.go:64] FLAG: --v="2"
Sep 16 12:00:33.719163 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710337    2559 flags.go:64] FLAG: --version="false"
Sep 16 12:00:33.719163 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710341    2559 flags.go:64] FLAG: --vmodule=""
Sep 16 12:00:33.719163 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710345    2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 16 12:00:33.719163 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.710348    2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 16 12:00:33.719163 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.710888    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 12:00:33.719163 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.710912    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 12:00:33.719163 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.710921    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 12:00:33.719163 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.710928    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 12:00:33.719163 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.710933    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 12:00:33.719163 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.710938    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 12:00:33.719163 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.710943    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 12:00:33.719163 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.710947    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 12:00:33.719163 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.710953    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 12:00:33.719163 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.710960    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 12:00:33.719163 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.710967    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 12:00:33.719163 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.710972    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 12:00:33.719163 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.710977    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 12:00:33.719163 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.710987    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 12:00:33.719680 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.710991    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 12:00:33.719680 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.710996    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 12:00:33.719680 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711000    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 12:00:33.719680 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711005    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 12:00:33.719680 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711010    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 12:00:33.719680 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711015    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 12:00:33.719680 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711019    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 12:00:33.719680 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711024    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 12:00:33.719680 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711028    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 12:00:33.719680 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711033    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 12:00:33.719680 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711038    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 12:00:33.719680 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711047    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 12:00:33.719680 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711051    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 12:00:33.719680 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711055    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 12:00:33.719680 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711060    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 12:00:33.719680 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711064    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 12:00:33.719680 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711068    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 12:00:33.719680 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711073    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 12:00:33.719680 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711078    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 12:00:33.719680 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711085    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 12:00:33.720195 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711090    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 12:00:33.720195 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711094    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 12:00:33.720195 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711099    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 12:00:33.720195 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711103    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 12:00:33.720195 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711112    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 12:00:33.720195 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711117    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 12:00:33.720195 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711121    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 12:00:33.720195 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711125    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 12:00:33.720195 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711147    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 12:00:33.720195 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711152    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 12:00:33.720195 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711159    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 12:00:33.720195 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711164    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 12:00:33.720195 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711169    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 12:00:33.720195 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711173    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 12:00:33.720195 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711178    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 12:00:33.720195 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711182    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 12:00:33.720195 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711191    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 12:00:33.720195 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711196    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 12:00:33.720195 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711200    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 12:00:33.720671 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711204    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 12:00:33.720671 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711209    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 12:00:33.720671 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711214    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 12:00:33.720671 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711218    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 12:00:33.720671 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711223    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 12:00:33.720671 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711227    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 12:00:33.720671 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711232    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 12:00:33.720671 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711237    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 12:00:33.720671 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711241    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 12:00:33.720671 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711250    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 12:00:33.720671 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711255    2559 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 12:00:33.720671 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711260    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 12:00:33.720671 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711265    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 12:00:33.720671 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711271    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 12:00:33.720671 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711277    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 12:00:33.720671 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711282    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 12:00:33.720671 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711286    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 12:00:33.720671 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711290    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 12:00:33.720671 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711295    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 12:00:33.720671 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711300    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 12:00:33.721195 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711305    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 12:00:33.721195 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711309    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 12:00:33.721195 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711318    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 12:00:33.721195 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711323    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 12:00:33.721195 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711327    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 12:00:33.721195 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711332    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 12:00:33.721195 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711337    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 12:00:33.721195 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711341    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 12:00:33.721195 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711345    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 12:00:33.721195 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711350    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 12:00:33.721195 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711354    2559 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 12:00:33.721195 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711359    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 12:00:33.721195 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711364    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 12:00:33.721195 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711375    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 12:00:33.721195 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711384    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 12:00:33.721195 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711389    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 12:00:33.721195 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711394    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 12:00:33.721195 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711399    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 12:00:33.721195 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711403    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 12:00:33.721195 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711408    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 12:00:33.721697 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711412    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 12:00:33.721697 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711417    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 12:00:33.721697 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711421    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 12:00:33.721697 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711426    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 12:00:33.721697 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711435    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 12:00:33.721697 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.711439    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 12:00:33.721697 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.711450    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 16 12:00:33.721940 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.721919    2559 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 16 12:00:33.721968 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.721940    2559 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 16 12:00:33.722756 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.722746    2559 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 16 12:00:33.722788 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.722757    2559 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 16 12:00:33.722824 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.722810    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 12:00:33.722824 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.722816    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 12:00:33.722824 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.722819    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 12:00:33.722824 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.722822    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 12:00:33.722824 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.722825    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 12:00:33.722946 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.722828    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 12:00:33.722946 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.722831    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 12:00:33.722946 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.722834    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 12:00:33.722946 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.722837    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 12:00:33.722946 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.722840    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 12:00:33.722946 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.722842    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 12:00:33.722946 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.722845    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 12:00:33.722946 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.722848    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 12:00:33.722946 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.722850    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 12:00:33.722946 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.722853    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 12:00:33.722946 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.722855    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 12:00:33.722946 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.722858    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 12:00:33.722946 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.722861    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 12:00:33.722946 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.722864    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 12:00:33.722946 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.722867    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 12:00:33.722946 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.722869    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 12:00:33.722946 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.722871    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 12:00:33.722946 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.722874    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 12:00:33.722946 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.722877    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 12:00:33.722946 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.722880    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 12:00:33.723446 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.722882    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 12:00:33.723446 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.722885    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 12:00:33.723446 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.722888    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 12:00:33.723446 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.722892    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 12:00:33.723446 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.722896    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 12:00:33.723446 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.722899    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 12:00:33.723446 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.722902    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 12:00:33.723446 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.722905    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 12:00:33.723446 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.722907    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 12:00:33.723446 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.722910    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 12:00:33.723446 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.722913    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 12:00:33.723446 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.722916    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 12:00:33.723446 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.722918    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 12:00:33.723446 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.722923    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 12:00:33.723446 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.722926    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 12:00:33.723446 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.722929    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 12:00:33.723446 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.722932    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 12:00:33.723446 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.722935    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 12:00:33.723446 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.722938    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 12:00:33.723945 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.722941    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 12:00:33.723945 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.722944    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 12:00:33.723945 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.722947    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 12:00:33.723945 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.722950    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 12:00:33.723945 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.722953    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 12:00:33.723945 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.722957    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 12:00:33.723945 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.722960    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 12:00:33.723945 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.722963    2559 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 12:00:33.723945 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.722965    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 12:00:33.723945 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.722968    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 12:00:33.723945 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.722971    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 12:00:33.723945 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.722973    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 12:00:33.723945 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.722976    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 12:00:33.723945 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.722978    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 12:00:33.723945 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.722981    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 12:00:33.723945 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.722984    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 12:00:33.723945 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.722986    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 12:00:33.723945 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.722989    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 12:00:33.723945 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.722992    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 12:00:33.723945 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.722994    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 12:00:33.724424 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.722997    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 12:00:33.724424 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723000    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 12:00:33.724424 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723002    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 12:00:33.724424 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723005    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 12:00:33.724424 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723008    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 12:00:33.724424 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723010    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 12:00:33.724424 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723013    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 12:00:33.724424 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723016    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 12:00:33.724424 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723019    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 12:00:33.724424 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723021    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 12:00:33.724424 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723024    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 12:00:33.724424 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723027    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 12:00:33.724424 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723030    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 12:00:33.724424 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723033    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 12:00:33.724424 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723035    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 12:00:33.724424 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723038    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 12:00:33.724424 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723040    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 12:00:33.724424 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723043    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 12:00:33.724424 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723046    2559 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 12:00:33.724892 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723048    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 12:00:33.724892 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723051    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 12:00:33.724892 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723054    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 12:00:33.724892 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723056    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 12:00:33.724892 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723060    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 12:00:33.724892 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723063    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 12:00:33.724892 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723066    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 12:00:33.724892 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723069    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 12:00:33.724892 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723072    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 12:00:33.724892 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723075    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 12:00:33.724892 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723077    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 12:00:33.724892 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723080    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 12:00:33.724892 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723082    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 12:00:33.724892 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723085    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 12:00:33.724892 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723088    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 12:00:33.724892 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723090    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 12:00:33.725304 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.723095    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 16 12:00:33.725304 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723220    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 12:00:33.725304 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723225    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 12:00:33.725304 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723229    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 12:00:33.725304 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723232    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 12:00:33.725304 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723236    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 12:00:33.725304 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723238    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 12:00:33.725304 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723241    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 12:00:33.725304 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723243    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 12:00:33.725304 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723246    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 12:00:33.725304 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723248    2559 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 12:00:33.725304 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723252    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 12:00:33.725304 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723254    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 12:00:33.725304 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723258    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 12:00:33.725304 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723262    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 12:00:33.725675 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723265    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 12:00:33.725675 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723268    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 12:00:33.725675 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723271    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 12:00:33.725675 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723273    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 12:00:33.725675 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723276    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 12:00:33.725675 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723278    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 12:00:33.725675 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723281    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 12:00:33.725675 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723283    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 12:00:33.725675 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723286    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 12:00:33.725675 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723289    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 12:00:33.725675 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723292    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 12:00:33.725675 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723294    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 12:00:33.725675 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723297    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 12:00:33.725675 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723299    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 12:00:33.725675 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723302    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 12:00:33.725675 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723306    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 12:00:33.725675 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723309    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 12:00:33.725675 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723312    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 12:00:33.725675 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723315    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 12:00:33.726183 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723317    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 12:00:33.726183 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723320    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 12:00:33.726183 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723323    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 12:00:33.726183 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723325    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 12:00:33.726183 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723328    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 12:00:33.726183 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723331    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 12:00:33.726183 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723333    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 12:00:33.726183 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723336    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 12:00:33.726183 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723338    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 12:00:33.726183 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723341    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 12:00:33.726183 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723345    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 12:00:33.726183 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723347    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 12:00:33.726183 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723350    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 12:00:33.726183 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723352    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 12:00:33.726183 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723355    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 12:00:33.726183 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723357    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 12:00:33.726183 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723360    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 12:00:33.726183 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723362    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 12:00:33.726183 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723365    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 12:00:33.726643 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723367    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 12:00:33.726643 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723378    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 12:00:33.726643 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723381    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 12:00:33.726643 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723383    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 12:00:33.726643 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723386    2559 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 12:00:33.726643 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723389    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 12:00:33.726643 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723391    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 12:00:33.726643 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723394    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 12:00:33.726643 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723397    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 12:00:33.726643 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723399    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 12:00:33.726643 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723402    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 12:00:33.726643 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723404    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 12:00:33.726643 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723407    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 12:00:33.726643 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723409    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 12:00:33.726643 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723412    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 12:00:33.726643 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723415    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 12:00:33.726643 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723417    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 12:00:33.726643 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723420    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 12:00:33.726643 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723423    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 12:00:33.726643 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723425    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 12:00:33.727115 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723427    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 12:00:33.727115 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723430    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 12:00:33.727115 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723433    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 12:00:33.727115 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723436    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 12:00:33.727115 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723439    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 12:00:33.727115 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723441    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 12:00:33.727115 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723444    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 12:00:33.727115 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723447    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 12:00:33.727115 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723450    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 12:00:33.727115 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723452    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 12:00:33.727115 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723455    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 12:00:33.727115 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723459    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 12:00:33.727115 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723462    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 12:00:33.727115 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723465    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 12:00:33.727115 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723468    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 12:00:33.727115 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723471    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 12:00:33.727115 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723474    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 12:00:33.727115 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723476    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 12:00:33.727115 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723479    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 12:00:33.727611 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723481    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 12:00:33.727611 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723484    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 12:00:33.727611 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723486    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 12:00:33.727611 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723489    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 12:00:33.727611 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723492    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 12:00:33.727611 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723494    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 12:00:33.727611 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723496    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 12:00:33.727611 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:33.723499    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 12:00:33.727611 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.723504    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 16 12:00:33.727611 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.723599    2559 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 16 12:00:33.727611 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.726586    2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 16 12:00:33.727885 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.727769    2559 server.go:1019] "Starting client certificate rotation"
Sep 16 12:00:33.727885 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.727872    2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 16 12:00:33.727939 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.727900    2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 16 12:00:33.730919 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.730904    2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 16 12:00:33.732176 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.732159    2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 16 12:00:33.745998 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.745980    2559 log.go:25] "Validated CRI v1 runtime API"
Sep 16 12:00:33.749125 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.749111    2559 log.go:25] "Validated CRI v1 image API"
Sep 16 12:00:33.751834 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.751817    2559 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 16 12:00:33.757659 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.757512    2559 fs.go:135] Filesystem UUIDs: map[2839a130-9d65-4194-a5fa-93107ab30c8e:/dev/nvme0n1p4 754ee296-ac2c-47eb-844c-fe9ec9e761e1:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Sep 16 12:00:33.757659 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.757548    2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 16 12:00:33.761063 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.761046    2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 16 12:00:33.763810 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.763703    2559 manager.go:216] Machine: {Timestamp:2026-09-16 12:00:33.76245629 +0000 UTC m=+0.382775596 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099503 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2554fdbeb60a89f5b0e71bad30b1e4 SystemUUID:ec2554fd-beb6-0a89-f5b0-e71bad30b1e4 BootID:cbfae5dc-6eff-4a26-9b15-7adf81418cb4 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:e5:7d:c7:f1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:e5:7d:c7:f1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:72:9b:80:b4:de:51 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 16 12:00:33.763810 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.763805    2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 16 12:00:33.763925 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.763914    2559 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 16 12:00:33.767247 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.767225    2559 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 16 12:00:33.767382 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.767249    2559 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-251.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 16 12:00:33.768023 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.768014    2559 topology_manager.go:138] "Creating topology manager with none policy"
Sep 16 12:00:33.768055 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.768026    2559 container_manager_linux.go:309] "Creating device plugin manager"
Sep 16 12:00:33.768055 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.768034    2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 16 12:00:33.768663 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.768654    2559 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 16 12:00:33.769593 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.769584    2559 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 16 12:00:33.775568 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.775556    2559 state_mem.go:36] "Initialized new in-memory state store"
Sep 16 12:00:33.775675 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.775666    2559 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 16 12:00:33.775704 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.775694    2559 kubelet.go:486] "Attempting to sync node with API server"
Sep 16 12:00:33.775738 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.775707    2559 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 16 12:00:33.775738 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.775718    2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 16 12:00:33.775738 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.775728    2559 kubelet.go:398] "Adding apiserver pod source"
Sep 16 12:00:33.775738 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.775736    2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 16 12:00:33.776154 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.776142    2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 16 12:00:33.776199 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.776165    2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 16 12:00:33.779276 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.779257    2559 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 16 12:00:33.782085 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.782069    2559 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 16 12:00:33.782189 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.782101    2559 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 16 12:00:33.783939 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.783925    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 16 12:00:33.784005 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.783944    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 16 12:00:33.784005 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.783951    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 16 12:00:33.784005 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.783956    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 16 12:00:33.784005 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.783967    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 16 12:00:33.784005 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.783975    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 16 12:00:33.784005 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.783991    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 16 12:00:33.784005 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.783996    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 16 12:00:33.784005 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.784004    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 16 12:00:33.784005 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.784009    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 16 12:00:33.784399 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.784017    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 16 12:00:33.784399 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.784023    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 16 12:00:33.784970 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.784927    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 16 12:00:33.784970 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.784944    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 16 12:00:33.787820 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:33.787787    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 16 12:00:33.787820 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:33.787802    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-251.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 16 12:00:33.788984 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.788970    2559 server.go:1268] "Started kubelet"
Sep 16 12:00:33.789072 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.789046    2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 16 12:00:33.789246 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.789158    2559 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 16 12:00:33.789338 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.789298    2559 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 16 12:00:33.789911 ip-10-0-138-251 systemd[1]: Started Kubernetes Kubelet.
Sep 16 12:00:33.790965 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.790931    2559 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 16 12:00:33.792105 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.792087    2559 server.go:310] "Adding debug handlers to kubelet server"
Sep 16 12:00:33.795951 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.795932    2559 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-251.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 16 12:00:33.796251 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:33.796219    2559 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 16 12:00:33.797076 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:33.796014    2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-251.ec2.internal.18d5cb5e8639d4ca  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-251.ec2.internal,UID:ip-10-0-138-251.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-251.ec2.internal,},FirstTimestamp:2026-09-16 12:00:33.788941514 +0000 UTC m=+0.409260821,LastTimestamp:2026-09-16 12:00:33.788941514 +0000 UTC m=+0.409260821,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-251.ec2.internal,}"
Sep 16 12:00:33.798847 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.798822    2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 16 12:00:33.799421 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.799404    2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 16 12:00:33.800568 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.800547    2559 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 16 12:00:33.800568 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.800570    2559 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 16 12:00:33.800700 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.800572    2559 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 16 12:00:33.800754 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.800743    2559 reconstruct.go:97] "Volume reconstruction finished"
Sep 16 12:00:33.800754 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.800751    2559 reconciler.go:29] "Reconciler: start to sync state"
Sep 16 12:00:33.801516 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:33.801117    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-251.ec2.internal\" not found"
Sep 16 12:00:33.803331 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.803315    2559 factory.go:153] Registering CRI-O factory
Sep 16 12:00:33.803426 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.803334    2559 factory.go:223] Registration of the crio container factory successfully
Sep 16 12:00:33.803426 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.803401    2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 16 12:00:33.803426 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.803416    2559 factory.go:55] Registering systemd factory
Sep 16 12:00:33.803426 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.803428    2559 factory.go:223] Registration of the systemd container factory successfully
Sep 16 12:00:33.803692 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.803480    2559 factory.go:103] Registering Raw factory
Sep 16 12:00:33.803692 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.803519    2559 manager.go:1196] Started watching for new ooms in manager
Sep 16 12:00:33.804324 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.804307    2559 manager.go:349] Starting recovery of all containers
Sep 16 12:00:33.804543 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:33.804455    2559 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-251.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 16 12:00:33.804621 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:33.804575    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 16 12:00:33.814438 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.814420    2559 manager.go:354] Recovery completed
Sep 16 12:00:33.818390 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.818373    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 12:00:33.820228 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.820211    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-251.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 12:00:33.820302 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.820246    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-251.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 12:00:33.820302 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.820261    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-251.ec2.internal" event="NodeHasSufficientPID"
Sep 16 12:00:33.820837 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.820821    2559 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 16 12:00:33.820837 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.820830    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 12:00:33.820837 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.820837    2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 16 12:00:33.821024 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.820855    2559 state_mem.go:36] "Initialized new in-memory state store"
Sep 16 12:00:33.821584 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.821566    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-251.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 12:00:33.821649 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.821597    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-251.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 12:00:33.821649 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.821611    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-251.ec2.internal" event="NodeHasSufficientPID"
Sep 16 12:00:33.822351 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:33.822276    2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-251.ec2.internal.18d5cb5e88173987  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-251.ec2.internal,UID:ip-10-0-138-251.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-251.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-251.ec2.internal,},FirstTimestamp:2026-09-16 12:00:33.820227975 +0000 UTC m=+0.440547287,LastTimestamp:2026-09-16 12:00:33.820227975 +0000 UTC m=+0.440547287,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-251.ec2.internal,}"
Sep 16 12:00:33.823043 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.823030    2559 policy_none.go:49] "None policy: Start"
Sep 16 12:00:33.823091 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.823047    2559 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 16 12:00:33.823091 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.823058    2559 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 16 12:00:33.825098 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.825086    2559 policy_none.go:47] "Start"
Sep 16 12:00:33.830836 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:33.830771    2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-251.ec2.internal.18d5cb5e88179b86  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-251.ec2.internal,UID:ip-10-0-138-251.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-138-251.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-138-251.ec2.internal,},FirstTimestamp:2026-09-16 12:00:33.820253062 +0000 UTC m=+0.440572376,LastTimestamp:2026-09-16 12:00:33.820253062 +0000 UTC m=+0.440572376,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-251.ec2.internal,}"
Sep 16 12:00:33.832253 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:33.832189    2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-251.ec2.internal.18d5cb5e8817d097  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-251.ec2.internal,UID:ip-10-0-138-251.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-138-251.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-138-251.ec2.internal,},FirstTimestamp:2026-09-16 12:00:33.820266647 +0000 UTC m=+0.440585955,LastTimestamp:2026-09-16 12:00:33.820266647 +0000 UTC m=+0.440585955,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-251.ec2.internal,}"
Sep 16 12:00:33.841217 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:33.841142    2559 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-138-251.ec2.internal.18d5cb5e88173987\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-251.ec2.internal.18d5cb5e88173987  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-251.ec2.internal,UID:ip-10-0-138-251.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-251.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-251.ec2.internal,},FirstTimestamp:2026-09-16 12:00:33.820227975 +0000 UTC m=+0.440547287,LastTimestamp:2026-09-16 12:00:33.821582038 +0000 UTC m=+0.441901347,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-251.ec2.internal,}"
Sep 16 12:00:33.849626 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.849472    2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dn94z"
Sep 16 12:00:33.851442 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:33.851349    2559 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-138-251.ec2.internal.18d5cb5e88179b86\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-251.ec2.internal.18d5cb5e88179b86  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-251.ec2.internal,UID:ip-10-0-138-251.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-138-251.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-138-251.ec2.internal,},FirstTimestamp:2026-09-16 12:00:33.820253062 +0000 UTC m=+0.440572376,LastTimestamp:2026-09-16 12:00:33.821603371 +0000 UTC m=+0.441922679,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-251.ec2.internal,}"
Sep 16 12:00:33.856912 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.856895    2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dn94z"
Sep 16 12:00:33.882690 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.858797    2559 manager.go:337] "Starting Device Plugin manager"
Sep 16 12:00:33.882690 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:33.858834    2559 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 16 12:00:33.882690 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.858845    2559 server.go:87] "Starting device plugin registration server"
Sep 16 12:00:33.882690 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.859101    2559 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 16 12:00:33.882690 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.859325    2559 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 16 12:00:33.882690 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.859490    2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 16 12:00:33.882690 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.859567    2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 16 12:00:33.882690 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.859574    2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 16 12:00:33.882690 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:33.860791    2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 16 12:00:33.882690 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:33.860855    2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-251.ec2.internal\" not found"
Sep 16 12:00:33.882690 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:33.863295    2559 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-138-251.ec2.internal.18d5cb5e8817d097\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-251.ec2.internal.18d5cb5e8817d097  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-251.ec2.internal,UID:ip-10-0-138-251.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-138-251.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-138-251.ec2.internal,},FirstTimestamp:2026-09-16 12:00:33.820266647 +0000 UTC m=+0.440585955,LastTimestamp:2026-09-16 12:00:33.821616379 +0000 UTC m=+0.441935688,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-251.ec2.internal,}"
Sep 16 12:00:33.929992 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.929941    2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 16 12:00:33.931161 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.931122    2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 16 12:00:33.931288 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.931191    2559 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 16 12:00:33.931288 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.931218    2559 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 16 12:00:33.931403 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:33.931321    2559 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 16 12:00:33.933606 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.933587    2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 12:00:33.959652 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.959603    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 12:00:33.960573 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.960556    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-251.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 12:00:33.960652 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.960584    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-251.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 12:00:33.960652 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.960594    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-251.ec2.internal" event="NodeHasSufficientPID"
Sep 16 12:00:33.960652 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.960615    2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-251.ec2.internal"
Sep 16 12:00:33.969802 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:33.969784    2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-251.ec2.internal"
Sep 16 12:00:33.969871 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:33.969803    2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-251.ec2.internal\": node \"ip-10-0-138-251.ec2.internal\" not found"
Sep 16 12:00:33.995478 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:33.995457    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-251.ec2.internal\" not found"
Sep 16 12:00:34.032224 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.032201    2559 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-251.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-251.ec2.internal"]
Sep 16 12:00:34.032338 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.032301    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 12:00:34.033852 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.033835    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-251.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 12:00:34.033947 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.033867    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-251.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 12:00:34.033947 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.033883    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-251.ec2.internal" event="NodeHasSufficientPID"
Sep 16 12:00:34.036261 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.036246    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 12:00:34.036389 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.036364    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-251.ec2.internal"
Sep 16 12:00:34.036435 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.036403    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 12:00:34.036978 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.036959    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-251.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 12:00:34.037052 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.036991    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-251.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 12:00:34.037052 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.036998    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-251.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 12:00:34.037052 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.037007    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-251.ec2.internal" event="NodeHasSufficientPID"
Sep 16 12:00:34.037052 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.037018    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-251.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 12:00:34.037052 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.037032    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-251.ec2.internal" event="NodeHasSufficientPID"
Sep 16 12:00:34.039241 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.039225    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-251.ec2.internal"
Sep 16 12:00:34.039318 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.039250    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 12:00:34.039998 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.039978    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-251.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 12:00:34.040120 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.040008    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-251.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 12:00:34.040120 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.040019    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-251.ec2.internal" event="NodeHasSufficientPID"
Sep 16 12:00:34.060876 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:34.060848    2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-251.ec2.internal\" not found" node="ip-10-0-138-251.ec2.internal"
Sep 16 12:00:34.065338 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:34.065323    2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-251.ec2.internal\" not found" node="ip-10-0-138-251.ec2.internal"
Sep 16 12:00:34.096011 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:34.095993    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-251.ec2.internal\" not found"
Sep 16 12:00:34.101362 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.101348    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9ceb9740f429536d29654e686eae8a60-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-251.ec2.internal\" (UID: \"9ceb9740f429536d29654e686eae8a60\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-251.ec2.internal"
Sep 16 12:00:34.101428 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.101369    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9ceb9740f429536d29654e686eae8a60-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-251.ec2.internal\" (UID: \"9ceb9740f429536d29654e686eae8a60\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-251.ec2.internal"
Sep 16 12:00:34.101428 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.101388    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9111bdadcd9657efb2af1c537a733d27-config\") pod \"kube-apiserver-proxy-ip-10-0-138-251.ec2.internal\" (UID: \"9111bdadcd9657efb2af1c537a733d27\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-251.ec2.internal"
Sep 16 12:00:34.197061 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:34.197041    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-251.ec2.internal\" not found"
Sep 16 12:00:34.202406 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.202389    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9ceb9740f429536d29654e686eae8a60-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-251.ec2.internal\" (UID: \"9ceb9740f429536d29654e686eae8a60\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-251.ec2.internal"
Sep 16 12:00:34.202469 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.202413    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9111bdadcd9657efb2af1c537a733d27-config\") pod \"kube-apiserver-proxy-ip-10-0-138-251.ec2.internal\" (UID: \"9111bdadcd9657efb2af1c537a733d27\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-251.ec2.internal"
Sep 16 12:00:34.202469 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.202429    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9ceb9740f429536d29654e686eae8a60-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-251.ec2.internal\" (UID: \"9ceb9740f429536d29654e686eae8a60\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-251.ec2.internal"
Sep 16 12:00:34.202541 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.202476    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9111bdadcd9657efb2af1c537a733d27-config\") pod \"kube-apiserver-proxy-ip-10-0-138-251.ec2.internal\" (UID: \"9111bdadcd9657efb2af1c537a733d27\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-251.ec2.internal"
Sep 16 12:00:34.202541 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.202481    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9ceb9740f429536d29654e686eae8a60-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-251.ec2.internal\" (UID: \"9ceb9740f429536d29654e686eae8a60\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-251.ec2.internal"
Sep 16 12:00:34.202541 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.202507    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9ceb9740f429536d29654e686eae8a60-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-251.ec2.internal\" (UID: \"9ceb9740f429536d29654e686eae8a60\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-251.ec2.internal"
Sep 16 12:00:34.297867 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:34.297781    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-251.ec2.internal\" not found"
Sep 16 12:00:34.364958 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.364928    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-251.ec2.internal"
Sep 16 12:00:34.368320 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.368302    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-251.ec2.internal"
Sep 16 12:00:34.398720 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:34.398700    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-251.ec2.internal\" not found"
Sep 16 12:00:34.505185 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:34.505157    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-251.ec2.internal\" not found"
Sep 16 12:00:34.605387 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:34.605293    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-251.ec2.internal\" not found"
Sep 16 12:00:34.706522 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:34.706496    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-251.ec2.internal\" not found"
Sep 16 12:00:34.728282 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.728258    2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 16 12:00:34.728430 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.728413    2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 16 12:00:34.772867 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.772839    2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 12:00:34.776378 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.776365    2559 apiserver.go:52] "Watching apiserver"
Sep 16 12:00:34.789090 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.789074    2559 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 16 12:00:34.790372 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.790351    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-6tsgc","openshift-ovn-kubernetes/ovnkube-node-vjkjn","kube-system/global-pull-secret-syncer-tbc79","kube-system/konnectivity-agent-rsjgc","openshift-cluster-node-tuning-operator/tuned-nc7sf","openshift-dns/node-resolver-ch8pr","openshift-image-registry/node-ca-l5cpd","openshift-multus/multus-rhx78","openshift-network-diagnostics/network-check-target-2rdgh","openshift-network-operator/iptables-alerter-n5trt","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsszd","openshift-multus/multus-additional-cni-plugins-swz2v"]
Sep 16 12:00:34.793392 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.793373    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tsgc"
Sep 16 12:00:34.793504 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:34.793482    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tsgc" podUID="e261eb8b-bfaa-491d-afbe-6eb8fbc57324"
Sep 16 12:00:34.795814 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.795796    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn"
Sep 16 12:00:34.798236 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.798198    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tbc79"
Sep 16 12:00:34.798334 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:34.798274    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tbc79" podUID="28222687-d3b4-4c0c-81f3-cc24fdc912e8"
Sep 16 12:00:34.798466 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.798450    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 16 12:00:34.798542 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.798520    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 16 12:00:34.798606 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.798520    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 16 12:00:34.798606 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.798588    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 16 12:00:34.798740 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.798657    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 16 12:00:34.798800 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.798773    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-fcqrk\""
Sep 16 12:00:34.798841 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.798826    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 16 12:00:34.798920 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.798900    2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 16 12:00:34.800840 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.800820    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rsjgc"
Sep 16 12:00:34.801254 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.801215    2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-251.ec2.internal"
Sep 16 12:00:34.804048 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.804029    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9hkhs\""
Sep 16 12:00:34.804176 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.804102    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 16 12:00:34.804176 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.804124    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 16 12:00:34.805450 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.805433    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nc7sf"
Sep 16 12:00:34.805660 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.805628    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ce48f02b-95e4-4a34-b6f6-f44283e70086-log-socket\") pod \"ovnkube-node-vjkjn\" (UID: \"ce48f02b-95e4-4a34-b6f6-f44283e70086\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn"
Sep 16 12:00:34.805773 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.805679    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/28222687-d3b4-4c0c-81f3-cc24fdc912e8-kubelet-config\") pod \"global-pull-secret-syncer-tbc79\" (UID: \"28222687-d3b4-4c0c-81f3-cc24fdc912e8\") " pod="kube-system/global-pull-secret-syncer-tbc79"
Sep 16 12:00:34.805773 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.805716    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ce48f02b-95e4-4a34-b6f6-f44283e70086-run-ovn\") pod \"ovnkube-node-vjkjn\" (UID: \"ce48f02b-95e4-4a34-b6f6-f44283e70086\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn"
Sep 16 12:00:34.805884 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.805802    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ce48f02b-95e4-4a34-b6f6-f44283e70086-node-log\") pod \"ovnkube-node-vjkjn\" (UID: \"ce48f02b-95e4-4a34-b6f6-f44283e70086\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn"
Sep 16 12:00:34.805884 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.805826    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce48f02b-95e4-4a34-b6f6-f44283e70086-host-run-ovn-kubernetes\") pod \"ovnkube-node-vjkjn\" (UID: \"ce48f02b-95e4-4a34-b6f6-f44283e70086\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn"
Sep 16 12:00:34.805884 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.805845    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ce48f02b-95e4-4a34-b6f6-f44283e70086-host-cni-netd\") pod \"ovnkube-node-vjkjn\" (UID: \"ce48f02b-95e4-4a34-b6f6-f44283e70086\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn"
Sep 16 12:00:34.806041 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.805924    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6b817e44-5083-4c23-8480-340e10041f8f-agent-certs\") pod \"konnectivity-agent-rsjgc\" (UID: \"6b817e44-5083-4c23-8480-340e10041f8f\") " pod="kube-system/konnectivity-agent-rsjgc"
Sep 16 12:00:34.806041 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.805975    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ce48f02b-95e4-4a34-b6f6-f44283e70086-run-openvswitch\") pod \"ovnkube-node-vjkjn\" (UID: \"ce48f02b-95e4-4a34-b6f6-f44283e70086\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn"
Sep 16 12:00:34.806041 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.806021    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ce48f02b-95e4-4a34-b6f6-f44283e70086-env-overrides\") pod \"ovnkube-node-vjkjn\" (UID: \"ce48f02b-95e4-4a34-b6f6-f44283e70086\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn"
Sep 16 12:00:34.806194 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.806060    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce48f02b-95e4-4a34-b6f6-f44283e70086-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vjkjn\" (UID: \"ce48f02b-95e4-4a34-b6f6-f44283e70086\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn"
Sep 16 12:00:34.806322 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.806096    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlrd4\" (UniqueName: \"kubernetes.io/projected/ce48f02b-95e4-4a34-b6f6-f44283e70086-kube-api-access-nlrd4\") pod \"ovnkube-node-vjkjn\" (UID: \"ce48f02b-95e4-4a34-b6f6-f44283e70086\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn"
Sep 16 12:00:34.806774 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.806756    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ce48f02b-95e4-4a34-b6f6-f44283e70086-systemd-units\") pod \"ovnkube-node-vjkjn\" (UID: \"ce48f02b-95e4-4a34-b6f6-f44283e70086\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn"
Sep 16 12:00:34.806862 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.806791    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ce48f02b-95e4-4a34-b6f6-f44283e70086-ovnkube-config\") pod \"ovnkube-node-vjkjn\" (UID: \"ce48f02b-95e4-4a34-b6f6-f44283e70086\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn"
Sep 16 12:00:34.807190 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.807168    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/28222687-d3b4-4c0c-81f3-cc24fdc912e8-dbus\") pod \"global-pull-secret-syncer-tbc79\" (UID: \"28222687-d3b4-4c0c-81f3-cc24fdc912e8\") " pod="kube-system/global-pull-secret-syncer-tbc79"
Sep 16 12:00:34.807295 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.807203    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/28222687-d3b4-4c0c-81f3-cc24fdc912e8-original-pull-secret\") pod \"global-pull-secret-syncer-tbc79\" (UID: \"28222687-d3b4-4c0c-81f3-cc24fdc912e8\") " pod="kube-system/global-pull-secret-syncer-tbc79"
Sep 16 12:00:34.807295 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.807254    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce48f02b-95e4-4a34-b6f6-f44283e70086-host-kubelet\") pod \"ovnkube-node-vjkjn\" (UID: \"ce48f02b-95e4-4a34-b6f6-f44283e70086\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn"
Sep 16 12:00:34.807295 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.807288    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ce48f02b-95e4-4a34-b6f6-f44283e70086-var-lib-openvswitch\") pod \"ovnkube-node-vjkjn\" (UID: \"ce48f02b-95e4-4a34-b6f6-f44283e70086\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn"
Sep 16 12:00:34.807462 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.807308    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ce48f02b-95e4-4a34-b6f6-f44283e70086-host-cni-bin\") pod \"ovnkube-node-vjkjn\" (UID: \"ce48f02b-95e4-4a34-b6f6-f44283e70086\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn"
Sep 16 12:00:34.807462 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.807331    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6b817e44-5083-4c23-8480-340e10041f8f-konnectivity-ca\") pod \"konnectivity-agent-rsjgc\" (UID: \"6b817e44-5083-4c23-8480-340e10041f8f\") " pod="kube-system/konnectivity-agent-rsjgc"
Sep 16 12:00:34.807462 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.807352    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tg6kt\" (UniqueName: \"kubernetes.io/projected/e261eb8b-bfaa-491d-afbe-6eb8fbc57324-kube-api-access-tg6kt\") pod \"network-metrics-daemon-6tsgc\" (UID: \"e261eb8b-bfaa-491d-afbe-6eb8fbc57324\") " pod="openshift-multus/network-metrics-daemon-6tsgc"
Sep 16 12:00:34.807462 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.807368    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ce48f02b-95e4-4a34-b6f6-f44283e70086-host-run-netns\") pod \"ovnkube-node-vjkjn\" (UID: \"ce48f02b-95e4-4a34-b6f6-f44283e70086\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn"
Sep 16 12:00:34.807462 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.807396    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ce48f02b-95e4-4a34-b6f6-f44283e70086-run-systemd\") pod \"ovnkube-node-vjkjn\" (UID: \"ce48f02b-95e4-4a34-b6f6-f44283e70086\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn"
Sep 16 12:00:34.807462 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.807441    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ce48f02b-95e4-4a34-b6f6-f44283e70086-ovn-node-metrics-cert\") pod \"ovnkube-node-vjkjn\" (UID: \"ce48f02b-95e4-4a34-b6f6-f44283e70086\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn"
Sep 16 12:00:34.807721 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.807479    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ce48f02b-95e4-4a34-b6f6-f44283e70086-ovnkube-script-lib\") pod \"ovnkube-node-vjkjn\" (UID: \"ce48f02b-95e4-4a34-b6f6-f44283e70086\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn"
Sep 16 12:00:34.807721 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.807503    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e261eb8b-bfaa-491d-afbe-6eb8fbc57324-metrics-certs\") pod \"network-metrics-daemon-6tsgc\" (UID: \"e261eb8b-bfaa-491d-afbe-6eb8fbc57324\") " pod="openshift-multus/network-metrics-daemon-6tsgc"
Sep 16 12:00:34.807721 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.807547    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ce48f02b-95e4-4a34-b6f6-f44283e70086-host-slash\") pod \"ovnkube-node-vjkjn\" (UID: \"ce48f02b-95e4-4a34-b6f6-f44283e70086\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn"
Sep 16 12:00:34.807721 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.807624    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ce48f02b-95e4-4a34-b6f6-f44283e70086-etc-openvswitch\") pod \"ovnkube-node-vjkjn\" (UID: \"ce48f02b-95e4-4a34-b6f6-f44283e70086\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn"
Sep 16 12:00:34.808311 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.808291    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 16 12:00:34.808387 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.808291    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 16 12:00:34.808536 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.808517    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ch8pr"
Sep 16 12:00:34.808721 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.808702    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-klnsl\""
Sep 16 12:00:34.810762 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.810744    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 16 12:00:34.810856 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.810842    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-l5cpd"
Sep 16 12:00:34.811046 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.811022    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 16 12:00:34.811153 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.811092    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-jgr2j\""
Sep 16 12:00:34.811924 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.811907    2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 16 12:00:34.813326 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.813306    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rhx78"
Sep 16 12:00:34.813413 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.813382    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 16 12:00:34.813413 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.813391    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 16 12:00:34.813700 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.813678    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 16 12:00:34.813859 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.813845    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vjzqc\""
Sep 16 12:00:34.815730 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.815715    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rdgh"
Sep 16 12:00:34.815805 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:34.815778    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2rdgh" podUID="c334b0e3-888b-49a6-beae-f40e40caa548"
Sep 16 12:00:34.817379 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.817351    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 16 12:00:34.817477 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.817380    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 16 12:00:34.817766 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.817747    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 16 12:00:34.817899 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.817882    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 16 12:00:34.817986 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.817974    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-hcwlc\""
Sep 16 12:00:34.818280 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.818266    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-n5trt"
Sep 16 12:00:34.819118 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.819105    2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 16 12:00:34.819171 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.819161    2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-251.ec2.internal"
Sep 16 12:00:34.820636 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.820622    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 16 12:00:34.820779 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.820761    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-45qxq\""
Sep 16 12:00:34.820872 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.820835    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 16 12:00:34.820872 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.820865    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsszd"
Sep 16 12:00:34.821354 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.821339    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 16 12:00:34.823218 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.823198    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 16 12:00:34.823287 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.823198    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-gb646\""
Sep 16 12:00:34.823341 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.823311    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-251.ec2.internal"]
Sep 16 12:00:34.823417 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.823401    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-swz2v"
Sep 16 12:00:34.823450 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.823431    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 16 12:00:34.823486 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.823458    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 16 12:00:34.825988 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.825969    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 16 12:00:34.826083 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.825997    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 16 12:00:34.826387 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.826371    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-4l8gt\""
Sep 16 12:00:34.830196 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.830180    2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 16 12:00:34.830296 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.830280    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-138-251.ec2.internal"]
Sep 16 12:00:34.842477 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.842451    2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-tgtkt"
Sep 16 12:00:34.853181 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.853165    2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-tgtkt"
Sep 16 12:00:34.865076 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.865008    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-15 11:55:34 +0000 UTC" deadline="2028-03-04 11:50:23.205284434 +0000 UTC"
Sep 16 12:00:34.865076 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.865047    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12839h49m48.340243368s"
Sep 16 12:00:34.901978 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.901957    2559 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 16 12:00:34.908511 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.908490    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6b817e44-5083-4c23-8480-340e10041f8f-agent-certs\") pod \"konnectivity-agent-rsjgc\" (UID: \"6b817e44-5083-4c23-8480-340e10041f8f\") " pod="kube-system/konnectivity-agent-rsjgc"
Sep 16 12:00:34.908617 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.908533    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvz2c\" (UniqueName: \"kubernetes.io/projected/6bdcdaa1-6a36-4c63-8ba4-e95598e58778-kube-api-access-kvz2c\") pod \"aws-ebs-csi-driver-node-tsszd\" (UID: \"6bdcdaa1-6a36-4c63-8ba4-e95598e58778\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsszd"
Sep 16 12:00:34.908617 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.908563    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bc31abf4-e8c6-4be6-87b3-f412930ffa32-host-run-multus-certs\") pod \"multus-rhx78\" (UID: \"bc31abf4-e8c6-4be6-87b3-f412930ffa32\") " pod="openshift-multus/multus-rhx78"
Sep 16 12:00:34.908617 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.908590    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/94671c96-5c56-42f8-b7f7-f6f93b27dac0-host\") pod \"node-ca-l5cpd\" (UID: \"94671c96-5c56-42f8-b7f7-f6f93b27dac0\") " pod="openshift-image-registry/node-ca-l5cpd"
Sep 16 12:00:34.908746 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.908642    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftrr2\" (UniqueName: \"kubernetes.io/projected/e0181d86-c266-426e-a18d-0f0241e252a9-kube-api-access-ftrr2\") pod \"multus-additional-cni-plugins-swz2v\" (UID: \"e0181d86-c266-426e-a18d-0f0241e252a9\") " pod="openshift-multus/multus-additional-cni-plugins-swz2v"
Sep 16 12:00:34.908746 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.908677    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bc31abf4-e8c6-4be6-87b3-f412930ffa32-cnibin\") pod \"multus-rhx78\" (UID: \"bc31abf4-e8c6-4be6-87b3-f412930ffa32\") " pod="openshift-multus/multus-rhx78"
Sep 16 12:00:34.908746 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.908700    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e0181d86-c266-426e-a18d-0f0241e252a9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-swz2v\" (UID: \"e0181d86-c266-426e-a18d-0f0241e252a9\") " pod="openshift-multus/multus-additional-cni-plugins-swz2v"
Sep 16 12:00:34.908746 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.908723    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bc31abf4-e8c6-4be6-87b3-f412930ffa32-host-var-lib-kubelet\") pod \"multus-rhx78\" (UID: \"bc31abf4-e8c6-4be6-87b3-f412930ffa32\") " pod="openshift-multus/multus-rhx78"
Sep 16 12:00:34.908880 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.908744    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bc31abf4-e8c6-4be6-87b3-f412930ffa32-hostroot\") pod \"multus-rhx78\" (UID: \"bc31abf4-e8c6-4be6-87b3-f412930ffa32\") " pod="openshift-multus/multus-rhx78"
Sep 16 12:00:34.908880 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.908790    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrdrt\" (UniqueName: \"kubernetes.io/projected/adb5d466-089d-4022-b731-6ca3f650eeab-kube-api-access-qrdrt\") pod \"iptables-alerter-n5trt\" (UID: \"adb5d466-089d-4022-b731-6ca3f650eeab\") " pod="openshift-network-operator/iptables-alerter-n5trt"
Sep 16 12:00:34.908880 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.908835    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ce48f02b-95e4-4a34-b6f6-f44283e70086-ovnkube-config\") pod \"ovnkube-node-vjkjn\" (UID: \"ce48f02b-95e4-4a34-b6f6-f44283e70086\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn"
Sep 16 12:00:34.908880 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.908863    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/28222687-d3b4-4c0c-81f3-cc24fdc912e8-dbus\") pod \"global-pull-secret-syncer-tbc79\" (UID: \"28222687-d3b4-4c0c-81f3-cc24fdc912e8\") " pod="kube-system/global-pull-secret-syncer-tbc79"
Sep 16 12:00:34.909091 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.908881    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/28222687-d3b4-4c0c-81f3-cc24fdc912e8-original-pull-secret\") pod \"global-pull-secret-syncer-tbc79\" (UID: \"28222687-d3b4-4c0c-81f3-cc24fdc912e8\") " pod="kube-system/global-pull-secret-syncer-tbc79"
Sep 16 12:00:34.909091 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.908898    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/13ecb5ce-d0db-4a46-82d4-03e60d47b902-host\") pod \"tuned-nc7sf\" (UID: \"13ecb5ce-d0db-4a46-82d4-03e60d47b902\") " pod="openshift-cluster-node-tuning-operator/tuned-nc7sf"
Sep 16 12:00:34.909091 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.908942    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bc31abf4-e8c6-4be6-87b3-f412930ffa32-cni-binary-copy\") pod \"multus-rhx78\" (UID: \"bc31abf4-e8c6-4be6-87b3-f412930ffa32\") " pod="openshift-multus/multus-rhx78"
Sep 16 12:00:34.909091 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.908970    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bc31abf4-e8c6-4be6-87b3-f412930ffa32-host-var-lib-cni-multus\") pod \"multus-rhx78\" (UID: \"bc31abf4-e8c6-4be6-87b3-f412930ffa32\") " pod="openshift-multus/multus-rhx78"
Sep 16 12:00:34.909091 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.908972    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/28222687-d3b4-4c0c-81f3-cc24fdc912e8-dbus\") pod \"global-pull-secret-syncer-tbc79\" (UID: \"28222687-d3b4-4c0c-81f3-cc24fdc912e8\") " pod="kube-system/global-pull-secret-syncer-tbc79"
Sep 16 12:00:34.909091 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.909004    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bc31abf4-e8c6-4be6-87b3-f412930ffa32-multus-daemon-config\") pod \"multus-rhx78\" (UID: \"bc31abf4-e8c6-4be6-87b3-f412930ffa32\") " pod="openshift-multus/multus-rhx78"
Sep 16 12:00:34.909091 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.909027    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e0181d86-c266-426e-a18d-0f0241e252a9-system-cni-dir\") pod \"multus-additional-cni-plugins-swz2v\" (UID: \"e0181d86-c266-426e-a18d-0f0241e252a9\") " pod="openshift-multus/multus-additional-cni-plugins-swz2v"
Sep 16 12:00:34.909091 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:34.908994    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 12:00:34.909091 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.909048    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ce48f02b-95e4-4a34-b6f6-f44283e70086-run-systemd\") pod \"ovnkube-node-vjkjn\" (UID: \"ce48f02b-95e4-4a34-b6f6-f44283e70086\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn"
Sep 16 12:00:34.909091 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.909075    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ce48f02b-95e4-4a34-b6f6-f44283e70086-ovn-node-metrics-cert\") pod \"ovnkube-node-vjkjn\" (UID: \"ce48f02b-95e4-4a34-b6f6-f44283e70086\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn"
Sep 16 12:00:34.909593 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.909103    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/94671c96-5c56-42f8-b7f7-f6f93b27dac0-serviceca\") pod \"node-ca-l5cpd\" (UID: \"94671c96-5c56-42f8-b7f7-f6f93b27dac0\") " pod="openshift-image-registry/node-ca-l5cpd"
Sep 16 12:00:34.909593 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:34.909172    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28222687-d3b4-4c0c-81f3-cc24fdc912e8-original-pull-secret podName:28222687-d3b4-4c0c-81f3-cc24fdc912e8 nodeName:}" failed. No retries permitted until 2026-09-16 12:00:35.40911405 +0000 UTC m=+2.029433371 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/28222687-d3b4-4c0c-81f3-cc24fdc912e8-original-pull-secret") pod "global-pull-secret-syncer-tbc79" (UID: "28222687-d3b4-4c0c-81f3-cc24fdc912e8") : object "kube-system"/"original-pull-secret" not registered
Sep 16 12:00:34.909593 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.909201    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e0181d86-c266-426e-a18d-0f0241e252a9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-swz2v\" (UID: \"e0181d86-c266-426e-a18d-0f0241e252a9\") " pod="openshift-multus/multus-additional-cni-plugins-swz2v"
Sep 16 12:00:34.909593 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.909195    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ce48f02b-95e4-4a34-b6f6-f44283e70086-run-systemd\") pod \"ovnkube-node-vjkjn\" (UID: \"ce48f02b-95e4-4a34-b6f6-f44283e70086\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn"
Sep 16 12:00:34.909593 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.909265    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ce48f02b-95e4-4a34-b6f6-f44283e70086-host-slash\") pod \"ovnkube-node-vjkjn\" (UID: \"ce48f02b-95e4-4a34-b6f6-f44283e70086\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn"
Sep 16 12:00:34.909593 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.909310    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a826335e-773e-48e2-aa35-099d7466304b-tmp-dir\") pod \"node-resolver-ch8pr\" (UID: \"a826335e-773e-48e2-aa35-099d7466304b\") " pod="openshift-dns/node-resolver-ch8pr"
Sep 16 12:00:34.909593 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.909340    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6bdcdaa1-6a36-4c63-8ba4-e95598e58778-device-dir\") pod \"aws-ebs-csi-driver-node-tsszd\" (UID: \"6bdcdaa1-6a36-4c63-8ba4-e95598e58778\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsszd"
Sep 16 12:00:34.909593 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.909317    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ce48f02b-95e4-4a34-b6f6-f44283e70086-host-slash\") pod \"ovnkube-node-vjkjn\" (UID: \"ce48f02b-95e4-4a34-b6f6-f44283e70086\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn"
Sep 16 12:00:34.909593 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.909368    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bc31abf4-e8c6-4be6-87b3-f412930ffa32-multus-conf-dir\") pod \"multus-rhx78\" (UID: \"bc31abf4-e8c6-4be6-87b3-f412930ffa32\") " pod="openshift-multus/multus-rhx78"
Sep 16 12:00:34.909593 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.909406    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/adb5d466-089d-4022-b731-6ca3f650eeab-iptables-alerter-script\") pod \"iptables-alerter-n5trt\" (UID: \"adb5d466-089d-4022-b731-6ca3f650eeab\") " pod="openshift-network-operator/iptables-alerter-n5trt"
Sep 16 12:00:34.909593 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.909518    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e0181d86-c266-426e-a18d-0f0241e252a9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-swz2v\" (UID: \"e0181d86-c266-426e-a18d-0f0241e252a9\") " pod="openshift-multus/multus-additional-cni-plugins-swz2v"
Sep 16 12:00:34.909593 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.909546    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13ecb5ce-d0db-4a46-82d4-03e60d47b902-etc-kubernetes\") pod \"tuned-nc7sf\" (UID: \"13ecb5ce-d0db-4a46-82d4-03e60d47b902\") " pod="openshift-cluster-node-tuning-operator/tuned-nc7sf"
Sep 16 12:00:34.909593 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.909579    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ce48f02b-95e4-4a34-b6f6-f44283e70086-host-cni-netd\") pod \"ovnkube-node-vjkjn\" (UID: \"ce48f02b-95e4-4a34-b6f6-f44283e70086\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn"
Sep 16 12:00:34.910249 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.909616    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ce48f02b-95e4-4a34-b6f6-f44283e70086-host-cni-netd\") pod \"ovnkube-node-vjkjn\" (UID: \"ce48f02b-95e4-4a34-b6f6-f44283e70086\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn"
Sep 16 12:00:34.910249 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.909634    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6bdcdaa1-6a36-4c63-8ba4-e95598e58778-registration-dir\") pod \"aws-ebs-csi-driver-node-tsszd\" (UID: \"6bdcdaa1-6a36-4c63-8ba4-e95598e58778\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsszd"
Sep 16 12:00:34.910249 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.909663    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/13ecb5ce-d0db-4a46-82d4-03e60d47b902-run\") pod \"tuned-nc7sf\" (UID: \"13ecb5ce-d0db-4a46-82d4-03e60d47b902\") " pod="openshift-cluster-node-tuning-operator/tuned-nc7sf"
Sep 16 12:00:34.910249 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.909689    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/13ecb5ce-d0db-4a46-82d4-03e60d47b902-var-lib-kubelet\") pod \"tuned-nc7sf\" (UID: \"13ecb5ce-d0db-4a46-82d4-03e60d47b902\") " pod="openshift-cluster-node-tuning-operator/tuned-nc7sf"
Sep 16 12:00:34.910249 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.909714    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/13ecb5ce-d0db-4a46-82d4-03e60d47b902-etc-tuned\") pod \"tuned-nc7sf\" (UID: \"13ecb5ce-d0db-4a46-82d4-03e60d47b902\") " pod="openshift-cluster-node-tuning-operator/tuned-nc7sf"
Sep 16 12:00:34.910249 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.909737    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bc31abf4-e8c6-4be6-87b3-f412930ffa32-host-run-netns\") pod \"multus-rhx78\" (UID: \"bc31abf4-e8c6-4be6-87b3-f412930ffa32\") " pod="openshift-multus/multus-rhx78"
Sep 16 12:00:34.910249 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.909768    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ce48f02b-95e4-4a34-b6f6-f44283e70086-run-openvswitch\") pod \"ovnkube-node-vjkjn\" (UID: \"ce48f02b-95e4-4a34-b6f6-f44283e70086\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn"
Sep 16 12:00:34.910249 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.909794    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ce48f02b-95e4-4a34-b6f6-f44283e70086-env-overrides\") pod \"ovnkube-node-vjkjn\" (UID: \"ce48f02b-95e4-4a34-b6f6-f44283e70086\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn"
Sep 16 12:00:34.910249 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.909820    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsjjz\" (UniqueName: \"kubernetes.io/projected/c334b0e3-888b-49a6-beae-f40e40caa548-kube-api-access-tsjjz\") pod \"network-check-target-2rdgh\" (UID: \"c334b0e3-888b-49a6-beae-f40e40caa548\") " pod="openshift-network-diagnostics/network-check-target-2rdgh"
Sep 16 12:00:34.910249 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.909845    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6bdcdaa1-6a36-4c63-8ba4-e95598e58778-sys-fs\") pod \"aws-ebs-csi-driver-node-tsszd\" (UID: \"6bdcdaa1-6a36-4c63-8ba4-e95598e58778\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsszd"
Sep 16 12:00:34.910249 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.909869    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/13ecb5ce-d0db-4a46-82d4-03e60d47b902-etc-sysctl-d\") pod \"tuned-nc7sf\" (UID: \"13ecb5ce-d0db-4a46-82d4-03e60d47b902\") " pod="openshift-cluster-node-tuning-operator/tuned-nc7sf"
Sep 16 12:00:34.910249 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.909895    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/13ecb5ce-d0db-4a46-82d4-03e60d47b902-etc-systemd\") pod \"tuned-nc7sf\" (UID: \"13ecb5ce-d0db-4a46-82d4-03e60d47b902\") " pod="openshift-cluster-node-tuning-operator/tuned-nc7sf"
Sep 16 12:00:34.910249 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.909908    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ce48f02b-95e4-4a34-b6f6-f44283e70086-run-openvswitch\") pod \"ovnkube-node-vjkjn\" (UID: \"ce48f02b-95e4-4a34-b6f6-f44283e70086\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn"
Sep 16 12:00:34.910249 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.909918    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/13ecb5ce-d0db-4a46-82d4-03e60d47b902-sys\") pod \"tuned-nc7sf\" (UID: \"13ecb5ce-d0db-4a46-82d4-03e60d47b902\") " pod="openshift-cluster-node-tuning-operator/tuned-nc7sf"
Sep 16 12:00:34.910249 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.909968    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce48f02b-95e4-4a34-b6f6-f44283e70086-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vjkjn\" (UID: \"ce48f02b-95e4-4a34-b6f6-f44283e70086\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn"
Sep 16 12:00:34.910249 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.910006    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r29p7\" (UniqueName: \"kubernetes.io/projected/a826335e-773e-48e2-aa35-099d7466304b-kube-api-access-r29p7\") pod \"node-resolver-ch8pr\" (UID: \"a826335e-773e-48e2-aa35-099d7466304b\") " pod="openshift-dns/node-resolver-ch8pr"
Sep 16 12:00:34.910952 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.910017    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce48f02b-95e4-4a34-b6f6-f44283e70086-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vjkjn\" (UID: \"ce48f02b-95e4-4a34-b6f6-f44283e70086\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn"
Sep 16 12:00:34.910952 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.910027    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pn9v6\" (UniqueName: \"kubernetes.io/projected/13ecb5ce-d0db-4a46-82d4-03e60d47b902-kube-api-access-pn9v6\") pod \"tuned-nc7sf\" (UID: \"13ecb5ce-d0db-4a46-82d4-03e60d47b902\") " pod="openshift-cluster-node-tuning-operator/tuned-nc7sf"
Sep 16 12:00:34.910952 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.910058    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bc31abf4-e8c6-4be6-87b3-f412930ffa32-multus-cni-dir\") pod \"multus-rhx78\" (UID: \"bc31abf4-e8c6-4be6-87b3-f412930ffa32\") " pod="openshift-multus/multus-rhx78"
Sep 16 12:00:34.910952 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.910079    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bc31abf4-e8c6-4be6-87b3-f412930ffa32-host-run-k8s-cni-cncf-io\") pod \"multus-rhx78\" (UID: \"bc31abf4-e8c6-4be6-87b3-f412930ffa32\") " pod="openshift-multus/multus-rhx78"
Sep 16 12:00:34.910952 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.910100    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bc31abf4-e8c6-4be6-87b3-f412930ffa32-etc-kubernetes\") pod \"multus-rhx78\" (UID: \"bc31abf4-e8c6-4be6-87b3-f412930ffa32\") " pod="openshift-multus/multus-rhx78"
Sep 16 12:00:34.910952 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.910106    2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 16 12:00:34.910952 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.910164    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlrd4\" (UniqueName: \"kubernetes.io/projected/ce48f02b-95e4-4a34-b6f6-f44283e70086-kube-api-access-nlrd4\") pod \"ovnkube-node-vjkjn\" (UID: \"ce48f02b-95e4-4a34-b6f6-f44283e70086\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn"
Sep 16 12:00:34.910952 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.910196    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/adb5d466-089d-4022-b731-6ca3f650eeab-host-slash\") pod \"iptables-alerter-n5trt\" (UID: \"adb5d466-089d-4022-b731-6ca3f650eeab\") " pod="openshift-network-operator/iptables-alerter-n5trt"
Sep 16 12:00:34.910952 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.910219    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ce48f02b-95e4-4a34-b6f6-f44283e70086-systemd-units\") pod \"ovnkube-node-vjkjn\" (UID: \"ce48f02b-95e4-4a34-b6f6-f44283e70086\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn"
Sep 16 12:00:34.910952 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.910245    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e0181d86-c266-426e-a18d-0f0241e252a9-cnibin\") pod \"multus-additional-cni-plugins-swz2v\" (UID: \"e0181d86-c266-426e-a18d-0f0241e252a9\") " pod="openshift-multus/multus-additional-cni-plugins-swz2v"
Sep 16 12:00:34.910952 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.910265    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/13ecb5ce-d0db-4a46-82d4-03e60d47b902-etc-modprobe-d\") pod \"tuned-nc7sf\" (UID: \"13ecb5ce-d0db-4a46-82d4-03e60d47b902\") " pod="openshift-cluster-node-tuning-operator/tuned-nc7sf"
Sep 16 12:00:34.910952 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.910304    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bc31abf4-e8c6-4be6-87b3-f412930ffa32-host-var-lib-cni-bin\") pod \"multus-rhx78\" (UID: \"bc31abf4-e8c6-4be6-87b3-f412930ffa32\") " pod="openshift-multus/multus-rhx78"
Sep 16 12:00:34.910952 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.910338    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ce48f02b-95e4-4a34-b6f6-f44283e70086-systemd-units\") pod \"ovnkube-node-vjkjn\" (UID: \"ce48f02b-95e4-4a34-b6f6-f44283e70086\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn"
Sep 16 12:00:34.910952 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.910390    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce48f02b-95e4-4a34-b6f6-f44283e70086-host-kubelet\") pod \"ovnkube-node-vjkjn\" (UID: \"ce48f02b-95e4-4a34-b6f6-f44283e70086\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn"
Sep 16 12:00:34.910952 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.910456    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce48f02b-95e4-4a34-b6f6-f44283e70086-host-kubelet\") pod \"ovnkube-node-vjkjn\" (UID: \"ce48f02b-95e4-4a34-b6f6-f44283e70086\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn"
Sep 16 12:00:34.910952 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.910507    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ce48f02b-95e4-4a34-b6f6-f44283e70086-var-lib-openvswitch\") pod \"ovnkube-node-vjkjn\" (UID: \"ce48f02b-95e4-4a34-b6f6-f44283e70086\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn"
Sep 16 12:00:34.910952 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.910546    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ce48f02b-95e4-4a34-b6f6-f44283e70086-host-cni-bin\") pod \"ovnkube-node-vjkjn\" (UID: \"ce48f02b-95e4-4a34-b6f6-f44283e70086\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn"
Sep 16 12:00:34.911574 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.910585    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ce48f02b-95e4-4a34-b6f6-f44283e70086-var-lib-openvswitch\") pod \"ovnkube-node-vjkjn\" (UID: \"ce48f02b-95e4-4a34-b6f6-f44283e70086\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn"
Sep 16 12:00:34.911574 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.910654    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ce48f02b-95e4-4a34-b6f6-f44283e70086-host-cni-bin\") pod \"ovnkube-node-vjkjn\" (UID: \"ce48f02b-95e4-4a34-b6f6-f44283e70086\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn"
Sep 16 12:00:34.911574 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.910676    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a826335e-773e-48e2-aa35-099d7466304b-hosts-file\") pod \"node-resolver-ch8pr\" (UID: \"a826335e-773e-48e2-aa35-099d7466304b\") " pod="openshift-dns/node-resolver-ch8pr"
Sep 16 12:00:34.911574 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.910709    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bc31abf4-e8c6-4be6-87b3-f412930ffa32-multus-socket-dir-parent\") pod \"multus-rhx78\" (UID: \"bc31abf4-e8c6-4be6-87b3-f412930ffa32\") " pod="openshift-multus/multus-rhx78"
Sep 16 12:00:34.911574 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.910742    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f24tt\" (UniqueName: \"kubernetes.io/projected/bc31abf4-e8c6-4be6-87b3-f412930ffa32-kube-api-access-f24tt\") pod \"multus-rhx78\" (UID: \"bc31abf4-e8c6-4be6-87b3-f412930ffa32\") " pod="openshift-multus/multus-rhx78"
Sep 16 12:00:34.911574 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.910766    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/13ecb5ce-d0db-4a46-82d4-03e60d47b902-etc-sysconfig\") pod \"tuned-nc7sf\" (UID: \"13ecb5ce-d0db-4a46-82d4-03e60d47b902\") " pod="openshift-cluster-node-tuning-operator/tuned-nc7sf"
Sep 16 12:00:34.911574 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.910788    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/13ecb5ce-d0db-4a46-82d4-03e60d47b902-etc-sysctl-conf\") pod \"tuned-nc7sf\" (UID: \"13ecb5ce-d0db-4a46-82d4-03e60d47b902\") " pod="openshift-cluster-node-tuning-operator/tuned-nc7sf"
Sep 16 12:00:34.911574 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.910816    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6b817e44-5083-4c23-8480-340e10041f8f-konnectivity-ca\") pod \"konnectivity-agent-rsjgc\" (UID: \"6b817e44-5083-4c23-8480-340e10041f8f\") " pod="kube-system/konnectivity-agent-rsjgc"
Sep 16 12:00:34.911574 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.910840    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tg6kt\" (UniqueName: \"kubernetes.io/projected/e261eb8b-bfaa-491d-afbe-6eb8fbc57324-kube-api-access-tg6kt\") pod \"network-metrics-daemon-6tsgc\" (UID: \"e261eb8b-bfaa-491d-afbe-6eb8fbc57324\") " pod="openshift-multus/network-metrics-daemon-6tsgc"
Sep 16 12:00:34.911574 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.910863    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ce48f02b-95e4-4a34-b6f6-f44283e70086-host-run-netns\") pod \"ovnkube-node-vjkjn\" (UID: \"ce48f02b-95e4-4a34-b6f6-f44283e70086\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn"
Sep 16 12:00:34.911574 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.910896    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ce48f02b-95e4-4a34-b6f6-f44283e70086-ovnkube-script-lib\") pod \"ovnkube-node-vjkjn\" (UID: \"ce48f02b-95e4-4a34-b6f6-f44283e70086\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn"
Sep 16 12:00:34.911574 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.910919    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wv2bl\" (UniqueName: \"kubernetes.io/projected/94671c96-5c56-42f8-b7f7-f6f93b27dac0-kube-api-access-wv2bl\") pod \"node-ca-l5cpd\" (UID: \"94671c96-5c56-42f8-b7f7-f6f93b27dac0\") " pod="openshift-image-registry/node-ca-l5cpd"
Sep 16 12:00:34.911574 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.910942    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6bdcdaa1-6a36-4c63-8ba4-e95598e58778-socket-dir\") pod \"aws-ebs-csi-driver-node-tsszd\" (UID: \"6bdcdaa1-6a36-4c63-8ba4-e95598e58778\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsszd"
Sep 16 12:00:34.911574 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.910966    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e261eb8b-bfaa-491d-afbe-6eb8fbc57324-metrics-certs\") pod \"network-metrics-daemon-6tsgc\" (UID: \"e261eb8b-bfaa-491d-afbe-6eb8fbc57324\") " pod="openshift-multus/network-metrics-daemon-6tsgc"
Sep 16 12:00:34.911574 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.910990    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ce48f02b-95e4-4a34-b6f6-f44283e70086-etc-openvswitch\") pod \"ovnkube-node-vjkjn\" (UID: \"ce48f02b-95e4-4a34-b6f6-f44283e70086\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn"
Sep 16 12:00:34.911574 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.911033    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ce48f02b-95e4-4a34-b6f6-f44283e70086-log-socket\") pod \"ovnkube-node-vjkjn\" (UID: \"ce48f02b-95e4-4a34-b6f6-f44283e70086\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn"
Sep 16 12:00:34.911574 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.911056    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/28222687-d3b4-4c0c-81f3-cc24fdc912e8-kubelet-config\") pod \"global-pull-secret-syncer-tbc79\" (UID: \"28222687-d3b4-4c0c-81f3-cc24fdc912e8\") " pod="kube-system/global-pull-secret-syncer-tbc79"
Sep 16 12:00:34.912380 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.911081    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6bdcdaa1-6a36-4c63-8ba4-e95598e58778-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tsszd\" (UID: \"6bdcdaa1-6a36-4c63-8ba4-e95598e58778\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsszd"
Sep 16 12:00:34.912380 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.911115    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6bdcdaa1-6a36-4c63-8ba4-e95598e58778-etc-selinux\") pod \"aws-ebs-csi-driver-node-tsszd\" (UID: \"6bdcdaa1-6a36-4c63-8ba4-e95598e58778\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsszd"
Sep 16 12:00:34.912380 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.911142    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e0181d86-c266-426e-a18d-0f0241e252a9-cni-binary-copy\") pod \"multus-additional-cni-plugins-swz2v\" (UID: \"e0181d86-c266-426e-a18d-0f0241e252a9\") " pod="openshift-multus/multus-additional-cni-plugins-swz2v"
Sep 16 12:00:34.912380 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.911192    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/13ecb5ce-d0db-4a46-82d4-03e60d47b902-lib-modules\") pod \"tuned-nc7sf\" (UID: \"13ecb5ce-d0db-4a46-82d4-03e60d47b902\") " pod="openshift-cluster-node-tuning-operator/tuned-nc7sf"
Sep 16 12:00:34.912380 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:34.911212    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 12:00:34.912380 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.911220    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ce48f02b-95e4-4a34-b6f6-f44283e70086-run-ovn\") pod \"ovnkube-node-vjkjn\" (UID: \"ce48f02b-95e4-4a34-b6f6-f44283e70086\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn"
Sep 16 12:00:34.912380 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.911242    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ce48f02b-95e4-4a34-b6f6-f44283e70086-node-log\") pod \"ovnkube-node-vjkjn\" (UID: \"ce48f02b-95e4-4a34-b6f6-f44283e70086\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn"
Sep 16 12:00:34.912380 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:34.911265    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e261eb8b-bfaa-491d-afbe-6eb8fbc57324-metrics-certs podName:e261eb8b-bfaa-491d-afbe-6eb8fbc57324 nodeName:}" failed. No retries permitted until 2026-09-16 12:00:35.411247763 +0000 UTC m=+2.031567074 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e261eb8b-bfaa-491d-afbe-6eb8fbc57324-metrics-certs") pod "network-metrics-daemon-6tsgc" (UID: "e261eb8b-bfaa-491d-afbe-6eb8fbc57324") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 12:00:34.912380 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.911290    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ce48f02b-95e4-4a34-b6f6-f44283e70086-node-log\") pod \"ovnkube-node-vjkjn\" (UID: \"ce48f02b-95e4-4a34-b6f6-f44283e70086\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn"
Sep 16 12:00:34.912380 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.911299    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce48f02b-95e4-4a34-b6f6-f44283e70086-host-run-ovn-kubernetes\") pod \"ovnkube-node-vjkjn\" (UID: \"ce48f02b-95e4-4a34-b6f6-f44283e70086\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn"
Sep 16 12:00:34.912380 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.911348    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/13ecb5ce-d0db-4a46-82d4-03e60d47b902-tmp\") pod \"tuned-nc7sf\" (UID: \"13ecb5ce-d0db-4a46-82d4-03e60d47b902\") " pod="openshift-cluster-node-tuning-operator/tuned-nc7sf"
Sep 16 12:00:34.912380 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.911376    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bc31abf4-e8c6-4be6-87b3-f412930ffa32-system-cni-dir\") pod \"multus-rhx78\" (UID: \"bc31abf4-e8c6-4be6-87b3-f412930ffa32\") " pod="openshift-multus/multus-rhx78"
Sep 16 12:00:34.912380 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.911407    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/28222687-d3b4-4c0c-81f3-cc24fdc912e8-kubelet-config\") pod \"global-pull-secret-syncer-tbc79\" (UID: \"28222687-d3b4-4c0c-81f3-cc24fdc912e8\") " pod="kube-system/global-pull-secret-syncer-tbc79"
Sep 16 12:00:34.912380 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.911474    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ce48f02b-95e4-4a34-b6f6-f44283e70086-host-run-netns\") pod \"ovnkube-node-vjkjn\" (UID: \"ce48f02b-95e4-4a34-b6f6-f44283e70086\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn"
Sep 16 12:00:34.912380 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.911507    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ce48f02b-95e4-4a34-b6f6-f44283e70086-run-ovn\") pod \"ovnkube-node-vjkjn\" (UID: \"ce48f02b-95e4-4a34-b6f6-f44283e70086\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn"
Sep 16 12:00:34.912380 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.911522    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6b817e44-5083-4c23-8480-340e10041f8f-konnectivity-ca\") pod \"konnectivity-agent-rsjgc\" (UID: \"6b817e44-5083-4c23-8480-340e10041f8f\") " pod="kube-system/konnectivity-agent-rsjgc"
Sep 16 12:00:34.912380 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.911349    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ce48f02b-95e4-4a34-b6f6-f44283e70086-etc-openvswitch\") pod \"ovnkube-node-vjkjn\" (UID: \"ce48f02b-95e4-4a34-b6f6-f44283e70086\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn"
Sep 16 12:00:34.913043 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.911588    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce48f02b-95e4-4a34-b6f6-f44283e70086-host-run-ovn-kubernetes\") pod \"ovnkube-node-vjkjn\" (UID: \"ce48f02b-95e4-4a34-b6f6-f44283e70086\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn"
Sep 16 12:00:34.913043 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.911615    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ce48f02b-95e4-4a34-b6f6-f44283e70086-log-socket\") pod \"ovnkube-node-vjkjn\" (UID: \"ce48f02b-95e4-4a34-b6f6-f44283e70086\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn"
Sep 16 12:00:34.913043 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.912615    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ce48f02b-95e4-4a34-b6f6-f44283e70086-ovnkube-config\") pod \"ovnkube-node-vjkjn\" (UID: \"ce48f02b-95e4-4a34-b6f6-f44283e70086\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn"
Sep 16 12:00:34.913043 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.912648    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ce48f02b-95e4-4a34-b6f6-f44283e70086-env-overrides\") pod \"ovnkube-node-vjkjn\" (UID: \"ce48f02b-95e4-4a34-b6f6-f44283e70086\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn"
Sep 16 12:00:34.913303 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.913062    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ce48f02b-95e4-4a34-b6f6-f44283e70086-ovnkube-script-lib\") pod \"ovnkube-node-vjkjn\" (UID: \"ce48f02b-95e4-4a34-b6f6-f44283e70086\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn"
Sep 16 12:00:34.913974 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.913947    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6b817e44-5083-4c23-8480-340e10041f8f-agent-certs\") pod \"konnectivity-agent-rsjgc\" (UID: \"6b817e44-5083-4c23-8480-340e10041f8f\") " pod="kube-system/konnectivity-agent-rsjgc"
Sep 16 12:00:34.914746 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.914725    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ce48f02b-95e4-4a34-b6f6-f44283e70086-ovn-node-metrics-cert\") pod \"ovnkube-node-vjkjn\" (UID: \"ce48f02b-95e4-4a34-b6f6-f44283e70086\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn"
Sep 16 12:00:34.919154 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.919132    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlrd4\" (UniqueName: \"kubernetes.io/projected/ce48f02b-95e4-4a34-b6f6-f44283e70086-kube-api-access-nlrd4\") pod \"ovnkube-node-vjkjn\" (UID: \"ce48f02b-95e4-4a34-b6f6-f44283e70086\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn"
Sep 16 12:00:34.919290 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:34.919275    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tg6kt\" (UniqueName: \"kubernetes.io/projected/e261eb8b-bfaa-491d-afbe-6eb8fbc57324-kube-api-access-tg6kt\") pod \"network-metrics-daemon-6tsgc\" (UID: \"e261eb8b-bfaa-491d-afbe-6eb8fbc57324\") " pod="openshift-multus/network-metrics-daemon-6tsgc"
Sep 16 12:00:35.011651 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.011628    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a826335e-773e-48e2-aa35-099d7466304b-hosts-file\") pod \"node-resolver-ch8pr\" (UID: \"a826335e-773e-48e2-aa35-099d7466304b\") " pod="openshift-dns/node-resolver-ch8pr"
Sep 16 12:00:35.011778 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.011655    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bc31abf4-e8c6-4be6-87b3-f412930ffa32-multus-socket-dir-parent\") pod \"multus-rhx78\" (UID: \"bc31abf4-e8c6-4be6-87b3-f412930ffa32\") " pod="openshift-multus/multus-rhx78"
Sep 16 12:00:35.011778 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.011671    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f24tt\" (UniqueName: \"kubernetes.io/projected/bc31abf4-e8c6-4be6-87b3-f412930ffa32-kube-api-access-f24tt\") pod \"multus-rhx78\" (UID: \"bc31abf4-e8c6-4be6-87b3-f412930ffa32\") " pod="openshift-multus/multus-rhx78"
Sep 16 12:00:35.011778 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.011693    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/13ecb5ce-d0db-4a46-82d4-03e60d47b902-etc-sysconfig\") pod \"tuned-nc7sf\" (UID: \"13ecb5ce-d0db-4a46-82d4-03e60d47b902\") " pod="openshift-cluster-node-tuning-operator/tuned-nc7sf"
Sep 16 12:00:35.011778 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.011717    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/13ecb5ce-d0db-4a46-82d4-03e60d47b902-etc-sysctl-conf\") pod \"tuned-nc7sf\" (UID: \"13ecb5ce-d0db-4a46-82d4-03e60d47b902\") " pod="openshift-cluster-node-tuning-operator/tuned-nc7sf"
Sep 16 12:00:35.011778 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.011738    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a826335e-773e-48e2-aa35-099d7466304b-hosts-file\") pod \"node-resolver-ch8pr\" (UID: \"a826335e-773e-48e2-aa35-099d7466304b\") " pod="openshift-dns/node-resolver-ch8pr"
Sep 16 12:00:35.011778 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.011768    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wv2bl\" (UniqueName: \"kubernetes.io/projected/94671c96-5c56-42f8-b7f7-f6f93b27dac0-kube-api-access-wv2bl\") pod \"node-ca-l5cpd\" (UID: \"94671c96-5c56-42f8-b7f7-f6f93b27dac0\") " pod="openshift-image-registry/node-ca-l5cpd"
Sep 16 12:00:35.011778 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.011774    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bc31abf4-e8c6-4be6-87b3-f412930ffa32-multus-socket-dir-parent\") pod \"multus-rhx78\" (UID: \"bc31abf4-e8c6-4be6-87b3-f412930ffa32\") " pod="openshift-multus/multus-rhx78"
Sep 16 12:00:35.012086 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.011793    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/13ecb5ce-d0db-4a46-82d4-03e60d47b902-etc-sysconfig\") pod \"tuned-nc7sf\" (UID: \"13ecb5ce-d0db-4a46-82d4-03e60d47b902\") " pod="openshift-cluster-node-tuning-operator/tuned-nc7sf"
Sep 16 12:00:35.012086 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.011798    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6bdcdaa1-6a36-4c63-8ba4-e95598e58778-socket-dir\") pod \"aws-ebs-csi-driver-node-tsszd\" (UID: \"6bdcdaa1-6a36-4c63-8ba4-e95598e58778\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsszd"
Sep 16 12:00:35.012086 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.011858    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6bdcdaa1-6a36-4c63-8ba4-e95598e58778-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tsszd\" (UID: \"6bdcdaa1-6a36-4c63-8ba4-e95598e58778\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsszd"
Sep 16 12:00:35.012086 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.011871    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/13ecb5ce-d0db-4a46-82d4-03e60d47b902-etc-sysctl-conf\") pod \"tuned-nc7sf\" (UID: \"13ecb5ce-d0db-4a46-82d4-03e60d47b902\") " pod="openshift-cluster-node-tuning-operator/tuned-nc7sf"
Sep 16 12:00:35.012086 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.011885    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6bdcdaa1-6a36-4c63-8ba4-e95598e58778-etc-selinux\") pod \"aws-ebs-csi-driver-node-tsszd\" (UID: \"6bdcdaa1-6a36-4c63-8ba4-e95598e58778\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsszd"
Sep 16 12:00:35.012086 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.011933    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6bdcdaa1-6a36-4c63-8ba4-e95598e58778-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tsszd\" (UID: \"6bdcdaa1-6a36-4c63-8ba4-e95598e58778\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsszd"
Sep 16 12:00:35.012086 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.011963    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e0181d86-c266-426e-a18d-0f0241e252a9-cni-binary-copy\") pod \"multus-additional-cni-plugins-swz2v\" (UID: \"e0181d86-c266-426e-a18d-0f0241e252a9\") " pod="openshift-multus/multus-additional-cni-plugins-swz2v"
Sep 16 12:00:35.012086 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.011962    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6bdcdaa1-6a36-4c63-8ba4-e95598e58778-etc-selinux\") pod \"aws-ebs-csi-driver-node-tsszd\" (UID: \"6bdcdaa1-6a36-4c63-8ba4-e95598e58778\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsszd"
Sep 16 12:00:35.012086 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.011998    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/13ecb5ce-d0db-4a46-82d4-03e60d47b902-lib-modules\") pod \"tuned-nc7sf\" (UID: \"13ecb5ce-d0db-4a46-82d4-03e60d47b902\") " pod="openshift-cluster-node-tuning-operator/tuned-nc7sf"
Sep 16 12:00:35.012086 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.012018    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6bdcdaa1-6a36-4c63-8ba4-e95598e58778-socket-dir\") pod \"aws-ebs-csi-driver-node-tsszd\" (UID: \"6bdcdaa1-6a36-4c63-8ba4-e95598e58778\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsszd"
Sep 16 12:00:35.012086 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.012041    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/13ecb5ce-d0db-4a46-82d4-03e60d47b902-tmp\") pod \"tuned-nc7sf\" (UID: \"13ecb5ce-d0db-4a46-82d4-03e60d47b902\") " pod="openshift-cluster-node-tuning-operator/tuned-nc7sf"
Sep 16 12:00:35.012086 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.012078    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bc31abf4-e8c6-4be6-87b3-f412930ffa32-system-cni-dir\") pod \"multus-rhx78\" (UID: \"bc31abf4-e8c6-4be6-87b3-f412930ffa32\") " pod="openshift-multus/multus-rhx78"
Sep 16 12:00:35.012706 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.012104    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvz2c\" (UniqueName: \"kubernetes.io/projected/6bdcdaa1-6a36-4c63-8ba4-e95598e58778-kube-api-access-kvz2c\") pod \"aws-ebs-csi-driver-node-tsszd\" (UID: \"6bdcdaa1-6a36-4c63-8ba4-e95598e58778\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsszd"
Sep 16 12:00:35.012706 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.012121    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/13ecb5ce-d0db-4a46-82d4-03e60d47b902-lib-modules\") pod \"tuned-nc7sf\" (UID: \"13ecb5ce-d0db-4a46-82d4-03e60d47b902\") " pod="openshift-cluster-node-tuning-operator/tuned-nc7sf"
Sep 16 12:00:35.012706 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.012130    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bc31abf4-e8c6-4be6-87b3-f412930ffa32-host-run-multus-certs\") pod \"multus-rhx78\" (UID: \"bc31abf4-e8c6-4be6-87b3-f412930ffa32\") " pod="openshift-multus/multus-rhx78"
Sep 16 12:00:35.012706 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.012155    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/94671c96-5c56-42f8-b7f7-f6f93b27dac0-host\") pod \"node-ca-l5cpd\" (UID: \"94671c96-5c56-42f8-b7f7-f6f93b27dac0\") " pod="openshift-image-registry/node-ca-l5cpd"
Sep 16 12:00:35.012706 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.012205    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bc31abf4-e8c6-4be6-87b3-f412930ffa32-system-cni-dir\") pod \"multus-rhx78\" (UID: \"bc31abf4-e8c6-4be6-87b3-f412930ffa32\") " pod="openshift-multus/multus-rhx78"
Sep 16 12:00:35.012706 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.012226    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftrr2\" (UniqueName: \"kubernetes.io/projected/e0181d86-c266-426e-a18d-0f0241e252a9-kube-api-access-ftrr2\") pod \"multus-additional-cni-plugins-swz2v\" (UID: \"e0181d86-c266-426e-a18d-0f0241e252a9\") " pod="openshift-multus/multus-additional-cni-plugins-swz2v"
Sep 16 12:00:35.012706 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.012243    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/94671c96-5c56-42f8-b7f7-f6f93b27dac0-host\") pod \"node-ca-l5cpd\" (UID: \"94671c96-5c56-42f8-b7f7-f6f93b27dac0\") " pod="openshift-image-registry/node-ca-l5cpd"
Sep 16 12:00:35.012706 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.012258    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bc31abf4-e8c6-4be6-87b3-f412930ffa32-cnibin\") pod \"multus-rhx78\" (UID: \"bc31abf4-e8c6-4be6-87b3-f412930ffa32\") " pod="openshift-multus/multus-rhx78"
Sep 16 12:00:35.012706 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.012228    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bc31abf4-e8c6-4be6-87b3-f412930ffa32-host-run-multus-certs\") pod \"multus-rhx78\" (UID: \"bc31abf4-e8c6-4be6-87b3-f412930ffa32\") " pod="openshift-multus/multus-rhx78"
Sep 16 12:00:35.012706 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.012284    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e0181d86-c266-426e-a18d-0f0241e252a9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-swz2v\" (UID: \"e0181d86-c266-426e-a18d-0f0241e252a9\") " pod="openshift-multus/multus-additional-cni-plugins-swz2v"
Sep 16 12:00:35.012706 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.012332    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bc31abf4-e8c6-4be6-87b3-f412930ffa32-host-var-lib-kubelet\") pod \"multus-rhx78\" (UID: \"bc31abf4-e8c6-4be6-87b3-f412930ffa32\") " pod="openshift-multus/multus-rhx78"
Sep 16 12:00:35.012706 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.012372    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bc31abf4-e8c6-4be6-87b3-f412930ffa32-hostroot\") pod \"multus-rhx78\" (UID: \"bc31abf4-e8c6-4be6-87b3-f412930ffa32\") " pod="openshift-multus/multus-rhx78"
Sep 16 12:00:35.012706 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.012402    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrdrt\" (UniqueName: \"kubernetes.io/projected/adb5d466-089d-4022-b731-6ca3f650eeab-kube-api-access-qrdrt\") pod \"iptables-alerter-n5trt\" (UID: \"adb5d466-089d-4022-b731-6ca3f650eeab\") " pod="openshift-network-operator/iptables-alerter-n5trt"
Sep 16 12:00:35.012706 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.012410    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bc31abf4-e8c6-4be6-87b3-f412930ffa32-host-var-lib-kubelet\") pod \"multus-rhx78\" (UID: \"bc31abf4-e8c6-4be6-87b3-f412930ffa32\") " pod="openshift-multus/multus-rhx78"
Sep 16 12:00:35.012706 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.012427    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bc31abf4-e8c6-4be6-87b3-f412930ffa32-cnibin\") pod \"multus-rhx78\" (UID: \"bc31abf4-e8c6-4be6-87b3-f412930ffa32\") " pod="openshift-multus/multus-rhx78"
Sep 16 12:00:35.012706 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.012443    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e0181d86-c266-426e-a18d-0f0241e252a9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-swz2v\" (UID: \"e0181d86-c266-426e-a18d-0f0241e252a9\") " pod="openshift-multus/multus-additional-cni-plugins-swz2v"
Sep 16 12:00:35.012706 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.012461    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/13ecb5ce-d0db-4a46-82d4-03e60d47b902-host\") pod \"tuned-nc7sf\" (UID: \"13ecb5ce-d0db-4a46-82d4-03e60d47b902\") " pod="openshift-cluster-node-tuning-operator/tuned-nc7sf"
Sep 16 12:00:35.012706 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.012475    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bc31abf4-e8c6-4be6-87b3-f412930ffa32-hostroot\") pod \"multus-rhx78\" (UID: \"bc31abf4-e8c6-4be6-87b3-f412930ffa32\") " pod="openshift-multus/multus-rhx78"
Sep 16 12:00:35.013684 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.012488    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bc31abf4-e8c6-4be6-87b3-f412930ffa32-cni-binary-copy\") pod \"multus-rhx78\" (UID: \"bc31abf4-e8c6-4be6-87b3-f412930ffa32\") " pod="openshift-multus/multus-rhx78"
Sep 16 12:00:35.013684 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.012516    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bc31abf4-e8c6-4be6-87b3-f412930ffa32-host-var-lib-cni-multus\") pod \"multus-rhx78\" (UID: \"bc31abf4-e8c6-4be6-87b3-f412930ffa32\") " pod="openshift-multus/multus-rhx78"
Sep 16 12:00:35.013684 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.012541    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/13ecb5ce-d0db-4a46-82d4-03e60d47b902-host\") pod \"tuned-nc7sf\" (UID: \"13ecb5ce-d0db-4a46-82d4-03e60d47b902\") " pod="openshift-cluster-node-tuning-operator/tuned-nc7sf"
Sep 16 12:00:35.013684 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.012547    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e0181d86-c266-426e-a18d-0f0241e252a9-cni-binary-copy\") pod \"multus-additional-cni-plugins-swz2v\" (UID: \"e0181d86-c266-426e-a18d-0f0241e252a9\") " pod="openshift-multus/multus-additional-cni-plugins-swz2v"
Sep 16 12:00:35.013684 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.012545    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bc31abf4-e8c6-4be6-87b3-f412930ffa32-multus-daemon-config\") pod \"multus-rhx78\" (UID: \"bc31abf4-e8c6-4be6-87b3-f412930ffa32\") " pod="openshift-multus/multus-rhx78"
Sep 16 12:00:35.013684 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.012580    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bc31abf4-e8c6-4be6-87b3-f412930ffa32-host-var-lib-cni-multus\") pod \"multus-rhx78\" (UID: \"bc31abf4-e8c6-4be6-87b3-f412930ffa32\") " pod="openshift-multus/multus-rhx78"
Sep 16 12:00:35.013684 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.012587    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e0181d86-c266-426e-a18d-0f0241e252a9-system-cni-dir\") pod \"multus-additional-cni-plugins-swz2v\" (UID: \"e0181d86-c266-426e-a18d-0f0241e252a9\") " pod="openshift-multus/multus-additional-cni-plugins-swz2v"
Sep 16 12:00:35.013684 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.012614    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e0181d86-c266-426e-a18d-0f0241e252a9-system-cni-dir\") pod \"multus-additional-cni-plugins-swz2v\" (UID: \"e0181d86-c266-426e-a18d-0f0241e252a9\") " pod="openshift-multus/multus-additional-cni-plugins-swz2v"
Sep 16 12:00:35.013684 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.012627    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/94671c96-5c56-42f8-b7f7-f6f93b27dac0-serviceca\") pod \"node-ca-l5cpd\" (UID: \"94671c96-5c56-42f8-b7f7-f6f93b27dac0\") " pod="openshift-image-registry/node-ca-l5cpd"
Sep 16 12:00:35.013684 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.012656    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e0181d86-c266-426e-a18d-0f0241e252a9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-swz2v\" (UID: \"e0181d86-c266-426e-a18d-0f0241e252a9\") " pod="openshift-multus/multus-additional-cni-plugins-swz2v"
Sep 16 12:00:35.013684 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.012687    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a826335e-773e-48e2-aa35-099d7466304b-tmp-dir\") pod \"node-resolver-ch8pr\" (UID: \"a826335e-773e-48e2-aa35-099d7466304b\") " pod="openshift-dns/node-resolver-ch8pr"
Sep 16 12:00:35.013684 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.012746    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6bdcdaa1-6a36-4c63-8ba4-e95598e58778-device-dir\") pod \"aws-ebs-csi-driver-node-tsszd\" (UID: \"6bdcdaa1-6a36-4c63-8ba4-e95598e58778\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsszd"
Sep 16 12:00:35.013684 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.012782    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bc31abf4-e8c6-4be6-87b3-f412930ffa32-multus-conf-dir\") pod \"multus-rhx78\" (UID: \"bc31abf4-e8c6-4be6-87b3-f412930ffa32\") " pod="openshift-multus/multus-rhx78"
Sep 16 12:00:35.013684 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.012808    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/adb5d466-089d-4022-b731-6ca3f650eeab-iptables-alerter-script\") pod \"iptables-alerter-n5trt\" (UID: \"adb5d466-089d-4022-b731-6ca3f650eeab\") " pod="openshift-network-operator/iptables-alerter-n5trt"
Sep 16 12:00:35.013684 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.012837    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e0181d86-c266-426e-a18d-0f0241e252a9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-swz2v\" (UID: \"e0181d86-c266-426e-a18d-0f0241e252a9\") " pod="openshift-multus/multus-additional-cni-plugins-swz2v"
Sep 16 12:00:35.013684 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.012856    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6bdcdaa1-6a36-4c63-8ba4-e95598e58778-device-dir\") pod \"aws-ebs-csi-driver-node-tsszd\" (UID: \"6bdcdaa1-6a36-4c63-8ba4-e95598e58778\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsszd"
Sep 16 12:00:35.013684 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.012881    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13ecb5ce-d0db-4a46-82d4-03e60d47b902-etc-kubernetes\") pod \"tuned-nc7sf\" (UID: \"13ecb5ce-d0db-4a46-82d4-03e60d47b902\") " pod="openshift-cluster-node-tuning-operator/tuned-nc7sf"
Sep 16 12:00:35.014382 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.012910    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6bdcdaa1-6a36-4c63-8ba4-e95598e58778-registration-dir\") pod \"aws-ebs-csi-driver-node-tsszd\" (UID: \"6bdcdaa1-6a36-4c63-8ba4-e95598e58778\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsszd"
Sep 16 12:00:35.014382 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.012936    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/13ecb5ce-d0db-4a46-82d4-03e60d47b902-run\") pod \"tuned-nc7sf\" (UID: \"13ecb5ce-d0db-4a46-82d4-03e60d47b902\") " pod="openshift-cluster-node-tuning-operator/tuned-nc7sf"
Sep 16 12:00:35.014382 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.012964    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/13ecb5ce-d0db-4a46-82d4-03e60d47b902-var-lib-kubelet\") pod \"tuned-nc7sf\" (UID: \"13ecb5ce-d0db-4a46-82d4-03e60d47b902\") " pod="openshift-cluster-node-tuning-operator/tuned-nc7sf"
Sep 16 12:00:35.014382 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.013021    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/13ecb5ce-d0db-4a46-82d4-03e60d47b902-etc-tuned\") pod \"tuned-nc7sf\" (UID: \"13ecb5ce-d0db-4a46-82d4-03e60d47b902\") " pod="openshift-cluster-node-tuning-operator/tuned-nc7sf"
Sep 16 12:00:35.014382 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.013047    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bc31abf4-e8c6-4be6-87b3-f412930ffa32-host-run-netns\") pod \"multus-rhx78\" (UID: \"bc31abf4-e8c6-4be6-87b3-f412930ffa32\") " pod="openshift-multus/multus-rhx78"
Sep 16 12:00:35.014382 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.013064    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a826335e-773e-48e2-aa35-099d7466304b-tmp-dir\") pod \"node-resolver-ch8pr\" (UID: \"a826335e-773e-48e2-aa35-099d7466304b\") " pod="openshift-dns/node-resolver-ch8pr"
Sep 16 12:00:35.014382 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.013088    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsjjz\" (UniqueName: \"kubernetes.io/projected/c334b0e3-888b-49a6-beae-f40e40caa548-kube-api-access-tsjjz\") pod \"network-check-target-2rdgh\" (UID: \"c334b0e3-888b-49a6-beae-f40e40caa548\") " pod="openshift-network-diagnostics/network-check-target-2rdgh"
Sep 16 12:00:35.014382 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.013091    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/94671c96-5c56-42f8-b7f7-f6f93b27dac0-serviceca\") pod \"node-ca-l5cpd\" (UID: \"94671c96-5c56-42f8-b7f7-f6f93b27dac0\") " pod="openshift-image-registry/node-ca-l5cpd"
Sep 16 12:00:35.014382 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.013144    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/13ecb5ce-d0db-4a46-82d4-03e60d47b902-run\") pod \"tuned-nc7sf\" (UID: \"13ecb5ce-d0db-4a46-82d4-03e60d47b902\") " pod="openshift-cluster-node-tuning-operator/tuned-nc7sf"
Sep 16 12:00:35.014382 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.013177    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6bdcdaa1-6a36-4c63-8ba4-e95598e58778-sys-fs\") pod \"aws-ebs-csi-driver-node-tsszd\" (UID: \"6bdcdaa1-6a36-4c63-8ba4-e95598e58778\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsszd"
Sep 16 12:00:35.014382 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.013239    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/13ecb5ce-d0db-4a46-82d4-03e60d47b902-etc-sysctl-d\") pod \"tuned-nc7sf\" (UID: \"13ecb5ce-d0db-4a46-82d4-03e60d47b902\") " pod="openshift-cluster-node-tuning-operator/tuned-nc7sf"
Sep 16 12:00:35.014382 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.013244    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13ecb5ce-d0db-4a46-82d4-03e60d47b902-etc-kubernetes\") pod \"tuned-nc7sf\" (UID: \"13ecb5ce-d0db-4a46-82d4-03e60d47b902\") " pod="openshift-cluster-node-tuning-operator/tuned-nc7sf"
Sep 16 12:00:35.014382 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.013252    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e0181d86-c266-426e-a18d-0f0241e252a9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-swz2v\" (UID: \"e0181d86-c266-426e-a18d-0f0241e252a9\") " pod="openshift-multus/multus-additional-cni-plugins-swz2v"
Sep 16 12:00:35.014382 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.013272    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/13ecb5ce-d0db-4a46-82d4-03e60d47b902-etc-systemd\") pod \"tuned-nc7sf\" (UID: \"13ecb5ce-d0db-4a46-82d4-03e60d47b902\") " pod="openshift-cluster-node-tuning-operator/tuned-nc7sf"
Sep 16 12:00:35.014382 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.013257    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bc31abf4-e8c6-4be6-87b3-f412930ffa32-cni-binary-copy\") pod \"multus-rhx78\" (UID: \"bc31abf4-e8c6-4be6-87b3-f412930ffa32\") " pod="openshift-multus/multus-rhx78"
Sep 16 12:00:35.014382 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.013281    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bc31abf4-e8c6-4be6-87b3-f412930ffa32-multus-daemon-config\") pod \"multus-rhx78\" (UID: \"bc31abf4-e8c6-4be6-87b3-f412930ffa32\") " pod="openshift-multus/multus-rhx78"
Sep 16 12:00:35.014382 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.013206    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bc31abf4-e8c6-4be6-87b3-f412930ffa32-host-run-netns\") pod \"multus-rhx78\" (UID: \"bc31abf4-e8c6-4be6-87b3-f412930ffa32\") " pod="openshift-multus/multus-rhx78"
Sep 16 12:00:35.014382 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.013310    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6bdcdaa1-6a36-4c63-8ba4-e95598e58778-sys-fs\") pod \"aws-ebs-csi-driver-node-tsszd\" (UID: \"6bdcdaa1-6a36-4c63-8ba4-e95598e58778\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsszd"
Sep 16 12:00:35.014952 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.013320    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/13ecb5ce-d0db-4a46-82d4-03e60d47b902-var-lib-kubelet\") pod \"tuned-nc7sf\" (UID: \"13ecb5ce-d0db-4a46-82d4-03e60d47b902\") " pod="openshift-cluster-node-tuning-operator/tuned-nc7sf"
Sep 16 12:00:35.014952 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.013355    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/13ecb5ce-d0db-4a46-82d4-03e60d47b902-sys\") pod \"tuned-nc7sf\" (UID: \"13ecb5ce-d0db-4a46-82d4-03e60d47b902\") " pod="openshift-cluster-node-tuning-operator/tuned-nc7sf"
Sep 16 12:00:35.014952 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.013356    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/13ecb5ce-d0db-4a46-82d4-03e60d47b902-etc-sysctl-d\") pod \"tuned-nc7sf\" (UID: \"13ecb5ce-d0db-4a46-82d4-03e60d47b902\") " pod="openshift-cluster-node-tuning-operator/tuned-nc7sf"
Sep 16 12:00:35.014952 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.013380    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r29p7\" (UniqueName: \"kubernetes.io/projected/a826335e-773e-48e2-aa35-099d7466304b-kube-api-access-r29p7\") pod \"node-resolver-ch8pr\" (UID: \"a826335e-773e-48e2-aa35-099d7466304b\") " pod="openshift-dns/node-resolver-ch8pr"
Sep 16 12:00:35.014952 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.013409    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6bdcdaa1-6a36-4c63-8ba4-e95598e58778-registration-dir\") pod \"aws-ebs-csi-driver-node-tsszd\" (UID: \"6bdcdaa1-6a36-4c63-8ba4-e95598e58778\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsszd"
Sep 16 12:00:35.014952 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.013414    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pn9v6\" (UniqueName: \"kubernetes.io/projected/13ecb5ce-d0db-4a46-82d4-03e60d47b902-kube-api-access-pn9v6\") pod \"tuned-nc7sf\" (UID: \"13ecb5ce-d0db-4a46-82d4-03e60d47b902\") " pod="openshift-cluster-node-tuning-operator/tuned-nc7sf"
Sep 16 12:00:35.014952 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.013456    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bc31abf4-e8c6-4be6-87b3-f412930ffa32-multus-cni-dir\") pod \"multus-rhx78\" (UID: \"bc31abf4-e8c6-4be6-87b3-f412930ffa32\") " pod="openshift-multus/multus-rhx78"
Sep 16 12:00:35.014952 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.013456    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bc31abf4-e8c6-4be6-87b3-f412930ffa32-multus-conf-dir\") pod \"multus-rhx78\" (UID: \"bc31abf4-e8c6-4be6-87b3-f412930ffa32\") " pod="openshift-multus/multus-rhx78"
Sep 16 12:00:35.014952 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.013502    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bc31abf4-e8c6-4be6-87b3-f412930ffa32-host-run-k8s-cni-cncf-io\") pod \"multus-rhx78\" (UID: \"bc31abf4-e8c6-4be6-87b3-f412930ffa32\") " pod="openshift-multus/multus-rhx78"
Sep 16 12:00:35.014952 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.013519    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bc31abf4-e8c6-4be6-87b3-f412930ffa32-etc-kubernetes\") pod \"multus-rhx78\" (UID: \"bc31abf4-e8c6-4be6-87b3-f412930ffa32\") " pod="openshift-multus/multus-rhx78"
Sep 16 12:00:35.014952 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.013578    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bc31abf4-e8c6-4be6-87b3-f412930ffa32-multus-cni-dir\") pod \"multus-rhx78\" (UID: \"bc31abf4-e8c6-4be6-87b3-f412930ffa32\") " pod="openshift-multus/multus-rhx78"
Sep 16 12:00:35.014952 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.013600    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/adb5d466-089d-4022-b731-6ca3f650eeab-iptables-alerter-script\") pod \"iptables-alerter-n5trt\" (UID: \"adb5d466-089d-4022-b731-6ca3f650eeab\") " pod="openshift-network-operator/iptables-alerter-n5trt"
Sep 16 12:00:35.014952 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.013634    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/13ecb5ce-d0db-4a46-82d4-03e60d47b902-sys\") pod \"tuned-nc7sf\" (UID: \"13ecb5ce-d0db-4a46-82d4-03e60d47b902\") " pod="openshift-cluster-node-tuning-operator/tuned-nc7sf"
Sep 16 12:00:35.014952 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.013641    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bc31abf4-e8c6-4be6-87b3-f412930ffa32-etc-kubernetes\") pod \"multus-rhx78\" (UID: \"bc31abf4-e8c6-4be6-87b3-f412930ffa32\") " pod="openshift-multus/multus-rhx78"
Sep 16 12:00:35.014952 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.013673    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/13ecb5ce-d0db-4a46-82d4-03e60d47b902-etc-systemd\") pod \"tuned-nc7sf\" (UID: \"13ecb5ce-d0db-4a46-82d4-03e60d47b902\") " pod="openshift-cluster-node-tuning-operator/tuned-nc7sf"
Sep 16 12:00:35.014952 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.013687    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bc31abf4-e8c6-4be6-87b3-f412930ffa32-host-run-k8s-cni-cncf-io\") pod \"multus-rhx78\" (UID: \"bc31abf4-e8c6-4be6-87b3-f412930ffa32\") " pod="openshift-multus/multus-rhx78"
Sep 16 12:00:35.014952 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.013709    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/adb5d466-089d-4022-b731-6ca3f650eeab-host-slash\") pod \"iptables-alerter-n5trt\" (UID: \"adb5d466-089d-4022-b731-6ca3f650eeab\") " pod="openshift-network-operator/iptables-alerter-n5trt"
Sep 16 12:00:35.014952 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.013741    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e0181d86-c266-426e-a18d-0f0241e252a9-cnibin\") pod \"multus-additional-cni-plugins-swz2v\" (UID: \"e0181d86-c266-426e-a18d-0f0241e252a9\") " pod="openshift-multus/multus-additional-cni-plugins-swz2v"
Sep 16 12:00:35.015550 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.013766    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/adb5d466-089d-4022-b731-6ca3f650eeab-host-slash\") pod \"iptables-alerter-n5trt\" (UID: \"adb5d466-089d-4022-b731-6ca3f650eeab\") " pod="openshift-network-operator/iptables-alerter-n5trt"
Sep 16 12:00:35.015550 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.013797    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/13ecb5ce-d0db-4a46-82d4-03e60d47b902-etc-modprobe-d\") pod \"tuned-nc7sf\" (UID: \"13ecb5ce-d0db-4a46-82d4-03e60d47b902\") " pod="openshift-cluster-node-tuning-operator/tuned-nc7sf"
Sep 16 12:00:35.015550 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.013838    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e0181d86-c266-426e-a18d-0f0241e252a9-cnibin\") pod \"multus-additional-cni-plugins-swz2v\" (UID: \"e0181d86-c266-426e-a18d-0f0241e252a9\") " pod="openshift-multus/multus-additional-cni-plugins-swz2v"
Sep 16 12:00:35.015550 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.013868    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e0181d86-c266-426e-a18d-0f0241e252a9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-swz2v\" (UID: \"e0181d86-c266-426e-a18d-0f0241e252a9\") " pod="openshift-multus/multus-additional-cni-plugins-swz2v"
Sep 16 12:00:35.015550 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.013891    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bc31abf4-e8c6-4be6-87b3-f412930ffa32-host-var-lib-cni-bin\") pod \"multus-rhx78\" (UID: \"bc31abf4-e8c6-4be6-87b3-f412930ffa32\") " pod="openshift-multus/multus-rhx78"
Sep 16 12:00:35.015550 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.013928    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bc31abf4-e8c6-4be6-87b3-f412930ffa32-host-var-lib-cni-bin\") pod \"multus-rhx78\" (UID: \"bc31abf4-e8c6-4be6-87b3-f412930ffa32\") " pod="openshift-multus/multus-rhx78"
Sep 16 12:00:35.015550 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.013976    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/13ecb5ce-d0db-4a46-82d4-03e60d47b902-etc-modprobe-d\") pod \"tuned-nc7sf\" (UID: \"13ecb5ce-d0db-4a46-82d4-03e60d47b902\") " pod="openshift-cluster-node-tuning-operator/tuned-nc7sf"
Sep 16 12:00:35.015765 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.015705    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/13ecb5ce-d0db-4a46-82d4-03e60d47b902-etc-tuned\") pod \"tuned-nc7sf\" (UID: \"13ecb5ce-d0db-4a46-82d4-03e60d47b902\") " pod="openshift-cluster-node-tuning-operator/tuned-nc7sf"
Sep 16 12:00:35.015798 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.015765    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/13ecb5ce-d0db-4a46-82d4-03e60d47b902-tmp\") pod \"tuned-nc7sf\" (UID: \"13ecb5ce-d0db-4a46-82d4-03e60d47b902\") " pod="openshift-cluster-node-tuning-operator/tuned-nc7sf"
Sep 16 12:00:35.020050 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.020023    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f24tt\" (UniqueName: \"kubernetes.io/projected/bc31abf4-e8c6-4be6-87b3-f412930ffa32-kube-api-access-f24tt\") pod \"multus-rhx78\" (UID: \"bc31abf4-e8c6-4be6-87b3-f412930ffa32\") " pod="openshift-multus/multus-rhx78"
Sep 16 12:00:35.020589 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.020558    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrdrt\" (UniqueName: \"kubernetes.io/projected/adb5d466-089d-4022-b731-6ca3f650eeab-kube-api-access-qrdrt\") pod \"iptables-alerter-n5trt\" (UID: \"adb5d466-089d-4022-b731-6ca3f650eeab\") " pod="openshift-network-operator/iptables-alerter-n5trt"
Sep 16 12:00:35.020696 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.020566    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftrr2\" (UniqueName: \"kubernetes.io/projected/e0181d86-c266-426e-a18d-0f0241e252a9-kube-api-access-ftrr2\") pod \"multus-additional-cni-plugins-swz2v\" (UID: \"e0181d86-c266-426e-a18d-0f0241e252a9\") " pod="openshift-multus/multus-additional-cni-plugins-swz2v"
Sep 16 12:00:35.020769 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.020718    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wv2bl\" (UniqueName: \"kubernetes.io/projected/94671c96-5c56-42f8-b7f7-f6f93b27dac0-kube-api-access-wv2bl\") pod \"node-ca-l5cpd\" (UID: \"94671c96-5c56-42f8-b7f7-f6f93b27dac0\") " pod="openshift-image-registry/node-ca-l5cpd"
Sep 16 12:00:35.021346 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.021329    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvz2c\" (UniqueName: \"kubernetes.io/projected/6bdcdaa1-6a36-4c63-8ba4-e95598e58778-kube-api-access-kvz2c\") pod \"aws-ebs-csi-driver-node-tsszd\" (UID: \"6bdcdaa1-6a36-4c63-8ba4-e95598e58778\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsszd"
Sep 16 12:00:35.022406 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:35.022386    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 12:00:35.022406 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:35.022406    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 12:00:35.022406 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:35.022416    2559 projected.go:196] Error preparing data for projected volume kube-api-access-tsjjz for pod openshift-network-diagnostics/network-check-target-2rdgh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 12:00:35.022633 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:35.022476    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c334b0e3-888b-49a6-beae-f40e40caa548-kube-api-access-tsjjz podName:c334b0e3-888b-49a6-beae-f40e40caa548 nodeName:}" failed. No retries permitted until 2026-09-16 12:00:35.52245891 +0000 UTC m=+2.142778224 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-tsjjz" (UniqueName: "kubernetes.io/projected/c334b0e3-888b-49a6-beae-f40e40caa548-kube-api-access-tsjjz") pod "network-check-target-2rdgh" (UID: "c334b0e3-888b-49a6-beae-f40e40caa548") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 12:00:35.023933 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.023915    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r29p7\" (UniqueName: \"kubernetes.io/projected/a826335e-773e-48e2-aa35-099d7466304b-kube-api-access-r29p7\") pod \"node-resolver-ch8pr\" (UID: \"a826335e-773e-48e2-aa35-099d7466304b\") " pod="openshift-dns/node-resolver-ch8pr"
Sep 16 12:00:35.024423 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.024403    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pn9v6\" (UniqueName: \"kubernetes.io/projected/13ecb5ce-d0db-4a46-82d4-03e60d47b902-kube-api-access-pn9v6\") pod \"tuned-nc7sf\" (UID: \"13ecb5ce-d0db-4a46-82d4-03e60d47b902\") " pod="openshift-cluster-node-tuning-operator/tuned-nc7sf"
Sep 16 12:00:35.128537 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.128464    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn"
Sep 16 12:00:35.147046 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.147023    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rsjgc"
Sep 16 12:00:35.168651 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.168627    2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 12:00:35.169448 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.169428    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nc7sf"
Sep 16 12:00:35.178676 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.178659    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ch8pr"
Sep 16 12:00:35.193328 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.193300    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-l5cpd"
Sep 16 12:00:35.213637 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.213614    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rhx78"
Sep 16 12:00:35.217410 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:35.217359    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda826335e_773e_48e2_aa35_099d7466304b.slice/crio-e54a9ce7ddcdc170ee43be9f5cc881a5a8c05be06cabc9d12cc4420262011125 WatchSource:0}: Error finding container e54a9ce7ddcdc170ee43be9f5cc881a5a8c05be06cabc9d12cc4420262011125: Status 404 returned error can't find the container with id e54a9ce7ddcdc170ee43be9f5cc881a5a8c05be06cabc9d12cc4420262011125
Sep 16 12:00:35.217977 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:35.217957    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13ecb5ce_d0db_4a46_82d4_03e60d47b902.slice/crio-7a8323ed9ccaaf2531334b4ae83c37dff824704f385997e72576655de7908494 WatchSource:0}: Error finding container 7a8323ed9ccaaf2531334b4ae83c37dff824704f385997e72576655de7908494: Status 404 returned error can't find the container with id 7a8323ed9ccaaf2531334b4ae83c37dff824704f385997e72576655de7908494
Sep 16 12:00:35.219126 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:35.219105    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b817e44_5083_4c23_8480_340e10041f8f.slice/crio-0b340d45374090b03c009c26d6303d4cbe1115c0f6d8ce2dda6effdff210fdcc WatchSource:0}: Error finding container 0b340d45374090b03c009c26d6303d4cbe1115c0f6d8ce2dda6effdff210fdcc: Status 404 returned error can't find the container with id 0b340d45374090b03c009c26d6303d4cbe1115c0f6d8ce2dda6effdff210fdcc
Sep 16 12:00:35.219763 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:35.219739    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ceb9740f429536d29654e686eae8a60.slice/crio-fc6e622cd7ec7f5f8e4e626fc1d94dd8093c27e078223c050849cc18fe9e25fd WatchSource:0}: Error finding container fc6e622cd7ec7f5f8e4e626fc1d94dd8093c27e078223c050849cc18fe9e25fd: Status 404 returned error can't find the container with id fc6e622cd7ec7f5f8e4e626fc1d94dd8093c27e078223c050849cc18fe9e25fd
Sep 16 12:00:35.220470 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:35.220441    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9111bdadcd9657efb2af1c537a733d27.slice/crio-b97228b1cb48baf6f0eac6fc7bd8cd902743f6c06580e96deaaa03b54727b4f8 WatchSource:0}: Error finding container b97228b1cb48baf6f0eac6fc7bd8cd902743f6c06580e96deaaa03b54727b4f8: Status 404 returned error can't find the container with id b97228b1cb48baf6f0eac6fc7bd8cd902743f6c06580e96deaaa03b54727b4f8
Sep 16 12:00:35.221508 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:35.221486    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94671c96_5c56_42f8_b7f7_f6f93b27dac0.slice/crio-2e0f6ec5a0abad6642805174768ce2801f8488e5a0fe6375c2b43a6809c48eb9 WatchSource:0}: Error finding container 2e0f6ec5a0abad6642805174768ce2801f8488e5a0fe6375c2b43a6809c48eb9: Status 404 returned error can't find the container with id 2e0f6ec5a0abad6642805174768ce2801f8488e5a0fe6375c2b43a6809c48eb9
Sep 16 12:00:35.224215 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.224000    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 12:00:35.227065 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:35.226935    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc31abf4_e8c6_4be6_87b3_f412930ffa32.slice/crio-7646590f6bdcd05f53026cabd5b751f0e9e0f551cf2d0277cc8dae4014cd21e5 WatchSource:0}: Error finding container 7646590f6bdcd05f53026cabd5b751f0e9e0f551cf2d0277cc8dae4014cd21e5: Status 404 returned error can't find the container with id 7646590f6bdcd05f53026cabd5b751f0e9e0f551cf2d0277cc8dae4014cd21e5
Sep 16 12:00:35.235776 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.235757    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-n5trt"
Sep 16 12:00:35.246249 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:35.246226    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadb5d466_089d_4022_b731_6ca3f650eeab.slice/crio-6e08a8ec7ef2e0329043639bc80ec373140658e5e8677959e3d4766ac687458e WatchSource:0}: Error finding container 6e08a8ec7ef2e0329043639bc80ec373140658e5e8677959e3d4766ac687458e: Status 404 returned error can't find the container with id 6e08a8ec7ef2e0329043639bc80ec373140658e5e8677959e3d4766ac687458e
Sep 16 12:00:35.254281 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.254264    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsszd"
Sep 16 12:00:35.258761 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.258743    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-swz2v"
Sep 16 12:00:35.262677 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:35.262655    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bdcdaa1_6a36_4c63_8ba4_e95598e58778.slice/crio-eaa45e6c043b8d83c524ca76da537ec746fcb4962339a76118748b0d8c6284fa WatchSource:0}: Error finding container eaa45e6c043b8d83c524ca76da537ec746fcb4962339a76118748b0d8c6284fa: Status 404 returned error can't find the container with id eaa45e6c043b8d83c524ca76da537ec746fcb4962339a76118748b0d8c6284fa
Sep 16 12:00:35.267162 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:35.267134    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0181d86_c266_426e_a18d_0f0241e252a9.slice/crio-01b22e6813814fa2ebf7e097a53aabdcf0a0addb6fd463371c70ef85acc854d1 WatchSource:0}: Error finding container 01b22e6813814fa2ebf7e097a53aabdcf0a0addb6fd463371c70ef85acc854d1: Status 404 returned error can't find the container with id 01b22e6813814fa2ebf7e097a53aabdcf0a0addb6fd463371c70ef85acc854d1
Sep 16 12:00:35.353394 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.353367    2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 12:00:35.415280 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.415215    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e261eb8b-bfaa-491d-afbe-6eb8fbc57324-metrics-certs\") pod \"network-metrics-daemon-6tsgc\" (UID: \"e261eb8b-bfaa-491d-afbe-6eb8fbc57324\") " pod="openshift-multus/network-metrics-daemon-6tsgc"
Sep 16 12:00:35.415280 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.415259    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/28222687-d3b4-4c0c-81f3-cc24fdc912e8-original-pull-secret\") pod \"global-pull-secret-syncer-tbc79\" (UID: \"28222687-d3b4-4c0c-81f3-cc24fdc912e8\") " pod="kube-system/global-pull-secret-syncer-tbc79"
Sep 16 12:00:35.415472 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:35.415363    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 12:00:35.415472 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:35.415379    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 12:00:35.415472 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:35.415411    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28222687-d3b4-4c0c-81f3-cc24fdc912e8-original-pull-secret podName:28222687-d3b4-4c0c-81f3-cc24fdc912e8 nodeName:}" failed. No retries permitted until 2026-09-16 12:00:36.415398885 +0000 UTC m=+3.035718180 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/28222687-d3b4-4c0c-81f3-cc24fdc912e8-original-pull-secret") pod "global-pull-secret-syncer-tbc79" (UID: "28222687-d3b4-4c0c-81f3-cc24fdc912e8") : object "kube-system"/"original-pull-secret" not registered
Sep 16 12:00:35.415472 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:35.415436    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e261eb8b-bfaa-491d-afbe-6eb8fbc57324-metrics-certs podName:e261eb8b-bfaa-491d-afbe-6eb8fbc57324 nodeName:}" failed. No retries permitted until 2026-09-16 12:00:36.415417673 +0000 UTC m=+3.035736984 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e261eb8b-bfaa-491d-afbe-6eb8fbc57324-metrics-certs") pod "network-metrics-daemon-6tsgc" (UID: "e261eb8b-bfaa-491d-afbe-6eb8fbc57324") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 12:00:35.503717 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:00:35.503695    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce48f02b_95e4_4a34_b6f6_f44283e70086.slice/crio-520405e368663cce5c0d4f18ea49f3c0a08513ab59b4a0c11ad46dc48f746540 WatchSource:0}: Error finding container 520405e368663cce5c0d4f18ea49f3c0a08513ab59b4a0c11ad46dc48f746540: Status 404 returned error can't find the container with id 520405e368663cce5c0d4f18ea49f3c0a08513ab59b4a0c11ad46dc48f746540
Sep 16 12:00:35.616192 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.616157    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsjjz\" (UniqueName: \"kubernetes.io/projected/c334b0e3-888b-49a6-beae-f40e40caa548-kube-api-access-tsjjz\") pod \"network-check-target-2rdgh\" (UID: \"c334b0e3-888b-49a6-beae-f40e40caa548\") " pod="openshift-network-diagnostics/network-check-target-2rdgh"
Sep 16 12:00:35.616327 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:35.616308    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 12:00:35.616368 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:35.616334    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 12:00:35.616368 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:35.616344    2559 projected.go:196] Error preparing data for projected volume kube-api-access-tsjjz for pod openshift-network-diagnostics/network-check-target-2rdgh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 12:00:35.616439 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:35.616395    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c334b0e3-888b-49a6-beae-f40e40caa548-kube-api-access-tsjjz podName:c334b0e3-888b-49a6-beae-f40e40caa548 nodeName:}" failed. No retries permitted until 2026-09-16 12:00:36.616381246 +0000 UTC m=+3.236700562 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-tsjjz" (UniqueName: "kubernetes.io/projected/c334b0e3-888b-49a6-beae-f40e40caa548-kube-api-access-tsjjz") pod "network-check-target-2rdgh" (UID: "c334b0e3-888b-49a6-beae-f40e40caa548") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 12:00:35.856241 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.856068    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-15 11:55:35 +0000 UTC" deadline="2028-02-21 11:54:51.004231526 +0000 UTC"
Sep 16 12:00:35.856241 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.856172    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12551h54m15.148065071s"
Sep 16 12:00:35.938096 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.938033    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn" event={"ID":"ce48f02b-95e4-4a34-b6f6-f44283e70086","Type":"ContainerStarted","Data":"520405e368663cce5c0d4f18ea49f3c0a08513ab59b4a0c11ad46dc48f746540"}
Sep 16 12:00:35.943595 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.943565    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsszd" event={"ID":"6bdcdaa1-6a36-4c63-8ba4-e95598e58778","Type":"ContainerStarted","Data":"eaa45e6c043b8d83c524ca76da537ec746fcb4962339a76118748b0d8c6284fa"}
Sep 16 12:00:35.945343 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.945313    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-n5trt" event={"ID":"adb5d466-089d-4022-b731-6ca3f650eeab","Type":"ContainerStarted","Data":"6e08a8ec7ef2e0329043639bc80ec373140658e5e8677959e3d4766ac687458e"}
Sep 16 12:00:35.947036 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.947009    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ch8pr" event={"ID":"a826335e-773e-48e2-aa35-099d7466304b","Type":"ContainerStarted","Data":"e54a9ce7ddcdc170ee43be9f5cc881a5a8c05be06cabc9d12cc4420262011125"}
Sep 16 12:00:35.949092 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.949018    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nc7sf" event={"ID":"13ecb5ce-d0db-4a46-82d4-03e60d47b902","Type":"ContainerStarted","Data":"7a8323ed9ccaaf2531334b4ae83c37dff824704f385997e72576655de7908494"}
Sep 16 12:00:35.952621 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.952594    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-swz2v" event={"ID":"e0181d86-c266-426e-a18d-0f0241e252a9","Type":"ContainerStarted","Data":"01b22e6813814fa2ebf7e097a53aabdcf0a0addb6fd463371c70ef85acc854d1"}
Sep 16 12:00:35.954458 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.954417    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rhx78" event={"ID":"bc31abf4-e8c6-4be6-87b3-f412930ffa32","Type":"ContainerStarted","Data":"7646590f6bdcd05f53026cabd5b751f0e9e0f551cf2d0277cc8dae4014cd21e5"}
Sep 16 12:00:35.957419 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.957395    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-l5cpd" event={"ID":"94671c96-5c56-42f8-b7f7-f6f93b27dac0","Type":"ContainerStarted","Data":"2e0f6ec5a0abad6642805174768ce2801f8488e5a0fe6375c2b43a6809c48eb9"}
Sep 16 12:00:35.959931 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.959854    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rsjgc" event={"ID":"6b817e44-5083-4c23-8480-340e10041f8f","Type":"ContainerStarted","Data":"0b340d45374090b03c009c26d6303d4cbe1115c0f6d8ce2dda6effdff210fdcc"}
Sep 16 12:00:35.965040 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.964956    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-251.ec2.internal" event={"ID":"9ceb9740f429536d29654e686eae8a60","Type":"ContainerStarted","Data":"fc6e622cd7ec7f5f8e4e626fc1d94dd8093c27e078223c050849cc18fe9e25fd"}
Sep 16 12:00:35.967840 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:35.967818    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-251.ec2.internal" event={"ID":"9111bdadcd9657efb2af1c537a733d27","Type":"ContainerStarted","Data":"b97228b1cb48baf6f0eac6fc7bd8cd902743f6c06580e96deaaa03b54727b4f8"}
Sep 16 12:00:36.096273 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:36.096236    2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 12:00:36.425202 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:36.424177    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/28222687-d3b4-4c0c-81f3-cc24fdc912e8-original-pull-secret\") pod \"global-pull-secret-syncer-tbc79\" (UID: \"28222687-d3b4-4c0c-81f3-cc24fdc912e8\") " pod="kube-system/global-pull-secret-syncer-tbc79"
Sep 16 12:00:36.425202 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:36.424281    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e261eb8b-bfaa-491d-afbe-6eb8fbc57324-metrics-certs\") pod \"network-metrics-daemon-6tsgc\" (UID: \"e261eb8b-bfaa-491d-afbe-6eb8fbc57324\") " pod="openshift-multus/network-metrics-daemon-6tsgc"
Sep 16 12:00:36.425202 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:36.424491    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 12:00:36.425202 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:36.424561    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e261eb8b-bfaa-491d-afbe-6eb8fbc57324-metrics-certs podName:e261eb8b-bfaa-491d-afbe-6eb8fbc57324 nodeName:}" failed. No retries permitted until 2026-09-16 12:00:38.42453935 +0000 UTC m=+5.044858650 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e261eb8b-bfaa-491d-afbe-6eb8fbc57324-metrics-certs") pod "network-metrics-daemon-6tsgc" (UID: "e261eb8b-bfaa-491d-afbe-6eb8fbc57324") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 12:00:36.425202 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:36.425007    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 12:00:36.425202 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:36.425155    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28222687-d3b4-4c0c-81f3-cc24fdc912e8-original-pull-secret podName:28222687-d3b4-4c0c-81f3-cc24fdc912e8 nodeName:}" failed. No retries permitted until 2026-09-16 12:00:38.425114719 +0000 UTC m=+5.045434102 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/28222687-d3b4-4c0c-81f3-cc24fdc912e8-original-pull-secret") pod "global-pull-secret-syncer-tbc79" (UID: "28222687-d3b4-4c0c-81f3-cc24fdc912e8") : object "kube-system"/"original-pull-secret" not registered
Sep 16 12:00:36.626687 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:36.626643    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsjjz\" (UniqueName: \"kubernetes.io/projected/c334b0e3-888b-49a6-beae-f40e40caa548-kube-api-access-tsjjz\") pod \"network-check-target-2rdgh\" (UID: \"c334b0e3-888b-49a6-beae-f40e40caa548\") " pod="openshift-network-diagnostics/network-check-target-2rdgh"
Sep 16 12:00:36.626892 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:36.626865    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 12:00:36.626892 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:36.626887    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 12:00:36.627003 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:36.626901    2559 projected.go:196] Error preparing data for projected volume kube-api-access-tsjjz for pod openshift-network-diagnostics/network-check-target-2rdgh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 12:00:36.627003 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:36.626969    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c334b0e3-888b-49a6-beae-f40e40caa548-kube-api-access-tsjjz podName:c334b0e3-888b-49a6-beae-f40e40caa548 nodeName:}" failed. No retries permitted until 2026-09-16 12:00:38.626947035 +0000 UTC m=+5.247266356 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-tsjjz" (UniqueName: "kubernetes.io/projected/c334b0e3-888b-49a6-beae-f40e40caa548-kube-api-access-tsjjz") pod "network-check-target-2rdgh" (UID: "c334b0e3-888b-49a6-beae-f40e40caa548") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 12:00:36.856821 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:36.856728    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-15 11:55:35 +0000 UTC" deadline="2028-03-24 23:38:37.238282947 +0000 UTC"
Sep 16 12:00:36.856821 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:36.856768    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13331h38m0.381520034s"
Sep 16 12:00:36.931710 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:36.931652    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tbc79"
Sep 16 12:00:36.931907 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:36.931796    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tbc79" podUID="28222687-d3b4-4c0c-81f3-cc24fdc912e8"
Sep 16 12:00:36.932262 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:36.932240    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rdgh"
Sep 16 12:00:36.932384 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:36.932344    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2rdgh" podUID="c334b0e3-888b-49a6-beae-f40e40caa548"
Sep 16 12:00:36.932445 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:36.932417    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tsgc"
Sep 16 12:00:36.932520 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:36.932502    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tsgc" podUID="e261eb8b-bfaa-491d-afbe-6eb8fbc57324"
Sep 16 12:00:38.441578 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:38.441496    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e261eb8b-bfaa-491d-afbe-6eb8fbc57324-metrics-certs\") pod \"network-metrics-daemon-6tsgc\" (UID: \"e261eb8b-bfaa-491d-afbe-6eb8fbc57324\") " pod="openshift-multus/network-metrics-daemon-6tsgc"
Sep 16 12:00:38.441578 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:38.441565    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/28222687-d3b4-4c0c-81f3-cc24fdc912e8-original-pull-secret\") pod \"global-pull-secret-syncer-tbc79\" (UID: \"28222687-d3b4-4c0c-81f3-cc24fdc912e8\") " pod="kube-system/global-pull-secret-syncer-tbc79"
Sep 16 12:00:38.442088 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:38.441688    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 12:00:38.442088 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:38.441751    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28222687-d3b4-4c0c-81f3-cc24fdc912e8-original-pull-secret podName:28222687-d3b4-4c0c-81f3-cc24fdc912e8 nodeName:}" failed. No retries permitted until 2026-09-16 12:00:42.441731634 +0000 UTC m=+9.062050946 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/28222687-d3b4-4c0c-81f3-cc24fdc912e8-original-pull-secret") pod "global-pull-secret-syncer-tbc79" (UID: "28222687-d3b4-4c0c-81f3-cc24fdc912e8") : object "kube-system"/"original-pull-secret" not registered
Sep 16 12:00:38.442255 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:38.442198    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 12:00:38.442320 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:38.442281    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e261eb8b-bfaa-491d-afbe-6eb8fbc57324-metrics-certs podName:e261eb8b-bfaa-491d-afbe-6eb8fbc57324 nodeName:}" failed. No retries permitted until 2026-09-16 12:00:42.442262086 +0000 UTC m=+9.062581397 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e261eb8b-bfaa-491d-afbe-6eb8fbc57324-metrics-certs") pod "network-metrics-daemon-6tsgc" (UID: "e261eb8b-bfaa-491d-afbe-6eb8fbc57324") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 12:00:38.643870 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:38.643831    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsjjz\" (UniqueName: \"kubernetes.io/projected/c334b0e3-888b-49a6-beae-f40e40caa548-kube-api-access-tsjjz\") pod \"network-check-target-2rdgh\" (UID: \"c334b0e3-888b-49a6-beae-f40e40caa548\") " pod="openshift-network-diagnostics/network-check-target-2rdgh"
Sep 16 12:00:38.644093 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:38.644075    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 12:00:38.644170 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:38.644104    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 12:00:38.644170 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:38.644118    2559 projected.go:196] Error preparing data for projected volume kube-api-access-tsjjz for pod openshift-network-diagnostics/network-check-target-2rdgh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 12:00:38.644281 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:38.644195    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c334b0e3-888b-49a6-beae-f40e40caa548-kube-api-access-tsjjz podName:c334b0e3-888b-49a6-beae-f40e40caa548 nodeName:}" failed. No retries permitted until 2026-09-16 12:00:42.644177078 +0000 UTC m=+9.264496392 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-tsjjz" (UniqueName: "kubernetes.io/projected/c334b0e3-888b-49a6-beae-f40e40caa548-kube-api-access-tsjjz") pod "network-check-target-2rdgh" (UID: "c334b0e3-888b-49a6-beae-f40e40caa548") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 12:00:38.933032 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:38.932171    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tbc79"
Sep 16 12:00:38.933032 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:38.932320    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tbc79" podUID="28222687-d3b4-4c0c-81f3-cc24fdc912e8"
Sep 16 12:00:38.933032 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:38.932697    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rdgh"
Sep 16 12:00:38.933032 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:38.932799    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2rdgh" podUID="c334b0e3-888b-49a6-beae-f40e40caa548"
Sep 16 12:00:38.933032 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:38.932857    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tsgc"
Sep 16 12:00:38.933032 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:38.932941    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tsgc" podUID="e261eb8b-bfaa-491d-afbe-6eb8fbc57324"
Sep 16 12:00:40.932459 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:40.931773    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tbc79"
Sep 16 12:00:40.932459 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:40.931874    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tbc79" podUID="28222687-d3b4-4c0c-81f3-cc24fdc912e8"
Sep 16 12:00:40.932459 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:40.932174    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rdgh"
Sep 16 12:00:40.932459 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:40.932266    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2rdgh" podUID="c334b0e3-888b-49a6-beae-f40e40caa548"
Sep 16 12:00:40.932459 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:40.932319    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tsgc"
Sep 16 12:00:40.932459 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:40.932405    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tsgc" podUID="e261eb8b-bfaa-491d-afbe-6eb8fbc57324"
Sep 16 12:00:42.476277 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:42.476239    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e261eb8b-bfaa-491d-afbe-6eb8fbc57324-metrics-certs\") pod \"network-metrics-daemon-6tsgc\" (UID: \"e261eb8b-bfaa-491d-afbe-6eb8fbc57324\") " pod="openshift-multus/network-metrics-daemon-6tsgc"
Sep 16 12:00:42.476737 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:42.476306    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/28222687-d3b4-4c0c-81f3-cc24fdc912e8-original-pull-secret\") pod \"global-pull-secret-syncer-tbc79\" (UID: \"28222687-d3b4-4c0c-81f3-cc24fdc912e8\") " pod="kube-system/global-pull-secret-syncer-tbc79"
Sep 16 12:00:42.476737 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:42.476430    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 12:00:42.476737 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:42.476447    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 12:00:42.476737 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:42.476495    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28222687-d3b4-4c0c-81f3-cc24fdc912e8-original-pull-secret podName:28222687-d3b4-4c0c-81f3-cc24fdc912e8 nodeName:}" failed. No retries permitted until 2026-09-16 12:00:50.476476032 +0000 UTC m=+17.096795366 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/28222687-d3b4-4c0c-81f3-cc24fdc912e8-original-pull-secret") pod "global-pull-secret-syncer-tbc79" (UID: "28222687-d3b4-4c0c-81f3-cc24fdc912e8") : object "kube-system"/"original-pull-secret" not registered
Sep 16 12:00:42.476737 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:42.476518    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e261eb8b-bfaa-491d-afbe-6eb8fbc57324-metrics-certs podName:e261eb8b-bfaa-491d-afbe-6eb8fbc57324 nodeName:}" failed. No retries permitted until 2026-09-16 12:00:50.47650689 +0000 UTC m=+17.096826185 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e261eb8b-bfaa-491d-afbe-6eb8fbc57324-metrics-certs") pod "network-metrics-daemon-6tsgc" (UID: "e261eb8b-bfaa-491d-afbe-6eb8fbc57324") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 12:00:42.678082 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:42.677995    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsjjz\" (UniqueName: \"kubernetes.io/projected/c334b0e3-888b-49a6-beae-f40e40caa548-kube-api-access-tsjjz\") pod \"network-check-target-2rdgh\" (UID: \"c334b0e3-888b-49a6-beae-f40e40caa548\") " pod="openshift-network-diagnostics/network-check-target-2rdgh"
Sep 16 12:00:42.678267 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:42.678191    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 12:00:42.678267 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:42.678219    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 12:00:42.678267 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:42.678231    2559 projected.go:196] Error preparing data for projected volume kube-api-access-tsjjz for pod openshift-network-diagnostics/network-check-target-2rdgh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 12:00:42.678420 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:42.678309    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c334b0e3-888b-49a6-beae-f40e40caa548-kube-api-access-tsjjz podName:c334b0e3-888b-49a6-beae-f40e40caa548 nodeName:}" failed. No retries permitted until 2026-09-16 12:00:50.678281409 +0000 UTC m=+17.298600725 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-tsjjz" (UniqueName: "kubernetes.io/projected/c334b0e3-888b-49a6-beae-f40e40caa548-kube-api-access-tsjjz") pod "network-check-target-2rdgh" (UID: "c334b0e3-888b-49a6-beae-f40e40caa548") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 12:00:42.932008 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:42.931933    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tsgc"
Sep 16 12:00:42.932184 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:42.931933    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tbc79"
Sep 16 12:00:42.932184 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:42.932051    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tsgc" podUID="e261eb8b-bfaa-491d-afbe-6eb8fbc57324"
Sep 16 12:00:42.932184 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:42.931933    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rdgh"
Sep 16 12:00:42.932184 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:42.932163    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tbc79" podUID="28222687-d3b4-4c0c-81f3-cc24fdc912e8"
Sep 16 12:00:42.932940 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:42.932884    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2rdgh" podUID="c334b0e3-888b-49a6-beae-f40e40caa548"
Sep 16 12:00:44.932417 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:44.932376    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tbc79"
Sep 16 12:00:44.932856 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:44.932558    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tbc79" podUID="28222687-d3b4-4c0c-81f3-cc24fdc912e8"
Sep 16 12:00:44.932914 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:44.932896    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rdgh"
Sep 16 12:00:44.932976 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:44.932958    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2rdgh" podUID="c334b0e3-888b-49a6-beae-f40e40caa548"
Sep 16 12:00:44.933026 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:44.933010    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tsgc"
Sep 16 12:00:44.933083 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:44.933060    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tsgc" podUID="e261eb8b-bfaa-491d-afbe-6eb8fbc57324"
Sep 16 12:00:46.932443 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:46.932403    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rdgh"
Sep 16 12:00:46.932832 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:46.932413    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tsgc"
Sep 16 12:00:46.932832 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:46.932526    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2rdgh" podUID="c334b0e3-888b-49a6-beae-f40e40caa548"
Sep 16 12:00:46.932832 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:46.932599    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tsgc" podUID="e261eb8b-bfaa-491d-afbe-6eb8fbc57324"
Sep 16 12:00:46.932832 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:46.932415    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tbc79"
Sep 16 12:00:46.932832 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:46.932691    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tbc79" podUID="28222687-d3b4-4c0c-81f3-cc24fdc912e8"
Sep 16 12:00:48.932199 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:48.932161    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tbc79"
Sep 16 12:00:48.932199 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:48.932200    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tsgc"
Sep 16 12:00:48.932199 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:48.932201    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rdgh"
Sep 16 12:00:48.932743 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:48.932294    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tbc79" podUID="28222687-d3b4-4c0c-81f3-cc24fdc912e8"
Sep 16 12:00:48.932743 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:48.932348    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tsgc" podUID="e261eb8b-bfaa-491d-afbe-6eb8fbc57324"
Sep 16 12:00:48.932743 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:48.932426    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2rdgh" podUID="c334b0e3-888b-49a6-beae-f40e40caa548"
Sep 16 12:00:50.535422 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:50.535380    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e261eb8b-bfaa-491d-afbe-6eb8fbc57324-metrics-certs\") pod \"network-metrics-daemon-6tsgc\" (UID: \"e261eb8b-bfaa-491d-afbe-6eb8fbc57324\") " pod="openshift-multus/network-metrics-daemon-6tsgc"
Sep 16 12:00:50.535766 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:50.535432    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/28222687-d3b4-4c0c-81f3-cc24fdc912e8-original-pull-secret\") pod \"global-pull-secret-syncer-tbc79\" (UID: \"28222687-d3b4-4c0c-81f3-cc24fdc912e8\") " pod="kube-system/global-pull-secret-syncer-tbc79"
Sep 16 12:00:50.535766 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:50.535538    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 12:00:50.535766 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:50.535601    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28222687-d3b4-4c0c-81f3-cc24fdc912e8-original-pull-secret podName:28222687-d3b4-4c0c-81f3-cc24fdc912e8 nodeName:}" failed. No retries permitted until 2026-09-16 12:01:06.535586841 +0000 UTC m=+33.155906135 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/28222687-d3b4-4c0c-81f3-cc24fdc912e8-original-pull-secret") pod "global-pull-secret-syncer-tbc79" (UID: "28222687-d3b4-4c0c-81f3-cc24fdc912e8") : object "kube-system"/"original-pull-secret" not registered
Sep 16 12:00:50.535766 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:50.535538    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 12:00:50.535766 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:50.535642    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e261eb8b-bfaa-491d-afbe-6eb8fbc57324-metrics-certs podName:e261eb8b-bfaa-491d-afbe-6eb8fbc57324 nodeName:}" failed. No retries permitted until 2026-09-16 12:01:06.535632595 +0000 UTC m=+33.155951903 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e261eb8b-bfaa-491d-afbe-6eb8fbc57324-metrics-certs") pod "network-metrics-daemon-6tsgc" (UID: "e261eb8b-bfaa-491d-afbe-6eb8fbc57324") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 12:00:50.736933 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:50.736898    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsjjz\" (UniqueName: \"kubernetes.io/projected/c334b0e3-888b-49a6-beae-f40e40caa548-kube-api-access-tsjjz\") pod \"network-check-target-2rdgh\" (UID: \"c334b0e3-888b-49a6-beae-f40e40caa548\") " pod="openshift-network-diagnostics/network-check-target-2rdgh"
Sep 16 12:00:50.737096 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:50.737042    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 12:00:50.737096 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:50.737058    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 12:00:50.737096 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:50.737066    2559 projected.go:196] Error preparing data for projected volume kube-api-access-tsjjz for pod openshift-network-diagnostics/network-check-target-2rdgh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 12:00:50.737225 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:50.737114    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c334b0e3-888b-49a6-beae-f40e40caa548-kube-api-access-tsjjz podName:c334b0e3-888b-49a6-beae-f40e40caa548 nodeName:}" failed. No retries permitted until 2026-09-16 12:01:06.737102473 +0000 UTC m=+33.357421767 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-tsjjz" (UniqueName: "kubernetes.io/projected/c334b0e3-888b-49a6-beae-f40e40caa548-kube-api-access-tsjjz") pod "network-check-target-2rdgh" (UID: "c334b0e3-888b-49a6-beae-f40e40caa548") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 12:00:50.932149 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:50.932048    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tsgc"
Sep 16 12:00:50.932149 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:50.932093    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tbc79"
Sep 16 12:00:50.932149 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:50.932050    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rdgh"
Sep 16 12:00:50.932411 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:50.932208    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tsgc" podUID="e261eb8b-bfaa-491d-afbe-6eb8fbc57324"
Sep 16 12:00:50.932411 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:50.932318    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tbc79" podUID="28222687-d3b4-4c0c-81f3-cc24fdc912e8"
Sep 16 12:00:50.932562 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:50.932416    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2rdgh" podUID="c334b0e3-888b-49a6-beae-f40e40caa548"
Sep 16 12:00:52.932613 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:52.932083    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rdgh"
Sep 16 12:00:52.932613 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:52.932146    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tbc79"
Sep 16 12:00:52.932613 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:52.932146    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tsgc"
Sep 16 12:00:52.932613 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:52.932227    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2rdgh" podUID="c334b0e3-888b-49a6-beae-f40e40caa548"
Sep 16 12:00:52.932613 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:52.932334    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tsgc" podUID="e261eb8b-bfaa-491d-afbe-6eb8fbc57324"
Sep 16 12:00:52.932613 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:52.932401    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tbc79" podUID="28222687-d3b4-4c0c-81f3-cc24fdc912e8"
Sep 16 12:00:54.933715 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:54.933485    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tbc79"
Sep 16 12:00:54.934940 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:54.933839    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tsgc"
Sep 16 12:00:54.934940 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:54.933940    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rdgh"
Sep 16 12:00:54.935235 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:54.935077    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tbc79" podUID="28222687-d3b4-4c0c-81f3-cc24fdc912e8"
Sep 16 12:00:54.935235 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:54.935216    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tsgc" podUID="e261eb8b-bfaa-491d-afbe-6eb8fbc57324"
Sep 16 12:00:54.935357 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:54.935289    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2rdgh" podUID="c334b0e3-888b-49a6-beae-f40e40caa548"
Sep 16 12:00:55.014998 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:55.014498    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nc7sf" event={"ID":"13ecb5ce-d0db-4a46-82d4-03e60d47b902","Type":"ContainerStarted","Data":"025b65e0bee56401a8c7b53752f0ac729685034cbd141db90daf6717355413ee"}
Sep 16 12:00:55.019364 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:55.019331    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rhx78" event={"ID":"bc31abf4-e8c6-4be6-87b3-f412930ffa32","Type":"ContainerStarted","Data":"7686cb1b800ca23097c8c672d1254da3e4c85395360b742ec44da046faf493c4"}
Sep 16 12:00:55.023228 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:55.022997    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-251.ec2.internal" event={"ID":"9111bdadcd9657efb2af1c537a733d27","Type":"ContainerStarted","Data":"5f10c71d034098e13e0693c1f534f6dc86749522f39a768a90abe387fb9818f9"}
Sep 16 12:00:55.028192 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:55.028055    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn" event={"ID":"ce48f02b-95e4-4a34-b6f6-f44283e70086","Type":"ContainerStarted","Data":"75d32f9bd086cbd663a47671fc625628b5c989a5f82ab78325fe151c046a34af"}
Sep 16 12:00:55.048121 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:55.046083    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-nc7sf" podStartSLOduration=2.057039882 podStartE2EDuration="21.046059966s" totalImagesPullingTime="18.989020084s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:00:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:00:55.032450475 +0000 UTC m=+21.652769791" watchObservedRunningTime="2026-09-16 12:00:55.046059966 +0000 UTC m=+21.666379282"
Sep 16 12:00:55.075356 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:55.075301    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-251.ec2.internal" podStartSLOduration=20.075280848 podStartE2EDuration="20.075280848s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:00:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:00:55.048062463 +0000 UTC m=+21.668381756" watchObservedRunningTime="2026-09-16 12:00:55.075280848 +0000 UTC m=+21.695600165"
Sep 16 12:00:56.031883 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:56.031697    2559 generic.go:356] "Generic (PLEG): container finished" podID="e0181d86-c266-426e-a18d-0f0241e252a9" containerID="29934583b46ec951efec7b8e913e78baceb1810647cde940bd9e714b6dddb0c4" exitCode=0
Sep 16 12:00:56.032584 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:56.031782    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-swz2v" event={"ID":"e0181d86-c266-426e-a18d-0f0241e252a9","Type":"ContainerDied","Data":"29934583b46ec951efec7b8e913e78baceb1810647cde940bd9e714b6dddb0c4"}
Sep 16 12:00:56.033984 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:56.033951    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-l5cpd" event={"ID":"94671c96-5c56-42f8-b7f7-f6f93b27dac0","Type":"ContainerStarted","Data":"cc1adaf6b00f52e16faef8f7ecaa0128c2c8dd6c977f6d2f213da08567420aca"}
Sep 16 12:00:56.038461 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:56.038011    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rsjgc" event={"ID":"6b817e44-5083-4c23-8480-340e10041f8f","Type":"ContainerStarted","Data":"11b14660481c5970df52e0ec98cf24735f75684ec922f79de4254e53e8a39629"}
Sep 16 12:00:56.040619 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:56.040589    2559 generic.go:356] "Generic (PLEG): container finished" podID="9ceb9740f429536d29654e686eae8a60" containerID="34f56c1c2ae41b2b54a614a10a851d28347c0fce0dabf1d9d2b780df1ee533f3" exitCode=0
Sep 16 12:00:56.040709 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:56.040631    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-251.ec2.internal" event={"ID":"9ceb9740f429536d29654e686eae8a60","Type":"ContainerDied","Data":"34f56c1c2ae41b2b54a614a10a851d28347c0fce0dabf1d9d2b780df1ee533f3"}
Sep 16 12:00:56.044169 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:56.044145    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn" event={"ID":"ce48f02b-95e4-4a34-b6f6-f44283e70086","Type":"ContainerStarted","Data":"39a3a780a95a524b9dd4078e7190a0a5c6a92bf139742e008a0f78099e5558f0"}
Sep 16 12:00:56.044258 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:56.044208    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn" event={"ID":"ce48f02b-95e4-4a34-b6f6-f44283e70086","Type":"ContainerStarted","Data":"bf79e2d6c2c876f77c2ce755963f08729a162b548dabfbf14d6c7cdbd1477f43"}
Sep 16 12:00:56.044362 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:56.044259    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn" event={"ID":"ce48f02b-95e4-4a34-b6f6-f44283e70086","Type":"ContainerStarted","Data":"147dc03af849ceee88eb9d4562aca9dfe0fdd3e46cd856957a7f00cc7ba36648"}
Sep 16 12:00:56.044362 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:56.044301    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn" event={"ID":"ce48f02b-95e4-4a34-b6f6-f44283e70086","Type":"ContainerStarted","Data":"def7f4c925d43953399a0c4fdd0a19ccaedb1cde55de9971b721250cba7cb466"}
Sep 16 12:00:56.044362 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:56.044332    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn" event={"ID":"ce48f02b-95e4-4a34-b6f6-f44283e70086","Type":"ContainerStarted","Data":"e8af12c65c6f4ee74ada1068aea1c1d411e184cd2279209625c7aa318250b71b"}
Sep 16 12:00:56.045755 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:56.045734    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsszd" event={"ID":"6bdcdaa1-6a36-4c63-8ba4-e95598e58778","Type":"ContainerStarted","Data":"6c0a123a5e6b5d2558ee8a789f49608a01b00da21e0c6a440cbc7655b82b7142"}
Sep 16 12:00:56.047598 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:56.047579    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-n5trt" event={"ID":"adb5d466-089d-4022-b731-6ca3f650eeab","Type":"ContainerStarted","Data":"ffb0b66ad8d7250541010c891c60895d0dca72bc7b43214d2f0da0025782ada5"}
Sep 16 12:00:56.049485 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:56.049464    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ch8pr" event={"ID":"a826335e-773e-48e2-aa35-099d7466304b","Type":"ContainerStarted","Data":"8844a477fdd2054aaa645bc414c9405c0e00ee429fa30f4a73dcbb965104e072"}
Sep 16 12:00:56.052790 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:56.052631    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-rhx78" podStartSLOduration=3.034718366 podStartE2EDuration="22.052615753s" totalImagesPullingTime="19.017897387s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:00:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:00:55.075246498 +0000 UTC m=+21.695565815" watchObservedRunningTime="2026-09-16 12:00:56.052615753 +0000 UTC m=+22.672935070"
Sep 16 12:00:56.065915 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:56.065879    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-ch8pr" podStartSLOduration=3.256783478 podStartE2EDuration="22.06586506s" totalImagesPullingTime="18.809081582s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:00:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:00:56.06551809 +0000 UTC m=+22.685837405" watchObservedRunningTime="2026-09-16 12:00:56.06586506 +0000 UTC m=+22.686184375"
Sep 16 12:00:56.094435 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:56.094381    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-l5cpd" podStartSLOduration=3.104428521 podStartE2EDuration="22.094363855s" totalImagesPullingTime="18.989935334s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:00:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:00:56.093396576 +0000 UTC m=+22.713715892" watchObservedRunningTime="2026-09-16 12:00:56.094363855 +0000 UTC m=+22.714683173"
Sep 16 12:00:56.108721 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:56.108678    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-n5trt" podStartSLOduration=3.141001004 podStartE2EDuration="22.108667234s" totalImagesPullingTime="18.96766623s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:00:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:00:56.108314386 +0000 UTC m=+22.728633701" watchObservedRunningTime="2026-09-16 12:00:56.108667234 +0000 UTC m=+22.728986551"
Sep 16 12:00:56.122078 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:56.122040    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-rsjgc" podStartSLOduration=3.131029775 podStartE2EDuration="22.12202401s" totalImagesPullingTime="18.990994235s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:00:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:00:56.12150662 +0000 UTC m=+22.741825938" watchObservedRunningTime="2026-09-16 12:00:56.12202401 +0000 UTC m=+22.742343326"
Sep 16 12:00:56.318498 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:56.318475    2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 16 12:00:56.872165 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:56.872063    2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-16T12:00:56.318493307Z","UUID":"e4c70153-e907-425b-a3fa-a07b46c3b1fd","Handler":null,"Name":"","Endpoint":""}
Sep 16 12:00:56.873593 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:56.873575    2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 16 12:00:56.873698 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:56.873605    2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 16 12:00:56.932285 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:56.932203    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tbc79"
Sep 16 12:00:56.932285 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:56.932244    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rdgh"
Sep 16 12:00:56.932517 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:56.932214    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tsgc"
Sep 16 12:00:56.932517 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:56.932351    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tbc79" podUID="28222687-d3b4-4c0c-81f3-cc24fdc912e8"
Sep 16 12:00:56.932517 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:56.932456    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2rdgh" podUID="c334b0e3-888b-49a6-beae-f40e40caa548"
Sep 16 12:00:56.932667 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:56.932527    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tsgc" podUID="e261eb8b-bfaa-491d-afbe-6eb8fbc57324"
Sep 16 12:00:57.056711 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:57.056673    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsszd" event={"ID":"6bdcdaa1-6a36-4c63-8ba4-e95598e58778","Type":"ContainerStarted","Data":"1831627026f9b97166cd4359cf9d305e293d46086774fdbd56bca0f6758e9f19"}
Sep 16 12:00:57.059827 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:57.059797    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-251.ec2.internal" event={"ID":"9ceb9740f429536d29654e686eae8a60","Type":"ContainerStarted","Data":"987cb1da3d068cb13fd0b2cbae9db8dfd9c9a7d67bb3ff3faf3fa0d7358e2c7f"}
Sep 16 12:00:58.066782 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:58.066742    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn" event={"ID":"ce48f02b-95e4-4a34-b6f6-f44283e70086","Type":"ContainerStarted","Data":"11b936fa858e94c953ef5e17b768d9d7e83fbe748bf7e26a01383541eb471743"}
Sep 16 12:00:58.069378 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:58.069346    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsszd" event={"ID":"6bdcdaa1-6a36-4c63-8ba4-e95598e58778","Type":"ContainerStarted","Data":"d8b64ce100f4405a50eea500348946d25feb21b17c1caef84fe36258a1fdc2a2"}
Sep 16 12:00:58.086919 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:58.086869    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsszd" podStartSLOduration=2.736889807 podStartE2EDuration="24.086852165s" totalImagesPullingTime="21.349962358s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:00:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:00:58.086338269 +0000 UTC m=+24.706657592" watchObservedRunningTime="2026-09-16 12:00:58.086852165 +0000 UTC m=+24.707171482"
Sep 16 12:00:58.087363 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:58.087334    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-251.ec2.internal" podStartSLOduration=23.087322209 podStartE2EDuration="23.087322209s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:00:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:00:57.075553718 +0000 UTC m=+23.695873070" watchObservedRunningTime="2026-09-16 12:00:58.087322209 +0000 UTC m=+24.707641525"
Sep 16 12:00:58.316741 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:58.316709    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-rsjgc"
Sep 16 12:00:58.317583 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:58.317531    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-rsjgc"
Sep 16 12:00:58.932142 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:58.931882    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tbc79"
Sep 16 12:00:58.932325 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:58.931882    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rdgh"
Sep 16 12:00:58.932325 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:58.932257    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tbc79" podUID="28222687-d3b4-4c0c-81f3-cc24fdc912e8"
Sep 16 12:00:58.932325 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:58.931882    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tsgc"
Sep 16 12:00:58.932484 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:58.932327    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2rdgh" podUID="c334b0e3-888b-49a6-beae-f40e40caa548"
Sep 16 12:00:58.932484 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:00:58.932399    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tsgc" podUID="e261eb8b-bfaa-491d-afbe-6eb8fbc57324"
Sep 16 12:00:59.071581 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:59.071546    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-rsjgc"
Sep 16 12:00:59.071970 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:00:59.071898    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-rsjgc"
Sep 16 12:01:00.931826 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:00.931790    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tbc79"
Sep 16 12:01:00.932294 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:00.931895    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rdgh"
Sep 16 12:01:00.932294 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:00.931896    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tbc79" podUID="28222687-d3b4-4c0c-81f3-cc24fdc912e8"
Sep 16 12:01:00.932294 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:00.931957    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tsgc"
Sep 16 12:01:00.932294 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:00.932040    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2rdgh" podUID="c334b0e3-888b-49a6-beae-f40e40caa548"
Sep 16 12:01:00.932294 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:00.932143    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tsgc" podUID="e261eb8b-bfaa-491d-afbe-6eb8fbc57324"
Sep 16 12:01:01.079068 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:01.078837    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-swz2v" event={"ID":"e0181d86-c266-426e-a18d-0f0241e252a9","Type":"ContainerStarted","Data":"3a087a32939ffdeccda6b4f06779a0192dfc71334b7295f16ce3acbf9a8dbd00"}
Sep 16 12:01:01.082807 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:01.082782    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn" event={"ID":"ce48f02b-95e4-4a34-b6f6-f44283e70086","Type":"ContainerStarted","Data":"9a8eb180f9c517a8b5010a0e9c84d74536c9b6e88faba33e001873f99a76159f"}
Sep 16 12:01:01.083058 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:01.083037    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn"
Sep 16 12:01:01.083187 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:01.083099    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn"
Sep 16 12:01:01.083187 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:01.083160    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn"
Sep 16 12:01:01.098041 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:01.098014    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn"
Sep 16 12:01:01.099571 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:01.099551    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn"
Sep 16 12:01:01.131106 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:01.131050    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn" podStartSLOduration=7.794528559 podStartE2EDuration="27.131035493s" totalImagesPullingTime="19.336506934s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:00:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:01:01.130573264 +0000 UTC m=+27.750892602" watchObservedRunningTime="2026-09-16 12:01:01.131035493 +0000 UTC m=+27.751354809"
Sep 16 12:01:02.086681 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:02.086643    2559 generic.go:356] "Generic (PLEG): container finished" podID="e0181d86-c266-426e-a18d-0f0241e252a9" containerID="3a087a32939ffdeccda6b4f06779a0192dfc71334b7295f16ce3acbf9a8dbd00" exitCode=0
Sep 16 12:01:02.087324 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:02.086714    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-swz2v" event={"ID":"e0181d86-c266-426e-a18d-0f0241e252a9","Type":"ContainerDied","Data":"3a087a32939ffdeccda6b4f06779a0192dfc71334b7295f16ce3acbf9a8dbd00"}
Sep 16 12:01:02.603565 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:02.603459    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2rdgh"]
Sep 16 12:01:02.603758 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:02.603657    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rdgh"
Sep 16 12:01:02.603831 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:02.603775    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2rdgh" podUID="c334b0e3-888b-49a6-beae-f40e40caa548"
Sep 16 12:01:02.604243 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:02.604222    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tbc79"]
Sep 16 12:01:02.604346 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:02.604306    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tbc79"
Sep 16 12:01:02.604436 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:02.604417    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tbc79" podUID="28222687-d3b4-4c0c-81f3-cc24fdc912e8"
Sep 16 12:01:02.604774 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:02.604757    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6tsgc"]
Sep 16 12:01:02.604849 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:02.604838    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tsgc"
Sep 16 12:01:02.604944 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:02.604915    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tsgc" podUID="e261eb8b-bfaa-491d-afbe-6eb8fbc57324"
Sep 16 12:01:03.934450 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:03.934423    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tbc79"
Sep 16 12:01:03.935002 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:03.934515    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rdgh"
Sep 16 12:01:03.935002 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:03.934521    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tbc79" podUID="28222687-d3b4-4c0c-81f3-cc24fdc912e8"
Sep 16 12:01:03.935002 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:03.934624    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2rdgh" podUID="c334b0e3-888b-49a6-beae-f40e40caa548"
Sep 16 12:01:03.935002 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:03.934670    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tsgc"
Sep 16 12:01:03.935002 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:03.934759    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tsgc" podUID="e261eb8b-bfaa-491d-afbe-6eb8fbc57324"
Sep 16 12:01:04.092791 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:04.092709    2559 generic.go:356] "Generic (PLEG): container finished" podID="e0181d86-c266-426e-a18d-0f0241e252a9" containerID="4a3d04b594972874c7ebf68d7e0c64d735f76684a531a9d14d3393c822dbbca6" exitCode=0
Sep 16 12:01:04.092791 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:04.092774    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-swz2v" event={"ID":"e0181d86-c266-426e-a18d-0f0241e252a9","Type":"ContainerDied","Data":"4a3d04b594972874c7ebf68d7e0c64d735f76684a531a9d14d3393c822dbbca6"}
Sep 16 12:01:05.935283 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:05.935085    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rdgh"
Sep 16 12:01:05.935769 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:05.935145    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tsgc"
Sep 16 12:01:05.935769 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:05.935358    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2rdgh" podUID="c334b0e3-888b-49a6-beae-f40e40caa548"
Sep 16 12:01:05.935769 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:05.935149    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tbc79"
Sep 16 12:01:05.935769 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:05.935434    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tsgc" podUID="e261eb8b-bfaa-491d-afbe-6eb8fbc57324"
Sep 16 12:01:05.935769 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:05.935538    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tbc79" podUID="28222687-d3b4-4c0c-81f3-cc24fdc912e8"
Sep 16 12:01:06.098509 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:06.098477    2559 generic.go:356] "Generic (PLEG): container finished" podID="e0181d86-c266-426e-a18d-0f0241e252a9" containerID="46a6b83a82b2712e2304db7ac72771fd270c782074d12f1cb6c7cfdcdd999ddc" exitCode=0
Sep 16 12:01:06.098691 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:06.098535    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-swz2v" event={"ID":"e0181d86-c266-426e-a18d-0f0241e252a9","Type":"ContainerDied","Data":"46a6b83a82b2712e2304db7ac72771fd270c782074d12f1cb6c7cfdcdd999ddc"}
Sep 16 12:01:06.550104 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:06.550068    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e261eb8b-bfaa-491d-afbe-6eb8fbc57324-metrics-certs\") pod \"network-metrics-daemon-6tsgc\" (UID: \"e261eb8b-bfaa-491d-afbe-6eb8fbc57324\") " pod="openshift-multus/network-metrics-daemon-6tsgc"
Sep 16 12:01:06.550281 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:06.550119    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/28222687-d3b4-4c0c-81f3-cc24fdc912e8-original-pull-secret\") pod \"global-pull-secret-syncer-tbc79\" (UID: \"28222687-d3b4-4c0c-81f3-cc24fdc912e8\") " pod="kube-system/global-pull-secret-syncer-tbc79"
Sep 16 12:01:06.550281 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:06.550219    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 12:01:06.550281 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:06.550272    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e261eb8b-bfaa-491d-afbe-6eb8fbc57324-metrics-certs podName:e261eb8b-bfaa-491d-afbe-6eb8fbc57324 nodeName:}" failed. No retries permitted until 2026-09-16 12:01:38.550259354 +0000 UTC m=+65.170578647 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e261eb8b-bfaa-491d-afbe-6eb8fbc57324-metrics-certs") pod "network-metrics-daemon-6tsgc" (UID: "e261eb8b-bfaa-491d-afbe-6eb8fbc57324") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 12:01:06.550281 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:06.550218    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 12:01:06.550427 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:06.550303    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28222687-d3b4-4c0c-81f3-cc24fdc912e8-original-pull-secret podName:28222687-d3b4-4c0c-81f3-cc24fdc912e8 nodeName:}" failed. No retries permitted until 2026-09-16 12:01:38.550297033 +0000 UTC m=+65.170616328 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/28222687-d3b4-4c0c-81f3-cc24fdc912e8-original-pull-secret") pod "global-pull-secret-syncer-tbc79" (UID: "28222687-d3b4-4c0c-81f3-cc24fdc912e8") : object "kube-system"/"original-pull-secret" not registered
Sep 16 12:01:06.751650 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:06.751617    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsjjz\" (UniqueName: \"kubernetes.io/projected/c334b0e3-888b-49a6-beae-f40e40caa548-kube-api-access-tsjjz\") pod \"network-check-target-2rdgh\" (UID: \"c334b0e3-888b-49a6-beae-f40e40caa548\") " pod="openshift-network-diagnostics/network-check-target-2rdgh"
Sep 16 12:01:06.751818 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:06.751769    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 12:01:06.751818 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:06.751790    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 12:01:06.751818 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:06.751799    2559 projected.go:196] Error preparing data for projected volume kube-api-access-tsjjz for pod openshift-network-diagnostics/network-check-target-2rdgh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 12:01:06.751911 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:06.751849    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c334b0e3-888b-49a6-beae-f40e40caa548-kube-api-access-tsjjz podName:c334b0e3-888b-49a6-beae-f40e40caa548 nodeName:}" failed. No retries permitted until 2026-09-16 12:01:38.751834703 +0000 UTC m=+65.372154012 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-tsjjz" (UniqueName: "kubernetes.io/projected/c334b0e3-888b-49a6-beae-f40e40caa548-kube-api-access-tsjjz") pod "network-check-target-2rdgh" (UID: "c334b0e3-888b-49a6-beae-f40e40caa548") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 12:01:07.934589 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:07.934563    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tsgc"
Sep 16 12:01:07.934955 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:07.934652    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tbc79"
Sep 16 12:01:07.934955 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:07.934657    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tsgc" podUID="e261eb8b-bfaa-491d-afbe-6eb8fbc57324"
Sep 16 12:01:07.934955 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:07.934725    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tbc79" podUID="28222687-d3b4-4c0c-81f3-cc24fdc912e8"
Sep 16 12:01:07.934955 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:07.934757    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rdgh"
Sep 16 12:01:07.934955 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:07.934800    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2rdgh" podUID="c334b0e3-888b-49a6-beae-f40e40caa548"
Sep 16 12:01:08.642858 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.642824    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-251.ec2.internal" event="NodeReady"
Sep 16 12:01:08.643024 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.642963    2559 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 16 12:01:08.676070 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.676035    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-hrvzp"]
Sep 16 12:01:08.695754 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.695725    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-dk9qm"]
Sep 16 12:01:08.696561 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.696261    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-hrvzp"
Sep 16 12:01:08.699001 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.698983    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 16 12:01:08.699240 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.699219    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 16 12:01:08.699525 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.699477    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 16 12:01:08.699525 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.699646    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 16 12:01:08.699525 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.699739    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-q6sbc\""
Sep 16 12:01:08.704224 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.704188    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 16 12:01:08.719969 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.719950    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-dk9qm"
Sep 16 12:01:08.719969 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.719965    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-85d4f6697c-9k6rn"]
Sep 16 12:01:08.722687 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.722663    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 16 12:01:08.722790 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.722692    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 16 12:01:08.722988 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.722968    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-5fm85\""
Sep 16 12:01:08.723209 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.723194    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 16 12:01:08.723209 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.723202    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 16 12:01:08.744061 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.744040    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-hrvzp"]
Sep 16 12:01:08.744171 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.744073    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-dk9qm"]
Sep 16 12:01:08.744171 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.744097    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-bcrqz"]
Sep 16 12:01:08.744352 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.744169    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85d4f6697c-9k6rn"
Sep 16 12:01:08.746842 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.746822    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 16 12:01:08.746940 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.746918    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 16 12:01:08.747017 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.747000    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 16 12:01:08.747074 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.747023    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pr5zs\""
Sep 16 12:01:08.753373 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.753350    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 16 12:01:08.760006 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.759986    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ptchc"]
Sep 16 12:01:08.760100 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.760090    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bcrqz"
Sep 16 12:01:08.762769 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.762744    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 16 12:01:08.762769 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.762742    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 16 12:01:08.762917 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.762839    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rfzsk\""
Sep 16 12:01:08.768404 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.768386    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmdms\" (UniqueName: \"kubernetes.io/projected/63ee784a-3b40-4259-9923-74a24d0203a0-kube-api-access-mmdms\") pod \"console-operator-696884fb9c-hrvzp\" (UID: \"63ee784a-3b40-4259-9923-74a24d0203a0\") " pod="openshift-console-operator/console-operator-696884fb9c-hrvzp"
Sep 16 12:01:08.768504 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.768445    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/63ee784a-3b40-4259-9923-74a24d0203a0-trusted-ca\") pod \"console-operator-696884fb9c-hrvzp\" (UID: \"63ee784a-3b40-4259-9923-74a24d0203a0\") " pod="openshift-console-operator/console-operator-696884fb9c-hrvzp"
Sep 16 12:01:08.768504 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.768478    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/63ee784a-3b40-4259-9923-74a24d0203a0-serving-cert\") pod \"console-operator-696884fb9c-hrvzp\" (UID: \"63ee784a-3b40-4259-9923-74a24d0203a0\") " pod="openshift-console-operator/console-operator-696884fb9c-hrvzp"
Sep 16 12:01:08.768615 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.768544    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/63ee784a-3b40-4259-9923-74a24d0203a0-config\") pod \"console-operator-696884fb9c-hrvzp\" (UID: \"63ee784a-3b40-4259-9923-74a24d0203a0\") " pod="openshift-console-operator/console-operator-696884fb9c-hrvzp"
Sep 16 12:01:08.775940 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.775921    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-48mv7"]
Sep 16 12:01:08.776027 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.775996    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ptchc"
Sep 16 12:01:08.778569 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.778547    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 16 12:01:08.778887 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.778809    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 16 12:01:08.778887 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.778819    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-knmsl\""
Sep 16 12:01:08.779024 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.778809    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 16 12:01:08.790150 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.790112    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-85d4f6697c-9k6rn"]
Sep 16 12:01:08.790230 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.790161    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ptchc"]
Sep 16 12:01:08.790230 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.790191    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-48mv7"]
Sep 16 12:01:08.790230 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.790211    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bcrqz"]
Sep 16 12:01:08.790365 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.790247    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-48mv7"
Sep 16 12:01:08.793039 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.792793    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-dp8xk\""
Sep 16 12:01:08.793039 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.792793    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 16 12:01:08.793039 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.792845    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 16 12:01:08.869640 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.869613    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/63ee784a-3b40-4259-9923-74a24d0203a0-trusted-ca\") pod \"console-operator-696884fb9c-hrvzp\" (UID: \"63ee784a-3b40-4259-9923-74a24d0203a0\") " pod="openshift-console-operator/console-operator-696884fb9c-hrvzp"
Sep 16 12:01:08.869802 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.869663    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/895f0b5d-bd3c-4065-8681-43f68ef87d04-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-48mv7\" (UID: \"895f0b5d-bd3c-4065-8681-43f68ef87d04\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-48mv7"
Sep 16 12:01:08.869802 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.869709    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/3c5a71bb-e6d1-45d8-8872-4165a3aa09e2-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-dk9qm\" (UID: \"3c5a71bb-e6d1-45d8-8872-4165a3aa09e2\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-dk9qm"
Sep 16 12:01:08.869802 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.869741    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c693f93f-7292-44cd-b745-8988a839dab9-installation-pull-secrets\") pod \"image-registry-85d4f6697c-9k6rn\" (UID: \"c693f93f-7292-44cd-b745-8988a839dab9\") " pod="openshift-image-registry/image-registry-85d4f6697c-9k6rn"
Sep 16 12:01:08.869802 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.869771    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/63ee784a-3b40-4259-9923-74a24d0203a0-serving-cert\") pod \"console-operator-696884fb9c-hrvzp\" (UID: \"63ee784a-3b40-4259-9923-74a24d0203a0\") " pod="openshift-console-operator/console-operator-696884fb9c-hrvzp"
Sep 16 12:01:08.869802 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.869797    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b153e4d5-33a6-4e3f-aa63-8aec2c778bb7-tmp-dir\") pod \"dns-default-bcrqz\" (UID: \"b153e4d5-33a6-4e3f-aa63-8aec2c778bb7\") " pod="openshift-dns/dns-default-bcrqz"
Sep 16 12:01:08.870059 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.869823    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c693f93f-7292-44cd-b745-8988a839dab9-registry-certificates\") pod \"image-registry-85d4f6697c-9k6rn\" (UID: \"c693f93f-7292-44cd-b745-8988a839dab9\") " pod="openshift-image-registry/image-registry-85d4f6697c-9k6rn"
Sep 16 12:01:08.870059 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.869865    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/63ee784a-3b40-4259-9923-74a24d0203a0-config\") pod \"console-operator-696884fb9c-hrvzp\" (UID: \"63ee784a-3b40-4259-9923-74a24d0203a0\") " pod="openshift-console-operator/console-operator-696884fb9c-hrvzp"
Sep 16 12:01:08.870059 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.869929    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b153e4d5-33a6-4e3f-aa63-8aec2c778bb7-metrics-tls\") pod \"dns-default-bcrqz\" (UID: \"b153e4d5-33a6-4e3f-aa63-8aec2c778bb7\") " pod="openshift-dns/dns-default-bcrqz"
Sep 16 12:01:08.870059 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.869989    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/895f0b5d-bd3c-4065-8681-43f68ef87d04-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-48mv7\" (UID: \"895f0b5d-bd3c-4065-8681-43f68ef87d04\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-48mv7"
Sep 16 12:01:08.870059 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.870019    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3c5a71bb-e6d1-45d8-8872-4165a3aa09e2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-dk9qm\" (UID: \"3c5a71bb-e6d1-45d8-8872-4165a3aa09e2\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-dk9qm"
Sep 16 12:01:08.870059 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.870050    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c693f93f-7292-44cd-b745-8988a839dab9-bound-sa-token\") pod \"image-registry-85d4f6697c-9k6rn\" (UID: \"c693f93f-7292-44cd-b745-8988a839dab9\") " pod="openshift-image-registry/image-registry-85d4f6697c-9k6rn"
Sep 16 12:01:08.870371 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.870106    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmdms\" (UniqueName: \"kubernetes.io/projected/63ee784a-3b40-4259-9923-74a24d0203a0-kube-api-access-mmdms\") pod \"console-operator-696884fb9c-hrvzp\" (UID: \"63ee784a-3b40-4259-9923-74a24d0203a0\") " pod="openshift-console-operator/console-operator-696884fb9c-hrvzp"
Sep 16 12:01:08.870371 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.870144    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c693f93f-7292-44cd-b745-8988a839dab9-registry-tls\") pod \"image-registry-85d4f6697c-9k6rn\" (UID: \"c693f93f-7292-44cd-b745-8988a839dab9\") " pod="openshift-image-registry/image-registry-85d4f6697c-9k6rn"
Sep 16 12:01:08.870371 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.870188    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c693f93f-7292-44cd-b745-8988a839dab9-image-registry-private-configuration\") pod \"image-registry-85d4f6697c-9k6rn\" (UID: \"c693f93f-7292-44cd-b745-8988a839dab9\") " pod="openshift-image-registry/image-registry-85d4f6697c-9k6rn"
Sep 16 12:01:08.870371 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.870218    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c693f93f-7292-44cd-b745-8988a839dab9-ca-trust-extracted\") pod \"image-registry-85d4f6697c-9k6rn\" (UID: \"c693f93f-7292-44cd-b745-8988a839dab9\") " pod="openshift-image-registry/image-registry-85d4f6697c-9k6rn"
Sep 16 12:01:08.870371 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.870242    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f5e5b43-7b68-4940-bba6-36238146b79d-cert\") pod \"ingress-canary-ptchc\" (UID: \"0f5e5b43-7b68-4940-bba6-36238146b79d\") " pod="openshift-ingress-canary/ingress-canary-ptchc"
Sep 16 12:01:08.870371 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.870264    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vspfj\" (UniqueName: \"kubernetes.io/projected/0f5e5b43-7b68-4940-bba6-36238146b79d-kube-api-access-vspfj\") pod \"ingress-canary-ptchc\" (UID: \"0f5e5b43-7b68-4940-bba6-36238146b79d\") " pod="openshift-ingress-canary/ingress-canary-ptchc"
Sep 16 12:01:08.870371 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.870286    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzvtk\" (UniqueName: \"kubernetes.io/projected/3c5a71bb-e6d1-45d8-8872-4165a3aa09e2-kube-api-access-tzvtk\") pod \"cluster-monitoring-operator-6cd954b897-dk9qm\" (UID: \"3c5a71bb-e6d1-45d8-8872-4165a3aa09e2\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-dk9qm"
Sep 16 12:01:08.870371 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.870311    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b153e4d5-33a6-4e3f-aa63-8aec2c778bb7-config-volume\") pod \"dns-default-bcrqz\" (UID: \"b153e4d5-33a6-4e3f-aa63-8aec2c778bb7\") " pod="openshift-dns/dns-default-bcrqz"
Sep 16 12:01:08.870694 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.870388    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxbfj\" (UniqueName: \"kubernetes.io/projected/b153e4d5-33a6-4e3f-aa63-8aec2c778bb7-kube-api-access-pxbfj\") pod \"dns-default-bcrqz\" (UID: \"b153e4d5-33a6-4e3f-aa63-8aec2c778bb7\") " pod="openshift-dns/dns-default-bcrqz"
Sep 16 12:01:08.870694 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.870441    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/63ee784a-3b40-4259-9923-74a24d0203a0-config\") pod \"console-operator-696884fb9c-hrvzp\" (UID: \"63ee784a-3b40-4259-9923-74a24d0203a0\") " pod="openshift-console-operator/console-operator-696884fb9c-hrvzp"
Sep 16 12:01:08.870694 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.870451    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c693f93f-7292-44cd-b745-8988a839dab9-trusted-ca\") pod \"image-registry-85d4f6697c-9k6rn\" (UID: \"c693f93f-7292-44cd-b745-8988a839dab9\") " pod="openshift-image-registry/image-registry-85d4f6697c-9k6rn"
Sep 16 12:01:08.870694 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.870489    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpdf5\" (UniqueName: \"kubernetes.io/projected/c693f93f-7292-44cd-b745-8988a839dab9-kube-api-access-fpdf5\") pod \"image-registry-85d4f6697c-9k6rn\" (UID: \"c693f93f-7292-44cd-b745-8988a839dab9\") " pod="openshift-image-registry/image-registry-85d4f6697c-9k6rn"
Sep 16 12:01:08.874337 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.874273    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/63ee784a-3b40-4259-9923-74a24d0203a0-serving-cert\") pod \"console-operator-696884fb9c-hrvzp\" (UID: \"63ee784a-3b40-4259-9923-74a24d0203a0\") " pod="openshift-console-operator/console-operator-696884fb9c-hrvzp"
Sep 16 12:01:08.879172 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.879148    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmdms\" (UniqueName: \"kubernetes.io/projected/63ee784a-3b40-4259-9923-74a24d0203a0-kube-api-access-mmdms\") pod \"console-operator-696884fb9c-hrvzp\" (UID: \"63ee784a-3b40-4259-9923-74a24d0203a0\") " pod="openshift-console-operator/console-operator-696884fb9c-hrvzp"
Sep 16 12:01:08.880104 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.880082    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/63ee784a-3b40-4259-9923-74a24d0203a0-trusted-ca\") pod \"console-operator-696884fb9c-hrvzp\" (UID: \"63ee784a-3b40-4259-9923-74a24d0203a0\") " pod="openshift-console-operator/console-operator-696884fb9c-hrvzp"
Sep 16 12:01:08.971208 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.971171    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c693f93f-7292-44cd-b745-8988a839dab9-bound-sa-token\") pod \"image-registry-85d4f6697c-9k6rn\" (UID: \"c693f93f-7292-44cd-b745-8988a839dab9\") " pod="openshift-image-registry/image-registry-85d4f6697c-9k6rn"
Sep 16 12:01:08.971591 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.971225    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c693f93f-7292-44cd-b745-8988a839dab9-registry-tls\") pod \"image-registry-85d4f6697c-9k6rn\" (UID: \"c693f93f-7292-44cd-b745-8988a839dab9\") " pod="openshift-image-registry/image-registry-85d4f6697c-9k6rn"
Sep 16 12:01:08.971591 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.971247    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c693f93f-7292-44cd-b745-8988a839dab9-image-registry-private-configuration\") pod \"image-registry-85d4f6697c-9k6rn\" (UID: \"c693f93f-7292-44cd-b745-8988a839dab9\") " pod="openshift-image-registry/image-registry-85d4f6697c-9k6rn"
Sep 16 12:01:08.971591 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.971278    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c693f93f-7292-44cd-b745-8988a839dab9-ca-trust-extracted\") pod \"image-registry-85d4f6697c-9k6rn\" (UID: \"c693f93f-7292-44cd-b745-8988a839dab9\") " pod="openshift-image-registry/image-registry-85d4f6697c-9k6rn"
Sep 16 12:01:08.971591 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.971304    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f5e5b43-7b68-4940-bba6-36238146b79d-cert\") pod \"ingress-canary-ptchc\" (UID: \"0f5e5b43-7b68-4940-bba6-36238146b79d\") " pod="openshift-ingress-canary/ingress-canary-ptchc"
Sep 16 12:01:08.971591 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.971326    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vspfj\" (UniqueName: \"kubernetes.io/projected/0f5e5b43-7b68-4940-bba6-36238146b79d-kube-api-access-vspfj\") pod \"ingress-canary-ptchc\" (UID: \"0f5e5b43-7b68-4940-bba6-36238146b79d\") " pod="openshift-ingress-canary/ingress-canary-ptchc"
Sep 16 12:01:08.971591 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:08.971345    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 16 12:01:08.971591 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:08.971362    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85d4f6697c-9k6rn: secret "image-registry-tls" not found
Sep 16 12:01:08.971591 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.971348    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzvtk\" (UniqueName: \"kubernetes.io/projected/3c5a71bb-e6d1-45d8-8872-4165a3aa09e2-kube-api-access-tzvtk\") pod \"cluster-monitoring-operator-6cd954b897-dk9qm\" (UID: \"3c5a71bb-e6d1-45d8-8872-4165a3aa09e2\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-dk9qm"
Sep 16 12:01:08.971591 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:08.971421    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c693f93f-7292-44cd-b745-8988a839dab9-registry-tls podName:c693f93f-7292-44cd-b745-8988a839dab9 nodeName:}" failed. No retries permitted until 2026-09-16 12:01:09.471402966 +0000 UTC m=+36.091722279 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c693f93f-7292-44cd-b745-8988a839dab9-registry-tls") pod "image-registry-85d4f6697c-9k6rn" (UID: "c693f93f-7292-44cd-b745-8988a839dab9") : secret "image-registry-tls" not found
Sep 16 12:01:08.971591 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.971448    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b153e4d5-33a6-4e3f-aa63-8aec2c778bb7-config-volume\") pod \"dns-default-bcrqz\" (UID: \"b153e4d5-33a6-4e3f-aa63-8aec2c778bb7\") " pod="openshift-dns/dns-default-bcrqz"
Sep 16 12:01:08.971591 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.971477    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxbfj\" (UniqueName: \"kubernetes.io/projected/b153e4d5-33a6-4e3f-aa63-8aec2c778bb7-kube-api-access-pxbfj\") pod \"dns-default-bcrqz\" (UID: \"b153e4d5-33a6-4e3f-aa63-8aec2c778bb7\") " pod="openshift-dns/dns-default-bcrqz"
Sep 16 12:01:08.971591 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.971508    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c693f93f-7292-44cd-b745-8988a839dab9-trusted-ca\") pod \"image-registry-85d4f6697c-9k6rn\" (UID: \"c693f93f-7292-44cd-b745-8988a839dab9\") " pod="openshift-image-registry/image-registry-85d4f6697c-9k6rn"
Sep 16 12:01:08.971591 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.971531    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpdf5\" (UniqueName: \"kubernetes.io/projected/c693f93f-7292-44cd-b745-8988a839dab9-kube-api-access-fpdf5\") pod \"image-registry-85d4f6697c-9k6rn\" (UID: \"c693f93f-7292-44cd-b745-8988a839dab9\") " pod="openshift-image-registry/image-registry-85d4f6697c-9k6rn"
Sep 16 12:01:08.971591 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.971583    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/895f0b5d-bd3c-4065-8681-43f68ef87d04-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-48mv7\" (UID: \"895f0b5d-bd3c-4065-8681-43f68ef87d04\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-48mv7"
Sep 16 12:01:08.972086 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:08.971649    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 16 12:01:08.972086 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:08.971690    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/895f0b5d-bd3c-4065-8681-43f68ef87d04-networking-console-plugin-cert podName:895f0b5d-bd3c-4065-8681-43f68ef87d04 nodeName:}" failed. No retries permitted until 2026-09-16 12:01:09.471677301 +0000 UTC m=+36.091996610 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/895f0b5d-bd3c-4065-8681-43f68ef87d04-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-48mv7" (UID: "895f0b5d-bd3c-4065-8681-43f68ef87d04") : secret "networking-console-plugin-cert" not found
Sep 16 12:01:08.972086 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.971882    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/3c5a71bb-e6d1-45d8-8872-4165a3aa09e2-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-dk9qm\" (UID: \"3c5a71bb-e6d1-45d8-8872-4165a3aa09e2\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-dk9qm"
Sep 16 12:01:08.972086 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.971913    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c693f93f-7292-44cd-b745-8988a839dab9-ca-trust-extracted\") pod \"image-registry-85d4f6697c-9k6rn\" (UID: \"c693f93f-7292-44cd-b745-8988a839dab9\") " pod="openshift-image-registry/image-registry-85d4f6697c-9k6rn"
Sep 16 12:01:08.972086 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.971934    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c693f93f-7292-44cd-b745-8988a839dab9-installation-pull-secrets\") pod \"image-registry-85d4f6697c-9k6rn\" (UID: \"c693f93f-7292-44cd-b745-8988a839dab9\") " pod="openshift-image-registry/image-registry-85d4f6697c-9k6rn"
Sep 16 12:01:08.972086 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.971968    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b153e4d5-33a6-4e3f-aa63-8aec2c778bb7-tmp-dir\") pod \"dns-default-bcrqz\" (UID: \"b153e4d5-33a6-4e3f-aa63-8aec2c778bb7\") " pod="openshift-dns/dns-default-bcrqz"
Sep 16 12:01:08.972086 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.971999    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c693f93f-7292-44cd-b745-8988a839dab9-registry-certificates\") pod \"image-registry-85d4f6697c-9k6rn\" (UID: \"c693f93f-7292-44cd-b745-8988a839dab9\") " pod="openshift-image-registry/image-registry-85d4f6697c-9k6rn"
Sep 16 12:01:08.972086 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.972045    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b153e4d5-33a6-4e3f-aa63-8aec2c778bb7-metrics-tls\") pod \"dns-default-bcrqz\" (UID: \"b153e4d5-33a6-4e3f-aa63-8aec2c778bb7\") " pod="openshift-dns/dns-default-bcrqz"
Sep 16 12:01:08.972086 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.972076    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/895f0b5d-bd3c-4065-8681-43f68ef87d04-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-48mv7\" (UID: \"895f0b5d-bd3c-4065-8681-43f68ef87d04\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-48mv7"
Sep 16 12:01:08.972539 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.972103    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3c5a71bb-e6d1-45d8-8872-4165a3aa09e2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-dk9qm\" (UID: \"3c5a71bb-e6d1-45d8-8872-4165a3aa09e2\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-dk9qm"
Sep 16 12:01:08.972539 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.972214    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b153e4d5-33a6-4e3f-aa63-8aec2c778bb7-config-volume\") pod \"dns-default-bcrqz\" (UID: \"b153e4d5-33a6-4e3f-aa63-8aec2c778bb7\") " pod="openshift-dns/dns-default-bcrqz"
Sep 16 12:01:08.972539 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:08.972245    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 16 12:01:08.972539 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:08.972296    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c5a71bb-e6d1-45d8-8872-4165a3aa09e2-cluster-monitoring-operator-tls podName:3c5a71bb-e6d1-45d8-8872-4165a3aa09e2 nodeName:}" failed. No retries permitted until 2026-09-16 12:01:09.472280589 +0000 UTC m=+36.092599902 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3c5a71bb-e6d1-45d8-8872-4165a3aa09e2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-dk9qm" (UID: "3c5a71bb-e6d1-45d8-8872-4165a3aa09e2") : secret "cluster-monitoring-operator-tls" not found
Sep 16 12:01:08.972539 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:08.972367    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 12:01:08.972539 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:08.972400    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b153e4d5-33a6-4e3f-aa63-8aec2c778bb7-metrics-tls podName:b153e4d5-33a6-4e3f-aa63-8aec2c778bb7 nodeName:}" failed. No retries permitted until 2026-09-16 12:01:09.472388917 +0000 UTC m=+36.092708226 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b153e4d5-33a6-4e3f-aa63-8aec2c778bb7-metrics-tls") pod "dns-default-bcrqz" (UID: "b153e4d5-33a6-4e3f-aa63-8aec2c778bb7") : secret "dns-default-metrics-tls" not found
Sep 16 12:01:08.972846 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.972632    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/3c5a71bb-e6d1-45d8-8872-4165a3aa09e2-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-dk9qm\" (UID: \"3c5a71bb-e6d1-45d8-8872-4165a3aa09e2\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-dk9qm"
Sep 16 12:01:08.972846 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.972632    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c693f93f-7292-44cd-b745-8988a839dab9-trusted-ca\") pod \"image-registry-85d4f6697c-9k6rn\" (UID: \"c693f93f-7292-44cd-b745-8988a839dab9\") " pod="openshift-image-registry/image-registry-85d4f6697c-9k6rn"
Sep 16 12:01:08.972846 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.972688    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c693f93f-7292-44cd-b745-8988a839dab9-registry-certificates\") pod \"image-registry-85d4f6697c-9k6rn\" (UID: \"c693f93f-7292-44cd-b745-8988a839dab9\") " pod="openshift-image-registry/image-registry-85d4f6697c-9k6rn"
Sep 16 12:01:08.972846 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.972701    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b153e4d5-33a6-4e3f-aa63-8aec2c778bb7-tmp-dir\") pod \"dns-default-bcrqz\" (UID: \"b153e4d5-33a6-4e3f-aa63-8aec2c778bb7\") " pod="openshift-dns/dns-default-bcrqz"
Sep 16 12:01:08.973080 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.973056    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/895f0b5d-bd3c-4065-8681-43f68ef87d04-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-48mv7\" (UID: \"895f0b5d-bd3c-4065-8681-43f68ef87d04\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-48mv7"
Sep 16 12:01:08.974427 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.974405    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c693f93f-7292-44cd-b745-8988a839dab9-image-registry-private-configuration\") pod \"image-registry-85d4f6697c-9k6rn\" (UID: \"c693f93f-7292-44cd-b745-8988a839dab9\") " pod="openshift-image-registry/image-registry-85d4f6697c-9k6rn"
Sep 16 12:01:08.974519 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.974489    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c693f93f-7292-44cd-b745-8988a839dab9-installation-pull-secrets\") pod \"image-registry-85d4f6697c-9k6rn\" (UID: \"c693f93f-7292-44cd-b745-8988a839dab9\") " pod="openshift-image-registry/image-registry-85d4f6697c-9k6rn"
Sep 16 12:01:08.974555 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.974535    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f5e5b43-7b68-4940-bba6-36238146b79d-cert\") pod \"ingress-canary-ptchc\" (UID: \"0f5e5b43-7b68-4940-bba6-36238146b79d\") " pod="openshift-ingress-canary/ingress-canary-ptchc"
Sep 16 12:01:08.980617 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.980590    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpdf5\" (UniqueName: \"kubernetes.io/projected/c693f93f-7292-44cd-b745-8988a839dab9-kube-api-access-fpdf5\") pod \"image-registry-85d4f6697c-9k6rn\" (UID: \"c693f93f-7292-44cd-b745-8988a839dab9\") " pod="openshift-image-registry/image-registry-85d4f6697c-9k6rn"
Sep 16 12:01:08.981439 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.981411    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c693f93f-7292-44cd-b745-8988a839dab9-bound-sa-token\") pod \"image-registry-85d4f6697c-9k6rn\" (UID: \"c693f93f-7292-44cd-b745-8988a839dab9\") " pod="openshift-image-registry/image-registry-85d4f6697c-9k6rn"
Sep 16 12:01:08.981555 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.981505    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxbfj\" (UniqueName: \"kubernetes.io/projected/b153e4d5-33a6-4e3f-aa63-8aec2c778bb7-kube-api-access-pxbfj\") pod \"dns-default-bcrqz\" (UID: \"b153e4d5-33a6-4e3f-aa63-8aec2c778bb7\") " pod="openshift-dns/dns-default-bcrqz"
Sep 16 12:01:08.981974 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.981952    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vspfj\" (UniqueName: \"kubernetes.io/projected/0f5e5b43-7b68-4940-bba6-36238146b79d-kube-api-access-vspfj\") pod \"ingress-canary-ptchc\" (UID: \"0f5e5b43-7b68-4940-bba6-36238146b79d\") " pod="openshift-ingress-canary/ingress-canary-ptchc"
Sep 16 12:01:08.982247 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:08.982230    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzvtk\" (UniqueName: \"kubernetes.io/projected/3c5a71bb-e6d1-45d8-8872-4165a3aa09e2-kube-api-access-tzvtk\") pod \"cluster-monitoring-operator-6cd954b897-dk9qm\" (UID: \"3c5a71bb-e6d1-45d8-8872-4165a3aa09e2\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-dk9qm"
Sep 16 12:01:09.007375 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:09.007342    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-hrvzp"
Sep 16 12:01:09.086422 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:09.086383    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ptchc"
Sep 16 12:01:09.281014 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:09.280941    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:01:09.338466 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:09.338439    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-hrvzp"]
Sep 16 12:01:09.342770 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:01:09.342742    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63ee784a_3b40_4259_9923_74a24d0203a0.slice/crio-1cec111cc0dd0a1043efac91ed5bab129efa5747b4eca3f56deaba23e3862aaf WatchSource:0}: Error finding container 1cec111cc0dd0a1043efac91ed5bab129efa5747b4eca3f56deaba23e3862aaf: Status 404 returned error can't find the container with id 1cec111cc0dd0a1043efac91ed5bab129efa5747b4eca3f56deaba23e3862aaf
Sep 16 12:01:09.371241 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:09.371206    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:01:09.379343 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:09.379323    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ptchc"]
Sep 16 12:01:09.382120 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:01:09.382098    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f5e5b43_7b68_4940_bba6_36238146b79d.slice/crio-cf8c523748c5f9cfdcc9488fe6c85821e917d8e49b1dbd2e9695dd0e0626a36a WatchSource:0}: Error finding container cf8c523748c5f9cfdcc9488fe6c85821e917d8e49b1dbd2e9695dd0e0626a36a: Status 404 returned error can't find the container with id cf8c523748c5f9cfdcc9488fe6c85821e917d8e49b1dbd2e9695dd0e0626a36a
Sep 16 12:01:09.431050 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:09.431024    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:01:09.476211 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:09.476183    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/895f0b5d-bd3c-4065-8681-43f68ef87d04-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-48mv7\" (UID: \"895f0b5d-bd3c-4065-8681-43f68ef87d04\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-48mv7"
Sep 16 12:01:09.476340 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:09.476227    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b153e4d5-33a6-4e3f-aa63-8aec2c778bb7-metrics-tls\") pod \"dns-default-bcrqz\" (UID: \"b153e4d5-33a6-4e3f-aa63-8aec2c778bb7\") " pod="openshift-dns/dns-default-bcrqz"
Sep 16 12:01:09.476340 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:09.476249    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3c5a71bb-e6d1-45d8-8872-4165a3aa09e2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-dk9qm\" (UID: \"3c5a71bb-e6d1-45d8-8872-4165a3aa09e2\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-dk9qm"
Sep 16 12:01:09.476340 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:09.476332    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 16 12:01:09.476459 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:09.476335    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 12:01:09.476459 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:09.476336    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 16 12:01:09.476459 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:09.476377    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c5a71bb-e6d1-45d8-8872-4165a3aa09e2-cluster-monitoring-operator-tls podName:3c5a71bb-e6d1-45d8-8872-4165a3aa09e2 nodeName:}" failed. No retries permitted until 2026-09-16 12:01:10.476364718 +0000 UTC m=+37.096684027 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3c5a71bb-e6d1-45d8-8872-4165a3aa09e2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-dk9qm" (UID: "3c5a71bb-e6d1-45d8-8872-4165a3aa09e2") : secret "cluster-monitoring-operator-tls" not found
Sep 16 12:01:09.476459 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:09.476418    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b153e4d5-33a6-4e3f-aa63-8aec2c778bb7-metrics-tls podName:b153e4d5-33a6-4e3f-aa63-8aec2c778bb7 nodeName:}" failed. No retries permitted until 2026-09-16 12:01:10.476404178 +0000 UTC m=+37.096723472 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b153e4d5-33a6-4e3f-aa63-8aec2c778bb7-metrics-tls") pod "dns-default-bcrqz" (UID: "b153e4d5-33a6-4e3f-aa63-8aec2c778bb7") : secret "dns-default-metrics-tls" not found
Sep 16 12:01:09.476459 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:09.476438    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/895f0b5d-bd3c-4065-8681-43f68ef87d04-networking-console-plugin-cert podName:895f0b5d-bd3c-4065-8681-43f68ef87d04 nodeName:}" failed. No retries permitted until 2026-09-16 12:01:10.476428624 +0000 UTC m=+37.096747921 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/895f0b5d-bd3c-4065-8681-43f68ef87d04-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-48mv7" (UID: "895f0b5d-bd3c-4065-8681-43f68ef87d04") : secret "networking-console-plugin-cert" not found
Sep 16 12:01:09.476638 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:09.476476    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c693f93f-7292-44cd-b745-8988a839dab9-registry-tls\") pod \"image-registry-85d4f6697c-9k6rn\" (UID: \"c693f93f-7292-44cd-b745-8988a839dab9\") " pod="openshift-image-registry/image-registry-85d4f6697c-9k6rn"
Sep 16 12:01:09.476638 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:09.476546    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 16 12:01:09.476638 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:09.476554    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85d4f6697c-9k6rn: secret "image-registry-tls" not found
Sep 16 12:01:09.476638 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:09.476581    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c693f93f-7292-44cd-b745-8988a839dab9-registry-tls podName:c693f93f-7292-44cd-b745-8988a839dab9 nodeName:}" failed. No retries permitted until 2026-09-16 12:01:10.47657465 +0000 UTC m=+37.096893944 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c693f93f-7292-44cd-b745-8988a839dab9-registry-tls") pod "image-registry-85d4f6697c-9k6rn" (UID: "c693f93f-7292-44cd-b745-8988a839dab9") : secret "image-registry-tls" not found
Sep 16 12:01:09.935735 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:09.935706    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rdgh"
Sep 16 12:01:09.935735 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:09.935728    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tsgc"
Sep 16 12:01:09.935952 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:09.935858    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tbc79"
Sep 16 12:01:09.939753 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:09.939627    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rfjm7\""
Sep 16 12:01:09.939753 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:09.939678    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 16 12:01:09.939952 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:09.939934    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 16 12:01:09.940005 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:09.939934    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 16 12:01:09.940005 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:09.939960    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 16 12:01:09.940005 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:09.939989    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hp2p6\""
Sep 16 12:01:10.110872 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:10.110642    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ptchc" event={"ID":"0f5e5b43-7b68-4940-bba6-36238146b79d","Type":"ContainerStarted","Data":"cf8c523748c5f9cfdcc9488fe6c85821e917d8e49b1dbd2e9695dd0e0626a36a"}
Sep 16 12:01:10.111937 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:10.111906    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-hrvzp" event={"ID":"63ee784a-3b40-4259-9923-74a24d0203a0","Type":"ContainerStarted","Data":"1cec111cc0dd0a1043efac91ed5bab129efa5747b4eca3f56deaba23e3862aaf"}
Sep 16 12:01:10.259646 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:10.259563    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:01:10.485252 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:10.485211    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c693f93f-7292-44cd-b745-8988a839dab9-registry-tls\") pod \"image-registry-85d4f6697c-9k6rn\" (UID: \"c693f93f-7292-44cd-b745-8988a839dab9\") " pod="openshift-image-registry/image-registry-85d4f6697c-9k6rn"
Sep 16 12:01:10.485440 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:10.485304    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/895f0b5d-bd3c-4065-8681-43f68ef87d04-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-48mv7\" (UID: \"895f0b5d-bd3c-4065-8681-43f68ef87d04\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-48mv7"
Sep 16 12:01:10.485440 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:10.485359    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b153e4d5-33a6-4e3f-aa63-8aec2c778bb7-metrics-tls\") pod \"dns-default-bcrqz\" (UID: \"b153e4d5-33a6-4e3f-aa63-8aec2c778bb7\") " pod="openshift-dns/dns-default-bcrqz"
Sep 16 12:01:10.485440 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:10.485389    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3c5a71bb-e6d1-45d8-8872-4165a3aa09e2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-dk9qm\" (UID: \"3c5a71bb-e6d1-45d8-8872-4165a3aa09e2\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-dk9qm"
Sep 16 12:01:10.485440 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:10.485398    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 16 12:01:10.485440 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:10.485418    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85d4f6697c-9k6rn: secret "image-registry-tls" not found
Sep 16 12:01:10.485693 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:10.485458    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 16 12:01:10.485693 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:10.485471    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c693f93f-7292-44cd-b745-8988a839dab9-registry-tls podName:c693f93f-7292-44cd-b745-8988a839dab9 nodeName:}" failed. No retries permitted until 2026-09-16 12:01:12.485454523 +0000 UTC m=+39.105773818 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c693f93f-7292-44cd-b745-8988a839dab9-registry-tls") pod "image-registry-85d4f6697c-9k6rn" (UID: "c693f93f-7292-44cd-b745-8988a839dab9") : secret "image-registry-tls" not found
Sep 16 12:01:10.485693 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:10.485504    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 12:01:10.485693 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:10.485465    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 16 12:01:10.485693 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:10.485525    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/895f0b5d-bd3c-4065-8681-43f68ef87d04-networking-console-plugin-cert podName:895f0b5d-bd3c-4065-8681-43f68ef87d04 nodeName:}" failed. No retries permitted until 2026-09-16 12:01:12.485504541 +0000 UTC m=+39.105823855 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/895f0b5d-bd3c-4065-8681-43f68ef87d04-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-48mv7" (UID: "895f0b5d-bd3c-4065-8681-43f68ef87d04") : secret "networking-console-plugin-cert" not found
Sep 16 12:01:10.485693 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:10.485578    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b153e4d5-33a6-4e3f-aa63-8aec2c778bb7-metrics-tls podName:b153e4d5-33a6-4e3f-aa63-8aec2c778bb7 nodeName:}" failed. No retries permitted until 2026-09-16 12:01:12.48556742 +0000 UTC m=+39.105886717 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b153e4d5-33a6-4e3f-aa63-8aec2c778bb7-metrics-tls") pod "dns-default-bcrqz" (UID: "b153e4d5-33a6-4e3f-aa63-8aec2c778bb7") : secret "dns-default-metrics-tls" not found
Sep 16 12:01:10.485693 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:10.485590    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c5a71bb-e6d1-45d8-8872-4165a3aa09e2-cluster-monitoring-operator-tls podName:3c5a71bb-e6d1-45d8-8872-4165a3aa09e2 nodeName:}" failed. No retries permitted until 2026-09-16 12:01:12.485583026 +0000 UTC m=+39.105902320 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3c5a71bb-e6d1-45d8-8872-4165a3aa09e2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-dk9qm" (UID: "3c5a71bb-e6d1-45d8-8872-4165a3aa09e2") : secret "cluster-monitoring-operator-tls" not found
Sep 16 12:01:11.095540 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:11.095499    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:01:12.120749 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:12.120611    2559 generic.go:356] "Generic (PLEG): container finished" podID="e0181d86-c266-426e-a18d-0f0241e252a9" containerID="93fe8b95c099aaad7e7741a25cc39c47e72d154b2017fe320ec39c7566a9d89f" exitCode=0
Sep 16 12:01:12.120749 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:12.120664    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-swz2v" event={"ID":"e0181d86-c266-426e-a18d-0f0241e252a9","Type":"ContainerDied","Data":"93fe8b95c099aaad7e7741a25cc39c47e72d154b2017fe320ec39c7566a9d89f"}
Sep 16 12:01:12.502800 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:12.502759    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b153e4d5-33a6-4e3f-aa63-8aec2c778bb7-metrics-tls\") pod \"dns-default-bcrqz\" (UID: \"b153e4d5-33a6-4e3f-aa63-8aec2c778bb7\") " pod="openshift-dns/dns-default-bcrqz"
Sep 16 12:01:12.502965 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:12.502810    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3c5a71bb-e6d1-45d8-8872-4165a3aa09e2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-dk9qm\" (UID: \"3c5a71bb-e6d1-45d8-8872-4165a3aa09e2\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-dk9qm"
Sep 16 12:01:12.502965 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:12.502857    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c693f93f-7292-44cd-b745-8988a839dab9-registry-tls\") pod \"image-registry-85d4f6697c-9k6rn\" (UID: \"c693f93f-7292-44cd-b745-8988a839dab9\") " pod="openshift-image-registry/image-registry-85d4f6697c-9k6rn"
Sep 16 12:01:12.502965 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:12.502943    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 12:01:12.503152 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:12.502987    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 16 12:01:12.503152 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:12.503004    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 16 12:01:12.503152 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:12.503021    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b153e4d5-33a6-4e3f-aa63-8aec2c778bb7-metrics-tls podName:b153e4d5-33a6-4e3f-aa63-8aec2c778bb7 nodeName:}" failed. No retries permitted until 2026-09-16 12:01:16.502999067 +0000 UTC m=+43.123318364 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b153e4d5-33a6-4e3f-aa63-8aec2c778bb7-metrics-tls") pod "dns-default-bcrqz" (UID: "b153e4d5-33a6-4e3f-aa63-8aec2c778bb7") : secret "dns-default-metrics-tls" not found
Sep 16 12:01:12.503152 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:12.503048    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c5a71bb-e6d1-45d8-8872-4165a3aa09e2-cluster-monitoring-operator-tls podName:3c5a71bb-e6d1-45d8-8872-4165a3aa09e2 nodeName:}" failed. No retries permitted until 2026-09-16 12:01:16.503030676 +0000 UTC m=+43.123349989 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3c5a71bb-e6d1-45d8-8872-4165a3aa09e2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-dk9qm" (UID: "3c5a71bb-e6d1-45d8-8872-4165a3aa09e2") : secret "cluster-monitoring-operator-tls" not found
Sep 16 12:01:12.503152 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:12.503070    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/895f0b5d-bd3c-4065-8681-43f68ef87d04-networking-console-plugin-cert podName:895f0b5d-bd3c-4065-8681-43f68ef87d04 nodeName:}" failed. No retries permitted until 2026-09-16 12:01:16.503058987 +0000 UTC m=+43.123378309 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/895f0b5d-bd3c-4065-8681-43f68ef87d04-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-48mv7" (UID: "895f0b5d-bd3c-4065-8681-43f68ef87d04") : secret "networking-console-plugin-cert" not found
Sep 16 12:01:12.503152 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:12.503076    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 16 12:01:12.503152 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:12.503087    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85d4f6697c-9k6rn: secret "image-registry-tls" not found
Sep 16 12:01:12.503152 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:12.503114    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c693f93f-7292-44cd-b745-8988a839dab9-registry-tls podName:c693f93f-7292-44cd-b745-8988a839dab9 nodeName:}" failed. No retries permitted until 2026-09-16 12:01:16.503107289 +0000 UTC m=+43.123426583 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c693f93f-7292-44cd-b745-8988a839dab9-registry-tls") pod "image-registry-85d4f6697c-9k6rn" (UID: "c693f93f-7292-44cd-b745-8988a839dab9") : secret "image-registry-tls" not found
Sep 16 12:01:12.503152 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:12.502947    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/895f0b5d-bd3c-4065-8681-43f68ef87d04-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-48mv7\" (UID: \"895f0b5d-bd3c-4065-8681-43f68ef87d04\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-48mv7"
Sep 16 12:01:12.849671 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:12.849583    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:01:13.127306 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:13.127225    2559 generic.go:356] "Generic (PLEG): container finished" podID="e0181d86-c266-426e-a18d-0f0241e252a9" containerID="66b1cedcb278e871a36e9125474d14ae8509ee98bc3d1502de5bb9a8af671bff" exitCode=0
Sep 16 12:01:13.127306 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:13.127298    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-swz2v" event={"ID":"e0181d86-c266-426e-a18d-0f0241e252a9","Type":"ContainerDied","Data":"66b1cedcb278e871a36e9125474d14ae8509ee98bc3d1502de5bb9a8af671bff"}
Sep 16 12:01:15.137274 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:15.137205    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-hrvzp_63ee784a-3b40-4259-9923-74a24d0203a0/console-operator/0.log"
Sep 16 12:01:15.137274 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:15.137244    2559 generic.go:356] "Generic (PLEG): container finished" podID="63ee784a-3b40-4259-9923-74a24d0203a0" containerID="f24ae618378448229711b979ef738c7744ce6db3061f5a3625e9981fed5151fb" exitCode=255
Sep 16 12:01:15.137754 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:15.137331    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-hrvzp" event={"ID":"63ee784a-3b40-4259-9923-74a24d0203a0","Type":"ContainerDied","Data":"f24ae618378448229711b979ef738c7744ce6db3061f5a3625e9981fed5151fb"}
Sep 16 12:01:15.137754 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:15.137519    2559 scope.go:117] "RemoveContainer" containerID="f24ae618378448229711b979ef738c7744ce6db3061f5a3625e9981fed5151fb"
Sep 16 12:01:15.138928 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:15.138904    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ptchc" event={"ID":"0f5e5b43-7b68-4940-bba6-36238146b79d","Type":"ContainerStarted","Data":"8ae80639f8a5d61f30752629eb54f7deea43f77ded3a6d64fec580dfed976fae"}
Sep 16 12:01:15.142222 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:15.142197    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-swz2v" event={"ID":"e0181d86-c266-426e-a18d-0f0241e252a9","Type":"ContainerStarted","Data":"2c1fef1d7ca008f6aca9bd0a9cd5b23bfea71b1e7e4ffd0f82fb600013ff78ba"}
Sep 16 12:01:15.178107 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:15.178060    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-swz2v" podStartSLOduration=9.736808463 podStartE2EDuration="41.178044914s" totalImagesPullingTime="31.441236451s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:00:34 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:01:15.176918034 +0000 UTC m=+41.797237350" watchObservedRunningTime="2026-09-16 12:01:15.178044914 +0000 UTC m=+41.798364229"
Sep 16 12:01:15.196339 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:15.196298    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ptchc" podStartSLOduration=1.924935641 podStartE2EDuration="7.196283779s" totalImagesPullingTime="5.271348138s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:01:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:01:15.196000406 +0000 UTC m=+41.816319725" watchObservedRunningTime="2026-09-16 12:01:15.196283779 +0000 UTC m=+41.816603094"
Sep 16 12:01:15.300940 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:15.300907    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:01:15.361454 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:15.361427    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:01:16.146596 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:16.146527    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-hrvzp_63ee784a-3b40-4259-9923-74a24d0203a0/console-operator/1.log"
Sep 16 12:01:16.146946 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:16.146908    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-hrvzp_63ee784a-3b40-4259-9923-74a24d0203a0/console-operator/0.log"
Sep 16 12:01:16.146997 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:16.146941    2559 generic.go:356] "Generic (PLEG): container finished" podID="63ee784a-3b40-4259-9923-74a24d0203a0" containerID="d43eb2de715caa82df9c491e1a1a9a8b3f2c266f7205191c02df323ae57d0039" exitCode=255
Sep 16 12:01:16.147053 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:16.147031    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-hrvzp" event={"ID":"63ee784a-3b40-4259-9923-74a24d0203a0","Type":"ContainerDied","Data":"d43eb2de715caa82df9c491e1a1a9a8b3f2c266f7205191c02df323ae57d0039"}
Sep 16 12:01:16.147100 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:16.147083    2559 scope.go:117] "RemoveContainer" containerID="f24ae618378448229711b979ef738c7744ce6db3061f5a3625e9981fed5151fb"
Sep 16 12:01:16.147307 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:16.147288    2559 scope.go:117] "RemoveContainer" containerID="d43eb2de715caa82df9c491e1a1a9a8b3f2c266f7205191c02df323ae57d0039"
Sep 16 12:01:16.147510 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:16.147479    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-hrvzp_openshift-console-operator(63ee784a-3b40-4259-9923-74a24d0203a0)\"" pod="openshift-console-operator/console-operator-696884fb9c-hrvzp" podUID="63ee784a-3b40-4259-9923-74a24d0203a0"
Sep 16 12:01:16.538485 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:16.538449    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c693f93f-7292-44cd-b745-8988a839dab9-registry-tls\") pod \"image-registry-85d4f6697c-9k6rn\" (UID: \"c693f93f-7292-44cd-b745-8988a839dab9\") " pod="openshift-image-registry/image-registry-85d4f6697c-9k6rn"
Sep 16 12:01:16.538662 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:16.538511    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/895f0b5d-bd3c-4065-8681-43f68ef87d04-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-48mv7\" (UID: \"895f0b5d-bd3c-4065-8681-43f68ef87d04\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-48mv7"
Sep 16 12:01:16.538662 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:16.538554    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b153e4d5-33a6-4e3f-aa63-8aec2c778bb7-metrics-tls\") pod \"dns-default-bcrqz\" (UID: \"b153e4d5-33a6-4e3f-aa63-8aec2c778bb7\") " pod="openshift-dns/dns-default-bcrqz"
Sep 16 12:01:16.538662 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:16.538574    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3c5a71bb-e6d1-45d8-8872-4165a3aa09e2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-dk9qm\" (UID: \"3c5a71bb-e6d1-45d8-8872-4165a3aa09e2\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-dk9qm"
Sep 16 12:01:16.538662 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:16.538616    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 16 12:01:16.538662 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:16.538636    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85d4f6697c-9k6rn: secret "image-registry-tls" not found
Sep 16 12:01:16.538921 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:16.538674    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 16 12:01:16.538921 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:16.538706    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c693f93f-7292-44cd-b745-8988a839dab9-registry-tls podName:c693f93f-7292-44cd-b745-8988a839dab9 nodeName:}" failed. No retries permitted until 2026-09-16 12:01:24.538683429 +0000 UTC m=+51.159002739 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c693f93f-7292-44cd-b745-8988a839dab9-registry-tls") pod "image-registry-85d4f6697c-9k6rn" (UID: "c693f93f-7292-44cd-b745-8988a839dab9") : secret "image-registry-tls" not found
Sep 16 12:01:16.538921 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:16.538728    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/895f0b5d-bd3c-4065-8681-43f68ef87d04-networking-console-plugin-cert podName:895f0b5d-bd3c-4065-8681-43f68ef87d04 nodeName:}" failed. No retries permitted until 2026-09-16 12:01:24.538719078 +0000 UTC m=+51.159038403 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/895f0b5d-bd3c-4065-8681-43f68ef87d04-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-48mv7" (UID: "895f0b5d-bd3c-4065-8681-43f68ef87d04") : secret "networking-console-plugin-cert" not found
Sep 16 12:01:16.538921 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:16.538674    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 16 12:01:16.538921 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:16.538677    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 12:01:16.538921 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:16.538833    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c5a71bb-e6d1-45d8-8872-4165a3aa09e2-cluster-monitoring-operator-tls podName:3c5a71bb-e6d1-45d8-8872-4165a3aa09e2 nodeName:}" failed. No retries permitted until 2026-09-16 12:01:24.538818143 +0000 UTC m=+51.159137442 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3c5a71bb-e6d1-45d8-8872-4165a3aa09e2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-dk9qm" (UID: "3c5a71bb-e6d1-45d8-8872-4165a3aa09e2") : secret "cluster-monitoring-operator-tls" not found
Sep 16 12:01:16.538921 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:16.538850    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b153e4d5-33a6-4e3f-aa63-8aec2c778bb7-metrics-tls podName:b153e4d5-33a6-4e3f-aa63-8aec2c778bb7 nodeName:}" failed. No retries permitted until 2026-09-16 12:01:24.538840192 +0000 UTC m=+51.159159502 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b153e4d5-33a6-4e3f-aa63-8aec2c778bb7-metrics-tls") pod "dns-default-bcrqz" (UID: "b153e4d5-33a6-4e3f-aa63-8aec2c778bb7") : secret "dns-default-metrics-tls" not found
Sep 16 12:01:17.150611 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:17.150582    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-hrvzp_63ee784a-3b40-4259-9923-74a24d0203a0/console-operator/1.log"
Sep 16 12:01:17.150996 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:17.150889    2559 scope.go:117] "RemoveContainer" containerID="d43eb2de715caa82df9c491e1a1a9a8b3f2c266f7205191c02df323ae57d0039"
Sep 16 12:01:17.151045 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:17.151031    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-hrvzp_openshift-console-operator(63ee784a-3b40-4259-9923-74a24d0203a0)\"" pod="openshift-console-operator/console-operator-696884fb9c-hrvzp" podUID="63ee784a-3b40-4259-9923-74a24d0203a0"
Sep 16 12:01:19.008069 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:19.008027    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-hrvzp"
Sep 16 12:01:19.008656 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:19.008124    2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-hrvzp"
Sep 16 12:01:19.008656 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:19.008546    2559 scope.go:117] "RemoveContainer" containerID="d43eb2de715caa82df9c491e1a1a9a8b3f2c266f7205191c02df323ae57d0039"
Sep 16 12:01:19.008798 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:19.008774    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-hrvzp_openshift-console-operator(63ee784a-3b40-4259-9923-74a24d0203a0)\"" pod="openshift-console-operator/console-operator-696884fb9c-hrvzp" podUID="63ee784a-3b40-4259-9923-74a24d0203a0"
Sep 16 12:01:20.523401 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:20.523363    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:01:20.623600 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:20.623568    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:01:21.390955 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:21.390927    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:01:21.451258 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:21.451211    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:01:22.556398 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:22.556365    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:01:22.619758 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:22.619730    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:01:23.519644 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:23.519613    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:01:23.613532 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:23.613504    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:01:24.605598 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:24.605564    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b153e4d5-33a6-4e3f-aa63-8aec2c778bb7-metrics-tls\") pod \"dns-default-bcrqz\" (UID: \"b153e4d5-33a6-4e3f-aa63-8aec2c778bb7\") " pod="openshift-dns/dns-default-bcrqz"
Sep 16 12:01:24.605598 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:24.605600    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3c5a71bb-e6d1-45d8-8872-4165a3aa09e2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-dk9qm\" (UID: \"3c5a71bb-e6d1-45d8-8872-4165a3aa09e2\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-dk9qm"
Sep 16 12:01:24.605812 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:24.605640    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c693f93f-7292-44cd-b745-8988a839dab9-registry-tls\") pod \"image-registry-85d4f6697c-9k6rn\" (UID: \"c693f93f-7292-44cd-b745-8988a839dab9\") " pod="openshift-image-registry/image-registry-85d4f6697c-9k6rn"
Sep 16 12:01:24.605812 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:24.605688    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/895f0b5d-bd3c-4065-8681-43f68ef87d04-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-48mv7\" (UID: \"895f0b5d-bd3c-4065-8681-43f68ef87d04\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-48mv7"
Sep 16 12:01:24.605812 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:24.605752    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 12:01:24.605812 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:24.605767    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 16 12:01:24.605812 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:24.605798    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 16 12:01:24.605812 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:24.605812    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85d4f6697c-9k6rn: secret "image-registry-tls" not found
Sep 16 12:01:24.605984 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:24.605824    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b153e4d5-33a6-4e3f-aa63-8aec2c778bb7-metrics-tls podName:b153e4d5-33a6-4e3f-aa63-8aec2c778bb7 nodeName:}" failed. No retries permitted until 2026-09-16 12:01:40.605808054 +0000 UTC m=+67.226127351 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b153e4d5-33a6-4e3f-aa63-8aec2c778bb7-metrics-tls") pod "dns-default-bcrqz" (UID: "b153e4d5-33a6-4e3f-aa63-8aec2c778bb7") : secret "dns-default-metrics-tls" not found
Sep 16 12:01:24.605984 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:24.605752    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 16 12:01:24.605984 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:24.605841    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/895f0b5d-bd3c-4065-8681-43f68ef87d04-networking-console-plugin-cert podName:895f0b5d-bd3c-4065-8681-43f68ef87d04 nodeName:}" failed. No retries permitted until 2026-09-16 12:01:40.605834858 +0000 UTC m=+67.226154151 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/895f0b5d-bd3c-4065-8681-43f68ef87d04-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-48mv7" (UID: "895f0b5d-bd3c-4065-8681-43f68ef87d04") : secret "networking-console-plugin-cert" not found
Sep 16 12:01:24.605984 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:24.605882    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c693f93f-7292-44cd-b745-8988a839dab9-registry-tls podName:c693f93f-7292-44cd-b745-8988a839dab9 nodeName:}" failed. No retries permitted until 2026-09-16 12:01:40.605868891 +0000 UTC m=+67.226188200 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c693f93f-7292-44cd-b745-8988a839dab9-registry-tls") pod "image-registry-85d4f6697c-9k6rn" (UID: "c693f93f-7292-44cd-b745-8988a839dab9") : secret "image-registry-tls" not found
Sep 16 12:01:24.605984 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:24.605903    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c5a71bb-e6d1-45d8-8872-4165a3aa09e2-cluster-monitoring-operator-tls podName:3c5a71bb-e6d1-45d8-8872-4165a3aa09e2 nodeName:}" failed. No retries permitted until 2026-09-16 12:01:40.605893707 +0000 UTC m=+67.226213005 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3c5a71bb-e6d1-45d8-8872-4165a3aa09e2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-dk9qm" (UID: "3c5a71bb-e6d1-45d8-8872-4165a3aa09e2") : secret "cluster-monitoring-operator-tls" not found
Sep 16 12:01:32.932075 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:32.932041    2559 scope.go:117] "RemoveContainer" containerID="d43eb2de715caa82df9c491e1a1a9a8b3f2c266f7205191c02df323ae57d0039"
Sep 16 12:01:33.099794 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:33.099769    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vjkjn"
Sep 16 12:01:33.189733 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:33.189646    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-hrvzp_63ee784a-3b40-4259-9923-74a24d0203a0/console-operator/2.log"
Sep 16 12:01:33.190095 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:33.190079    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-hrvzp_63ee784a-3b40-4259-9923-74a24d0203a0/console-operator/1.log"
Sep 16 12:01:33.190161 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:33.190111    2559 generic.go:356] "Generic (PLEG): container finished" podID="63ee784a-3b40-4259-9923-74a24d0203a0" containerID="406bb222b7819107e79b016a83cc776d671c4f8ad04b25f80963bc225bc1d15e" exitCode=255
Sep 16 12:01:33.190194 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:33.190167    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-hrvzp" event={"ID":"63ee784a-3b40-4259-9923-74a24d0203a0","Type":"ContainerDied","Data":"406bb222b7819107e79b016a83cc776d671c4f8ad04b25f80963bc225bc1d15e"}
Sep 16 12:01:33.190233 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:33.190227    2559 scope.go:117] "RemoveContainer" containerID="d43eb2de715caa82df9c491e1a1a9a8b3f2c266f7205191c02df323ae57d0039"
Sep 16 12:01:33.190494 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:33.190479    2559 scope.go:117] "RemoveContainer" containerID="406bb222b7819107e79b016a83cc776d671c4f8ad04b25f80963bc225bc1d15e"
Sep 16 12:01:33.190655 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:33.190638    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-696884fb9c-hrvzp_openshift-console-operator(63ee784a-3b40-4259-9923-74a24d0203a0)\"" pod="openshift-console-operator/console-operator-696884fb9c-hrvzp" podUID="63ee784a-3b40-4259-9923-74a24d0203a0"
Sep 16 12:01:33.249366 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:33.249329    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:01:33.324011 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:33.323975    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:01:34.194516 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:34.194484    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-hrvzp_63ee784a-3b40-4259-9923-74a24d0203a0/console-operator/2.log"
Sep 16 12:01:38.612480 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:38.612441    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e261eb8b-bfaa-491d-afbe-6eb8fbc57324-metrics-certs\") pod \"network-metrics-daemon-6tsgc\" (UID: \"e261eb8b-bfaa-491d-afbe-6eb8fbc57324\") " pod="openshift-multus/network-metrics-daemon-6tsgc"
Sep 16 12:01:38.612932 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:38.612505    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/28222687-d3b4-4c0c-81f3-cc24fdc912e8-original-pull-secret\") pod \"global-pull-secret-syncer-tbc79\" (UID: \"28222687-d3b4-4c0c-81f3-cc24fdc912e8\") " pod="kube-system/global-pull-secret-syncer-tbc79"
Sep 16 12:01:38.615501 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:38.615479    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 16 12:01:38.615553 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:38.615493    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 16 12:01:38.623703 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:38.623681    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 16 12:01:38.623784 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:38.623752    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e261eb8b-bfaa-491d-afbe-6eb8fbc57324-metrics-certs podName:e261eb8b-bfaa-491d-afbe-6eb8fbc57324 nodeName:}" failed. No retries permitted until 2026-09-16 12:02:42.623731264 +0000 UTC m=+129.244050571 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e261eb8b-bfaa-491d-afbe-6eb8fbc57324-metrics-certs") pod "network-metrics-daemon-6tsgc" (UID: "e261eb8b-bfaa-491d-afbe-6eb8fbc57324") : secret "metrics-daemon-secret" not found
Sep 16 12:01:38.626501 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:38.626483    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/28222687-d3b4-4c0c-81f3-cc24fdc912e8-original-pull-secret\") pod \"global-pull-secret-syncer-tbc79\" (UID: \"28222687-d3b4-4c0c-81f3-cc24fdc912e8\") " pod="kube-system/global-pull-secret-syncer-tbc79"
Sep 16 12:01:38.760297 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:38.760246    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tbc79"
Sep 16 12:01:38.814569 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:38.814541    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsjjz\" (UniqueName: \"kubernetes.io/projected/c334b0e3-888b-49a6-beae-f40e40caa548-kube-api-access-tsjjz\") pod \"network-check-target-2rdgh\" (UID: \"c334b0e3-888b-49a6-beae-f40e40caa548\") " pod="openshift-network-diagnostics/network-check-target-2rdgh"
Sep 16 12:01:38.817857 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:38.817836    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 16 12:01:38.827867 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:38.827844    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 16 12:01:38.837404 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:38.837385    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsjjz\" (UniqueName: \"kubernetes.io/projected/c334b0e3-888b-49a6-beae-f40e40caa548-kube-api-access-tsjjz\") pod \"network-check-target-2rdgh\" (UID: \"c334b0e3-888b-49a6-beae-f40e40caa548\") " pod="openshift-network-diagnostics/network-check-target-2rdgh"
Sep 16 12:01:39.007482 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:39.007436    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-hrvzp"
Sep 16 12:01:39.007642 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:39.007509    2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-hrvzp"
Sep 16 12:01:39.007823 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:39.007811    2559 scope.go:117] "RemoveContainer" containerID="406bb222b7819107e79b016a83cc776d671c4f8ad04b25f80963bc225bc1d15e"
Sep 16 12:01:39.007983 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:39.007964    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-696884fb9c-hrvzp_openshift-console-operator(63ee784a-3b40-4259-9923-74a24d0203a0)\"" pod="openshift-console-operator/console-operator-696884fb9c-hrvzp" podUID="63ee784a-3b40-4259-9923-74a24d0203a0"
Sep 16 12:01:39.029834 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:39.029806    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tbc79"]
Sep 16 12:01:39.032758 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:01:39.032731    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28222687_d3b4_4c0c_81f3_cc24fdc912e8.slice/crio-7ff4af5d790fa880a72e79db53b0e255a3e921154c4adce3274baba3c43ea427 WatchSource:0}: Error finding container 7ff4af5d790fa880a72e79db53b0e255a3e921154c4adce3274baba3c43ea427: Status 404 returned error can't find the container with id 7ff4af5d790fa880a72e79db53b0e255a3e921154c4adce3274baba3c43ea427
Sep 16 12:01:39.050426 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:39.050378    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rfjm7\""
Sep 16 12:01:39.057951 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:39.057927    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rdgh"
Sep 16 12:01:39.207788 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:39.207753    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tbc79" event={"ID":"28222687-d3b4-4c0c-81f3-cc24fdc912e8","Type":"ContainerStarted","Data":"7ff4af5d790fa880a72e79db53b0e255a3e921154c4adce3274baba3c43ea427"}
Sep 16 12:01:39.321101 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:39.321079    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2rdgh"]
Sep 16 12:01:39.323216 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:01:39.323191    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc334b0e3_888b_49a6_beae_f40e40caa548.slice/crio-9c67ed843625fe2e451085265ff198f650a8079ae9759e39626cd138933a2e7c WatchSource:0}: Error finding container 9c67ed843625fe2e451085265ff198f650a8079ae9759e39626cd138933a2e7c: Status 404 returned error can't find the container with id 9c67ed843625fe2e451085265ff198f650a8079ae9759e39626cd138933a2e7c
Sep 16 12:01:40.216748 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:40.216701    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2rdgh" event={"ID":"c334b0e3-888b-49a6-beae-f40e40caa548","Type":"ContainerStarted","Data":"9c67ed843625fe2e451085265ff198f650a8079ae9759e39626cd138933a2e7c"}
Sep 16 12:01:40.630737 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:40.630651    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b153e4d5-33a6-4e3f-aa63-8aec2c778bb7-metrics-tls\") pod \"dns-default-bcrqz\" (UID: \"b153e4d5-33a6-4e3f-aa63-8aec2c778bb7\") " pod="openshift-dns/dns-default-bcrqz"
Sep 16 12:01:40.630737 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:40.630701    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3c5a71bb-e6d1-45d8-8872-4165a3aa09e2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-dk9qm\" (UID: \"3c5a71bb-e6d1-45d8-8872-4165a3aa09e2\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-dk9qm"
Sep 16 12:01:40.630958 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:40.630749    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c693f93f-7292-44cd-b745-8988a839dab9-registry-tls\") pod \"image-registry-85d4f6697c-9k6rn\" (UID: \"c693f93f-7292-44cd-b745-8988a839dab9\") " pod="openshift-image-registry/image-registry-85d4f6697c-9k6rn"
Sep 16 12:01:40.630958 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:40.630807    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/895f0b5d-bd3c-4065-8681-43f68ef87d04-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-48mv7\" (UID: \"895f0b5d-bd3c-4065-8681-43f68ef87d04\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-48mv7"
Sep 16 12:01:40.630958 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:40.630825    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 12:01:40.630958 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:40.630859    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 16 12:01:40.630958 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:40.630915    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b153e4d5-33a6-4e3f-aa63-8aec2c778bb7-metrics-tls podName:b153e4d5-33a6-4e3f-aa63-8aec2c778bb7 nodeName:}" failed. No retries permitted until 2026-09-16 12:02:12.630894938 +0000 UTC m=+99.251214240 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b153e4d5-33a6-4e3f-aa63-8aec2c778bb7-metrics-tls") pod "dns-default-bcrqz" (UID: "b153e4d5-33a6-4e3f-aa63-8aec2c778bb7") : secret "dns-default-metrics-tls" not found
Sep 16 12:01:40.630958 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:40.630920    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 16 12:01:40.630958 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:40.630930    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c5a71bb-e6d1-45d8-8872-4165a3aa09e2-cluster-monitoring-operator-tls podName:3c5a71bb-e6d1-45d8-8872-4165a3aa09e2 nodeName:}" failed. No retries permitted until 2026-09-16 12:02:12.630924506 +0000 UTC m=+99.251243799 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3c5a71bb-e6d1-45d8-8872-4165a3aa09e2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-dk9qm" (UID: "3c5a71bb-e6d1-45d8-8872-4165a3aa09e2") : secret "cluster-monitoring-operator-tls" not found
Sep 16 12:01:40.631268 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:40.630970    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 16 12:01:40.631268 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:40.630984    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/895f0b5d-bd3c-4065-8681-43f68ef87d04-networking-console-plugin-cert podName:895f0b5d-bd3c-4065-8681-43f68ef87d04 nodeName:}" failed. No retries permitted until 2026-09-16 12:02:12.630967365 +0000 UTC m=+99.251286683 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/895f0b5d-bd3c-4065-8681-43f68ef87d04-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-48mv7" (UID: "895f0b5d-bd3c-4065-8681-43f68ef87d04") : secret "networking-console-plugin-cert" not found
Sep 16 12:01:40.631268 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:40.630991    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85d4f6697c-9k6rn: secret "image-registry-tls" not found
Sep 16 12:01:40.631268 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:40.631057    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c693f93f-7292-44cd-b745-8988a839dab9-registry-tls podName:c693f93f-7292-44cd-b745-8988a839dab9 nodeName:}" failed. No retries permitted until 2026-09-16 12:02:12.631039987 +0000 UTC m=+99.251359284 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c693f93f-7292-44cd-b745-8988a839dab9-registry-tls") pod "image-registry-85d4f6697c-9k6rn" (UID: "c693f93f-7292-44cd-b745-8988a839dab9") : secret "image-registry-tls" not found
Sep 16 12:01:42.533407 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:42.533370    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:01:43.203463 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:43.203434    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:01:44.364147 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:44.364108    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:01:45.188186 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:45.188147    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:01:45.230465 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:45.230432    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2rdgh" event={"ID":"c334b0e3-888b-49a6-beae-f40e40caa548","Type":"ContainerStarted","Data":"c81e883cff286ca67e51dfc18ef2fffd18290a6247fc3cf79ae0a818a3bc19f7"}
Sep 16 12:01:45.230612 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:45.230553    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-2rdgh"
Sep 16 12:01:45.231963 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:45.231938    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tbc79" event={"ID":"28222687-d3b4-4c0c-81f3-cc24fdc912e8","Type":"ContainerStarted","Data":"0427faec2d8f629cc7e0448abbb1b4efa911439c896a0c15eceacbf4e43635bc"}
Sep 16 12:01:45.246571 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:45.246502    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-2rdgh" podStartSLOduration=66.140201467 podStartE2EDuration="1m11.246489508s" totalImagesPullingTime="5.106288041s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:00:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:01:45.245748272 +0000 UTC m=+71.866067588" watchObservedRunningTime="2026-09-16 12:01:45.246489508 +0000 UTC m=+71.866808849"
Sep 16 12:01:45.261497 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:45.261451    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-tbc79" podStartSLOduration=65.873473841 podStartE2EDuration="1m11.261434882s" totalImagesPullingTime="5.387961041s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:00:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:01:45.260423928 +0000 UTC m=+71.880743246" watchObservedRunningTime="2026-09-16 12:01:45.261434882 +0000 UTC m=+71.881754197"
Sep 16 12:01:45.269183 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:45.269157    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:01:49.600486 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:49.600452    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:01:49.658886 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:49.658856    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:01:53.933044 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:53.933012    2559 scope.go:117] "RemoveContainer" containerID="406bb222b7819107e79b016a83cc776d671c4f8ad04b25f80963bc225bc1d15e"
Sep 16 12:01:54.255832 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:54.255758    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-hrvzp_63ee784a-3b40-4259-9923-74a24d0203a0/console-operator/3.log"
Sep 16 12:01:54.256213 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:54.256199    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-hrvzp_63ee784a-3b40-4259-9923-74a24d0203a0/console-operator/2.log"
Sep 16 12:01:54.256272 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:54.256231    2559 generic.go:356] "Generic (PLEG): container finished" podID="63ee784a-3b40-4259-9923-74a24d0203a0" containerID="ff2a87efe47610262242e952d2ee833bbdf57eab5c1258c8bb61fc336bfec69e" exitCode=255
Sep 16 12:01:54.256272 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:54.256261    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-hrvzp" event={"ID":"63ee784a-3b40-4259-9923-74a24d0203a0","Type":"ContainerDied","Data":"ff2a87efe47610262242e952d2ee833bbdf57eab5c1258c8bb61fc336bfec69e"}
Sep 16 12:01:54.256348 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:54.256302    2559 scope.go:117] "RemoveContainer" containerID="406bb222b7819107e79b016a83cc776d671c4f8ad04b25f80963bc225bc1d15e"
Sep 16 12:01:54.256600 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:54.256582    2559 scope.go:117] "RemoveContainer" containerID="ff2a87efe47610262242e952d2ee833bbdf57eab5c1258c8bb61fc336bfec69e"
Sep 16 12:01:54.256792 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:54.256772    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 40s restarting failed container=console-operator pod=console-operator-696884fb9c-hrvzp_openshift-console-operator(63ee784a-3b40-4259-9923-74a24d0203a0)\"" pod="openshift-console-operator/console-operator-696884fb9c-hrvzp" podUID="63ee784a-3b40-4259-9923-74a24d0203a0"
Sep 16 12:01:55.260599 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:55.260571    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-hrvzp_63ee784a-3b40-4259-9923-74a24d0203a0/console-operator/3.log"
Sep 16 12:01:59.007531 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:59.007409    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-hrvzp"
Sep 16 12:01:59.007921 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:59.007540    2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-hrvzp"
Sep 16 12:01:59.007921 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:59.007770    2559 scope.go:117] "RemoveContainer" containerID="ff2a87efe47610262242e952d2ee833bbdf57eab5c1258c8bb61fc336bfec69e"
Sep 16 12:01:59.008002 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:59.007919    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 40s restarting failed container=console-operator pod=console-operator-696884fb9c-hrvzp_openshift-console-operator(63ee784a-3b40-4259-9923-74a24d0203a0)\"" pod="openshift-console-operator/console-operator-696884fb9c-hrvzp" podUID="63ee784a-3b40-4259-9923-74a24d0203a0"
Sep 16 12:01:59.270620 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:01:59.270547    2559 scope.go:117] "RemoveContainer" containerID="ff2a87efe47610262242e952d2ee833bbdf57eab5c1258c8bb61fc336bfec69e"
Sep 16 12:01:59.270755 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:01:59.270708    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 40s restarting failed container=console-operator pod=console-operator-696884fb9c-hrvzp_openshift-console-operator(63ee784a-3b40-4259-9923-74a24d0203a0)\"" pod="openshift-console-operator/console-operator-696884fb9c-hrvzp" podUID="63ee784a-3b40-4259-9923-74a24d0203a0"
Sep 16 12:02:10.932224 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:02:10.932188    2559 scope.go:117] "RemoveContainer" containerID="ff2a87efe47610262242e952d2ee833bbdf57eab5c1258c8bb61fc336bfec69e"
Sep 16 12:02:10.932784 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:02:10.932407    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 40s restarting failed container=console-operator pod=console-operator-696884fb9c-hrvzp_openshift-console-operator(63ee784a-3b40-4259-9923-74a24d0203a0)\"" pod="openshift-console-operator/console-operator-696884fb9c-hrvzp" podUID="63ee784a-3b40-4259-9923-74a24d0203a0"
Sep 16 12:02:12.148726 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:02:12.148693    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:02:12.208463 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:02:12.208434    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:02:12.685858 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:02:12.685819    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c693f93f-7292-44cd-b745-8988a839dab9-registry-tls\") pod \"image-registry-85d4f6697c-9k6rn\" (UID: \"c693f93f-7292-44cd-b745-8988a839dab9\") " pod="openshift-image-registry/image-registry-85d4f6697c-9k6rn"
Sep 16 12:02:12.686037 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:02:12.685892    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/895f0b5d-bd3c-4065-8681-43f68ef87d04-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-48mv7\" (UID: \"895f0b5d-bd3c-4065-8681-43f68ef87d04\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-48mv7"
Sep 16 12:02:12.686037 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:02:12.685937    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b153e4d5-33a6-4e3f-aa63-8aec2c778bb7-metrics-tls\") pod \"dns-default-bcrqz\" (UID: \"b153e4d5-33a6-4e3f-aa63-8aec2c778bb7\") " pod="openshift-dns/dns-default-bcrqz"
Sep 16 12:02:12.686037 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:02:12.685981    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3c5a71bb-e6d1-45d8-8872-4165a3aa09e2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-dk9qm\" (UID: \"3c5a71bb-e6d1-45d8-8872-4165a3aa09e2\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-dk9qm"
Sep 16 12:02:12.686212 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:02:12.685983    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 16 12:02:12.686212 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:02:12.686044    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 16 12:02:12.686212 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:02:12.686051    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85d4f6697c-9k6rn: secret "image-registry-tls" not found
Sep 16 12:02:12.686212 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:02:12.686075    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 12:02:12.686212 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:02:12.686112    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c5a71bb-e6d1-45d8-8872-4165a3aa09e2-cluster-monitoring-operator-tls podName:3c5a71bb-e6d1-45d8-8872-4165a3aa09e2 nodeName:}" failed. No retries permitted until 2026-09-16 12:03:16.686097041 +0000 UTC m=+163.306416348 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3c5a71bb-e6d1-45d8-8872-4165a3aa09e2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-dk9qm" (UID: "3c5a71bb-e6d1-45d8-8872-4165a3aa09e2") : secret "cluster-monitoring-operator-tls" not found
Sep 16 12:02:12.686212 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:02:12.686145    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c693f93f-7292-44cd-b745-8988a839dab9-registry-tls podName:c693f93f-7292-44cd-b745-8988a839dab9 nodeName:}" failed. No retries permitted until 2026-09-16 12:03:16.686123015 +0000 UTC m=+163.306442308 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c693f93f-7292-44cd-b745-8988a839dab9-registry-tls") pod "image-registry-85d4f6697c-9k6rn" (UID: "c693f93f-7292-44cd-b745-8988a839dab9") : secret "image-registry-tls" not found
Sep 16 12:02:12.686212 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:02:12.686148    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 16 12:02:12.686212 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:02:12.686161    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b153e4d5-33a6-4e3f-aa63-8aec2c778bb7-metrics-tls podName:b153e4d5-33a6-4e3f-aa63-8aec2c778bb7 nodeName:}" failed. No retries permitted until 2026-09-16 12:03:16.686152358 +0000 UTC m=+163.306471661 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b153e4d5-33a6-4e3f-aa63-8aec2c778bb7-metrics-tls") pod "dns-default-bcrqz" (UID: "b153e4d5-33a6-4e3f-aa63-8aec2c778bb7") : secret "dns-default-metrics-tls" not found
Sep 16 12:02:12.686212 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:02:12.686214    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/895f0b5d-bd3c-4065-8681-43f68ef87d04-networking-console-plugin-cert podName:895f0b5d-bd3c-4065-8681-43f68ef87d04 nodeName:}" failed. No retries permitted until 2026-09-16 12:03:16.686200027 +0000 UTC m=+163.306519326 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/895f0b5d-bd3c-4065-8681-43f68ef87d04-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-48mv7" (UID: "895f0b5d-bd3c-4065-8681-43f68ef87d04") : secret "networking-console-plugin-cert" not found
Sep 16 12:02:16.237336 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:02:16.237311    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-2rdgh"
Sep 16 12:02:25.932083 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:02:25.932049    2559 scope.go:117] "RemoveContainer" containerID="ff2a87efe47610262242e952d2ee833bbdf57eab5c1258c8bb61fc336bfec69e"
Sep 16 12:02:25.932548 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:02:25.932234    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 40s restarting failed container=console-operator pod=console-operator-696884fb9c-hrvzp_openshift-console-operator(63ee784a-3b40-4259-9923-74a24d0203a0)\"" pod="openshift-console-operator/console-operator-696884fb9c-hrvzp" podUID="63ee784a-3b40-4259-9923-74a24d0203a0"
Sep 16 12:02:37.932747 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:02:37.932717    2559 scope.go:117] "RemoveContainer" containerID="ff2a87efe47610262242e952d2ee833bbdf57eab5c1258c8bb61fc336bfec69e"
Sep 16 12:02:38.363381 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:02:38.363309    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-hrvzp_63ee784a-3b40-4259-9923-74a24d0203a0/console-operator/4.log"
Sep 16 12:02:38.363710 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:02:38.363696    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-hrvzp_63ee784a-3b40-4259-9923-74a24d0203a0/console-operator/3.log"
Sep 16 12:02:38.363758 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:02:38.363727    2559 generic.go:356] "Generic (PLEG): container finished" podID="63ee784a-3b40-4259-9923-74a24d0203a0" containerID="1db64358c0a86fc932c7aaecb8c376b2b154f1bb273b505eca4e7c41df5197d1" exitCode=255
Sep 16 12:02:38.363792 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:02:38.363763    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-hrvzp" event={"ID":"63ee784a-3b40-4259-9923-74a24d0203a0","Type":"ContainerDied","Data":"1db64358c0a86fc932c7aaecb8c376b2b154f1bb273b505eca4e7c41df5197d1"}
Sep 16 12:02:38.363835 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:02:38.363807    2559 scope.go:117] "RemoveContainer" containerID="ff2a87efe47610262242e952d2ee833bbdf57eab5c1258c8bb61fc336bfec69e"
Sep 16 12:02:38.364101 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:02:38.364081    2559 scope.go:117] "RemoveContainer" containerID="1db64358c0a86fc932c7aaecb8c376b2b154f1bb273b505eca4e7c41df5197d1"
Sep 16 12:02:38.364264 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:02:38.364247    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=console-operator pod=console-operator-696884fb9c-hrvzp_openshift-console-operator(63ee784a-3b40-4259-9923-74a24d0203a0)\"" pod="openshift-console-operator/console-operator-696884fb9c-hrvzp" podUID="63ee784a-3b40-4259-9923-74a24d0203a0"
Sep 16 12:02:39.007744 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:02:39.007693    2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-hrvzp"
Sep 16 12:02:39.007744 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:02:39.007759    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-hrvzp"
Sep 16 12:02:39.367511 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:02:39.367426    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-hrvzp_63ee784a-3b40-4259-9923-74a24d0203a0/console-operator/4.log"
Sep 16 12:02:39.367753 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:02:39.367738    2559 scope.go:117] "RemoveContainer" containerID="1db64358c0a86fc932c7aaecb8c376b2b154f1bb273b505eca4e7c41df5197d1"
Sep 16 12:02:39.367898 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:02:39.367881    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=console-operator pod=console-operator-696884fb9c-hrvzp_openshift-console-operator(63ee784a-3b40-4259-9923-74a24d0203a0)\"" pod="openshift-console-operator/console-operator-696884fb9c-hrvzp" podUID="63ee784a-3b40-4259-9923-74a24d0203a0"
Sep 16 12:02:42.711123 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:02:42.711065    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e261eb8b-bfaa-491d-afbe-6eb8fbc57324-metrics-certs\") pod \"network-metrics-daemon-6tsgc\" (UID: \"e261eb8b-bfaa-491d-afbe-6eb8fbc57324\") " pod="openshift-multus/network-metrics-daemon-6tsgc"
Sep 16 12:02:42.711629 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:02:42.711243    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 16 12:02:42.711629 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:02:42.711306    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e261eb8b-bfaa-491d-afbe-6eb8fbc57324-metrics-certs podName:e261eb8b-bfaa-491d-afbe-6eb8fbc57324 nodeName:}" failed. No retries permitted until 2026-09-16 12:04:44.711290625 +0000 UTC m=+251.331609919 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e261eb8b-bfaa-491d-afbe-6eb8fbc57324-metrics-certs") pod "network-metrics-daemon-6tsgc" (UID: "e261eb8b-bfaa-491d-afbe-6eb8fbc57324") : secret "metrics-daemon-secret" not found
Sep 16 12:02:52.931912 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:02:52.931878    2559 scope.go:117] "RemoveContainer" containerID="1db64358c0a86fc932c7aaecb8c376b2b154f1bb273b505eca4e7c41df5197d1"
Sep 16 12:02:52.932307 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:02:52.932036    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=console-operator pod=console-operator-696884fb9c-hrvzp_openshift-console-operator(63ee784a-3b40-4259-9923-74a24d0203a0)\"" pod="openshift-console-operator/console-operator-696884fb9c-hrvzp" podUID="63ee784a-3b40-4259-9923-74a24d0203a0"
Sep 16 12:02:58.727301 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:02:58.727265    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:03:06.932122 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:03:06.932088    2559 scope.go:117] "RemoveContainer" containerID="1db64358c0a86fc932c7aaecb8c376b2b154f1bb273b505eca4e7c41df5197d1"
Sep 16 12:03:06.932511 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:03:06.932266    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=console-operator pod=console-operator-696884fb9c-hrvzp_openshift-console-operator(63ee784a-3b40-4259-9923-74a24d0203a0)\"" pod="openshift-console-operator/console-operator-696884fb9c-hrvzp" podUID="63ee784a-3b40-4259-9923-74a24d0203a0"
Sep 16 12:03:11.728160 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:03:11.728104    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[cluster-monitoring-operator-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-dk9qm" podUID="3c5a71bb-e6d1-45d8-8872-4165a3aa09e2"
Sep 16 12:03:11.755528 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:03:11.755494    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-85d4f6697c-9k6rn" podUID="c693f93f-7292-44cd-b745-8988a839dab9"
Sep 16 12:03:11.770665 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:03:11.770635    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-bcrqz" podUID="b153e4d5-33a6-4e3f-aa63-8aec2c778bb7"
Sep 16 12:03:11.800096 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:03:11.800069    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-48mv7" podUID="895f0b5d-bd3c-4065-8681-43f68ef87d04"
Sep 16 12:03:12.447697 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:03:12.447621    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85d4f6697c-9k6rn"
Sep 16 12:03:12.447697 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:03:12.447635    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bcrqz"
Sep 16 12:03:12.447697 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:03:12.447621    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-48mv7"
Sep 16 12:03:12.447962 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:03:12.447621    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-dk9qm"
Sep 16 12:03:12.953854 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:03:12.953815    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-6tsgc" podUID="e261eb8b-bfaa-491d-afbe-6eb8fbc57324"
Sep 16 12:03:13.587327 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:03:13.587294    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:03:16.762006 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:03:16.761964    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c693f93f-7292-44cd-b745-8988a839dab9-registry-tls\") pod \"image-registry-85d4f6697c-9k6rn\" (UID: \"c693f93f-7292-44cd-b745-8988a839dab9\") " pod="openshift-image-registry/image-registry-85d4f6697c-9k6rn"
Sep 16 12:03:16.762485 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:03:16.762028    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/895f0b5d-bd3c-4065-8681-43f68ef87d04-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-48mv7\" (UID: \"895f0b5d-bd3c-4065-8681-43f68ef87d04\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-48mv7"
Sep 16 12:03:16.762485 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:03:16.762073    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b153e4d5-33a6-4e3f-aa63-8aec2c778bb7-metrics-tls\") pod \"dns-default-bcrqz\" (UID: \"b153e4d5-33a6-4e3f-aa63-8aec2c778bb7\") " pod="openshift-dns/dns-default-bcrqz"
Sep 16 12:03:16.762485 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:03:16.762095    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3c5a71bb-e6d1-45d8-8872-4165a3aa09e2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-dk9qm\" (UID: \"3c5a71bb-e6d1-45d8-8872-4165a3aa09e2\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-dk9qm"
Sep 16 12:03:16.762485 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:03:16.762127    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 16 12:03:16.762485 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:03:16.762213    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 16 12:03:16.762485 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:03:16.762162    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 16 12:03:16.762485 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:03:16.762232    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/895f0b5d-bd3c-4065-8681-43f68ef87d04-networking-console-plugin-cert podName:895f0b5d-bd3c-4065-8681-43f68ef87d04 nodeName:}" failed. No retries permitted until 2026-09-16 12:05:18.76221683 +0000 UTC m=+285.382536129 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/895f0b5d-bd3c-4065-8681-43f68ef87d04-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-48mv7" (UID: "895f0b5d-bd3c-4065-8681-43f68ef87d04") : secret "networking-console-plugin-cert" not found
Sep 16 12:03:16.762485 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:03:16.762236    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85d4f6697c-9k6rn: secret "image-registry-tls" not found
Sep 16 12:03:16.762485 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:03:16.762213    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 12:03:16.762485 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:03:16.762275    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c5a71bb-e6d1-45d8-8872-4165a3aa09e2-cluster-monitoring-operator-tls podName:3c5a71bb-e6d1-45d8-8872-4165a3aa09e2 nodeName:}" failed. No retries permitted until 2026-09-16 12:05:18.762258654 +0000 UTC m=+285.382577962 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3c5a71bb-e6d1-45d8-8872-4165a3aa09e2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-dk9qm" (UID: "3c5a71bb-e6d1-45d8-8872-4165a3aa09e2") : secret "cluster-monitoring-operator-tls" not found
Sep 16 12:03:16.762485 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:03:16.762307    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c693f93f-7292-44cd-b745-8988a839dab9-registry-tls podName:c693f93f-7292-44cd-b745-8988a839dab9 nodeName:}" failed. No retries permitted until 2026-09-16 12:05:18.76229351 +0000 UTC m=+285.382612812 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c693f93f-7292-44cd-b745-8988a839dab9-registry-tls") pod "image-registry-85d4f6697c-9k6rn" (UID: "c693f93f-7292-44cd-b745-8988a839dab9") : secret "image-registry-tls" not found
Sep 16 12:03:16.762485 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:03:16.762331    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b153e4d5-33a6-4e3f-aa63-8aec2c778bb7-metrics-tls podName:b153e4d5-33a6-4e3f-aa63-8aec2c778bb7 nodeName:}" failed. No retries permitted until 2026-09-16 12:05:18.76231345 +0000 UTC m=+285.382632765 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b153e4d5-33a6-4e3f-aa63-8aec2c778bb7-metrics-tls") pod "dns-default-bcrqz" (UID: "b153e4d5-33a6-4e3f-aa63-8aec2c778bb7") : secret "dns-default-metrics-tls" not found
Sep 16 12:03:17.932633 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:03:17.932592    2559 scope.go:117] "RemoveContainer" containerID="1db64358c0a86fc932c7aaecb8c376b2b154f1bb273b505eca4e7c41df5197d1"
Sep 16 12:03:17.933100 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:03:17.932760    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=console-operator pod=console-operator-696884fb9c-hrvzp_openshift-console-operator(63ee784a-3b40-4259-9923-74a24d0203a0)\"" pod="openshift-console-operator/console-operator-696884fb9c-hrvzp" podUID="63ee784a-3b40-4259-9923-74a24d0203a0"
Sep 16 12:03:26.931738 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:03:26.931650    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tsgc"
Sep 16 12:03:28.932453 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:03:28.932421    2559 scope.go:117] "RemoveContainer" containerID="1db64358c0a86fc932c7aaecb8c376b2b154f1bb273b505eca4e7c41df5197d1"
Sep 16 12:03:28.932831 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:03:28.932576    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=console-operator pod=console-operator-696884fb9c-hrvzp_openshift-console-operator(63ee784a-3b40-4259-9923-74a24d0203a0)\"" pod="openshift-console-operator/console-operator-696884fb9c-hrvzp" podUID="63ee784a-3b40-4259-9923-74a24d0203a0"
Sep 16 12:03:39.931997 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:03:39.931963    2559 scope.go:117] "RemoveContainer" containerID="1db64358c0a86fc932c7aaecb8c376b2b154f1bb273b505eca4e7c41df5197d1"
Sep 16 12:03:39.932397 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:03:39.932123    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=console-operator pod=console-operator-696884fb9c-hrvzp_openshift-console-operator(63ee784a-3b40-4259-9923-74a24d0203a0)\"" pod="openshift-console-operator/console-operator-696884fb9c-hrvzp" podUID="63ee784a-3b40-4259-9923-74a24d0203a0"
Sep 16 12:03:50.931902 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:03:50.931864    2559 scope.go:117] "RemoveContainer" containerID="1db64358c0a86fc932c7aaecb8c376b2b154f1bb273b505eca4e7c41df5197d1"
Sep 16 12:03:50.932395 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:03:50.932030    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=console-operator pod=console-operator-696884fb9c-hrvzp_openshift-console-operator(63ee784a-3b40-4259-9923-74a24d0203a0)\"" pod="openshift-console-operator/console-operator-696884fb9c-hrvzp" podUID="63ee784a-3b40-4259-9923-74a24d0203a0"
Sep 16 12:04:02.932255 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:04:02.932216    2559 scope.go:117] "RemoveContainer" containerID="1db64358c0a86fc932c7aaecb8c376b2b154f1bb273b505eca4e7c41df5197d1"
Sep 16 12:04:03.575223 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:04:03.575198    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-hrvzp_63ee784a-3b40-4259-9923-74a24d0203a0/console-operator/5.log"
Sep 16 12:04:03.575629 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:04:03.575611    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-hrvzp_63ee784a-3b40-4259-9923-74a24d0203a0/console-operator/4.log"
Sep 16 12:04:03.575752 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:04:03.575649    2559 generic.go:356] "Generic (PLEG): container finished" podID="63ee784a-3b40-4259-9923-74a24d0203a0" containerID="0bcdff328fc8be6375948106a0964eca9119cf43c3897cfb9fdedca5a214b895" exitCode=255
Sep 16 12:04:03.575752 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:04:03.575692    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-hrvzp" event={"ID":"63ee784a-3b40-4259-9923-74a24d0203a0","Type":"ContainerDied","Data":"0bcdff328fc8be6375948106a0964eca9119cf43c3897cfb9fdedca5a214b895"}
Sep 16 12:04:03.575752 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:04:03.575749    2559 scope.go:117] "RemoveContainer" containerID="1db64358c0a86fc932c7aaecb8c376b2b154f1bb273b505eca4e7c41df5197d1"
Sep 16 12:04:03.576055 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:04:03.576036    2559 scope.go:117] "RemoveContainer" containerID="0bcdff328fc8be6375948106a0964eca9119cf43c3897cfb9fdedca5a214b895"
Sep 16 12:04:03.576252 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:04:03.576231    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=console-operator pod=console-operator-696884fb9c-hrvzp_openshift-console-operator(63ee784a-3b40-4259-9923-74a24d0203a0)\"" pod="openshift-console-operator/console-operator-696884fb9c-hrvzp" podUID="63ee784a-3b40-4259-9923-74a24d0203a0"
Sep 16 12:04:04.579284 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:04:04.579257    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-hrvzp_63ee784a-3b40-4259-9923-74a24d0203a0/console-operator/5.log"
Sep 16 12:04:09.007412 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:04:09.007378    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-hrvzp"
Sep 16 12:04:09.007785 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:04:09.007483    2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-hrvzp"
Sep 16 12:04:09.007785 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:04:09.007730    2559 scope.go:117] "RemoveContainer" containerID="0bcdff328fc8be6375948106a0964eca9119cf43c3897cfb9fdedca5a214b895"
Sep 16 12:04:09.007901 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:04:09.007861    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=console-operator pod=console-operator-696884fb9c-hrvzp_openshift-console-operator(63ee784a-3b40-4259-9923-74a24d0203a0)\"" pod="openshift-console-operator/console-operator-696884fb9c-hrvzp" podUID="63ee784a-3b40-4259-9923-74a24d0203a0"
Sep 16 12:04:09.591975 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:04:09.591951    2559 scope.go:117] "RemoveContainer" containerID="0bcdff328fc8be6375948106a0964eca9119cf43c3897cfb9fdedca5a214b895"
Sep 16 12:04:09.592158 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:04:09.592089    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=console-operator pod=console-operator-696884fb9c-hrvzp_openshift-console-operator(63ee784a-3b40-4259-9923-74a24d0203a0)\"" pod="openshift-console-operator/console-operator-696884fb9c-hrvzp" podUID="63ee784a-3b40-4259-9923-74a24d0203a0"
Sep 16 12:04:22.932314 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:04:22.932278    2559 scope.go:117] "RemoveContainer" containerID="0bcdff328fc8be6375948106a0964eca9119cf43c3897cfb9fdedca5a214b895"
Sep 16 12:04:22.932708 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:04:22.932437    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=console-operator pod=console-operator-696884fb9c-hrvzp_openshift-console-operator(63ee784a-3b40-4259-9923-74a24d0203a0)\"" pod="openshift-console-operator/console-operator-696884fb9c-hrvzp" podUID="63ee784a-3b40-4259-9923-74a24d0203a0"
Sep 16 12:04:36.932429 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:04:36.932394    2559 scope.go:117] "RemoveContainer" containerID="0bcdff328fc8be6375948106a0964eca9119cf43c3897cfb9fdedca5a214b895"
Sep 16 12:04:36.932911 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:04:36.932548    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=console-operator pod=console-operator-696884fb9c-hrvzp_openshift-console-operator(63ee784a-3b40-4259-9923-74a24d0203a0)\"" pod="openshift-console-operator/console-operator-696884fb9c-hrvzp" podUID="63ee784a-3b40-4259-9923-74a24d0203a0"
Sep 16 12:04:44.800937 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:04:44.800898    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e261eb8b-bfaa-491d-afbe-6eb8fbc57324-metrics-certs\") pod \"network-metrics-daemon-6tsgc\" (UID: \"e261eb8b-bfaa-491d-afbe-6eb8fbc57324\") " pod="openshift-multus/network-metrics-daemon-6tsgc"
Sep 16 12:04:44.801330 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:04:44.801020    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 16 12:04:44.801330 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:04:44.801077    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e261eb8b-bfaa-491d-afbe-6eb8fbc57324-metrics-certs podName:e261eb8b-bfaa-491d-afbe-6eb8fbc57324 nodeName:}" failed. No retries permitted until 2026-09-16 12:06:46.801063564 +0000 UTC m=+373.421382871 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e261eb8b-bfaa-491d-afbe-6eb8fbc57324-metrics-certs") pod "network-metrics-daemon-6tsgc" (UID: "e261eb8b-bfaa-491d-afbe-6eb8fbc57324") : secret "metrics-daemon-secret" not found
Sep 16 12:04:48.932395 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:04:48.932365    2559 scope.go:117] "RemoveContainer" containerID="0bcdff328fc8be6375948106a0964eca9119cf43c3897cfb9fdedca5a214b895"
Sep 16 12:04:48.932772 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:04:48.932518    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=console-operator pod=console-operator-696884fb9c-hrvzp_openshift-console-operator(63ee784a-3b40-4259-9923-74a24d0203a0)\"" pod="openshift-console-operator/console-operator-696884fb9c-hrvzp" podUID="63ee784a-3b40-4259-9923-74a24d0203a0"
Sep 16 12:05:01.932527 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:01.932449    2559 scope.go:117] "RemoveContainer" containerID="0bcdff328fc8be6375948106a0964eca9119cf43c3897cfb9fdedca5a214b895"
Sep 16 12:05:01.932930 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:05:01.932610    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=console-operator pod=console-operator-696884fb9c-hrvzp_openshift-console-operator(63ee784a-3b40-4259-9923-74a24d0203a0)\"" pod="openshift-console-operator/console-operator-696884fb9c-hrvzp" podUID="63ee784a-3b40-4259-9923-74a24d0203a0"
Sep 16 12:05:02.206576 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:02.206487    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:05:06.333041 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:06.333006    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-8r45z"]
Sep 16 12:05:06.334732 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:06.334713    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-l54l2"]
Sep 16 12:05:06.334858 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:06.334838    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-8r45z"
Sep 16 12:05:06.336393 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:06.336375    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-l54l2"
Sep 16 12:05:06.337689 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:06.337673    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 16 12:05:06.338459 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:06.338420    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 16 12:05:06.338459 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:06.338436    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 16 12:05:06.338616 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:06.338471    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 16 12:05:06.338616 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:06.338487    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-5p755\""
Sep 16 12:05:06.339001 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:06.338985    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 16 12:05:06.339001 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:06.338998    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-87l5v\""
Sep 16 12:05:06.341689 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:06.341670    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 16 12:05:06.341764 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:06.341670    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 16 12:05:06.352973 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:06.352952    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-8r45z"]
Sep 16 12:05:06.365516 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:06.365487    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-l54l2"]
Sep 16 12:05:06.416518 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:06.416484    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-5rb28"]
Sep 16 12:05:06.418215 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:06.418199    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-5rb28"
Sep 16 12:05:06.420958 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:06.420934    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 16 12:05:06.421059 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:06.420934    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 16 12:05:06.421113 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:06.421068    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-8bmcr\""
Sep 16 12:05:06.421113 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:06.421094    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 16 12:05:06.421335 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:06.421322    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 16 12:05:06.429041 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:06.429021    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-5rb28"]
Sep 16 12:05:06.453854 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:06.453806    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vg2tr\" (UniqueName: \"kubernetes.io/projected/3d7e2955-48ab-4420-8db4-21d7f35404f3-kube-api-access-vg2tr\") pod \"cluster-samples-operator-86499c89c4-l54l2\" (UID: \"3d7e2955-48ab-4420-8db4-21d7f35404f3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-l54l2"
Sep 16 12:05:06.454048 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:06.453894    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3d7e2955-48ab-4420-8db4-21d7f35404f3-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-l54l2\" (UID: \"3d7e2955-48ab-4420-8db4-21d7f35404f3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-l54l2"
Sep 16 12:05:06.454048 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:06.453917    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-227l9\" (UniqueName: \"kubernetes.io/projected/1a31434c-3312-4330-bf77-681bb7bdb281-kube-api-access-227l9\") pod \"kube-storage-version-migrator-operator-6c8f84f897-8r45z\" (UID: \"1a31434c-3312-4330-bf77-681bb7bdb281\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-8r45z"
Sep 16 12:05:06.454048 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:06.453947    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1a31434c-3312-4330-bf77-681bb7bdb281-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-8r45z\" (UID: \"1a31434c-3312-4330-bf77-681bb7bdb281\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-8r45z"
Sep 16 12:05:06.454048 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:06.453990    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1a31434c-3312-4330-bf77-681bb7bdb281-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-8r45z\" (UID: \"1a31434c-3312-4330-bf77-681bb7bdb281\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-8r45z"
Sep 16 12:05:06.478988 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:06.478935    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:05:06.555300 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:06.555243    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2693aa2f-baac-4e11-b7c1-84fa6c51cae7-serving-cert\") pod \"service-ca-operator-cf7c776b7-5rb28\" (UID: \"2693aa2f-baac-4e11-b7c1-84fa6c51cae7\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-5rb28"
Sep 16 12:05:06.555300 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:06.555308    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gvj9\" (UniqueName: \"kubernetes.io/projected/2693aa2f-baac-4e11-b7c1-84fa6c51cae7-kube-api-access-8gvj9\") pod \"service-ca-operator-cf7c776b7-5rb28\" (UID: \"2693aa2f-baac-4e11-b7c1-84fa6c51cae7\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-5rb28"
Sep 16 12:05:06.555498 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:06.555388    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-227l9\" (UniqueName: \"kubernetes.io/projected/1a31434c-3312-4330-bf77-681bb7bdb281-kube-api-access-227l9\") pod \"kube-storage-version-migrator-operator-6c8f84f897-8r45z\" (UID: \"1a31434c-3312-4330-bf77-681bb7bdb281\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-8r45z"
Sep 16 12:05:06.555498 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:06.555435    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3d7e2955-48ab-4420-8db4-21d7f35404f3-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-l54l2\" (UID: \"3d7e2955-48ab-4420-8db4-21d7f35404f3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-l54l2"
Sep 16 12:05:06.555566 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:05:06.555532    2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 16 12:05:06.555603 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:05:06.555598    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d7e2955-48ab-4420-8db4-21d7f35404f3-samples-operator-tls podName:3d7e2955-48ab-4420-8db4-21d7f35404f3 nodeName:}" failed. No retries permitted until 2026-09-16 12:05:07.055580393 +0000 UTC m=+273.675899688 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3d7e2955-48ab-4420-8db4-21d7f35404f3-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-l54l2" (UID: "3d7e2955-48ab-4420-8db4-21d7f35404f3") : secret "samples-operator-tls" not found
Sep 16 12:05:06.555674 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:06.555655    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1a31434c-3312-4330-bf77-681bb7bdb281-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-8r45z\" (UID: \"1a31434c-3312-4330-bf77-681bb7bdb281\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-8r45z"
Sep 16 12:05:06.555720 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:06.555704    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1a31434c-3312-4330-bf77-681bb7bdb281-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-8r45z\" (UID: \"1a31434c-3312-4330-bf77-681bb7bdb281\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-8r45z"
Sep 16 12:05:06.555755 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:06.555740    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2693aa2f-baac-4e11-b7c1-84fa6c51cae7-config\") pod \"service-ca-operator-cf7c776b7-5rb28\" (UID: \"2693aa2f-baac-4e11-b7c1-84fa6c51cae7\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-5rb28"
Sep 16 12:05:06.555796 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:06.555777    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vg2tr\" (UniqueName: \"kubernetes.io/projected/3d7e2955-48ab-4420-8db4-21d7f35404f3-kube-api-access-vg2tr\") pod \"cluster-samples-operator-86499c89c4-l54l2\" (UID: \"3d7e2955-48ab-4420-8db4-21d7f35404f3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-l54l2"
Sep 16 12:05:06.556241 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:06.556225    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1a31434c-3312-4330-bf77-681bb7bdb281-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-8r45z\" (UID: \"1a31434c-3312-4330-bf77-681bb7bdb281\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-8r45z"
Sep 16 12:05:06.557887 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:06.557870    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1a31434c-3312-4330-bf77-681bb7bdb281-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-8r45z\" (UID: \"1a31434c-3312-4330-bf77-681bb7bdb281\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-8r45z"
Sep 16 12:05:06.566810 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:06.566777    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-227l9\" (UniqueName: \"kubernetes.io/projected/1a31434c-3312-4330-bf77-681bb7bdb281-kube-api-access-227l9\") pod \"kube-storage-version-migrator-operator-6c8f84f897-8r45z\" (UID: \"1a31434c-3312-4330-bf77-681bb7bdb281\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-8r45z"
Sep 16 12:05:06.566949 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:06.566929    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vg2tr\" (UniqueName: \"kubernetes.io/projected/3d7e2955-48ab-4420-8db4-21d7f35404f3-kube-api-access-vg2tr\") pod \"cluster-samples-operator-86499c89c4-l54l2\" (UID: \"3d7e2955-48ab-4420-8db4-21d7f35404f3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-l54l2"
Sep 16 12:05:06.577363 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:06.577333    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:05:06.644522 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:06.644437    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-8r45z"
Sep 16 12:05:06.656666 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:06.656636    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gvj9\" (UniqueName: \"kubernetes.io/projected/2693aa2f-baac-4e11-b7c1-84fa6c51cae7-kube-api-access-8gvj9\") pod \"service-ca-operator-cf7c776b7-5rb28\" (UID: \"2693aa2f-baac-4e11-b7c1-84fa6c51cae7\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-5rb28"
Sep 16 12:05:06.656769 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:06.656753    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2693aa2f-baac-4e11-b7c1-84fa6c51cae7-config\") pod \"service-ca-operator-cf7c776b7-5rb28\" (UID: \"2693aa2f-baac-4e11-b7c1-84fa6c51cae7\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-5rb28"
Sep 16 12:05:06.656846 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:06.656824    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2693aa2f-baac-4e11-b7c1-84fa6c51cae7-serving-cert\") pod \"service-ca-operator-cf7c776b7-5rb28\" (UID: \"2693aa2f-baac-4e11-b7c1-84fa6c51cae7\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-5rb28"
Sep 16 12:05:06.657334 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:06.657309    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2693aa2f-baac-4e11-b7c1-84fa6c51cae7-config\") pod \"service-ca-operator-cf7c776b7-5rb28\" (UID: \"2693aa2f-baac-4e11-b7c1-84fa6c51cae7\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-5rb28"
Sep 16 12:05:06.659202 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:06.659183    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2693aa2f-baac-4e11-b7c1-84fa6c51cae7-serving-cert\") pod \"service-ca-operator-cf7c776b7-5rb28\" (UID: \"2693aa2f-baac-4e11-b7c1-84fa6c51cae7\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-5rb28"
Sep 16 12:05:06.664891 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:06.664866    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gvj9\" (UniqueName: \"kubernetes.io/projected/2693aa2f-baac-4e11-b7c1-84fa6c51cae7-kube-api-access-8gvj9\") pod \"service-ca-operator-cf7c776b7-5rb28\" (UID: \"2693aa2f-baac-4e11-b7c1-84fa6c51cae7\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-5rb28"
Sep 16 12:05:06.726564 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:06.726528    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-5rb28"
Sep 16 12:05:06.910173 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:06.910146    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-8r45z"]
Sep 16 12:05:06.912446 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:05:06.912422    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a31434c_3312_4330_bf77_681bb7bdb281.slice/crio-b7b1ed85c024b8c567aa8f69b2db0936edfefb8c4f04dc50971e1284c08de7f2 WatchSource:0}: Error finding container b7b1ed85c024b8c567aa8f69b2db0936edfefb8c4f04dc50971e1284c08de7f2: Status 404 returned error can't find the container with id b7b1ed85c024b8c567aa8f69b2db0936edfefb8c4f04dc50971e1284c08de7f2
Sep 16 12:05:06.993894 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:06.993787    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-5rb28"]
Sep 16 12:05:06.996317 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:05:06.996282    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2693aa2f_baac_4e11_b7c1_84fa6c51cae7.slice/crio-110fd8c06d29d5f5805b4685ae9dd6ceeb8fd01ccc786849d6ddc489e7628220 WatchSource:0}: Error finding container 110fd8c06d29d5f5805b4685ae9dd6ceeb8fd01ccc786849d6ddc489e7628220: Status 404 returned error can't find the container with id 110fd8c06d29d5f5805b4685ae9dd6ceeb8fd01ccc786849d6ddc489e7628220
Sep 16 12:05:07.060587 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:07.060548    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3d7e2955-48ab-4420-8db4-21d7f35404f3-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-l54l2\" (UID: \"3d7e2955-48ab-4420-8db4-21d7f35404f3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-l54l2"
Sep 16 12:05:07.060748 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:05:07.060699    2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 16 12:05:07.060788 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:05:07.060759    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d7e2955-48ab-4420-8db4-21d7f35404f3-samples-operator-tls podName:3d7e2955-48ab-4420-8db4-21d7f35404f3 nodeName:}" failed. No retries permitted until 2026-09-16 12:05:08.060743852 +0000 UTC m=+274.681063147 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3d7e2955-48ab-4420-8db4-21d7f35404f3-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-l54l2" (UID: "3d7e2955-48ab-4420-8db4-21d7f35404f3") : secret "samples-operator-tls" not found
Sep 16 12:05:07.735681 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:07.735607    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-8r45z" event={"ID":"1a31434c-3312-4330-bf77-681bb7bdb281","Type":"ContainerStarted","Data":"b7b1ed85c024b8c567aa8f69b2db0936edfefb8c4f04dc50971e1284c08de7f2"}
Sep 16 12:05:07.736921 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:07.736895    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-5rb28" event={"ID":"2693aa2f-baac-4e11-b7c1-84fa6c51cae7","Type":"ContainerStarted","Data":"110fd8c06d29d5f5805b4685ae9dd6ceeb8fd01ccc786849d6ddc489e7628220"}
Sep 16 12:05:08.069158 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:08.069042    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3d7e2955-48ab-4420-8db4-21d7f35404f3-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-l54l2\" (UID: \"3d7e2955-48ab-4420-8db4-21d7f35404f3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-l54l2"
Sep 16 12:05:08.069315 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:05:08.069237    2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 16 12:05:08.069386 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:05:08.069317    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d7e2955-48ab-4420-8db4-21d7f35404f3-samples-operator-tls podName:3d7e2955-48ab-4420-8db4-21d7f35404f3 nodeName:}" failed. No retries permitted until 2026-09-16 12:05:10.06929509 +0000 UTC m=+276.689614387 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3d7e2955-48ab-4420-8db4-21d7f35404f3-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-l54l2" (UID: "3d7e2955-48ab-4420-8db4-21d7f35404f3") : secret "samples-operator-tls" not found
Sep 16 12:05:09.138005 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:09.137962    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:05:09.497202 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:09.497159    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:05:09.745675 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:09.745643    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-5rb28" event={"ID":"2693aa2f-baac-4e11-b7c1-84fa6c51cae7","Type":"ContainerStarted","Data":"35cee1b38122321131f0c7e44ddbaba5b35cc8fa469f63646ba04bb4b77d69a9"}
Sep 16 12:05:09.747335 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:09.747276    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-8r45z" event={"ID":"1a31434c-3312-4330-bf77-681bb7bdb281","Type":"ContainerStarted","Data":"906bbc88b1fd911ea2b3c2cf30b586f1a89226779b8c60354beecd0989dadf8a"}
Sep 16 12:05:09.761196 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:09.761122    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-5rb28" podStartSLOduration=1.098253691 podStartE2EDuration="3.76110179s" totalImagesPullingTime="2.662848099s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:05:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:05:09.759150944 +0000 UTC m=+276.379470260" watchObservedRunningTime="2026-09-16 12:05:09.76110179 +0000 UTC m=+276.381421104"
Sep 16 12:05:09.777084 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:09.777020    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-8r45z" podStartSLOduration=0.999807931 podStartE2EDuration="3.777002792s" totalImagesPullingTime="2.777194861s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:05:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:05:09.775905505 +0000 UTC m=+276.396224822" watchObservedRunningTime="2026-09-16 12:05:09.777002792 +0000 UTC m=+276.397322108"
Sep 16 12:05:10.089698 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:10.089597    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3d7e2955-48ab-4420-8db4-21d7f35404f3-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-l54l2\" (UID: \"3d7e2955-48ab-4420-8db4-21d7f35404f3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-l54l2"
Sep 16 12:05:10.089848 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:05:10.089773    2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 16 12:05:10.089897 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:05:10.089857    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d7e2955-48ab-4420-8db4-21d7f35404f3-samples-operator-tls podName:3d7e2955-48ab-4420-8db4-21d7f35404f3 nodeName:}" failed. No retries permitted until 2026-09-16 12:05:14.089835152 +0000 UTC m=+280.710154449 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3d7e2955-48ab-4420-8db4-21d7f35404f3-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-l54l2" (UID: "3d7e2955-48ab-4420-8db4-21d7f35404f3") : secret "samples-operator-tls" not found
Sep 16 12:05:10.181891 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:10.181858    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-dd4bl"]
Sep 16 12:05:10.184034 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:10.184015    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dd4bl"
Sep 16 12:05:10.186491 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:10.186464    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lnmtw\""
Sep 16 12:05:10.186655 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:10.186618    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 16 12:05:10.186735 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:10.186668    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 16 12:05:10.186961 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:10.186816    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 16 12:05:10.186961 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:10.186842    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 16 12:05:10.200563 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:10.200537    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dd4bl"]
Sep 16 12:05:10.202664 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:10.202640    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:05:10.262450 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:10.262417    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:05:10.290685 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:10.290639    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ce3f4812-de43-4d0e-9ba6-b00f862ce514-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dd4bl\" (UID: \"ce3f4812-de43-4d0e-9ba6-b00f862ce514\") " pod="openshift-insights/insights-runtime-extractor-dd4bl"
Sep 16 12:05:10.290797 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:10.290698    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ce3f4812-de43-4d0e-9ba6-b00f862ce514-data-volume\") pod \"insights-runtime-extractor-dd4bl\" (UID: \"ce3f4812-de43-4d0e-9ba6-b00f862ce514\") " pod="openshift-insights/insights-runtime-extractor-dd4bl"
Sep 16 12:05:10.290797 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:10.290770    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c655p\" (UniqueName: \"kubernetes.io/projected/ce3f4812-de43-4d0e-9ba6-b00f862ce514-kube-api-access-c655p\") pod \"insights-runtime-extractor-dd4bl\" (UID: \"ce3f4812-de43-4d0e-9ba6-b00f862ce514\") " pod="openshift-insights/insights-runtime-extractor-dd4bl"
Sep 16 12:05:10.290879 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:10.290857    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ce3f4812-de43-4d0e-9ba6-b00f862ce514-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dd4bl\" (UID: \"ce3f4812-de43-4d0e-9ba6-b00f862ce514\") " pod="openshift-insights/insights-runtime-extractor-dd4bl"
Sep 16 12:05:10.290983 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:10.290961    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ce3f4812-de43-4d0e-9ba6-b00f862ce514-crio-socket\") pod \"insights-runtime-extractor-dd4bl\" (UID: \"ce3f4812-de43-4d0e-9ba6-b00f862ce514\") " pod="openshift-insights/insights-runtime-extractor-dd4bl"
Sep 16 12:05:10.392361 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:10.392273    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ce3f4812-de43-4d0e-9ba6-b00f862ce514-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dd4bl\" (UID: \"ce3f4812-de43-4d0e-9ba6-b00f862ce514\") " pod="openshift-insights/insights-runtime-extractor-dd4bl"
Sep 16 12:05:10.392361 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:10.392327    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ce3f4812-de43-4d0e-9ba6-b00f862ce514-data-volume\") pod \"insights-runtime-extractor-dd4bl\" (UID: \"ce3f4812-de43-4d0e-9ba6-b00f862ce514\") " pod="openshift-insights/insights-runtime-extractor-dd4bl"
Sep 16 12:05:10.392582 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:10.392382    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c655p\" (UniqueName: \"kubernetes.io/projected/ce3f4812-de43-4d0e-9ba6-b00f862ce514-kube-api-access-c655p\") pod \"insights-runtime-extractor-dd4bl\" (UID: \"ce3f4812-de43-4d0e-9ba6-b00f862ce514\") " pod="openshift-insights/insights-runtime-extractor-dd4bl"
Sep 16 12:05:10.392582 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:05:10.392423    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 12:05:10.392582 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:05:10.392491    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce3f4812-de43-4d0e-9ba6-b00f862ce514-insights-runtime-extractor-tls podName:ce3f4812-de43-4d0e-9ba6-b00f862ce514 nodeName:}" failed. No retries permitted until 2026-09-16 12:05:10.892469874 +0000 UTC m=+277.512789186 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ce3f4812-de43-4d0e-9ba6-b00f862ce514-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dd4bl" (UID: "ce3f4812-de43-4d0e-9ba6-b00f862ce514") : secret "insights-runtime-extractor-tls" not found
Sep 16 12:05:10.392582 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:10.392516    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ce3f4812-de43-4d0e-9ba6-b00f862ce514-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dd4bl\" (UID: \"ce3f4812-de43-4d0e-9ba6-b00f862ce514\") " pod="openshift-insights/insights-runtime-extractor-dd4bl"
Sep 16 12:05:10.392582 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:10.392577    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ce3f4812-de43-4d0e-9ba6-b00f862ce514-crio-socket\") pod \"insights-runtime-extractor-dd4bl\" (UID: \"ce3f4812-de43-4d0e-9ba6-b00f862ce514\") " pod="openshift-insights/insights-runtime-extractor-dd4bl"
Sep 16 12:05:10.392833 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:10.392665    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ce3f4812-de43-4d0e-9ba6-b00f862ce514-crio-socket\") pod \"insights-runtime-extractor-dd4bl\" (UID: \"ce3f4812-de43-4d0e-9ba6-b00f862ce514\") " pod="openshift-insights/insights-runtime-extractor-dd4bl"
Sep 16 12:05:10.392833 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:05:10.392670    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 16 12:05:10.392833 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:10.392721    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ce3f4812-de43-4d0e-9ba6-b00f862ce514-data-volume\") pod \"insights-runtime-extractor-dd4bl\" (UID: \"ce3f4812-de43-4d0e-9ba6-b00f862ce514\") " pod="openshift-insights/insights-runtime-extractor-dd4bl"
Sep 16 12:05:10.392833 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:05:10.392736    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ce3f4812-de43-4d0e-9ba6-b00f862ce514-kube-rbac-proxy-cm podName:ce3f4812-de43-4d0e-9ba6-b00f862ce514 nodeName:}" failed. No retries permitted until 2026-09-16 12:05:10.892719248 +0000 UTC m=+277.513038547 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ce3f4812-de43-4d0e-9ba6-b00f862ce514-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dd4bl" (UID: "ce3f4812-de43-4d0e-9ba6-b00f862ce514") : configmap "kube-rbac-proxy" not found
Sep 16 12:05:10.403525 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:10.403501    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c655p\" (UniqueName: \"kubernetes.io/projected/ce3f4812-de43-4d0e-9ba6-b00f862ce514-kube-api-access-c655p\") pod \"insights-runtime-extractor-dd4bl\" (UID: \"ce3f4812-de43-4d0e-9ba6-b00f862ce514\") " pod="openshift-insights/insights-runtime-extractor-dd4bl"
Sep 16 12:05:10.895804 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:10.895767    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ce3f4812-de43-4d0e-9ba6-b00f862ce514-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dd4bl\" (UID: \"ce3f4812-de43-4d0e-9ba6-b00f862ce514\") " pod="openshift-insights/insights-runtime-extractor-dd4bl"
Sep 16 12:05:10.896013 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:05:10.895907    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 12:05:10.896013 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:10.895946    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ce3f4812-de43-4d0e-9ba6-b00f862ce514-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dd4bl\" (UID: \"ce3f4812-de43-4d0e-9ba6-b00f862ce514\") " pod="openshift-insights/insights-runtime-extractor-dd4bl"
Sep 16 12:05:10.896013 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:05:10.896000    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce3f4812-de43-4d0e-9ba6-b00f862ce514-insights-runtime-extractor-tls podName:ce3f4812-de43-4d0e-9ba6-b00f862ce514 nodeName:}" failed. No retries permitted until 2026-09-16 12:05:11.895980133 +0000 UTC m=+278.516299440 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ce3f4812-de43-4d0e-9ba6-b00f862ce514-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dd4bl" (UID: "ce3f4812-de43-4d0e-9ba6-b00f862ce514") : secret "insights-runtime-extractor-tls" not found
Sep 16 12:05:10.896013 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:05:10.896004    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 16 12:05:10.896228 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:05:10.896068    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ce3f4812-de43-4d0e-9ba6-b00f862ce514-kube-rbac-proxy-cm podName:ce3f4812-de43-4d0e-9ba6-b00f862ce514 nodeName:}" failed. No retries permitted until 2026-09-16 12:05:11.896051074 +0000 UTC m=+278.516370385 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ce3f4812-de43-4d0e-9ba6-b00f862ce514-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dd4bl" (UID: "ce3f4812-de43-4d0e-9ba6-b00f862ce514") : configmap "kube-rbac-proxy" not found
Sep 16 12:05:10.942656 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:10.942608    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:05:11.034226 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:11.034189    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:05:11.092449 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:11.092420    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:05:11.339956 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:11.339916    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:05:11.395282 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:11.395252    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:05:11.618391 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:11.618312    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:05:11.719796 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:11.719767    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:05:11.902613 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:11.902577    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ce3f4812-de43-4d0e-9ba6-b00f862ce514-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dd4bl\" (UID: \"ce3f4812-de43-4d0e-9ba6-b00f862ce514\") " pod="openshift-insights/insights-runtime-extractor-dd4bl"
Sep 16 12:05:11.902775 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:11.902636    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ce3f4812-de43-4d0e-9ba6-b00f862ce514-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dd4bl\" (UID: \"ce3f4812-de43-4d0e-9ba6-b00f862ce514\") " pod="openshift-insights/insights-runtime-extractor-dd4bl"
Sep 16 12:05:11.902775 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:05:11.902701    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 16 12:05:11.902775 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:05:11.902736    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 12:05:11.902775 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:05:11.902766    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ce3f4812-de43-4d0e-9ba6-b00f862ce514-kube-rbac-proxy-cm podName:ce3f4812-de43-4d0e-9ba6-b00f862ce514 nodeName:}" failed. No retries permitted until 2026-09-16 12:05:13.902750457 +0000 UTC m=+280.523069750 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ce3f4812-de43-4d0e-9ba6-b00f862ce514-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dd4bl" (UID: "ce3f4812-de43-4d0e-9ba6-b00f862ce514") : configmap "kube-rbac-proxy" not found
Sep 16 12:05:11.902922 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:05:11.902781    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce3f4812-de43-4d0e-9ba6-b00f862ce514-insights-runtime-extractor-tls podName:ce3f4812-de43-4d0e-9ba6-b00f862ce514 nodeName:}" failed. No retries permitted until 2026-09-16 12:05:13.90277482 +0000 UTC m=+280.523094114 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ce3f4812-de43-4d0e-9ba6-b00f862ce514-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dd4bl" (UID: "ce3f4812-de43-4d0e-9ba6-b00f862ce514") : secret "insights-runtime-extractor-tls" not found
Sep 16 12:05:11.983877 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:11.983832    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-bvlvm"]
Sep 16 12:05:11.986345 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:11.986317    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-bvlvm"
Sep 16 12:05:11.988846 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:11.988823    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 16 12:05:11.988943 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:11.988824    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 16 12:05:11.989992 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:11.989971    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-fb9rw\""
Sep 16 12:05:11.994522 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:11.994502    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-bvlvm"]
Sep 16 12:05:12.024738 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:12.024711    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:05:12.093118 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:12.093087    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:05:12.104770 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:12.104744    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pc42l\" (UniqueName: \"kubernetes.io/projected/8ef70f87-8024-4b34-9c17-d9d275b5feb2-kube-api-access-pc42l\") pod \"migrator-8b4d697c5-bvlvm\" (UID: \"8ef70f87-8024-4b34-9c17-d9d275b5feb2\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-bvlvm"
Sep 16 12:05:12.152490 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:12.152467    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ch8pr_a826335e-773e-48e2-aa35-099d7466304b/dns-node-resolver/0.log"
Sep 16 12:05:12.205529 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:12.205459    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pc42l\" (UniqueName: \"kubernetes.io/projected/8ef70f87-8024-4b34-9c17-d9d275b5feb2-kube-api-access-pc42l\") pod \"migrator-8b4d697c5-bvlvm\" (UID: \"8ef70f87-8024-4b34-9c17-d9d275b5feb2\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-bvlvm"
Sep 16 12:05:12.213737 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:12.213698    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pc42l\" (UniqueName: \"kubernetes.io/projected/8ef70f87-8024-4b34-9c17-d9d275b5feb2-kube-api-access-pc42l\") pod \"migrator-8b4d697c5-bvlvm\" (UID: \"8ef70f87-8024-4b34-9c17-d9d275b5feb2\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-bvlvm"
Sep 16 12:05:12.296146 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:12.296090    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-bvlvm"
Sep 16 12:05:12.563275 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:12.563183    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-bvlvm"]
Sep 16 12:05:12.568248 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:05:12.568221    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ef70f87_8024_4b34_9c17_d9d275b5feb2.slice/crio-e178f2a8850940f9cf559a0ceaccd2de2f3b218fc31005049063159c322ae7a4 WatchSource:0}: Error finding container e178f2a8850940f9cf559a0ceaccd2de2f3b218fc31005049063159c322ae7a4: Status 404 returned error can't find the container with id e178f2a8850940f9cf559a0ceaccd2de2f3b218fc31005049063159c322ae7a4
Sep 16 12:05:12.759152 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:12.759093    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-bvlvm" event={"ID":"8ef70f87-8024-4b34-9c17-d9d275b5feb2","Type":"ContainerStarted","Data":"e178f2a8850940f9cf559a0ceaccd2de2f3b218fc31005049063159c322ae7a4"}
Sep 16 12:05:13.265697 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:13.265662    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:05:13.324305 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:13.324277    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:05:13.355173 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:13.355149    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-l5cpd_94671c96-5c56-42f8-b7f7-f6f93b27dac0/node-ca/0.log"
Sep 16 12:05:13.753476 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:13.753449    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ptchc_0f5e5b43-7b68-4940-bba6-36238146b79d/serve-healthcheck-canary/0.log"
Sep 16 12:05:13.923434 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:13.923401    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ce3f4812-de43-4d0e-9ba6-b00f862ce514-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dd4bl\" (UID: \"ce3f4812-de43-4d0e-9ba6-b00f862ce514\") " pod="openshift-insights/insights-runtime-extractor-dd4bl"
Sep 16 12:05:13.923613 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:05:13.923553    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 12:05:13.923613 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:13.923565    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ce3f4812-de43-4d0e-9ba6-b00f862ce514-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dd4bl\" (UID: \"ce3f4812-de43-4d0e-9ba6-b00f862ce514\") " pod="openshift-insights/insights-runtime-extractor-dd4bl"
Sep 16 12:05:13.923716 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:05:13.923617    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce3f4812-de43-4d0e-9ba6-b00f862ce514-insights-runtime-extractor-tls podName:ce3f4812-de43-4d0e-9ba6-b00f862ce514 nodeName:}" failed. No retries permitted until 2026-09-16 12:05:17.923599497 +0000 UTC m=+284.543918791 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ce3f4812-de43-4d0e-9ba6-b00f862ce514-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dd4bl" (UID: "ce3f4812-de43-4d0e-9ba6-b00f862ce514") : secret "insights-runtime-extractor-tls" not found
Sep 16 12:05:13.923716 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:05:13.923660    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 16 12:05:13.923838 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:05:13.923718    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ce3f4812-de43-4d0e-9ba6-b00f862ce514-kube-rbac-proxy-cm podName:ce3f4812-de43-4d0e-9ba6-b00f862ce514 nodeName:}" failed. No retries permitted until 2026-09-16 12:05:17.923701845 +0000 UTC m=+284.544021145 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ce3f4812-de43-4d0e-9ba6-b00f862ce514-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dd4bl" (UID: "ce3f4812-de43-4d0e-9ba6-b00f862ce514") : configmap "kube-rbac-proxy" not found
Sep 16 12:05:14.124738 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:14.124646    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3d7e2955-48ab-4420-8db4-21d7f35404f3-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-l54l2\" (UID: \"3d7e2955-48ab-4420-8db4-21d7f35404f3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-l54l2"
Sep 16 12:05:14.124905 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:05:14.124785    2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 16 12:05:14.124905 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:05:14.124848    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d7e2955-48ab-4420-8db4-21d7f35404f3-samples-operator-tls podName:3d7e2955-48ab-4420-8db4-21d7f35404f3 nodeName:}" failed. No retries permitted until 2026-09-16 12:05:22.124832369 +0000 UTC m=+288.745151666 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3d7e2955-48ab-4420-8db4-21d7f35404f3-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-l54l2" (UID: "3d7e2955-48ab-4420-8db4-21d7f35404f3") : secret "samples-operator-tls" not found
Sep 16 12:05:14.165563 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:14.165526    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:05:14.766897 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:14.766867    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-bvlvm" event={"ID":"8ef70f87-8024-4b34-9c17-d9d275b5feb2","Type":"ContainerStarted","Data":"d4f93c3b74d7ac09d3eafdee106d6c7ccf22133bbebb21b044f865dd7327d010"}
Sep 16 12:05:14.767322 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:14.766916    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-bvlvm" event={"ID":"8ef70f87-8024-4b34-9c17-d9d275b5feb2","Type":"ContainerStarted","Data":"d5c9431bc33710fb4d14e1233d010edfeec783d370d402afe6ee224119ecfd42"}
Sep 16 12:05:14.783793 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:14.783743    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-bvlvm" podStartSLOduration=2.168029262 podStartE2EDuration="3.783725267s" totalImagesPullingTime="1.615696005s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:05:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:05:14.783305739 +0000 UTC m=+281.403625070" watchObservedRunningTime="2026-09-16 12:05:14.783725267 +0000 UTC m=+281.404044582"
Sep 16 12:05:15.448914 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:05:15.448876    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-85d4f6697c-9k6rn" podUID="c693f93f-7292-44cd-b745-8988a839dab9"
Sep 16 12:05:15.448914 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:05:15.448877    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-48mv7" podUID="895f0b5d-bd3c-4065-8681-43f68ef87d04"
Sep 16 12:05:15.449110 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:05:15.448876    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-bcrqz" podUID="b153e4d5-33a6-4e3f-aa63-8aec2c778bb7"
Sep 16 12:05:15.449110 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:05:15.448877    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[cluster-monitoring-operator-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-dk9qm" podUID="3c5a71bb-e6d1-45d8-8872-4165a3aa09e2"
Sep 16 12:05:15.770184 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:15.770074    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85d4f6697c-9k6rn"
Sep 16 12:05:15.770184 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:15.770092    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bcrqz"
Sep 16 12:05:15.770184 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:15.770092    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-48mv7"
Sep 16 12:05:15.770731 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:15.770389    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-dk9qm"
Sep 16 12:05:16.932618 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:16.932587    2559 scope.go:117] "RemoveContainer" containerID="0bcdff328fc8be6375948106a0964eca9119cf43c3897cfb9fdedca5a214b895"
Sep 16 12:05:16.932996 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:05:16.932752    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=console-operator pod=console-operator-696884fb9c-hrvzp_openshift-console-operator(63ee784a-3b40-4259-9923-74a24d0203a0)\"" pod="openshift-console-operator/console-operator-696884fb9c-hrvzp" podUID="63ee784a-3b40-4259-9923-74a24d0203a0"
Sep 16 12:05:17.400168 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:17.400110    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:05:17.503060 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:17.503025    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:05:17.608881 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:17.608832    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:05:17.713176 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:17.713078    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:05:17.816095 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:17.816061    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:05:17.913004 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:17.912968    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:05:17.955501 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:17.955461    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ce3f4812-de43-4d0e-9ba6-b00f862ce514-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dd4bl\" (UID: \"ce3f4812-de43-4d0e-9ba6-b00f862ce514\") " pod="openshift-insights/insights-runtime-extractor-dd4bl"
Sep 16 12:05:17.955885 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:17.955526    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ce3f4812-de43-4d0e-9ba6-b00f862ce514-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dd4bl\" (UID: \"ce3f4812-de43-4d0e-9ba6-b00f862ce514\") " pod="openshift-insights/insights-runtime-extractor-dd4bl"
Sep 16 12:05:17.955885 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:05:17.955593    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 16 12:05:17.955885 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:05:17.955620    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 12:05:17.955885 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:05:17.955665    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ce3f4812-de43-4d0e-9ba6-b00f862ce514-kube-rbac-proxy-cm podName:ce3f4812-de43-4d0e-9ba6-b00f862ce514 nodeName:}" failed. No retries permitted until 2026-09-16 12:05:25.955644831 +0000 UTC m=+292.575964139 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ce3f4812-de43-4d0e-9ba6-b00f862ce514-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dd4bl" (UID: "ce3f4812-de43-4d0e-9ba6-b00f862ce514") : configmap "kube-rbac-proxy" not found
Sep 16 12:05:17.955885 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:05:17.955681    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce3f4812-de43-4d0e-9ba6-b00f862ce514-insights-runtime-extractor-tls podName:ce3f4812-de43-4d0e-9ba6-b00f862ce514 nodeName:}" failed. No retries permitted until 2026-09-16 12:05:25.955674577 +0000 UTC m=+292.575993870 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ce3f4812-de43-4d0e-9ba6-b00f862ce514-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dd4bl" (UID: "ce3f4812-de43-4d0e-9ba6-b00f862ce514") : secret "insights-runtime-extractor-tls" not found
Sep 16 12:05:18.101868 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:18.101786    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:05:18.863004 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:18.862970    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c693f93f-7292-44cd-b745-8988a839dab9-registry-tls\") pod \"image-registry-85d4f6697c-9k6rn\" (UID: \"c693f93f-7292-44cd-b745-8988a839dab9\") " pod="openshift-image-registry/image-registry-85d4f6697c-9k6rn"
Sep 16 12:05:18.863219 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:18.863045    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/895f0b5d-bd3c-4065-8681-43f68ef87d04-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-48mv7\" (UID: \"895f0b5d-bd3c-4065-8681-43f68ef87d04\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-48mv7"
Sep 16 12:05:18.863219 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:18.863078    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b153e4d5-33a6-4e3f-aa63-8aec2c778bb7-metrics-tls\") pod \"dns-default-bcrqz\" (UID: \"b153e4d5-33a6-4e3f-aa63-8aec2c778bb7\") " pod="openshift-dns/dns-default-bcrqz"
Sep 16 12:05:18.863219 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:18.863096    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3c5a71bb-e6d1-45d8-8872-4165a3aa09e2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-dk9qm\" (UID: \"3c5a71bb-e6d1-45d8-8872-4165a3aa09e2\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-dk9qm"
Sep 16 12:05:18.863219 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:05:18.863126    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 16 12:05:18.863219 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:05:18.863165    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85d4f6697c-9k6rn: secret "image-registry-tls" not found
Sep 16 12:05:18.863219 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:05:18.863209    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 12:05:18.863219 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:05:18.863219    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c693f93f-7292-44cd-b745-8988a839dab9-registry-tls podName:c693f93f-7292-44cd-b745-8988a839dab9 nodeName:}" failed. No retries permitted until 2026-09-16 12:07:20.86320489 +0000 UTC m=+407.483524183 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c693f93f-7292-44cd-b745-8988a839dab9-registry-tls") pod "image-registry-85d4f6697c-9k6rn" (UID: "c693f93f-7292-44cd-b745-8988a839dab9") : secret "image-registry-tls" not found
Sep 16 12:05:18.863545 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:05:18.863254    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b153e4d5-33a6-4e3f-aa63-8aec2c778bb7-metrics-tls podName:b153e4d5-33a6-4e3f-aa63-8aec2c778bb7 nodeName:}" failed. No retries permitted until 2026-09-16 12:07:20.863242817 +0000 UTC m=+407.483562112 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b153e4d5-33a6-4e3f-aa63-8aec2c778bb7-metrics-tls") pod "dns-default-bcrqz" (UID: "b153e4d5-33a6-4e3f-aa63-8aec2c778bb7") : secret "dns-default-metrics-tls" not found
Sep 16 12:05:18.863545 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:05:18.863209    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 16 12:05:18.863545 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:05:18.863209    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 16 12:05:18.863545 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:05:18.863289    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c5a71bb-e6d1-45d8-8872-4165a3aa09e2-cluster-monitoring-operator-tls podName:3c5a71bb-e6d1-45d8-8872-4165a3aa09e2 nodeName:}" failed. No retries permitted until 2026-09-16 12:07:20.863280461 +0000 UTC m=+407.483599757 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3c5a71bb-e6d1-45d8-8872-4165a3aa09e2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-dk9qm" (UID: "3c5a71bb-e6d1-45d8-8872-4165a3aa09e2") : secret "cluster-monitoring-operator-tls" not found
Sep 16 12:05:18.863545 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:05:18.863314    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/895f0b5d-bd3c-4065-8681-43f68ef87d04-networking-console-plugin-cert podName:895f0b5d-bd3c-4065-8681-43f68ef87d04 nodeName:}" failed. No retries permitted until 2026-09-16 12:07:20.863304797 +0000 UTC m=+407.483624106 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/895f0b5d-bd3c-4065-8681-43f68ef87d04-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-48mv7" (UID: "895f0b5d-bd3c-4065-8681-43f68ef87d04") : secret "networking-console-plugin-cert" not found
Sep 16 12:05:19.124880 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:19.124802    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:05:19.293217 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:19.293184    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:05:19.489779 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:19.489743    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:05:19.898833 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:19.898781    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:05:20.507885 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:20.507851    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:05:21.104060 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:21.104021    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:05:21.205064 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:21.205026    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:05:21.305873 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:21.305837    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:05:21.359931 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:21.359821    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:05:21.688350 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:21.688302    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:05:21.888568 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:21.888541    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:05:22.189913 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:22.189869    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3d7e2955-48ab-4420-8db4-21d7f35404f3-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-l54l2\" (UID: \"3d7e2955-48ab-4420-8db4-21d7f35404f3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-l54l2"
Sep 16 12:05:22.192400 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:22.192381    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3d7e2955-48ab-4420-8db4-21d7f35404f3-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-l54l2\" (UID: \"3d7e2955-48ab-4420-8db4-21d7f35404f3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-l54l2"
Sep 16 12:05:22.248955 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:22.248926    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-l54l2"
Sep 16 12:05:22.304746 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:22.304663    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:05:22.516748 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:22.516674    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-l54l2"]
Sep 16 12:05:22.790041 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:22.789959    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-l54l2" event={"ID":"3d7e2955-48ab-4420-8db4-21d7f35404f3","Type":"ContainerStarted","Data":"fef50f65b01899a1b450c6ef213b570b7e7630f5be1017f08c03ac1d4b0fa87f"}
Sep 16 12:05:22.896027 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:22.895997    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:05:23.287873 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:23.287821    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:05:23.389208 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:23.389177    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:05:23.497562 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:23.497513    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:05:23.938780 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:23.938748    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:05:24.095383 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:24.095346    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:05:24.230539 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:24.230454    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:05:24.331998 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:24.331963    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:05:24.494601 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:24.494536    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:05:24.798041 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:24.797955    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-l54l2" event={"ID":"3d7e2955-48ab-4420-8db4-21d7f35404f3","Type":"ContainerStarted","Data":"5aec3c97cd6ee872ee188ca8bbec4de947f4a0d0329301f59a2d539a8b4de3b4"}
Sep 16 12:05:24.798041 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:24.798041    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-l54l2" event={"ID":"3d7e2955-48ab-4420-8db4-21d7f35404f3","Type":"ContainerStarted","Data":"0ba51901f5c60a0cd852ade826ead27b72c7c5c117a4d5049193a96dc20fd8be"}
Sep 16 12:05:24.816635 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:24.816587    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-l54l2" podStartSLOduration=16.871613531 podStartE2EDuration="18.816572328s" totalImagesPullingTime="1.944958797s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:05:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:05:24.816413396 +0000 UTC m=+291.436732714" watchObservedRunningTime="2026-09-16 12:05:24.816572328 +0000 UTC m=+291.436891657"
Sep 16 12:05:24.892460 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:24.892428    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:05:25.092831 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:25.092751    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:05:25.823753 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:25.823719    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:05:25.924751 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:25.924723    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:05:26.024831 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:26.024795    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ce3f4812-de43-4d0e-9ba6-b00f862ce514-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dd4bl\" (UID: \"ce3f4812-de43-4d0e-9ba6-b00f862ce514\") " pod="openshift-insights/insights-runtime-extractor-dd4bl"
Sep 16 12:05:26.024969 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:26.024860    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ce3f4812-de43-4d0e-9ba6-b00f862ce514-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dd4bl\" (UID: \"ce3f4812-de43-4d0e-9ba6-b00f862ce514\") " pod="openshift-insights/insights-runtime-extractor-dd4bl"
Sep 16 12:05:26.024969 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:05:26.024943    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 12:05:26.025059 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:05:26.024996    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce3f4812-de43-4d0e-9ba6-b00f862ce514-insights-runtime-extractor-tls podName:ce3f4812-de43-4d0e-9ba6-b00f862ce514 nodeName:}" failed. No retries permitted until 2026-09-16 12:05:42.024982829 +0000 UTC m=+308.645302135 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ce3f4812-de43-4d0e-9ba6-b00f862ce514-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dd4bl" (UID: "ce3f4812-de43-4d0e-9ba6-b00f862ce514") : secret "insights-runtime-extractor-tls" not found
Sep 16 12:05:26.025326 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:26.025306    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ce3f4812-de43-4d0e-9ba6-b00f862ce514-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dd4bl\" (UID: \"ce3f4812-de43-4d0e-9ba6-b00f862ce514\") " pod="openshift-insights/insights-runtime-extractor-dd4bl"
Sep 16 12:05:26.289218 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:26.289183    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:05:26.497124 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:26.497094    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:05:26.739975 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:26.739940    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:05:27.097286 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:27.097202    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:05:27.698964 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:27.698928    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:05:27.889673 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:27.889626    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:05:28.097083 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:28.096976    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:05:29.931792 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:29.931758    2559 scope.go:117] "RemoveContainer" containerID="0bcdff328fc8be6375948106a0964eca9119cf43c3897cfb9fdedca5a214b895"
Sep 16 12:05:29.932176 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:05:29.931938    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=console-operator pod=console-operator-696884fb9c-hrvzp_openshift-console-operator(63ee784a-3b40-4259-9923-74a24d0203a0)\"" pod="openshift-console-operator/console-operator-696884fb9c-hrvzp" podUID="63ee784a-3b40-4259-9923-74a24d0203a0"
Sep 16 12:05:29.932280 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:05:29.932248    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-6tsgc" podUID="e261eb8b-bfaa-491d-afbe-6eb8fbc57324"
Sep 16 12:05:32.198767 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:32.198733    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-85d4f6697c-9k6rn"]
Sep 16 12:05:32.199196 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:05:32.198964    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-85d4f6697c-9k6rn" podUID="c693f93f-7292-44cd-b745-8988a839dab9"
Sep 16 12:05:32.237780 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:32.237741    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-85b77c8745-q88bz"]
Sep 16 12:05:32.239616 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:32.239598    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85b77c8745-q88bz"
Sep 16 12:05:32.254628 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:32.254598    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-85b77c8745-q88bz"]
Sep 16 12:05:32.272489 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:32.272453    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/21d9dd2a-7747-4c79-8a50-e021bded662c-ca-trust-extracted\") pod \"image-registry-85b77c8745-q88bz\" (UID: \"21d9dd2a-7747-4c79-8a50-e021bded662c\") " pod="openshift-image-registry/image-registry-85b77c8745-q88bz"
Sep 16 12:05:32.272644 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:32.272521    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l89wb\" (UniqueName: \"kubernetes.io/projected/21d9dd2a-7747-4c79-8a50-e021bded662c-kube-api-access-l89wb\") pod \"image-registry-85b77c8745-q88bz\" (UID: \"21d9dd2a-7747-4c79-8a50-e021bded662c\") " pod="openshift-image-registry/image-registry-85b77c8745-q88bz"
Sep 16 12:05:32.272644 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:32.272542    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/21d9dd2a-7747-4c79-8a50-e021bded662c-registry-tls\") pod \"image-registry-85b77c8745-q88bz\" (UID: \"21d9dd2a-7747-4c79-8a50-e021bded662c\") " pod="openshift-image-registry/image-registry-85b77c8745-q88bz"
Sep 16 12:05:32.272644 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:32.272565    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/21d9dd2a-7747-4c79-8a50-e021bded662c-installation-pull-secrets\") pod \"image-registry-85b77c8745-q88bz\" (UID: \"21d9dd2a-7747-4c79-8a50-e021bded662c\") " pod="openshift-image-registry/image-registry-85b77c8745-q88bz"
Sep 16 12:05:32.272644 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:32.272584    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/21d9dd2a-7747-4c79-8a50-e021bded662c-bound-sa-token\") pod \"image-registry-85b77c8745-q88bz\" (UID: \"21d9dd2a-7747-4c79-8a50-e021bded662c\") " pod="openshift-image-registry/image-registry-85b77c8745-q88bz"
Sep 16 12:05:32.272807 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:32.272637    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/21d9dd2a-7747-4c79-8a50-e021bded662c-image-registry-private-configuration\") pod \"image-registry-85b77c8745-q88bz\" (UID: \"21d9dd2a-7747-4c79-8a50-e021bded662c\") " pod="openshift-image-registry/image-registry-85b77c8745-q88bz"
Sep 16 12:05:32.272807 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:32.272668    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/21d9dd2a-7747-4c79-8a50-e021bded662c-trusted-ca\") pod \"image-registry-85b77c8745-q88bz\" (UID: \"21d9dd2a-7747-4c79-8a50-e021bded662c\") " pod="openshift-image-registry/image-registry-85b77c8745-q88bz"
Sep 16 12:05:32.272807 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:32.272710    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/21d9dd2a-7747-4c79-8a50-e021bded662c-registry-certificates\") pod \"image-registry-85b77c8745-q88bz\" (UID: \"21d9dd2a-7747-4c79-8a50-e021bded662c\") " pod="openshift-image-registry/image-registry-85b77c8745-q88bz"
Sep 16 12:05:32.278496 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:32.278468    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:05:32.373081 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:32.373047    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/21d9dd2a-7747-4c79-8a50-e021bded662c-registry-certificates\") pod \"image-registry-85b77c8745-q88bz\" (UID: \"21d9dd2a-7747-4c79-8a50-e021bded662c\") " pod="openshift-image-registry/image-registry-85b77c8745-q88bz"
Sep 16 12:05:32.373298 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:32.373118    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/21d9dd2a-7747-4c79-8a50-e021bded662c-ca-trust-extracted\") pod \"image-registry-85b77c8745-q88bz\" (UID: \"21d9dd2a-7747-4c79-8a50-e021bded662c\") " pod="openshift-image-registry/image-registry-85b77c8745-q88bz"
Sep 16 12:05:32.373298 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:32.373214    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l89wb\" (UniqueName: \"kubernetes.io/projected/21d9dd2a-7747-4c79-8a50-e021bded662c-kube-api-access-l89wb\") pod \"image-registry-85b77c8745-q88bz\" (UID: \"21d9dd2a-7747-4c79-8a50-e021bded662c\") " pod="openshift-image-registry/image-registry-85b77c8745-q88bz"
Sep 16 12:05:32.373298 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:32.373249    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/21d9dd2a-7747-4c79-8a50-e021bded662c-registry-tls\") pod \"image-registry-85b77c8745-q88bz\" (UID: \"21d9dd2a-7747-4c79-8a50-e021bded662c\") " pod="openshift-image-registry/image-registry-85b77c8745-q88bz"
Sep 16 12:05:32.373298 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:32.373283    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/21d9dd2a-7747-4c79-8a50-e021bded662c-installation-pull-secrets\") pod \"image-registry-85b77c8745-q88bz\" (UID: \"21d9dd2a-7747-4c79-8a50-e021bded662c\") " pod="openshift-image-registry/image-registry-85b77c8745-q88bz"
Sep 16 12:05:32.373499 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:32.373306    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/21d9dd2a-7747-4c79-8a50-e021bded662c-bound-sa-token\") pod \"image-registry-85b77c8745-q88bz\" (UID: \"21d9dd2a-7747-4c79-8a50-e021bded662c\") " pod="openshift-image-registry/image-registry-85b77c8745-q88bz"
Sep 16 12:05:32.373499 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:32.373340    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/21d9dd2a-7747-4c79-8a50-e021bded662c-image-registry-private-configuration\") pod \"image-registry-85b77c8745-q88bz\" (UID: \"21d9dd2a-7747-4c79-8a50-e021bded662c\") " pod="openshift-image-registry/image-registry-85b77c8745-q88bz"
Sep 16 12:05:32.373499 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:32.373363    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/21d9dd2a-7747-4c79-8a50-e021bded662c-trusted-ca\") pod \"image-registry-85b77c8745-q88bz\" (UID: \"21d9dd2a-7747-4c79-8a50-e021bded662c\") " pod="openshift-image-registry/image-registry-85b77c8745-q88bz"
Sep 16 12:05:32.373645 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:32.373615    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/21d9dd2a-7747-4c79-8a50-e021bded662c-ca-trust-extracted\") pod \"image-registry-85b77c8745-q88bz\" (UID: \"21d9dd2a-7747-4c79-8a50-e021bded662c\") " pod="openshift-image-registry/image-registry-85b77c8745-q88bz"
Sep 16 12:05:32.374034 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:32.374007    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/21d9dd2a-7747-4c79-8a50-e021bded662c-registry-certificates\") pod \"image-registry-85b77c8745-q88bz\" (UID: \"21d9dd2a-7747-4c79-8a50-e021bded662c\") " pod="openshift-image-registry/image-registry-85b77c8745-q88bz"
Sep 16 12:05:32.374166 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:32.374027    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:05:32.374404 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:32.374383    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/21d9dd2a-7747-4c79-8a50-e021bded662c-trusted-ca\") pod \"image-registry-85b77c8745-q88bz\" (UID: \"21d9dd2a-7747-4c79-8a50-e021bded662c\") " pod="openshift-image-registry/image-registry-85b77c8745-q88bz"
Sep 16 12:05:32.375790 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:32.375770    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/21d9dd2a-7747-4c79-8a50-e021bded662c-registry-tls\") pod \"image-registry-85b77c8745-q88bz\" (UID: \"21d9dd2a-7747-4c79-8a50-e021bded662c\") " pod="openshift-image-registry/image-registry-85b77c8745-q88bz"
Sep 16 12:05:32.376283 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:32.376262    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/21d9dd2a-7747-4c79-8a50-e021bded662c-image-registry-private-configuration\") pod \"image-registry-85b77c8745-q88bz\" (UID: \"21d9dd2a-7747-4c79-8a50-e021bded662c\") " pod="openshift-image-registry/image-registry-85b77c8745-q88bz"
Sep 16 12:05:32.376427 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:32.376405    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/21d9dd2a-7747-4c79-8a50-e021bded662c-installation-pull-secrets\") pod \"image-registry-85b77c8745-q88bz\" (UID: \"21d9dd2a-7747-4c79-8a50-e021bded662c\") " pod="openshift-image-registry/image-registry-85b77c8745-q88bz"
Sep 16 12:05:32.381633 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:32.381614    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l89wb\" (UniqueName: \"kubernetes.io/projected/21d9dd2a-7747-4c79-8a50-e021bded662c-kube-api-access-l89wb\") pod \"image-registry-85b77c8745-q88bz\" (UID: \"21d9dd2a-7747-4c79-8a50-e021bded662c\") " pod="openshift-image-registry/image-registry-85b77c8745-q88bz"
Sep 16 12:05:32.383475 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:32.383455    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/21d9dd2a-7747-4c79-8a50-e021bded662c-bound-sa-token\") pod \"image-registry-85b77c8745-q88bz\" (UID: \"21d9dd2a-7747-4c79-8a50-e021bded662c\") " pod="openshift-image-registry/image-registry-85b77c8745-q88bz"
Sep 16 12:05:32.550739 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:32.550664    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pr5zs\""
Sep 16 12:05:32.558702 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:32.558677    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85b77c8745-q88bz"
Sep 16 12:05:32.821700 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:32.821624    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85d4f6697c-9k6rn"
Sep 16 12:05:32.827056 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:32.827035    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85d4f6697c-9k6rn"
Sep 16 12:05:32.829700 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:32.829678    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-85b77c8745-q88bz"]
Sep 16 12:05:32.833098 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:05:32.833077    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21d9dd2a_7747_4c79_8a50_e021bded662c.slice/crio-b42cf5e82125aa3ce716f6d2a4ed6f00f2886110717a8c46b3e03647bda37c36 WatchSource:0}: Error finding container b42cf5e82125aa3ce716f6d2a4ed6f00f2886110717a8c46b3e03647bda37c36: Status 404 returned error can't find the container with id b42cf5e82125aa3ce716f6d2a4ed6f00f2886110717a8c46b3e03647bda37c36
Sep 16 12:05:32.876887 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:32.876861    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fpdf5\" (UniqueName: \"kubernetes.io/projected/c693f93f-7292-44cd-b745-8988a839dab9-kube-api-access-fpdf5\") pod \"c693f93f-7292-44cd-b745-8988a839dab9\" (UID: \"c693f93f-7292-44cd-b745-8988a839dab9\") "
Sep 16 12:05:32.876959 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:32.876921    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c693f93f-7292-44cd-b745-8988a839dab9-bound-sa-token\") pod \"c693f93f-7292-44cd-b745-8988a839dab9\" (UID: \"c693f93f-7292-44cd-b745-8988a839dab9\") "
Sep 16 12:05:32.878800 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:32.878778    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c693f93f-7292-44cd-b745-8988a839dab9-kube-api-access-fpdf5" (OuterVolumeSpecName: "kube-api-access-fpdf5") pod "c693f93f-7292-44cd-b745-8988a839dab9" (UID: "c693f93f-7292-44cd-b745-8988a839dab9"). InnerVolumeSpecName "kube-api-access-fpdf5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:05:32.878920 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:32.878895    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c693f93f-7292-44cd-b745-8988a839dab9-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "c693f93f-7292-44cd-b745-8988a839dab9" (UID: "c693f93f-7292-44cd-b745-8988a839dab9"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:05:32.977704 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:32.977667    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c693f93f-7292-44cd-b745-8988a839dab9-registry-certificates\") pod \"c693f93f-7292-44cd-b745-8988a839dab9\" (UID: \"c693f93f-7292-44cd-b745-8988a839dab9\") "
Sep 16 12:05:32.977892 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:32.977719    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c693f93f-7292-44cd-b745-8988a839dab9-trusted-ca\") pod \"c693f93f-7292-44cd-b745-8988a839dab9\" (UID: \"c693f93f-7292-44cd-b745-8988a839dab9\") "
Sep 16 12:05:32.977892 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:32.977751    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c693f93f-7292-44cd-b745-8988a839dab9-installation-pull-secrets\") pod \"c693f93f-7292-44cd-b745-8988a839dab9\" (UID: \"c693f93f-7292-44cd-b745-8988a839dab9\") "
Sep 16 12:05:32.977892 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:32.977777    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c693f93f-7292-44cd-b745-8988a839dab9-ca-trust-extracted\") pod \"c693f93f-7292-44cd-b745-8988a839dab9\" (UID: \"c693f93f-7292-44cd-b745-8988a839dab9\") "
Sep 16 12:05:32.977892 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:32.977810    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c693f93f-7292-44cd-b745-8988a839dab9-image-registry-private-configuration\") pod \"c693f93f-7292-44cd-b745-8988a839dab9\" (UID: \"c693f93f-7292-44cd-b745-8988a839dab9\") "
Sep 16 12:05:32.978087 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:32.978018    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c693f93f-7292-44cd-b745-8988a839dab9-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "c693f93f-7292-44cd-b745-8988a839dab9" (UID: "c693f93f-7292-44cd-b745-8988a839dab9"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:05:32.978087 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:32.978062    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c693f93f-7292-44cd-b745-8988a839dab9-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "c693f93f-7292-44cd-b745-8988a839dab9" (UID: "c693f93f-7292-44cd-b745-8988a839dab9"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:05:32.978087 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:32.978078    2559 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c693f93f-7292-44cd-b745-8988a839dab9-ca-trust-extracted\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:05:32.978263 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:32.978096    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fpdf5\" (UniqueName: \"kubernetes.io/projected/c693f93f-7292-44cd-b745-8988a839dab9-kube-api-access-fpdf5\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:05:32.978263 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:32.978112    2559 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c693f93f-7292-44cd-b745-8988a839dab9-bound-sa-token\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:05:32.978263 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:32.978154    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c693f93f-7292-44cd-b745-8988a839dab9-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "c693f93f-7292-44cd-b745-8988a839dab9" (UID: "c693f93f-7292-44cd-b745-8988a839dab9"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:05:32.979927 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:32.979901    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c693f93f-7292-44cd-b745-8988a839dab9-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "c693f93f-7292-44cd-b745-8988a839dab9" (UID: "c693f93f-7292-44cd-b745-8988a839dab9"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 12:05:32.980030 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:32.979965    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c693f93f-7292-44cd-b745-8988a839dab9-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "c693f93f-7292-44cd-b745-8988a839dab9" (UID: "c693f93f-7292-44cd-b745-8988a839dab9"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 12:05:33.078821 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:33.078735    2559 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c693f93f-7292-44cd-b745-8988a839dab9-registry-certificates\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:05:33.078821 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:33.078767    2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c693f93f-7292-44cd-b745-8988a839dab9-trusted-ca\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:05:33.078821 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:33.078779    2559 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c693f93f-7292-44cd-b745-8988a839dab9-installation-pull-secrets\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:05:33.078821 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:33.078788    2559 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c693f93f-7292-44cd-b745-8988a839dab9-image-registry-private-configuration\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:05:33.809892 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:33.809865    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-hrvzp_63ee784a-3b40-4259-9923-74a24d0203a0/console-operator/5.log"
Sep 16 12:05:33.812362 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:33.812341    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-hrvzp_63ee784a-3b40-4259-9923-74a24d0203a0/console-operator/5.log"
Sep 16 12:05:33.818213 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:33.818197    2559 kubelet.go:1648] "Image garbage collection succeeded"
Sep 16 12:05:33.825393 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:33.825368    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85d4f6697c-9k6rn"
Sep 16 12:05:33.825496 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:33.825401    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-85b77c8745-q88bz" event={"ID":"21d9dd2a-7747-4c79-8a50-e021bded662c","Type":"ContainerStarted","Data":"715ab88d15dc17e22a0210c5d06ba90c23b4099176b0bbbea3c1620bd30a8d49"}
Sep 16 12:05:33.825496 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:33.825452    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-85b77c8745-q88bz" event={"ID":"21d9dd2a-7747-4c79-8a50-e021bded662c","Type":"ContainerStarted","Data":"b42cf5e82125aa3ce716f6d2a4ed6f00f2886110717a8c46b3e03647bda37c36"}
Sep 16 12:05:33.825676 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:33.825659    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-85b77c8745-q88bz"
Sep 16 12:05:33.849471 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:33.849434    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-85b77c8745-q88bz" podStartSLOduration=1.849419944 podStartE2EDuration="1.849419944s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:05:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:05:33.848484895 +0000 UTC m=+300.468804211" watchObservedRunningTime="2026-09-16 12:05:33.849419944 +0000 UTC m=+300.469739260"
Sep 16 12:05:33.873303 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:33.873179    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-85d4f6697c-9k6rn"]
Sep 16 12:05:33.904605 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:33.878728    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-85d4f6697c-9k6rn"]
Sep 16 12:05:33.904605 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:33.884470    2559 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c693f93f-7292-44cd-b745-8988a839dab9-registry-tls\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:05:33.938488 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:33.938456    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c693f93f-7292-44cd-b745-8988a839dab9" path="/var/lib/kubelet/pods/c693f93f-7292-44cd-b745-8988a839dab9/volumes"
Sep 16 12:05:39.236036 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:39.236003    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:05:40.931914 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:40.931880    2559 scope.go:117] "RemoveContainer" containerID="0bcdff328fc8be6375948106a0964eca9119cf43c3897cfb9fdedca5a214b895"
Sep 16 12:05:40.932325 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:05:40.932052    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=console-operator pod=console-operator-696884fb9c-hrvzp_openshift-console-operator(63ee784a-3b40-4259-9923-74a24d0203a0)\"" pod="openshift-console-operator/console-operator-696884fb9c-hrvzp" podUID="63ee784a-3b40-4259-9923-74a24d0203a0"
Sep 16 12:05:41.307310 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:41.307227    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:05:42.050254 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:42.050204    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ce3f4812-de43-4d0e-9ba6-b00f862ce514-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dd4bl\" (UID: \"ce3f4812-de43-4d0e-9ba6-b00f862ce514\") " pod="openshift-insights/insights-runtime-extractor-dd4bl"
Sep 16 12:05:42.052525 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:42.052506    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ce3f4812-de43-4d0e-9ba6-b00f862ce514-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dd4bl\" (UID: \"ce3f4812-de43-4d0e-9ba6-b00f862ce514\") " pod="openshift-insights/insights-runtime-extractor-dd4bl"
Sep 16 12:05:42.296259 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:42.296231    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lnmtw\""
Sep 16 12:05:42.304563 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:42.304511    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dd4bl"
Sep 16 12:05:42.575114 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:42.575044    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dd4bl"]
Sep 16 12:05:42.577856 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:05:42.577832    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce3f4812_de43_4d0e_9ba6_b00f862ce514.slice/crio-15136a24f3fbba15cda04ef83e8f5a4332fd7644658ad85425c151fd22f3fb04 WatchSource:0}: Error finding container 15136a24f3fbba15cda04ef83e8f5a4332fd7644658ad85425c151fd22f3fb04: Status 404 returned error can't find the container with id 15136a24f3fbba15cda04ef83e8f5a4332fd7644658ad85425c151fd22f3fb04
Sep 16 12:05:42.659733 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:42.659705    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 12:05:42.853406 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:42.853322    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dd4bl" event={"ID":"ce3f4812-de43-4d0e-9ba6-b00f862ce514","Type":"ContainerStarted","Data":"8d0fd5186cf81075cae392b9726b57bf37f6fa5442e67c7eb7adadb981c2c8b9"}
Sep 16 12:05:42.853406 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:42.853385    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dd4bl" event={"ID":"ce3f4812-de43-4d0e-9ba6-b00f862ce514","Type":"ContainerStarted","Data":"15136a24f3fbba15cda04ef83e8f5a4332fd7644658ad85425c151fd22f3fb04"}
Sep 16 12:05:43.858416 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:43.858380    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dd4bl" event={"ID":"ce3f4812-de43-4d0e-9ba6-b00f862ce514","Type":"ContainerStarted","Data":"a4b769e034e59dd9b700afbc0ee8787f42586f868747a90f872bd20d61741a76"}
Sep 16 12:05:43.934105 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:43.934072    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tsgc"
Sep 16 12:05:45.870526 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:45.870490    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dd4bl" event={"ID":"ce3f4812-de43-4d0e-9ba6-b00f862ce514","Type":"ContainerStarted","Data":"5d1db22a5d95cf264d404aa39543c01da7b70ddbc442e0f544ddef7602ea0194"}
Sep 16 12:05:45.888599 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:45.888548    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-dd4bl" podStartSLOduration=33.546055547 podStartE2EDuration="35.888531378s" totalImagesPullingTime="2.342475831s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:05:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:05:45.887438611 +0000 UTC m=+312.507757927" watchObservedRunningTime="2026-09-16 12:05:45.888531378 +0000 UTC m=+312.508850688"
Sep 16 12:05:47.204776 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:47.204746    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:05:47.306060 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:47.306025    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:05:47.405809 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:47.405776    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:05:47.919831 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:47.919799    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:05:48.019349 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:48.019314    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:05:54.833879 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:54.833846    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-85b77c8745-q88bz"
Sep 16 12:05:54.932679 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:54.932651    2559 scope.go:117] "RemoveContainer" containerID="0bcdff328fc8be6375948106a0964eca9119cf43c3897cfb9fdedca5a214b895"
Sep 16 12:05:54.932876 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:05:54.932855    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=console-operator pod=console-operator-696884fb9c-hrvzp_openshift-console-operator(63ee784a-3b40-4259-9923-74a24d0203a0)\"" pod="openshift-console-operator/console-operator-696884fb9c-hrvzp" podUID="63ee784a-3b40-4259-9923-74a24d0203a0"
Sep 16 12:05:54.960315 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:54.960284    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:05:55.061375 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:55.061338    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:05:55.161422 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:55.161391    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:05:56.234306 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:56.234272    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:05:56.331921 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:56.331890    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:05:56.994286 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:56.994252    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:05:57.089098 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:05:57.089066    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:06:05.932500 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:06:05.932465    2559 scope.go:117] "RemoveContainer" containerID="0bcdff328fc8be6375948106a0964eca9119cf43c3897cfb9fdedca5a214b895"
Sep 16 12:06:05.932990 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:06:05.932614    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=console-operator pod=console-operator-696884fb9c-hrvzp_openshift-console-operator(63ee784a-3b40-4259-9923-74a24d0203a0)\"" pod="openshift-console-operator/console-operator-696884fb9c-hrvzp" podUID="63ee784a-3b40-4259-9923-74a24d0203a0"
Sep 16 12:06:09.249228 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:06:09.249188    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:06:09.350954 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:06:09.350914    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:06:10.139359 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:06:10.139326    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:06:10.203345 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:06:10.203315    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:06:18.932541 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:06:18.932511    2559 scope.go:117] "RemoveContainer" containerID="0bcdff328fc8be6375948106a0964eca9119cf43c3897cfb9fdedca5a214b895"
Sep 16 12:06:18.932921 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:06:18.932671    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=console-operator pod=console-operator-696884fb9c-hrvzp_openshift-console-operator(63ee784a-3b40-4259-9923-74a24d0203a0)\"" pod="openshift-console-operator/console-operator-696884fb9c-hrvzp" podUID="63ee784a-3b40-4259-9923-74a24d0203a0"
Sep 16 12:06:20.974995 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:06:20.974964    2559 generic.go:356] "Generic (PLEG): container finished" podID="1a31434c-3312-4330-bf77-681bb7bdb281" containerID="906bbc88b1fd911ea2b3c2cf30b586f1a89226779b8c60354beecd0989dadf8a" exitCode=0
Sep 16 12:06:20.975370 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:06:20.975039    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-8r45z" event={"ID":"1a31434c-3312-4330-bf77-681bb7bdb281","Type":"ContainerDied","Data":"906bbc88b1fd911ea2b3c2cf30b586f1a89226779b8c60354beecd0989dadf8a"}
Sep 16 12:06:20.975370 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:06:20.975355    2559 scope.go:117] "RemoveContainer" containerID="906bbc88b1fd911ea2b3c2cf30b586f1a89226779b8c60354beecd0989dadf8a"
Sep 16 12:06:21.980026 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:06:21.979993    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-8r45z" event={"ID":"1a31434c-3312-4330-bf77-681bb7bdb281","Type":"ContainerStarted","Data":"559a31ead3d3335b724856173fe19d1e33e8a70e85fc178c5548c72dab764577"}
Sep 16 12:06:24.237279 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:06:24.237250    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:06:24.316285 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:06:24.316255    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:06:25.992966 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:06:25.992931    2559 generic.go:356] "Generic (PLEG): container finished" podID="2693aa2f-baac-4e11-b7c1-84fa6c51cae7" containerID="35cee1b38122321131f0c7e44ddbaba5b35cc8fa469f63646ba04bb4b77d69a9" exitCode=0
Sep 16 12:06:25.993363 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:06:25.992984    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-5rb28" event={"ID":"2693aa2f-baac-4e11-b7c1-84fa6c51cae7","Type":"ContainerDied","Data":"35cee1b38122321131f0c7e44ddbaba5b35cc8fa469f63646ba04bb4b77d69a9"}
Sep 16 12:06:25.993363 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:06:25.993299    2559 scope.go:117] "RemoveContainer" containerID="35cee1b38122321131f0c7e44ddbaba5b35cc8fa469f63646ba04bb4b77d69a9"
Sep 16 12:06:26.997995 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:06:26.997960    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-5rb28" event={"ID":"2693aa2f-baac-4e11-b7c1-84fa6c51cae7","Type":"ContainerStarted","Data":"82d891c7295eaffc93df071e8bfbecf1ae802f8080d65c15f3d885a3b685cd59"}
Sep 16 12:06:30.473327 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:06:30.473296    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:06:30.573766 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:06:30.573727    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:06:30.629606 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:06:30.629578    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:06:32.932410 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:06:32.932379    2559 scope.go:117] "RemoveContainer" containerID="0bcdff328fc8be6375948106a0964eca9119cf43c3897cfb9fdedca5a214b895"
Sep 16 12:06:32.932812 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:06:32.932545    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=console-operator pod=console-operator-696884fb9c-hrvzp_openshift-console-operator(63ee784a-3b40-4259-9923-74a24d0203a0)\"" pod="openshift-console-operator/console-operator-696884fb9c-hrvzp" podUID="63ee784a-3b40-4259-9923-74a24d0203a0"
Sep 16 12:06:39.242649 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:06:39.242611    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:06:39.347633 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:06:39.347596    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:06:43.933146 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:06:43.933102    2559 scope.go:117] "RemoveContainer" containerID="0bcdff328fc8be6375948106a0964eca9119cf43c3897cfb9fdedca5a214b895"
Sep 16 12:06:44.056664 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:06:44.056637    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-hrvzp_63ee784a-3b40-4259-9923-74a24d0203a0/console-operator/5.log"
Sep 16 12:06:44.056818 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:06:44.056714    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-hrvzp" event={"ID":"63ee784a-3b40-4259-9923-74a24d0203a0","Type":"ContainerStarted","Data":"556934b5d91a6f1273aa2f843c905df2de97af2772042c256daa405b4cb2a018"}
Sep 16 12:06:44.057027 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:06:44.057001    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-hrvzp"
Sep 16 12:06:44.088446 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:06:44.088397    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-696884fb9c-hrvzp" podStartSLOduration=364.783418842 podStartE2EDuration="6m10.088380767s" totalImagesPullingTime="5.304961925s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:00:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:06:44.087197594 +0000 UTC m=+370.707516910" watchObservedRunningTime="2026-09-16 12:06:44.088380767 +0000 UTC m=+370.708700082"
Sep 16 12:06:44.863264 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:06:44.863233    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-696884fb9c-hrvzp"
Sep 16 12:06:45.047371 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:06:45.047339    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-76f99584f4-5hnxh"]
Sep 16 12:06:45.049354 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:06:45.049332    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-5hnxh"
Sep 16 12:06:45.051952 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:06:45.051927    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-vtpg5\""
Sep 16 12:06:45.052067 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:06:45.051954    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 16 12:06:45.052067 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:06:45.051927    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 16 12:06:45.053347 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:06:45.053320    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:06:45.062246 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:06:45.062224    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-5hnxh"]
Sep 16 12:06:45.138888 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:06:45.138802    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:06:45.152999 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:06:45.152969    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpn7j\" (UniqueName: \"kubernetes.io/projected/3e7df9eb-85be-4e46-9d5a-0d490c9b267f-kube-api-access-gpn7j\") pod \"downloads-76f99584f4-5hnxh\" (UID: \"3e7df9eb-85be-4e46-9d5a-0d490c9b267f\") " pod="openshift-console/downloads-76f99584f4-5hnxh"
Sep 16 12:06:45.254068 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:06:45.254034    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpn7j\" (UniqueName: \"kubernetes.io/projected/3e7df9eb-85be-4e46-9d5a-0d490c9b267f-kube-api-access-gpn7j\") pod \"downloads-76f99584f4-5hnxh\" (UID: \"3e7df9eb-85be-4e46-9d5a-0d490c9b267f\") " pod="openshift-console/downloads-76f99584f4-5hnxh"
Sep 16 12:06:45.262716 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:06:45.262695    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpn7j\" (UniqueName: \"kubernetes.io/projected/3e7df9eb-85be-4e46-9d5a-0d490c9b267f-kube-api-access-gpn7j\") pod \"downloads-76f99584f4-5hnxh\" (UID: \"3e7df9eb-85be-4e46-9d5a-0d490c9b267f\") " pod="openshift-console/downloads-76f99584f4-5hnxh"
Sep 16 12:06:45.331917 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:06:45.331884    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:06:45.358452 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:06:45.358424    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-5hnxh"
Sep 16 12:06:45.519626 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:06:45.519589    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:06:45.581417 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:06:45.581383    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:06:45.630520 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:06:45.630482    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-5hnxh"]
Sep 16 12:06:45.633996 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:06:45.633964    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e7df9eb_85be_4e46_9d5a_0d490c9b267f.slice/crio-82834bdcde3703a99a74747c6c628157fe2d2698ca8508f28d10a1790a004612 WatchSource:0}: Error finding container 82834bdcde3703a99a74747c6c628157fe2d2698ca8508f28d10a1790a004612: Status 404 returned error can't find the container with id 82834bdcde3703a99a74747c6c628157fe2d2698ca8508f28d10a1790a004612
Sep 16 12:06:45.740639 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:06:45.740547    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:06:45.800419 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:06:45.800382    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:06:46.063679 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:06:46.063586    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-5hnxh" event={"ID":"3e7df9eb-85be-4e46-9d5a-0d490c9b267f","Type":"ContainerStarted","Data":"82834bdcde3703a99a74747c6c628157fe2d2698ca8508f28d10a1790a004612"}
Sep 16 12:06:46.125687 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:06:46.125645    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:06:46.183487 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:06:46.183454    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:06:46.724112 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:06:46.724082    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:06:46.868404 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:06:46.868367    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e261eb8b-bfaa-491d-afbe-6eb8fbc57324-metrics-certs\") pod \"network-metrics-daemon-6tsgc\" (UID: \"e261eb8b-bfaa-491d-afbe-6eb8fbc57324\") " pod="openshift-multus/network-metrics-daemon-6tsgc"
Sep 16 12:06:46.871023 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:06:46.870991    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e261eb8b-bfaa-491d-afbe-6eb8fbc57324-metrics-certs\") pod \"network-metrics-daemon-6tsgc\" (UID: \"e261eb8b-bfaa-491d-afbe-6eb8fbc57324\") " pod="openshift-multus/network-metrics-daemon-6tsgc"
Sep 16 12:06:46.927147 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:06:46.927103    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:06:46.937484 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:06:46.937462    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hp2p6\""
Sep 16 12:06:46.944891 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:06:46.944873    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tsgc"
Sep 16 12:06:47.216887 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:06:47.216851    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6tsgc"]
Sep 16 12:06:47.220623 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:06:47.220587    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode261eb8b_bfaa_491d_afbe_6eb8fbc57324.slice/crio-80c83991715316a026da0d2608f67c0c618dd32880b4b5d157ebb7f54485916f WatchSource:0}: Error finding container 80c83991715316a026da0d2608f67c0c618dd32880b4b5d157ebb7f54485916f: Status 404 returned error can't find the container with id 80c83991715316a026da0d2608f67c0c618dd32880b4b5d157ebb7f54485916f
Sep 16 12:06:47.236795 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:06:47.236759    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:06:48.072638 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:06:48.072596    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6tsgc" event={"ID":"e261eb8b-bfaa-491d-afbe-6eb8fbc57324","Type":"ContainerStarted","Data":"80c83991715316a026da0d2608f67c0c618dd32880b4b5d157ebb7f54485916f"}
Sep 16 12:06:48.145318 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:06:48.145280    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:06:48.242412 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:06:48.242377    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:06:49.078971 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:06:49.078936    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6tsgc" event={"ID":"e261eb8b-bfaa-491d-afbe-6eb8fbc57324","Type":"ContainerStarted","Data":"800150ba246aaa1f728336347474ec32ac1f3c02ebebc08e69ee8bd336838978"}
Sep 16 12:06:49.079155 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:06:49.078992    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6tsgc" event={"ID":"e261eb8b-bfaa-491d-afbe-6eb8fbc57324","Type":"ContainerStarted","Data":"32ea4c0ef48d46384a60293f36d44388bc9be77a2eefa28fe5a9198d0557ddd4"}
Sep 16 12:06:49.097075 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:06:49.097025    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-6tsgc" podStartSLOduration=373.8745199 podStartE2EDuration="6m15.097012399s" totalImagesPullingTime="1.222492499s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:00:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:06:49.096655385 +0000 UTC m=+375.716974702" watchObservedRunningTime="2026-09-16 12:06:49.097012399 +0000 UTC m=+375.717331714"
Sep 16 12:06:49.198619 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:06:49.198587    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:06:49.264746 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:06:49.264711    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:06:57.500048 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:06:57.500009    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:06:57.601397 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:06:57.601357    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:06:59.953263 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:06:59.953227    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:07:00.026059 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:00.026005    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:07:00.275984 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:00.275896    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:07:00.378392 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:00.378358    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:07:00.458418 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:00.458369    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:07:03.135027 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:03.134978    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-5hnxh" event={"ID":"3e7df9eb-85be-4e46-9d5a-0d490c9b267f","Type":"ContainerStarted","Data":"d384b829cfde9abfff5e29643aed9b069553dade9aee542a9bab4adf8ade5069"}
Sep 16 12:07:03.135530 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:03.135272    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-76f99584f4-5hnxh"
Sep 16 12:07:03.155313 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:03.155283    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-76f99584f4-5hnxh"
Sep 16 12:07:03.163200 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:03.163149    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-76f99584f4-5hnxh" podStartSLOduration=1.5164461729999998 podStartE2EDuration="18.163112582s" totalImagesPullingTime="16.646666409s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:06:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:07:03.160421883 +0000 UTC m=+389.780741203" watchObservedRunningTime="2026-09-16 12:07:03.163112582 +0000 UTC m=+389.783431899"
Sep 16 12:07:03.574696 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:03.574659    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:07:03.660921 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:03.660871    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:07:08.359089 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:08.359050    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:07:08.428973 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:08.428938    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:07:09.360001 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:09.359956    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:07:09.418495 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:09.418456    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:07:12.756040 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:12.756003    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:07:12.811306 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:12.811265    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:07:13.775266 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:13.775235    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:07:13.847628 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:13.847599    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:07:18.770943 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:07:18.770896    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[cluster-monitoring-operator-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-dk9qm" podUID="3c5a71bb-e6d1-45d8-8872-4165a3aa09e2"
Sep 16 12:07:18.770943 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:07:18.770909    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-48mv7" podUID="895f0b5d-bd3c-4065-8681-43f68ef87d04"
Sep 16 12:07:18.770943 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:07:18.770917    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-bcrqz" podUID="b153e4d5-33a6-4e3f-aa63-8aec2c778bb7"
Sep 16 12:07:19.189613 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:19.189581    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-dk9qm"
Sep 16 12:07:19.189798 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:19.189581    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bcrqz"
Sep 16 12:07:19.189798 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:19.189586    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-48mv7"
Sep 16 12:07:20.877050 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:20.877012    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/895f0b5d-bd3c-4065-8681-43f68ef87d04-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-48mv7\" (UID: \"895f0b5d-bd3c-4065-8681-43f68ef87d04\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-48mv7"
Sep 16 12:07:20.877450 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:20.877062    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b153e4d5-33a6-4e3f-aa63-8aec2c778bb7-metrics-tls\") pod \"dns-default-bcrqz\" (UID: \"b153e4d5-33a6-4e3f-aa63-8aec2c778bb7\") " pod="openshift-dns/dns-default-bcrqz"
Sep 16 12:07:20.877450 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:20.877093    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3c5a71bb-e6d1-45d8-8872-4165a3aa09e2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-dk9qm\" (UID: \"3c5a71bb-e6d1-45d8-8872-4165a3aa09e2\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-dk9qm"
Sep 16 12:07:20.879566 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:20.879539    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b153e4d5-33a6-4e3f-aa63-8aec2c778bb7-metrics-tls\") pod \"dns-default-bcrqz\" (UID: \"b153e4d5-33a6-4e3f-aa63-8aec2c778bb7\") " pod="openshift-dns/dns-default-bcrqz"
Sep 16 12:07:20.879680 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:20.879578    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/895f0b5d-bd3c-4065-8681-43f68ef87d04-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-48mv7\" (UID: \"895f0b5d-bd3c-4065-8681-43f68ef87d04\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-48mv7"
Sep 16 12:07:20.879680 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:20.879578    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3c5a71bb-e6d1-45d8-8872-4165a3aa09e2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-dk9qm\" (UID: \"3c5a71bb-e6d1-45d8-8872-4165a3aa09e2\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-dk9qm"
Sep 16 12:07:20.997098 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:20.997061    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rfzsk\""
Sep 16 12:07:20.997305 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:20.997120    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-dp8xk\""
Sep 16 12:07:20.997305 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:20.997121    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-5fm85\""
Sep 16 12:07:21.000891 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:21.000870    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-48mv7"
Sep 16 12:07:21.000891 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:21.000884    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-dk9qm"
Sep 16 12:07:21.001016 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:21.000912    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bcrqz"
Sep 16 12:07:21.323462 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:21.323434    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-48mv7"]
Sep 16 12:07:21.324142 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:07:21.324111    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod895f0b5d_bd3c_4065_8681_43f68ef87d04.slice/crio-021ab627a4150a173b128b635b61f77303c3a915b8b80cb4e446cbd7f534d84e WatchSource:0}: Error finding container 021ab627a4150a173b128b635b61f77303c3a915b8b80cb4e446cbd7f534d84e: Status 404 returned error can't find the container with id 021ab627a4150a173b128b635b61f77303c3a915b8b80cb4e446cbd7f534d84e
Sep 16 12:07:21.365168 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:21.365125    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-dk9qm"]
Sep 16 12:07:21.367472 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:07:21.367448    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c5a71bb_e6d1_45d8_8872_4165a3aa09e2.slice/crio-5102aeca209cda0b5044491d3a286ca4f2ff8ef50d121a2fa5a2a7ce9b3b50be WatchSource:0}: Error finding container 5102aeca209cda0b5044491d3a286ca4f2ff8ef50d121a2fa5a2a7ce9b3b50be: Status 404 returned error can't find the container with id 5102aeca209cda0b5044491d3a286ca4f2ff8ef50d121a2fa5a2a7ce9b3b50be
Sep 16 12:07:21.376387 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:21.376364    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bcrqz"]
Sep 16 12:07:21.378305 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:07:21.378284    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb153e4d5_33a6_4e3f_aa63_8aec2c778bb7.slice/crio-99b2435b6278755700332bbc5578362232040847c6cd69adb66475f491b9dff6 WatchSource:0}: Error finding container 99b2435b6278755700332bbc5578362232040847c6cd69adb66475f491b9dff6: Status 404 returned error can't find the container with id 99b2435b6278755700332bbc5578362232040847c6cd69adb66475f491b9dff6
Sep 16 12:07:22.202937 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:22.202857    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bcrqz" event={"ID":"b153e4d5-33a6-4e3f-aa63-8aec2c778bb7","Type":"ContainerStarted","Data":"99b2435b6278755700332bbc5578362232040847c6cd69adb66475f491b9dff6"}
Sep 16 12:07:22.204432 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:22.204386    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-48mv7" event={"ID":"895f0b5d-bd3c-4065-8681-43f68ef87d04","Type":"ContainerStarted","Data":"021ab627a4150a173b128b635b61f77303c3a915b8b80cb4e446cbd7f534d84e"}
Sep 16 12:07:22.206001 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:22.205973    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-dk9qm" event={"ID":"3c5a71bb-e6d1-45d8-8872-4165a3aa09e2","Type":"ContainerStarted","Data":"5102aeca209cda0b5044491d3a286ca4f2ff8ef50d121a2fa5a2a7ce9b3b50be"}
Sep 16 12:07:24.332324 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:24.332288    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:07:24.444472 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:24.444413    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:07:25.123532 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:25.123450    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:07:25.218788 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:25.218746    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-dk9qm" event={"ID":"3c5a71bb-e6d1-45d8-8872-4165a3aa09e2","Type":"ContainerStarted","Data":"16766dbe3e0d56be6f8559f2ddd35a4112b83c628a132a07d7abfe2215a736d0"}
Sep 16 12:07:25.220903 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:25.220875    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bcrqz" event={"ID":"b153e4d5-33a6-4e3f-aa63-8aec2c778bb7","Type":"ContainerStarted","Data":"c0e935370b11331596557c2cd23bbc13cbffa397f7f04d3a134d2c3cfc520dff"}
Sep 16 12:07:25.221040 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:25.220921    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bcrqz" event={"ID":"b153e4d5-33a6-4e3f-aa63-8aec2c778bb7","Type":"ContainerStarted","Data":"959280c95a498e9ad9da984cf787f7b5fd0371d7921a5983536ca47d66608fde"}
Sep 16 12:07:25.221040 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:25.220962    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-bcrqz"
Sep 16 12:07:25.222684 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:25.222659    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-48mv7" event={"ID":"895f0b5d-bd3c-4065-8681-43f68ef87d04","Type":"ContainerStarted","Data":"557c5f1f9a98764d9d5f159f98d102578026fc8a33f7ee8bcbe5850c981c9c74"}
Sep 16 12:07:25.241923 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:25.241881    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:07:25.257435 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:25.257389    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-dk9qm" podStartSLOduration=408.028767915 podStartE2EDuration="6m51.257375405s" totalImagesPullingTime="3.22860749s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:00:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:07:25.257047529 +0000 UTC m=+411.877366843" watchObservedRunningTime="2026-09-16 12:07:25.257375405 +0000 UTC m=+411.877694721"
Sep 16 12:07:25.331033 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:25.330983    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-48mv7" podStartSLOduration=400.116820117 podStartE2EDuration="6m43.330965444s" totalImagesPullingTime="3.214145327s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:00:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:07:25.328336926 +0000 UTC m=+411.948656243" watchObservedRunningTime="2026-09-16 12:07:25.330965444 +0000 UTC m=+411.951284760"
Sep 16 12:07:25.331466 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:25.331441    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-bcrqz" podStartSLOduration=374.116708149 podStartE2EDuration="6m17.331433111s" totalImagesPullingTime="3.214724962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:01:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:07:25.291971985 +0000 UTC m=+411.912291313" watchObservedRunningTime="2026-09-16 12:07:25.331433111 +0000 UTC m=+411.951752427"
Sep 16 12:07:25.371549 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:25.371508    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:07:25.512571 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:25.512529    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:07:25.619892 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:25.619852    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:07:25.719017 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:25.718979    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:07:29.314489 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:29.314448    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:07:29.338105 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:29.338074    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-rqht4"]
Sep 16 12:07:29.353072 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:29.353041    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-rqht4"]
Sep 16 12:07:29.353245 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:29.353190    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-rqht4"
Sep 16 12:07:29.355913 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:29.355872    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 16 12:07:29.355913 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:29.355890    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 16 12:07:29.357011 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:29.356992    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-qbkr6\""
Sep 16 12:07:29.357125 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:29.357021    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 16 12:07:29.376825 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:29.376798    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:07:29.439760 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:29.439718    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcqbp\" (UniqueName: \"kubernetes.io/projected/2ec6019f-4aa8-4bd8-ac53-8510a5cfcf6b-kube-api-access-zcqbp\") pod \"prometheus-operator-68bcd7f987-rqht4\" (UID: \"2ec6019f-4aa8-4bd8-ac53-8510a5cfcf6b\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-rqht4"
Sep 16 12:07:29.439915 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:29.439779    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2ec6019f-4aa8-4bd8-ac53-8510a5cfcf6b-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-rqht4\" (UID: \"2ec6019f-4aa8-4bd8-ac53-8510a5cfcf6b\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-rqht4"
Sep 16 12:07:29.439915 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:29.439801    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2ec6019f-4aa8-4bd8-ac53-8510a5cfcf6b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-rqht4\" (UID: \"2ec6019f-4aa8-4bd8-ac53-8510a5cfcf6b\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-rqht4"
Sep 16 12:07:29.439915 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:29.439836    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ec6019f-4aa8-4bd8-ac53-8510a5cfcf6b-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-rqht4\" (UID: \"2ec6019f-4aa8-4bd8-ac53-8510a5cfcf6b\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-rqht4"
Sep 16 12:07:29.541099 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:29.541069    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2ec6019f-4aa8-4bd8-ac53-8510a5cfcf6b-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-rqht4\" (UID: \"2ec6019f-4aa8-4bd8-ac53-8510a5cfcf6b\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-rqht4"
Sep 16 12:07:29.541276 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:29.541105    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2ec6019f-4aa8-4bd8-ac53-8510a5cfcf6b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-rqht4\" (UID: \"2ec6019f-4aa8-4bd8-ac53-8510a5cfcf6b\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-rqht4"
Sep 16 12:07:29.541276 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:29.541157    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ec6019f-4aa8-4bd8-ac53-8510a5cfcf6b-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-rqht4\" (UID: \"2ec6019f-4aa8-4bd8-ac53-8510a5cfcf6b\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-rqht4"
Sep 16 12:07:29.541276 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:29.541184    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcqbp\" (UniqueName: \"kubernetes.io/projected/2ec6019f-4aa8-4bd8-ac53-8510a5cfcf6b-kube-api-access-zcqbp\") pod \"prometheus-operator-68bcd7f987-rqht4\" (UID: \"2ec6019f-4aa8-4bd8-ac53-8510a5cfcf6b\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-rqht4"
Sep 16 12:07:29.541397 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:07:29.541312    2559 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Sep 16 12:07:29.541397 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:07:29.541386    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ec6019f-4aa8-4bd8-ac53-8510a5cfcf6b-prometheus-operator-tls podName:2ec6019f-4aa8-4bd8-ac53-8510a5cfcf6b nodeName:}" failed. No retries permitted until 2026-09-16 12:07:30.04136408 +0000 UTC m=+416.661683392 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/2ec6019f-4aa8-4bd8-ac53-8510a5cfcf6b-prometheus-operator-tls") pod "prometheus-operator-68bcd7f987-rqht4" (UID: "2ec6019f-4aa8-4bd8-ac53-8510a5cfcf6b") : secret "prometheus-operator-tls" not found
Sep 16 12:07:29.541846 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:29.541827    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2ec6019f-4aa8-4bd8-ac53-8510a5cfcf6b-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-rqht4\" (UID: \"2ec6019f-4aa8-4bd8-ac53-8510a5cfcf6b\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-rqht4"
Sep 16 12:07:29.543562 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:29.543544    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2ec6019f-4aa8-4bd8-ac53-8510a5cfcf6b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-rqht4\" (UID: \"2ec6019f-4aa8-4bd8-ac53-8510a5cfcf6b\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-rqht4"
Sep 16 12:07:29.550718 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:29.550692    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcqbp\" (UniqueName: \"kubernetes.io/projected/2ec6019f-4aa8-4bd8-ac53-8510a5cfcf6b-kube-api-access-zcqbp\") pod \"prometheus-operator-68bcd7f987-rqht4\" (UID: \"2ec6019f-4aa8-4bd8-ac53-8510a5cfcf6b\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-rqht4"
Sep 16 12:07:30.010167 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:30.010111    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:07:30.044448 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:30.044415    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ec6019f-4aa8-4bd8-ac53-8510a5cfcf6b-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-rqht4\" (UID: \"2ec6019f-4aa8-4bd8-ac53-8510a5cfcf6b\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-rqht4"
Sep 16 12:07:30.046828 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:30.046797    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ec6019f-4aa8-4bd8-ac53-8510a5cfcf6b-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-rqht4\" (UID: \"2ec6019f-4aa8-4bd8-ac53-8510a5cfcf6b\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-rqht4"
Sep 16 12:07:30.263013 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:30.262929    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-rqht4"
Sep 16 12:07:30.557870 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:30.557788    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-rqht4"]
Sep 16 12:07:30.561811 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:07:30.561776    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ec6019f_4aa8_4bd8_ac53_8510a5cfcf6b.slice/crio-1ec73dfd0250c51b38e9be1558329b454944af3b7a0fd19b67032340f6ebd447 WatchSource:0}: Error finding container 1ec73dfd0250c51b38e9be1558329b454944af3b7a0fd19b67032340f6ebd447: Status 404 returned error can't find the container with id 1ec73dfd0250c51b38e9be1558329b454944af3b7a0fd19b67032340f6ebd447
Sep 16 12:07:31.245803 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:31.245760    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-rqht4" event={"ID":"2ec6019f-4aa8-4bd8-ac53-8510a5cfcf6b","Type":"ContainerStarted","Data":"1ec73dfd0250c51b38e9be1558329b454944af3b7a0fd19b67032340f6ebd447"}
Sep 16 12:07:31.849507 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:31.849418    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:07:32.251726 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:32.251691    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-rqht4" event={"ID":"2ec6019f-4aa8-4bd8-ac53-8510a5cfcf6b","Type":"ContainerStarted","Data":"0692bdbb171fd9c59dc57c38085dc1ee5c57a457266bd8cdab1b69c3b0142f2c"}
Sep 16 12:07:32.251932 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:32.251744    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-rqht4" event={"ID":"2ec6019f-4aa8-4bd8-ac53-8510a5cfcf6b","Type":"ContainerStarted","Data":"0708885a42e693f613936e97273528aec7c3085b2406e17c89a7d01724b79b3e"}
Sep 16 12:07:32.268871 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:32.268812    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-68bcd7f987-rqht4" podStartSLOduration=2.235128981 podStartE2EDuration="3.268795235s" totalImagesPullingTime="1.033666254s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:07:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:07:32.267465803 +0000 UTC m=+418.887785119" watchObservedRunningTime="2026-09-16 12:07:32.268795235 +0000 UTC m=+418.889114550"
Sep 16 12:07:33.528817 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:33.528786    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:07:33.751002 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:33.750968    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:07:33.769329 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:33.769297    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-mmggg"]
Sep 16 12:07:33.771874 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:33.771852    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mmggg"
Sep 16 12:07:33.774451 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:33.774427    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 16 12:07:33.774583 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:33.774437    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 16 12:07:33.774583 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:33.774551    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 16 12:07:33.774734 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:33.774718    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-rk4zl\""
Sep 16 12:07:33.858687 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:33.858585    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:07:33.874919 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:33.874885    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cd7a3585-5624-4e47-8ac5-cbe16dc117c2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mmggg\" (UID: \"cd7a3585-5624-4e47-8ac5-cbe16dc117c2\") " pod="openshift-monitoring/node-exporter-mmggg"
Sep 16 12:07:33.875087 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:33.874930    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cd7a3585-5624-4e47-8ac5-cbe16dc117c2-sys\") pod \"node-exporter-mmggg\" (UID: \"cd7a3585-5624-4e47-8ac5-cbe16dc117c2\") " pod="openshift-monitoring/node-exporter-mmggg"
Sep 16 12:07:33.875087 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:33.874961    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd7a3585-5624-4e47-8ac5-cbe16dc117c2-metrics-client-ca\") pod \"node-exporter-mmggg\" (UID: \"cd7a3585-5624-4e47-8ac5-cbe16dc117c2\") " pod="openshift-monitoring/node-exporter-mmggg"
Sep 16 12:07:33.875087 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:33.874995    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x929d\" (UniqueName: \"kubernetes.io/projected/cd7a3585-5624-4e47-8ac5-cbe16dc117c2-kube-api-access-x929d\") pod \"node-exporter-mmggg\" (UID: \"cd7a3585-5624-4e47-8ac5-cbe16dc117c2\") " pod="openshift-monitoring/node-exporter-mmggg"
Sep 16 12:07:33.875087 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:33.875035    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cd7a3585-5624-4e47-8ac5-cbe16dc117c2-node-exporter-accelerators-collector-config\") pod \"node-exporter-mmggg\" (UID: \"cd7a3585-5624-4e47-8ac5-cbe16dc117c2\") " pod="openshift-monitoring/node-exporter-mmggg"
Sep 16 12:07:33.875269 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:33.875080    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cd7a3585-5624-4e47-8ac5-cbe16dc117c2-node-exporter-wtmp\") pod \"node-exporter-mmggg\" (UID: \"cd7a3585-5624-4e47-8ac5-cbe16dc117c2\") " pod="openshift-monitoring/node-exporter-mmggg"
Sep 16 12:07:33.875269 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:33.875122    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cd7a3585-5624-4e47-8ac5-cbe16dc117c2-node-exporter-tls\") pod \"node-exporter-mmggg\" (UID: \"cd7a3585-5624-4e47-8ac5-cbe16dc117c2\") " pod="openshift-monitoring/node-exporter-mmggg"
Sep 16 12:07:33.875269 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:33.875167    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cd7a3585-5624-4e47-8ac5-cbe16dc117c2-root\") pod \"node-exporter-mmggg\" (UID: \"cd7a3585-5624-4e47-8ac5-cbe16dc117c2\") " pod="openshift-monitoring/node-exporter-mmggg"
Sep 16 12:07:33.875269 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:33.875185    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cd7a3585-5624-4e47-8ac5-cbe16dc117c2-node-exporter-textfile\") pod \"node-exporter-mmggg\" (UID: \"cd7a3585-5624-4e47-8ac5-cbe16dc117c2\") " pod="openshift-monitoring/node-exporter-mmggg"
Sep 16 12:07:33.956408 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:33.956378    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:07:33.976433 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:33.976406    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cd7a3585-5624-4e47-8ac5-cbe16dc117c2-node-exporter-tls\") pod \"node-exporter-mmggg\" (UID: \"cd7a3585-5624-4e47-8ac5-cbe16dc117c2\") " pod="openshift-monitoring/node-exporter-mmggg"
Sep 16 12:07:33.976549 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:33.976439    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cd7a3585-5624-4e47-8ac5-cbe16dc117c2-root\") pod \"node-exporter-mmggg\" (UID: \"cd7a3585-5624-4e47-8ac5-cbe16dc117c2\") " pod="openshift-monitoring/node-exporter-mmggg"
Sep 16 12:07:33.976549 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:33.976455    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cd7a3585-5624-4e47-8ac5-cbe16dc117c2-node-exporter-textfile\") pod \"node-exporter-mmggg\" (UID: \"cd7a3585-5624-4e47-8ac5-cbe16dc117c2\") " pod="openshift-monitoring/node-exporter-mmggg"
Sep 16 12:07:33.976549 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:33.976501    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cd7a3585-5624-4e47-8ac5-cbe16dc117c2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mmggg\" (UID: \"cd7a3585-5624-4e47-8ac5-cbe16dc117c2\") " pod="openshift-monitoring/node-exporter-mmggg"
Sep 16 12:07:33.976549 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:33.976534    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cd7a3585-5624-4e47-8ac5-cbe16dc117c2-sys\") pod \"node-exporter-mmggg\" (UID: \"cd7a3585-5624-4e47-8ac5-cbe16dc117c2\") " pod="openshift-monitoring/node-exporter-mmggg"
Sep 16 12:07:33.976549 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:33.976535    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cd7a3585-5624-4e47-8ac5-cbe16dc117c2-root\") pod \"node-exporter-mmggg\" (UID: \"cd7a3585-5624-4e47-8ac5-cbe16dc117c2\") " pod="openshift-monitoring/node-exporter-mmggg"
Sep 16 12:07:33.976777 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:33.976557    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd7a3585-5624-4e47-8ac5-cbe16dc117c2-metrics-client-ca\") pod \"node-exporter-mmggg\" (UID: \"cd7a3585-5624-4e47-8ac5-cbe16dc117c2\") " pod="openshift-monitoring/node-exporter-mmggg"
Sep 16 12:07:33.976777 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:33.976579    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x929d\" (UniqueName: \"kubernetes.io/projected/cd7a3585-5624-4e47-8ac5-cbe16dc117c2-kube-api-access-x929d\") pod \"node-exporter-mmggg\" (UID: \"cd7a3585-5624-4e47-8ac5-cbe16dc117c2\") " pod="openshift-monitoring/node-exporter-mmggg"
Sep 16 12:07:33.976777 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:33.976615    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cd7a3585-5624-4e47-8ac5-cbe16dc117c2-node-exporter-accelerators-collector-config\") pod \"node-exporter-mmggg\" (UID: \"cd7a3585-5624-4e47-8ac5-cbe16dc117c2\") " pod="openshift-monitoring/node-exporter-mmggg"
Sep 16 12:07:33.976777 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:33.976638    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cd7a3585-5624-4e47-8ac5-cbe16dc117c2-node-exporter-wtmp\") pod \"node-exporter-mmggg\" (UID: \"cd7a3585-5624-4e47-8ac5-cbe16dc117c2\") " pod="openshift-monitoring/node-exporter-mmggg"
Sep 16 12:07:33.976777 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:33.976643    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cd7a3585-5624-4e47-8ac5-cbe16dc117c2-sys\") pod \"node-exporter-mmggg\" (UID: \"cd7a3585-5624-4e47-8ac5-cbe16dc117c2\") " pod="openshift-monitoring/node-exporter-mmggg"
Sep 16 12:07:33.976777 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:33.976773    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cd7a3585-5624-4e47-8ac5-cbe16dc117c2-node-exporter-textfile\") pod \"node-exporter-mmggg\" (UID: \"cd7a3585-5624-4e47-8ac5-cbe16dc117c2\") " pod="openshift-monitoring/node-exporter-mmggg"
Sep 16 12:07:33.976972 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:33.976784    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cd7a3585-5624-4e47-8ac5-cbe16dc117c2-node-exporter-wtmp\") pod \"node-exporter-mmggg\" (UID: \"cd7a3585-5624-4e47-8ac5-cbe16dc117c2\") " pod="openshift-monitoring/node-exporter-mmggg"
Sep 16 12:07:33.977159 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:33.977118    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd7a3585-5624-4e47-8ac5-cbe16dc117c2-metrics-client-ca\") pod \"node-exporter-mmggg\" (UID: \"cd7a3585-5624-4e47-8ac5-cbe16dc117c2\") " pod="openshift-monitoring/node-exporter-mmggg"
Sep 16 12:07:33.981480 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:33.981460    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 16 12:07:33.981545 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:33.981485    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 16 12:07:33.981545 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:33.981536    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 16 12:07:33.987341 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:33.987303    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cd7a3585-5624-4e47-8ac5-cbe16dc117c2-node-exporter-accelerators-collector-config\") pod \"node-exporter-mmggg\" (UID: \"cd7a3585-5624-4e47-8ac5-cbe16dc117c2\") " pod="openshift-monitoring/node-exporter-mmggg"
Sep 16 12:07:33.989127 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:33.989108    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cd7a3585-5624-4e47-8ac5-cbe16dc117c2-node-exporter-tls\") pod \"node-exporter-mmggg\" (UID: \"cd7a3585-5624-4e47-8ac5-cbe16dc117c2\") " pod="openshift-monitoring/node-exporter-mmggg"
Sep 16 12:07:33.989294 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:33.989278    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cd7a3585-5624-4e47-8ac5-cbe16dc117c2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mmggg\" (UID: \"cd7a3585-5624-4e47-8ac5-cbe16dc117c2\") " pod="openshift-monitoring/node-exporter-mmggg"
Sep 16 12:07:33.989342 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:33.989328    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x929d\" (UniqueName: \"kubernetes.io/projected/cd7a3585-5624-4e47-8ac5-cbe16dc117c2-kube-api-access-x929d\") pod \"node-exporter-mmggg\" (UID: \"cd7a3585-5624-4e47-8ac5-cbe16dc117c2\") " pod="openshift-monitoring/node-exporter-mmggg"
Sep 16 12:07:34.055932 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:34.055898    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:07:34.083372 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:34.083346    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-rk4zl\""
Sep 16 12:07:34.090653 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:34.090632    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mmggg"
Sep 16 12:07:34.102883 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:07:34.102855    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd7a3585_5624_4e47_8ac5_cbe16dc117c2.slice/crio-2af71eefb010eeb2b8f0b17fc558abe0c7cc32bfc3bc651d94e29ca77511aaa5 WatchSource:0}: Error finding container 2af71eefb010eeb2b8f0b17fc558abe0c7cc32bfc3bc651d94e29ca77511aaa5: Status 404 returned error can't find the container with id 2af71eefb010eeb2b8f0b17fc558abe0c7cc32bfc3bc651d94e29ca77511aaa5
Sep 16 12:07:34.236989 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:34.236954    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:07:34.259634 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:34.259594    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mmggg" event={"ID":"cd7a3585-5624-4e47-8ac5-cbe16dc117c2","Type":"ContainerStarted","Data":"2af71eefb010eeb2b8f0b17fc558abe0c7cc32bfc3bc651d94e29ca77511aaa5"}
Sep 16 12:07:34.336207 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:34.336172    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:07:34.743939 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:34.743883    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:07:34.819298 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:34.819240    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:07:35.203891 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:35.203867    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:07:35.228513 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:35.228490    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-bcrqz"
Sep 16 12:07:35.266750 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:35.266718    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mmggg" event={"ID":"cd7a3585-5624-4e47-8ac5-cbe16dc117c2","Type":"ContainerStarted","Data":"a08ec528364cbddd919d1007196db1fc6a00fce917d25fa11cbc372d98a748b8"}
Sep 16 12:07:36.272804 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:36.272773    2559 generic.go:356] "Generic (PLEG): container finished" podID="cd7a3585-5624-4e47-8ac5-cbe16dc117c2" containerID="a08ec528364cbddd919d1007196db1fc6a00fce917d25fa11cbc372d98a748b8" exitCode=0
Sep 16 12:07:36.273205 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:36.272858    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mmggg" event={"ID":"cd7a3585-5624-4e47-8ac5-cbe16dc117c2","Type":"ContainerDied","Data":"a08ec528364cbddd919d1007196db1fc6a00fce917d25fa11cbc372d98a748b8"}
Sep 16 12:07:36.717079 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:36.717040    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:07:36.792432 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:36.792392    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:07:36.951716 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:36.951684    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:07:37.008236 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:37.008153    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:07:37.280096 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:37.280007    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mmggg" event={"ID":"cd7a3585-5624-4e47-8ac5-cbe16dc117c2","Type":"ContainerStarted","Data":"93bbb55a784870ad12adefa40df71c424eaafc930b061304fa00198d45bd1b2e"}
Sep 16 12:07:37.280478 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:37.280113    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mmggg" event={"ID":"cd7a3585-5624-4e47-8ac5-cbe16dc117c2","Type":"ContainerStarted","Data":"14954eff94b32cec4447ab0c7309eae6a179e16747b8e283f9f73e5985551cda"}
Sep 16 12:07:37.299089 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:37.299038    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-mmggg" podStartSLOduration=3.157453388 podStartE2EDuration="4.299023143s" totalImagesPullingTime="1.070458041s" totalInitContainerRuntime="71.111714ms" isStatefulPod=true podCreationTimestamp="2026-09-16 12:07:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:07:37.297929884 +0000 UTC m=+423.918249211" watchObservedRunningTime="2026-09-16 12:07:37.299023143 +0000 UTC m=+423.919342458"
Sep 16 12:07:38.249968 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:38.249934    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-9484849cb-qjktm"]
Sep 16 12:07:38.267327 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:38.267289    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-9484849cb-qjktm"]
Sep 16 12:07:38.267498 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:38.267382    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-9484849cb-qjktm"
Sep 16 12:07:38.271242 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:38.271214    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 16 12:07:38.271382 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:38.271250    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dgeqdi7344lg7\""
Sep 16 12:07:38.271382 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:38.271303    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 16 12:07:38.271382 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:38.271217    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 16 12:07:38.271382 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:38.271365    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-cjc22\""
Sep 16 12:07:38.271606 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:38.271591    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 16 12:07:38.315068 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:38.315041    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfqdd\" (UniqueName: \"kubernetes.io/projected/195630ed-aaf5-4295-a92f-6d554450bd98-kube-api-access-nfqdd\") pod \"metrics-server-9484849cb-qjktm\" (UID: \"195630ed-aaf5-4295-a92f-6d554450bd98\") " pod="openshift-monitoring/metrics-server-9484849cb-qjktm"
Sep 16 12:07:38.315414 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:38.315088    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/195630ed-aaf5-4295-a92f-6d554450bd98-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-9484849cb-qjktm\" (UID: \"195630ed-aaf5-4295-a92f-6d554450bd98\") " pod="openshift-monitoring/metrics-server-9484849cb-qjktm"
Sep 16 12:07:38.315414 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:38.315116    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/195630ed-aaf5-4295-a92f-6d554450bd98-secret-metrics-server-tls\") pod \"metrics-server-9484849cb-qjktm\" (UID: \"195630ed-aaf5-4295-a92f-6d554450bd98\") " pod="openshift-monitoring/metrics-server-9484849cb-qjktm"
Sep 16 12:07:38.315414 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:38.315207    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/195630ed-aaf5-4295-a92f-6d554450bd98-audit-log\") pod \"metrics-server-9484849cb-qjktm\" (UID: \"195630ed-aaf5-4295-a92f-6d554450bd98\") " pod="openshift-monitoring/metrics-server-9484849cb-qjktm"
Sep 16 12:07:38.315414 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:38.315224    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/195630ed-aaf5-4295-a92f-6d554450bd98-client-ca-bundle\") pod \"metrics-server-9484849cb-qjktm\" (UID: \"195630ed-aaf5-4295-a92f-6d554450bd98\") " pod="openshift-monitoring/metrics-server-9484849cb-qjktm"
Sep 16 12:07:38.315414 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:38.315247    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/195630ed-aaf5-4295-a92f-6d554450bd98-secret-metrics-server-client-certs\") pod \"metrics-server-9484849cb-qjktm\" (UID: \"195630ed-aaf5-4295-a92f-6d554450bd98\") " pod="openshift-monitoring/metrics-server-9484849cb-qjktm"
Sep 16 12:07:38.315414 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:38.315299    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/195630ed-aaf5-4295-a92f-6d554450bd98-metrics-server-audit-profiles\") pod \"metrics-server-9484849cb-qjktm\" (UID: \"195630ed-aaf5-4295-a92f-6d554450bd98\") " pod="openshift-monitoring/metrics-server-9484849cb-qjktm"
Sep 16 12:07:38.416196 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:38.416155    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/195630ed-aaf5-4295-a92f-6d554450bd98-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-9484849cb-qjktm\" (UID: \"195630ed-aaf5-4295-a92f-6d554450bd98\") " pod="openshift-monitoring/metrics-server-9484849cb-qjktm"
Sep 16 12:07:38.416361 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:38.416340    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/195630ed-aaf5-4295-a92f-6d554450bd98-secret-metrics-server-tls\") pod \"metrics-server-9484849cb-qjktm\" (UID: \"195630ed-aaf5-4295-a92f-6d554450bd98\") " pod="openshift-monitoring/metrics-server-9484849cb-qjktm"
Sep 16 12:07:38.416423 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:38.416406    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/195630ed-aaf5-4295-a92f-6d554450bd98-audit-log\") pod \"metrics-server-9484849cb-qjktm\" (UID: \"195630ed-aaf5-4295-a92f-6d554450bd98\") " pod="openshift-monitoring/metrics-server-9484849cb-qjktm"
Sep 16 12:07:38.416484 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:38.416429    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/195630ed-aaf5-4295-a92f-6d554450bd98-client-ca-bundle\") pod \"metrics-server-9484849cb-qjktm\" (UID: \"195630ed-aaf5-4295-a92f-6d554450bd98\") " pod="openshift-monitoring/metrics-server-9484849cb-qjktm"
Sep 16 12:07:38.416564 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:38.416543    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/195630ed-aaf5-4295-a92f-6d554450bd98-secret-metrics-server-client-certs\") pod \"metrics-server-9484849cb-qjktm\" (UID: \"195630ed-aaf5-4295-a92f-6d554450bd98\") " pod="openshift-monitoring/metrics-server-9484849cb-qjktm"
Sep 16 12:07:38.416619 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:38.416594    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/195630ed-aaf5-4295-a92f-6d554450bd98-metrics-server-audit-profiles\") pod \"metrics-server-9484849cb-qjktm\" (UID: \"195630ed-aaf5-4295-a92f-6d554450bd98\") " pod="openshift-monitoring/metrics-server-9484849cb-qjktm"
Sep 16 12:07:38.416674 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:38.416652    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfqdd\" (UniqueName: \"kubernetes.io/projected/195630ed-aaf5-4295-a92f-6d554450bd98-kube-api-access-nfqdd\") pod \"metrics-server-9484849cb-qjktm\" (UID: \"195630ed-aaf5-4295-a92f-6d554450bd98\") " pod="openshift-monitoring/metrics-server-9484849cb-qjktm"
Sep 16 12:07:38.416938 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:38.416914    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/195630ed-aaf5-4295-a92f-6d554450bd98-audit-log\") pod \"metrics-server-9484849cb-qjktm\" (UID: \"195630ed-aaf5-4295-a92f-6d554450bd98\") " pod="openshift-monitoring/metrics-server-9484849cb-qjktm"
Sep 16 12:07:38.417176 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:38.417114    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/195630ed-aaf5-4295-a92f-6d554450bd98-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-9484849cb-qjktm\" (UID: \"195630ed-aaf5-4295-a92f-6d554450bd98\") " pod="openshift-monitoring/metrics-server-9484849cb-qjktm"
Sep 16 12:07:38.417678 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:38.417656    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/195630ed-aaf5-4295-a92f-6d554450bd98-metrics-server-audit-profiles\") pod \"metrics-server-9484849cb-qjktm\" (UID: \"195630ed-aaf5-4295-a92f-6d554450bd98\") " pod="openshift-monitoring/metrics-server-9484849cb-qjktm"
Sep 16 12:07:38.419115 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:38.419086    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/195630ed-aaf5-4295-a92f-6d554450bd98-secret-metrics-server-tls\") pod \"metrics-server-9484849cb-qjktm\" (UID: \"195630ed-aaf5-4295-a92f-6d554450bd98\") " pod="openshift-monitoring/metrics-server-9484849cb-qjktm"
Sep 16 12:07:38.419226 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:38.419154    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/195630ed-aaf5-4295-a92f-6d554450bd98-client-ca-bundle\") pod \"metrics-server-9484849cb-qjktm\" (UID: \"195630ed-aaf5-4295-a92f-6d554450bd98\") " pod="openshift-monitoring/metrics-server-9484849cb-qjktm"
Sep 16 12:07:38.419279 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:38.419222    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/195630ed-aaf5-4295-a92f-6d554450bd98-secret-metrics-server-client-certs\") pod \"metrics-server-9484849cb-qjktm\" (UID: \"195630ed-aaf5-4295-a92f-6d554450bd98\") " pod="openshift-monitoring/metrics-server-9484849cb-qjktm"
Sep 16 12:07:38.424386 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:38.424368    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfqdd\" (UniqueName: \"kubernetes.io/projected/195630ed-aaf5-4295-a92f-6d554450bd98-kube-api-access-nfqdd\") pod \"metrics-server-9484849cb-qjktm\" (UID: \"195630ed-aaf5-4295-a92f-6d554450bd98\") " pod="openshift-monitoring/metrics-server-9484849cb-qjktm"
Sep 16 12:07:38.530206 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:38.526599    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:07:38.576693 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:38.576658    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-9484849cb-qjktm"
Sep 16 12:07:38.594756 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:38.594721    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:07:38.739215 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:38.739182    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:07:38.788836 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:38.788764    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:07:38.878265 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:38.878234    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-9484849cb-qjktm"]
Sep 16 12:07:38.882004 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:07:38.881970    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod195630ed_aaf5_4295_a92f_6d554450bd98.slice/crio-9790e1c3d007869aa08c169f771635fd78bacae3d97ea30d7fda174667f31e6d WatchSource:0}: Error finding container 9790e1c3d007869aa08c169f771635fd78bacae3d97ea30d7fda174667f31e6d: Status 404 returned error can't find the container with id 9790e1c3d007869aa08c169f771635fd78bacae3d97ea30d7fda174667f31e6d
Sep 16 12:07:39.009116 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:39.009083    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:07:39.290427 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:39.290388    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-9484849cb-qjktm" event={"ID":"195630ed-aaf5-4295-a92f-6d554450bd98","Type":"ContainerStarted","Data":"9790e1c3d007869aa08c169f771635fd78bacae3d97ea30d7fda174667f31e6d"}
Sep 16 12:07:39.983863 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:39.983597    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 16 12:07:39.991681 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:39.991644    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:07:40.008718 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.008682    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 16 12:07:40.008892 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.008870    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:07:40.011834 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.011801    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 16 12:07:40.012068 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.012049    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 16 12:07:40.012293 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.012276    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4815bm7kdu831\""
Sep 16 12:07:40.013565 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.012760    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 16 12:07:40.013565 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.012803    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-qchxm\""
Sep 16 12:07:40.013565 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.012900    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 16 12:07:40.013565 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.013070    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 16 12:07:40.013565 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.013147    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 16 12:07:40.013565 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.013303    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 16 12:07:40.013565 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.013312    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 16 12:07:40.013565 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.013310    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 16 12:07:40.013565 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.013464    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 16 12:07:40.014145 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.014099    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 16 12:07:40.014145 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.014112    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 16 12:07:40.020245 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.020125    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 16 12:07:40.022770 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.022745    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 16 12:07:40.132570 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.132538    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/543fa5fc-eba3-4856-8b96-ab7ceb0b2843-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"543fa5fc-eba3-4856-8b96-ab7ceb0b2843\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:07:40.132570 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.132574    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/543fa5fc-eba3-4856-8b96-ab7ceb0b2843-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"543fa5fc-eba3-4856-8b96-ab7ceb0b2843\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:07:40.132762 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.132595    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/543fa5fc-eba3-4856-8b96-ab7ceb0b2843-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"543fa5fc-eba3-4856-8b96-ab7ceb0b2843\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:07:40.132762 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.132617    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8zjm\" (UniqueName: \"kubernetes.io/projected/543fa5fc-eba3-4856-8b96-ab7ceb0b2843-kube-api-access-s8zjm\") pod \"prometheus-k8s-0\" (UID: \"543fa5fc-eba3-4856-8b96-ab7ceb0b2843\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:07:40.132762 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.132672    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/543fa5fc-eba3-4856-8b96-ab7ceb0b2843-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"543fa5fc-eba3-4856-8b96-ab7ceb0b2843\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:07:40.132762 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.132704    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/543fa5fc-eba3-4856-8b96-ab7ceb0b2843-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"543fa5fc-eba3-4856-8b96-ab7ceb0b2843\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:07:40.132762 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.132746    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/543fa5fc-eba3-4856-8b96-ab7ceb0b2843-web-config\") pod \"prometheus-k8s-0\" (UID: \"543fa5fc-eba3-4856-8b96-ab7ceb0b2843\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:07:40.132919 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.132766    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/543fa5fc-eba3-4856-8b96-ab7ceb0b2843-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"543fa5fc-eba3-4856-8b96-ab7ceb0b2843\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:07:40.132919 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.132832    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/543fa5fc-eba3-4856-8b96-ab7ceb0b2843-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"543fa5fc-eba3-4856-8b96-ab7ceb0b2843\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:07:40.132919 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.132858    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/543fa5fc-eba3-4856-8b96-ab7ceb0b2843-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"543fa5fc-eba3-4856-8b96-ab7ceb0b2843\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:07:40.132919 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.132879    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/543fa5fc-eba3-4856-8b96-ab7ceb0b2843-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"543fa5fc-eba3-4856-8b96-ab7ceb0b2843\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:07:40.132919 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.132916    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/543fa5fc-eba3-4856-8b96-ab7ceb0b2843-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"543fa5fc-eba3-4856-8b96-ab7ceb0b2843\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:07:40.133156 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.132942    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/543fa5fc-eba3-4856-8b96-ab7ceb0b2843-config\") pod \"prometheus-k8s-0\" (UID: \"543fa5fc-eba3-4856-8b96-ab7ceb0b2843\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:07:40.133156 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.132962    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/543fa5fc-eba3-4856-8b96-ab7ceb0b2843-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"543fa5fc-eba3-4856-8b96-ab7ceb0b2843\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:07:40.133156 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.132979    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/543fa5fc-eba3-4856-8b96-ab7ceb0b2843-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"543fa5fc-eba3-4856-8b96-ab7ceb0b2843\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:07:40.133156 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.133005    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/543fa5fc-eba3-4856-8b96-ab7ceb0b2843-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"543fa5fc-eba3-4856-8b96-ab7ceb0b2843\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:07:40.133156 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.133069    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/543fa5fc-eba3-4856-8b96-ab7ceb0b2843-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"543fa5fc-eba3-4856-8b96-ab7ceb0b2843\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:07:40.133156 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.133112    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/543fa5fc-eba3-4856-8b96-ab7ceb0b2843-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"543fa5fc-eba3-4856-8b96-ab7ceb0b2843\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:07:40.133428 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.133181    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/543fa5fc-eba3-4856-8b96-ab7ceb0b2843-config-out\") pod \"prometheus-k8s-0\" (UID: \"543fa5fc-eba3-4856-8b96-ab7ceb0b2843\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:07:40.133428 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.133206    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/543fa5fc-eba3-4856-8b96-ab7ceb0b2843-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"543fa5fc-eba3-4856-8b96-ab7ceb0b2843\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:07:40.234405 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.234321    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/543fa5fc-eba3-4856-8b96-ab7ceb0b2843-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"543fa5fc-eba3-4856-8b96-ab7ceb0b2843\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:07:40.234405 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.234373    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/543fa5fc-eba3-4856-8b96-ab7ceb0b2843-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"543fa5fc-eba3-4856-8b96-ab7ceb0b2843\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:07:40.234405 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.234406    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/543fa5fc-eba3-4856-8b96-ab7ceb0b2843-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"543fa5fc-eba3-4856-8b96-ab7ceb0b2843\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:07:40.234690 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.234442    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/543fa5fc-eba3-4856-8b96-ab7ceb0b2843-config-out\") pod \"prometheus-k8s-0\" (UID: \"543fa5fc-eba3-4856-8b96-ab7ceb0b2843\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:07:40.234690 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.234471    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/543fa5fc-eba3-4856-8b96-ab7ceb0b2843-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"543fa5fc-eba3-4856-8b96-ab7ceb0b2843\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:07:40.234690 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.234508    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/543fa5fc-eba3-4856-8b96-ab7ceb0b2843-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"543fa5fc-eba3-4856-8b96-ab7ceb0b2843\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:07:40.234690 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.234536    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/543fa5fc-eba3-4856-8b96-ab7ceb0b2843-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"543fa5fc-eba3-4856-8b96-ab7ceb0b2843\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:07:40.234690 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.234559    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/543fa5fc-eba3-4856-8b96-ab7ceb0b2843-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"543fa5fc-eba3-4856-8b96-ab7ceb0b2843\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:07:40.234690 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.234581    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8zjm\" (UniqueName: \"kubernetes.io/projected/543fa5fc-eba3-4856-8b96-ab7ceb0b2843-kube-api-access-s8zjm\") pod \"prometheus-k8s-0\" (UID: \"543fa5fc-eba3-4856-8b96-ab7ceb0b2843\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:07:40.234690 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.234607    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/543fa5fc-eba3-4856-8b96-ab7ceb0b2843-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"543fa5fc-eba3-4856-8b96-ab7ceb0b2843\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:07:40.234690 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.234636    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/543fa5fc-eba3-4856-8b96-ab7ceb0b2843-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"543fa5fc-eba3-4856-8b96-ab7ceb0b2843\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:07:40.234690 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.234672    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/543fa5fc-eba3-4856-8b96-ab7ceb0b2843-web-config\") pod \"prometheus-k8s-0\" (UID: \"543fa5fc-eba3-4856-8b96-ab7ceb0b2843\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:07:40.235103 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.234703    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/543fa5fc-eba3-4856-8b96-ab7ceb0b2843-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"543fa5fc-eba3-4856-8b96-ab7ceb0b2843\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:07:40.235103 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.234747    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/543fa5fc-eba3-4856-8b96-ab7ceb0b2843-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"543fa5fc-eba3-4856-8b96-ab7ceb0b2843\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:07:40.235103 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.234773    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/543fa5fc-eba3-4856-8b96-ab7ceb0b2843-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"543fa5fc-eba3-4856-8b96-ab7ceb0b2843\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:07:40.235103 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.234801    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/543fa5fc-eba3-4856-8b96-ab7ceb0b2843-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"543fa5fc-eba3-4856-8b96-ab7ceb0b2843\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:07:40.235103 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.234836    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/543fa5fc-eba3-4856-8b96-ab7ceb0b2843-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"543fa5fc-eba3-4856-8b96-ab7ceb0b2843\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:07:40.235103 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.234871    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/543fa5fc-eba3-4856-8b96-ab7ceb0b2843-config\") pod \"prometheus-k8s-0\" (UID: \"543fa5fc-eba3-4856-8b96-ab7ceb0b2843\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:07:40.235103 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.234907    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/543fa5fc-eba3-4856-8b96-ab7ceb0b2843-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"543fa5fc-eba3-4856-8b96-ab7ceb0b2843\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:07:40.235103 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.234933    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/543fa5fc-eba3-4856-8b96-ab7ceb0b2843-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"543fa5fc-eba3-4856-8b96-ab7ceb0b2843\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:07:40.235518 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.235429    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/543fa5fc-eba3-4856-8b96-ab7ceb0b2843-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"543fa5fc-eba3-4856-8b96-ab7ceb0b2843\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:07:40.235773 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.235743    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/543fa5fc-eba3-4856-8b96-ab7ceb0b2843-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"543fa5fc-eba3-4856-8b96-ab7ceb0b2843\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:07:40.235869 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.235827    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/543fa5fc-eba3-4856-8b96-ab7ceb0b2843-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"543fa5fc-eba3-4856-8b96-ab7ceb0b2843\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:07:40.236593 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.235941    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/543fa5fc-eba3-4856-8b96-ab7ceb0b2843-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"543fa5fc-eba3-4856-8b96-ab7ceb0b2843\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:07:40.243482 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.240373    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/543fa5fc-eba3-4856-8b96-ab7ceb0b2843-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"543fa5fc-eba3-4856-8b96-ab7ceb0b2843\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:07:40.243482 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.240708    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/543fa5fc-eba3-4856-8b96-ab7ceb0b2843-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"543fa5fc-eba3-4856-8b96-ab7ceb0b2843\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:07:40.243482 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.240791    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/543fa5fc-eba3-4856-8b96-ab7ceb0b2843-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"543fa5fc-eba3-4856-8b96-ab7ceb0b2843\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:07:40.243482 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.241092    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/543fa5fc-eba3-4856-8b96-ab7ceb0b2843-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"543fa5fc-eba3-4856-8b96-ab7ceb0b2843\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:07:40.243482 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.241706    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/543fa5fc-eba3-4856-8b96-ab7ceb0b2843-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"543fa5fc-eba3-4856-8b96-ab7ceb0b2843\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:07:40.243482 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.243413    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/543fa5fc-eba3-4856-8b96-ab7ceb0b2843-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"543fa5fc-eba3-4856-8b96-ab7ceb0b2843\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:07:40.243862 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.243489    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/543fa5fc-eba3-4856-8b96-ab7ceb0b2843-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"543fa5fc-eba3-4856-8b96-ab7ceb0b2843\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:07:40.243862 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.243699    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/543fa5fc-eba3-4856-8b96-ab7ceb0b2843-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"543fa5fc-eba3-4856-8b96-ab7ceb0b2843\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:07:40.244228 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.244207    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/543fa5fc-eba3-4856-8b96-ab7ceb0b2843-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"543fa5fc-eba3-4856-8b96-ab7ceb0b2843\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:07:40.244698 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.244602    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/543fa5fc-eba3-4856-8b96-ab7ceb0b2843-config\") pod \"prometheus-k8s-0\" (UID: \"543fa5fc-eba3-4856-8b96-ab7ceb0b2843\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:07:40.244698 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.244632    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/543fa5fc-eba3-4856-8b96-ab7ceb0b2843-config-out\") pod \"prometheus-k8s-0\" (UID: \"543fa5fc-eba3-4856-8b96-ab7ceb0b2843\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:07:40.244698 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.244660    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/543fa5fc-eba3-4856-8b96-ab7ceb0b2843-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"543fa5fc-eba3-4856-8b96-ab7ceb0b2843\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:07:40.245009 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.244809    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/543fa5fc-eba3-4856-8b96-ab7ceb0b2843-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"543fa5fc-eba3-4856-8b96-ab7ceb0b2843\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:07:40.245215 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.245189    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8zjm\" (UniqueName: \"kubernetes.io/projected/543fa5fc-eba3-4856-8b96-ab7ceb0b2843-kube-api-access-s8zjm\") pod \"prometheus-k8s-0\" (UID: \"543fa5fc-eba3-4856-8b96-ab7ceb0b2843\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:07:40.245643 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.245614    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/543fa5fc-eba3-4856-8b96-ab7ceb0b2843-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"543fa5fc-eba3-4856-8b96-ab7ceb0b2843\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:07:40.246970 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.246930    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/543fa5fc-eba3-4856-8b96-ab7ceb0b2843-web-config\") pod \"prometheus-k8s-0\" (UID: \"543fa5fc-eba3-4856-8b96-ab7ceb0b2843\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:07:40.332520 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.332457    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:07:40.927345 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:40.927317    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 16 12:07:40.960759 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:07:40.960716    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod543fa5fc_eba3_4856_8b96_ab7ceb0b2843.slice/crio-150b1ef1daa850b62f027fc244eb8a70bae7e31babd8686c5748c71eb2fdc68a WatchSource:0}: Error finding container 150b1ef1daa850b62f027fc244eb8a70bae7e31babd8686c5748c71eb2fdc68a: Status 404 returned error can't find the container with id 150b1ef1daa850b62f027fc244eb8a70bae7e31babd8686c5748c71eb2fdc68a
Sep 16 12:07:41.300065 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:41.299964    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-9484849cb-qjktm" event={"ID":"195630ed-aaf5-4295-a92f-6d554450bd98","Type":"ContainerStarted","Data":"587f556d7d2400620682f1116173abbf2c88975755610770376a691a186b64f9"}
Sep 16 12:07:41.301557 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:41.301529    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"543fa5fc-eba3-4856-8b96-ab7ceb0b2843","Type":"ContainerStarted","Data":"150b1ef1daa850b62f027fc244eb8a70bae7e31babd8686c5748c71eb2fdc68a"}
Sep 16 12:07:41.318062 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:41.318014    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-9484849cb-qjktm" podStartSLOduration=1.215177201 podStartE2EDuration="3.317994265s" totalImagesPullingTime="2.102817064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:07:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:07:41.317803497 +0000 UTC m=+427.938122811" watchObservedRunningTime="2026-09-16 12:07:41.317994265 +0000 UTC m=+427.938313581"
Sep 16 12:07:43.314957 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:43.314919    2559 generic.go:356] "Generic (PLEG): container finished" podID="543fa5fc-eba3-4856-8b96-ab7ceb0b2843" containerID="be2a34799744aa0f76c3150c9b297f32eb9d12ce82e841369b7cc5e930f14170" exitCode=0
Sep 16 12:07:43.315402 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:43.315004    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"543fa5fc-eba3-4856-8b96-ab7ceb0b2843","Type":"ContainerDied","Data":"be2a34799744aa0f76c3150c9b297f32eb9d12ce82e841369b7cc5e930f14170"}
Sep 16 12:07:44.417075 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:44.417034    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:07:44.498799 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:44.498762    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:07:47.336548 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:47.336518    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"543fa5fc-eba3-4856-8b96-ab7ceb0b2843","Type":"ContainerStarted","Data":"dab50867229c4889555edc6141b2bb80cdc72196583c257213974717250afd4a"}
Sep 16 12:07:47.336932 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:47.336580    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"543fa5fc-eba3-4856-8b96-ab7ceb0b2843","Type":"ContainerStarted","Data":"c1c1485692fa1c9e201e4a4a04fbfc2d7b7b109e501546d004d008b34a9612f3"}
Sep 16 12:07:49.349807 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:49.349774    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"543fa5fc-eba3-4856-8b96-ab7ceb0b2843","Type":"ContainerStarted","Data":"6c5d3f7cf99df266e7cd1975d0a6e6e972287622543cb4f8809965701aa2aa7a"}
Sep 16 12:07:49.350199 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:49.349859    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"543fa5fc-eba3-4856-8b96-ab7ceb0b2843","Type":"ContainerStarted","Data":"f3ef74ff5fa4656e72d20c8146614edf2d04bd95ab061033cc863ccaa0e64ffa"}
Sep 16 12:07:49.786773 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:49.786686    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:07:49.893729 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:49.893683    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:07:50.005120 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:50.005058    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:07:50.360198 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:50.360166    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"543fa5fc-eba3-4856-8b96-ab7ceb0b2843","Type":"ContainerStarted","Data":"3f7fdaf22c086c00c694aaae367403d5541f1b5ff993f2120cb1a12c947b1eec"}
Sep 16 12:07:50.360592 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:50.360231    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"543fa5fc-eba3-4856-8b96-ab7ceb0b2843","Type":"ContainerStarted","Data":"3f9b93d82ca0419adadbf8c5aa6b4bd8365dc882638852dd42f1f4bd04ce5d50"}
Sep 16 12:07:50.391972 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:50.391913    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.610636931 podStartE2EDuration="11.391896705s" totalImagesPullingTime="7.758872959s" totalInitContainerRuntime="22.386815ms" isStatefulPod=false podCreationTimestamp="2026-09-16 12:07:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:07:50.389402116 +0000 UTC m=+437.009721432" watchObservedRunningTime="2026-09-16 12:07:50.391896705 +0000 UTC m=+437.012216021"
Sep 16 12:07:55.333216 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:55.333169    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:07:58.576932 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:58.576841    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-9484849cb-qjktm"
Sep 16 12:07:58.577337 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:07:58.577032    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-9484849cb-qjktm"
Sep 16 12:08:11.219014 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:08:11.218971    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:08:11.319879 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:08:11.319843    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:08:18.582524 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:08:18.582493    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-9484849cb-qjktm"
Sep 16 12:08:18.586283 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:08:18.586260    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-9484849cb-qjktm"
Sep 16 12:08:40.333617 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:08:40.333576    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:08:40.352739 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:08:40.352711    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:08:40.578757 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:08:40.578731    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:08:53.025751 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:08:53.025701    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:08:53.368317 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:08:53.368226    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:09:01.708441 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:09:01.708407    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:09:01.762402 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:09:01.762373    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:09:01.843736 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:09:01.843699    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:09:01.893495 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:09:01.893457    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:09:02.477696 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:09:02.477655    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:09:02.527404 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:09:02.527366    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:09:08.222904 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:09:08.222859    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:09:08.345593 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:09:08.345556    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:09:13.124263 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:09:13.124227    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:09:13.190457 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:09:13.190423    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:09:13.449196 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:09:13.449162    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:09:13.516405 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:09:13.516371    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:09:20.144501 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:09:20.144461    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:09:20.201553 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:09:20.201522    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:09:24.143387 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:09:24.143353    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:09:24.243879 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:09:24.243850    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:09:24.345144 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:09:24.345104    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:09:26.836567 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:09:26.836484    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:10:14.935532 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:10:14.935493    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:10:21.075418 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:10:21.075380    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:10:21.170166 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:10:21.170117    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:10:33.840489 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:10:33.840465    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-hrvzp_63ee784a-3b40-4259-9923-74a24d0203a0/console-operator/5.log"
Sep 16 12:10:33.842270 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:10:33.842248    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-hrvzp_63ee784a-3b40-4259-9923-74a24d0203a0/console-operator/5.log"
Sep 16 12:10:58.236611 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:10:58.236531    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:10:59.989346 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:10:59.989309    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:11:01.854929 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:11:01.854894    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:11:01.951572 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:11:01.951538    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:11:05.637314 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:11:05.637275    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:11:05.968807 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:11:05.968774    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:11:06.072940 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:11:06.072910    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:11:07.633157 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:11:07.633100    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:11:07.690006 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:11:07.689967    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:11:07.832969 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:11:07.832940    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:11:08.257914 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:11:08.257877    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:11:16.252015 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:11:16.251980    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:11:19.301279 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:11:19.301244    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:11:19.395389 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:11:19.395361    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:11:25.726630 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:11:25.726592    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:11:25.824735 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:11:25.824703    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:11:27.785882 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:11:27.785852    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:11:35.917488 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:11:35.917455    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:11:35.973783 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:11:35.973748    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:11:43.275517 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:11:43.275482    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:11:43.368712 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:11:43.368678    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:11:43.897146 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:11:43.897107    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:11:44.052924 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:11:44.052897    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:11:44.152723 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:11:44.152692    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:11:44.209873 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:11:44.209843    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7887d7f7b8-k6cfq"]
Sep 16 12:11:44.213162 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:11:44.213127    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7887d7f7b8-k6cfq"
Sep 16 12:11:44.216417 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:11:44.216398    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 16 12:11:44.216515 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:11:44.216479    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 16 12:11:44.217056 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:11:44.217039    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-lcl5n\""
Sep 16 12:11:44.217187 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:11:44.217170    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 16 12:11:44.217717 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:11:44.217702    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 16 12:11:44.330767 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:11:44.330730    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/edbebcfc-39ad-476f-b879-c85d843ef191-webhook-cert\") pod \"opendatahub-operator-controller-manager-7887d7f7b8-k6cfq\" (UID: \"edbebcfc-39ad-476f-b879-c85d843ef191\") " pod="opendatahub/opendatahub-operator-controller-manager-7887d7f7b8-k6cfq"
Sep 16 12:11:44.331174 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:11:44.330815    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r52k4\" (UniqueName: \"kubernetes.io/projected/edbebcfc-39ad-476f-b879-c85d843ef191-kube-api-access-r52k4\") pod \"opendatahub-operator-controller-manager-7887d7f7b8-k6cfq\" (UID: \"edbebcfc-39ad-476f-b879-c85d843ef191\") " pod="opendatahub/opendatahub-operator-controller-manager-7887d7f7b8-k6cfq"
Sep 16 12:11:44.331174 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:11:44.330860    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/edbebcfc-39ad-476f-b879-c85d843ef191-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7887d7f7b8-k6cfq\" (UID: \"edbebcfc-39ad-476f-b879-c85d843ef191\") " pod="opendatahub/opendatahub-operator-controller-manager-7887d7f7b8-k6cfq"
Sep 16 12:11:44.331174 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:11:44.330883    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/edbebcfc-39ad-476f-b879-c85d843ef191-manifests\") pod \"opendatahub-operator-controller-manager-7887d7f7b8-k6cfq\" (UID: \"edbebcfc-39ad-476f-b879-c85d843ef191\") " pod="opendatahub/opendatahub-operator-controller-manager-7887d7f7b8-k6cfq"
Sep 16 12:11:44.331174 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:11:44.330949    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/edbebcfc-39ad-476f-b879-c85d843ef191-tmp\") pod \"opendatahub-operator-controller-manager-7887d7f7b8-k6cfq\" (UID: \"edbebcfc-39ad-476f-b879-c85d843ef191\") " pod="opendatahub/opendatahub-operator-controller-manager-7887d7f7b8-k6cfq"
Sep 16 12:11:44.339165 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:11:44.339126    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7887d7f7b8-k6cfq"]
Sep 16 12:11:44.414033 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:11:44.413951    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:11:44.432164 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:11:44.432113    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/edbebcfc-39ad-476f-b879-c85d843ef191-webhook-cert\") pod \"opendatahub-operator-controller-manager-7887d7f7b8-k6cfq\" (UID: \"edbebcfc-39ad-476f-b879-c85d843ef191\") " pod="opendatahub/opendatahub-operator-controller-manager-7887d7f7b8-k6cfq"
Sep 16 12:11:44.432257 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:11:44.432183    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r52k4\" (UniqueName: \"kubernetes.io/projected/edbebcfc-39ad-476f-b879-c85d843ef191-kube-api-access-r52k4\") pod \"opendatahub-operator-controller-manager-7887d7f7b8-k6cfq\" (UID: \"edbebcfc-39ad-476f-b879-c85d843ef191\") " pod="opendatahub/opendatahub-operator-controller-manager-7887d7f7b8-k6cfq"
Sep 16 12:11:44.432257 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:11:44.432213    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/edbebcfc-39ad-476f-b879-c85d843ef191-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7887d7f7b8-k6cfq\" (UID: \"edbebcfc-39ad-476f-b879-c85d843ef191\") " pod="opendatahub/opendatahub-operator-controller-manager-7887d7f7b8-k6cfq"
Sep 16 12:11:44.432257 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:11:44.432228    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/edbebcfc-39ad-476f-b879-c85d843ef191-manifests\") pod \"opendatahub-operator-controller-manager-7887d7f7b8-k6cfq\" (UID: \"edbebcfc-39ad-476f-b879-c85d843ef191\") " pod="opendatahub/opendatahub-operator-controller-manager-7887d7f7b8-k6cfq"
Sep 16 12:11:44.432357 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:11:44.432263    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/edbebcfc-39ad-476f-b879-c85d843ef191-tmp\") pod \"opendatahub-operator-controller-manager-7887d7f7b8-k6cfq\" (UID: \"edbebcfc-39ad-476f-b879-c85d843ef191\") " pod="opendatahub/opendatahub-operator-controller-manager-7887d7f7b8-k6cfq"
Sep 16 12:11:44.432721 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:11:44.432692    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/edbebcfc-39ad-476f-b879-c85d843ef191-manifests\") pod \"opendatahub-operator-controller-manager-7887d7f7b8-k6cfq\" (UID: \"edbebcfc-39ad-476f-b879-c85d843ef191\") " pod="opendatahub/opendatahub-operator-controller-manager-7887d7f7b8-k6cfq"
Sep 16 12:11:44.434633 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:11:44.434604    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/edbebcfc-39ad-476f-b879-c85d843ef191-tmp\") pod \"opendatahub-operator-controller-manager-7887d7f7b8-k6cfq\" (UID: \"edbebcfc-39ad-476f-b879-c85d843ef191\") " pod="opendatahub/opendatahub-operator-controller-manager-7887d7f7b8-k6cfq"
Sep 16 12:11:44.434751 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:11:44.434650    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/edbebcfc-39ad-476f-b879-c85d843ef191-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7887d7f7b8-k6cfq\" (UID: \"edbebcfc-39ad-476f-b879-c85d843ef191\") " pod="opendatahub/opendatahub-operator-controller-manager-7887d7f7b8-k6cfq"
Sep 16 12:11:44.434751 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:11:44.434720    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/edbebcfc-39ad-476f-b879-c85d843ef191-webhook-cert\") pod \"opendatahub-operator-controller-manager-7887d7f7b8-k6cfq\" (UID: \"edbebcfc-39ad-476f-b879-c85d843ef191\") " pod="opendatahub/opendatahub-operator-controller-manager-7887d7f7b8-k6cfq"
Sep 16 12:11:44.441402 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:11:44.441383    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r52k4\" (UniqueName: \"kubernetes.io/projected/edbebcfc-39ad-476f-b879-c85d843ef191-kube-api-access-r52k4\") pod \"opendatahub-operator-controller-manager-7887d7f7b8-k6cfq\" (UID: \"edbebcfc-39ad-476f-b879-c85d843ef191\") " pod="opendatahub/opendatahub-operator-controller-manager-7887d7f7b8-k6cfq"
Sep 16 12:11:44.513936 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:11:44.513901    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:11:44.522912 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:11:44.522888    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7887d7f7b8-k6cfq"
Sep 16 12:11:44.616034 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:11:44.616003    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:11:44.715326 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:11:44.715236    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:11:44.786519 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:11:44.786485    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:11:44.800347 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:11:44.800324    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7887d7f7b8-k6cfq"]
Sep 16 12:11:44.803188 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:11:44.803117    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedbebcfc_39ad_476f_b879_c85d843ef191.slice/crio-fa8f7eec50af123e029b2c23204b5edf96b1c3ca05d0c55ad9d813d1678cd180 WatchSource:0}: Error finding container fa8f7eec50af123e029b2c23204b5edf96b1c3ca05d0c55ad9d813d1678cd180: Status 404 returned error can't find the container with id fa8f7eec50af123e029b2c23204b5edf96b1c3ca05d0c55ad9d813d1678cd180
Sep 16 12:11:44.804983 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:11:44.804964    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 12:11:44.843030 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:11:44.843001    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:11:44.946246 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:11:44.946211    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:11:45.044840 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:11:45.044750    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:11:45.271114 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:11:45.271079    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7887d7f7b8-k6cfq" event={"ID":"edbebcfc-39ad-476f-b879-c85d843ef191","Type":"ContainerStarted","Data":"fa8f7eec50af123e029b2c23204b5edf96b1c3ca05d0c55ad9d813d1678cd180"}
Sep 16 12:11:48.179418 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:11:48.179377    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:11:48.287757 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:11:48.287725    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7887d7f7b8-k6cfq" event={"ID":"edbebcfc-39ad-476f-b879-c85d843ef191","Type":"ContainerStarted","Data":"78f4718844878fd4c558230e0defdf61c54a17d3b16f994553bfdb72297f0f77"}
Sep 16 12:11:48.304736 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:11:48.304710    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:11:49.293965 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:11:49.293867    2559 generic.go:356] "Generic (PLEG): container finished" podID="edbebcfc-39ad-476f-b879-c85d843ef191" containerID="78f4718844878fd4c558230e0defdf61c54a17d3b16f994553bfdb72297f0f77" exitCode=0
Sep 16 12:11:49.294438 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:11:49.293958    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7887d7f7b8-k6cfq" event={"ID":"edbebcfc-39ad-476f-b879-c85d843ef191","Type":"ContainerDied","Data":"78f4718844878fd4c558230e0defdf61c54a17d3b16f994553bfdb72297f0f77"}
Sep 16 12:11:50.300464 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:11:50.300426    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7887d7f7b8-k6cfq" event={"ID":"edbebcfc-39ad-476f-b879-c85d843ef191","Type":"ContainerStarted","Data":"def1609586c0ff3fe8a6419fb4a6ccc5b095805b3b5d4bb8702fdc2491b373ef"}
Sep 16 12:11:50.300859 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:11:50.300519    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7887d7f7b8-k6cfq"
Sep 16 12:11:50.321219 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:11:50.321169    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7887d7f7b8-k6cfq" podStartSLOduration=1.893896378 podStartE2EDuration="6.321153618s" totalImagesPullingTime="3.344062765s" totalInitContainerRuntime="1.083194475s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:11:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:11:50.319693105 +0000 UTC m=+676.940012420" watchObservedRunningTime="2026-09-16 12:11:50.321153618 +0000 UTC m=+676.941472925"
Sep 16 12:11:57.682525 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:11:57.682485    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:11:57.741958 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:11:57.741922    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:12:01.306643 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:01.306615    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7887d7f7b8-k6cfq"
Sep 16 12:12:04.581443 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:04.581407    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:12:04.711606 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:04.711567    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:12:04.935444 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:04.935417    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:12:05.458651 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:05.458605    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:12:06.301429 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:06.301392    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r59mq"]
Sep 16 12:12:06.308762 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:06.308746    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r59mq"
Sep 16 12:12:06.311890 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:06.311861    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 16 12:12:06.312010 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:06.311863    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 16 12:12:06.312010 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:06.311979    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 16 12:12:06.312148 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:06.312116    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 16 12:12:06.312850 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:06.312829    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 16 12:12:06.312955 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:06.312867    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 16 12:12:06.313478 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:06.313461    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:12:06.314706 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:06.314690    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-kckwh\""
Sep 16 12:12:06.329675 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:06.329649    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r59mq"]
Sep 16 12:12:06.424051 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:06.424013    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8916a652-fa6a-4e6b-bd0f-38d393fc695a-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-r59mq\" (UID: \"8916a652-fa6a-4e6b-bd0f-38d393fc695a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r59mq"
Sep 16 12:12:06.424051 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:06.424051    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8916a652-fa6a-4e6b-bd0f-38d393fc695a-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-r59mq\" (UID: \"8916a652-fa6a-4e6b-bd0f-38d393fc695a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r59mq"
Sep 16 12:12:06.424342 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:06.424072    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8916a652-fa6a-4e6b-bd0f-38d393fc695a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-r59mq\" (UID: \"8916a652-fa6a-4e6b-bd0f-38d393fc695a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r59mq"
Sep 16 12:12:06.424342 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:06.424098    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x998c\" (UniqueName: \"kubernetes.io/projected/8916a652-fa6a-4e6b-bd0f-38d393fc695a-kube-api-access-x998c\") pod \"istiod-openshift-gateway-7b7995d5cd-r59mq\" (UID: \"8916a652-fa6a-4e6b-bd0f-38d393fc695a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r59mq"
Sep 16 12:12:06.424342 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:06.424169    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8916a652-fa6a-4e6b-bd0f-38d393fc695a-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-r59mq\" (UID: \"8916a652-fa6a-4e6b-bd0f-38d393fc695a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r59mq"
Sep 16 12:12:06.424342 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:06.424202    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8916a652-fa6a-4e6b-bd0f-38d393fc695a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-r59mq\" (UID: \"8916a652-fa6a-4e6b-bd0f-38d393fc695a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r59mq"
Sep 16 12:12:06.424342 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:06.424236    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8916a652-fa6a-4e6b-bd0f-38d393fc695a-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-r59mq\" (UID: \"8916a652-fa6a-4e6b-bd0f-38d393fc695a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r59mq"
Sep 16 12:12:06.425196 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:06.425175    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:12:06.525174 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:06.525106    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8916a652-fa6a-4e6b-bd0f-38d393fc695a-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-r59mq\" (UID: \"8916a652-fa6a-4e6b-bd0f-38d393fc695a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r59mq"
Sep 16 12:12:06.525348 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:06.525198    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8916a652-fa6a-4e6b-bd0f-38d393fc695a-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-r59mq\" (UID: \"8916a652-fa6a-4e6b-bd0f-38d393fc695a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r59mq"
Sep 16 12:12:06.525348 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:06.525223    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8916a652-fa6a-4e6b-bd0f-38d393fc695a-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-r59mq\" (UID: \"8916a652-fa6a-4e6b-bd0f-38d393fc695a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r59mq"
Sep 16 12:12:06.525348 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:06.525241    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8916a652-fa6a-4e6b-bd0f-38d393fc695a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-r59mq\" (UID: \"8916a652-fa6a-4e6b-bd0f-38d393fc695a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r59mq"
Sep 16 12:12:06.525348 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:06.525271    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x998c\" (UniqueName: \"kubernetes.io/projected/8916a652-fa6a-4e6b-bd0f-38d393fc695a-kube-api-access-x998c\") pod \"istiod-openshift-gateway-7b7995d5cd-r59mq\" (UID: \"8916a652-fa6a-4e6b-bd0f-38d393fc695a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r59mq"
Sep 16 12:12:06.525348 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:06.525310    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8916a652-fa6a-4e6b-bd0f-38d393fc695a-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-r59mq\" (UID: \"8916a652-fa6a-4e6b-bd0f-38d393fc695a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r59mq"
Sep 16 12:12:06.525348 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:06.525334    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8916a652-fa6a-4e6b-bd0f-38d393fc695a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-r59mq\" (UID: \"8916a652-fa6a-4e6b-bd0f-38d393fc695a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r59mq"
Sep 16 12:12:06.525918 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:06.525894    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8916a652-fa6a-4e6b-bd0f-38d393fc695a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-r59mq\" (UID: \"8916a652-fa6a-4e6b-bd0f-38d393fc695a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r59mq"
Sep 16 12:12:06.527715 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:06.527691    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8916a652-fa6a-4e6b-bd0f-38d393fc695a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-r59mq\" (UID: \"8916a652-fa6a-4e6b-bd0f-38d393fc695a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r59mq"
Sep 16 12:12:06.527812 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:06.527774    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8916a652-fa6a-4e6b-bd0f-38d393fc695a-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-r59mq\" (UID: \"8916a652-fa6a-4e6b-bd0f-38d393fc695a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r59mq"
Sep 16 12:12:06.527921 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:06.527902    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8916a652-fa6a-4e6b-bd0f-38d393fc695a-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-r59mq\" (UID: \"8916a652-fa6a-4e6b-bd0f-38d393fc695a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r59mq"
Sep 16 12:12:06.527974 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:06.527956    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8916a652-fa6a-4e6b-bd0f-38d393fc695a-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-r59mq\" (UID: \"8916a652-fa6a-4e6b-bd0f-38d393fc695a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r59mq"
Sep 16 12:12:06.533492 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:06.533475    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8916a652-fa6a-4e6b-bd0f-38d393fc695a-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-r59mq\" (UID: \"8916a652-fa6a-4e6b-bd0f-38d393fc695a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r59mq"
Sep 16 12:12:06.533947 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:06.533928    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x998c\" (UniqueName: \"kubernetes.io/projected/8916a652-fa6a-4e6b-bd0f-38d393fc695a-kube-api-access-x998c\") pod \"istiod-openshift-gateway-7b7995d5cd-r59mq\" (UID: \"8916a652-fa6a-4e6b-bd0f-38d393fc695a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r59mq"
Sep 16 12:12:06.617828 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:06.617744    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r59mq"
Sep 16 12:12:06.893835 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:06.893811    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r59mq"]
Sep 16 12:12:06.896293 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:12:06.896264    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8916a652_fa6a_4e6b_bd0f_38d393fc695a.slice/crio-088436e87b6073aa3fee8f697ab46b0ce2dd23806af767fbc62b111fac8057f1 WatchSource:0}: Error finding container 088436e87b6073aa3fee8f697ab46b0ce2dd23806af767fbc62b111fac8057f1: Status 404 returned error can't find the container with id 088436e87b6073aa3fee8f697ab46b0ce2dd23806af767fbc62b111fac8057f1
Sep 16 12:12:07.278844 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:07.278807    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:12:07.375460 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:07.375424    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r59mq" event={"ID":"8916a652-fa6a-4e6b-bd0f-38d393fc695a","Type":"ContainerStarted","Data":"088436e87b6073aa3fee8f697ab46b0ce2dd23806af767fbc62b111fac8057f1"}
Sep 16 12:12:09.145692 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:09.145654    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:12:09.246421 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:09.246347    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:12:09.427031 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:09.426989    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:12:09.427174 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:09.427076    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:12:10.390930 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:10.390898    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r59mq" event={"ID":"8916a652-fa6a-4e6b-bd0f-38d393fc695a","Type":"ContainerStarted","Data":"e1eed9d769e8549db33a7eb47c86302e66508877dc1738b2ee254151a2643a03"}
Sep 16 12:12:10.391379 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:10.391056    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r59mq"
Sep 16 12:12:10.392815 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:10.392789    2559 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-r59mq container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 16 12:12:10.392932 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:10.392867    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r59mq" podUID="8916a652-fa6a-4e6b-bd0f-38d393fc695a" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 12:12:10.411086 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:10.411028    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r59mq" podStartSLOduration=1.882564269 podStartE2EDuration="4.4110064s" totalImagesPullingTime="2.528442131s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:12:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:12:10.408705307 +0000 UTC m=+697.029024624" watchObservedRunningTime="2026-09-16 12:12:10.4110064 +0000 UTC m=+697.031325718"
Sep 16 12:12:10.694028 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:10.693983    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:12:10.765791 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:10.765758    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:12:11.215795 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:11.215746    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:12:11.395729 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:11.395698    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r59mq"
Sep 16 12:12:11.401444 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:11.401420    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:12:11.632412 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:11.632317    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:12:11.822322 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:11.822119    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:12:11.875452 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:11.875425    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:12:13.668964 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:13.668927    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:12:13.720904 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:13.720869    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:12:15.715102 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:15.715066    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:12:15.814940 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:15.814908    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:12:15.916803 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:15.916771    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:12:16.014921 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:16.014838    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:12:16.199290 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:16.199260    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:12:16.428741 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:16.428712    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:12:19.980539 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:19.980489    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:12:20.079446 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:20.079383    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:12:20.134911 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:20.134880    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:12:20.517598 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:20.517559    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-c7f7d6d7f-g866v"]
Sep 16 12:12:20.526189 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:20.526121    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-c7f7d6d7f-g866v"
Sep 16 12:12:20.528935 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:20.528887    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 16 12:12:20.528935 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:20.528932    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 16 12:12:20.529410 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:20.529387    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-c7f7d6d7f-g866v"]
Sep 16 12:12:20.530206 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:20.530187    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 16 12:12:20.530364 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:20.530253    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 16 12:12:20.530452 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:20.530256    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-sw8ht\""
Sep 16 12:12:20.530452 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:20.530355    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 16 12:12:20.536440 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:20.536419    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ae1d3547-f8ba-4536-8440-62227e3d9d28-cert\") pod \"lws-controller-manager-c7f7d6d7f-g866v\" (UID: \"ae1d3547-f8ba-4536-8440-62227e3d9d28\") " pod="openshift-lws-operator/lws-controller-manager-c7f7d6d7f-g866v"
Sep 16 12:12:20.536554 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:20.536491    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ae1d3547-f8ba-4536-8440-62227e3d9d28-metrics-cert\") pod \"lws-controller-manager-c7f7d6d7f-g866v\" (UID: \"ae1d3547-f8ba-4536-8440-62227e3d9d28\") " pod="openshift-lws-operator/lws-controller-manager-c7f7d6d7f-g866v"
Sep 16 12:12:20.536554 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:20.536519    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ae1d3547-f8ba-4536-8440-62227e3d9d28-manager-config\") pod \"lws-controller-manager-c7f7d6d7f-g866v\" (UID: \"ae1d3547-f8ba-4536-8440-62227e3d9d28\") " pod="openshift-lws-operator/lws-controller-manager-c7f7d6d7f-g866v"
Sep 16 12:12:20.536660 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:20.536577    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bddrc\" (UniqueName: \"kubernetes.io/projected/ae1d3547-f8ba-4536-8440-62227e3d9d28-kube-api-access-bddrc\") pod \"lws-controller-manager-c7f7d6d7f-g866v\" (UID: \"ae1d3547-f8ba-4536-8440-62227e3d9d28\") " pod="openshift-lws-operator/lws-controller-manager-c7f7d6d7f-g866v"
Sep 16 12:12:20.637465 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:20.637430    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bddrc\" (UniqueName: \"kubernetes.io/projected/ae1d3547-f8ba-4536-8440-62227e3d9d28-kube-api-access-bddrc\") pod \"lws-controller-manager-c7f7d6d7f-g866v\" (UID: \"ae1d3547-f8ba-4536-8440-62227e3d9d28\") " pod="openshift-lws-operator/lws-controller-manager-c7f7d6d7f-g866v"
Sep 16 12:12:20.637683 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:20.637504    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ae1d3547-f8ba-4536-8440-62227e3d9d28-cert\") pod \"lws-controller-manager-c7f7d6d7f-g866v\" (UID: \"ae1d3547-f8ba-4536-8440-62227e3d9d28\") " pod="openshift-lws-operator/lws-controller-manager-c7f7d6d7f-g866v"
Sep 16 12:12:20.637683 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:20.637566    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ae1d3547-f8ba-4536-8440-62227e3d9d28-metrics-cert\") pod \"lws-controller-manager-c7f7d6d7f-g866v\" (UID: \"ae1d3547-f8ba-4536-8440-62227e3d9d28\") " pod="openshift-lws-operator/lws-controller-manager-c7f7d6d7f-g866v"
Sep 16 12:12:20.637683 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:20.637589    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ae1d3547-f8ba-4536-8440-62227e3d9d28-manager-config\") pod \"lws-controller-manager-c7f7d6d7f-g866v\" (UID: \"ae1d3547-f8ba-4536-8440-62227e3d9d28\") " pod="openshift-lws-operator/lws-controller-manager-c7f7d6d7f-g866v"
Sep 16 12:12:20.638351 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:20.638327    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ae1d3547-f8ba-4536-8440-62227e3d9d28-manager-config\") pod \"lws-controller-manager-c7f7d6d7f-g866v\" (UID: \"ae1d3547-f8ba-4536-8440-62227e3d9d28\") " pod="openshift-lws-operator/lws-controller-manager-c7f7d6d7f-g866v"
Sep 16 12:12:20.640121 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:20.640100    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ae1d3547-f8ba-4536-8440-62227e3d9d28-metrics-cert\") pod \"lws-controller-manager-c7f7d6d7f-g866v\" (UID: \"ae1d3547-f8ba-4536-8440-62227e3d9d28\") " pod="openshift-lws-operator/lws-controller-manager-c7f7d6d7f-g866v"
Sep 16 12:12:20.640217 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:20.640157    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ae1d3547-f8ba-4536-8440-62227e3d9d28-cert\") pod \"lws-controller-manager-c7f7d6d7f-g866v\" (UID: \"ae1d3547-f8ba-4536-8440-62227e3d9d28\") " pod="openshift-lws-operator/lws-controller-manager-c7f7d6d7f-g866v"
Sep 16 12:12:20.644885 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:20.644859    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bddrc\" (UniqueName: \"kubernetes.io/projected/ae1d3547-f8ba-4536-8440-62227e3d9d28-kube-api-access-bddrc\") pod \"lws-controller-manager-c7f7d6d7f-g866v\" (UID: \"ae1d3547-f8ba-4536-8440-62227e3d9d28\") " pod="openshift-lws-operator/lws-controller-manager-c7f7d6d7f-g866v"
Sep 16 12:12:20.838406 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:20.838317    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-c7f7d6d7f-g866v"
Sep 16 12:12:21.118090 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:21.118066    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-c7f7d6d7f-g866v"]
Sep 16 12:12:21.120304 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:12:21.120275    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae1d3547_f8ba_4536_8440_62227e3d9d28.slice/crio-9d00c44a37aaf1071e3233ee6d8ed6824c133ac6c270b8be72772706d64cb747 WatchSource:0}: Error finding container 9d00c44a37aaf1071e3233ee6d8ed6824c133ac6c270b8be72772706d64cb747: Status 404 returned error can't find the container with id 9d00c44a37aaf1071e3233ee6d8ed6824c133ac6c270b8be72772706d64cb747
Sep 16 12:12:21.439084 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:21.439045    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-c7f7d6d7f-g866v" event={"ID":"ae1d3547-f8ba-4536-8440-62227e3d9d28","Type":"ContainerStarted","Data":"9d00c44a37aaf1071e3233ee6d8ed6824c133ac6c270b8be72772706d64cb747"}
Sep 16 12:12:23.394511 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:23.394478    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:12:23.486593 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:23.486562    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:12:24.332636 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:24.332605    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:12:24.441154 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:24.441105    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:12:24.453396 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:24.453362    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-c7f7d6d7f-g866v" event={"ID":"ae1d3547-f8ba-4536-8440-62227e3d9d28","Type":"ContainerStarted","Data":"1122d7b4a23513585a193eb2d498c18aa4c1e449cc817e2bfd47cbdab31fb37e"}
Sep 16 12:12:24.453568 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:24.453494    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-c7f7d6d7f-g866v"
Sep 16 12:12:24.477831 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:24.477777    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-c7f7d6d7f-g866v" podStartSLOduration=2.147853253 podStartE2EDuration="4.477761522s" totalImagesPullingTime="2.329908269s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:12:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:12:24.476617235 +0000 UTC m=+711.096936552" watchObservedRunningTime="2026-09-16 12:12:24.477761522 +0000 UTC m=+711.098080837"
Sep 16 12:12:25.016066 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:25.016028    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:12:25.103899 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:25.103865    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:12:25.670042 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:25.670005    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:12:25.830065 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:25.830028    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:12:26.285579 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:26.285544    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:12:26.411372 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:26.411333    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r59mq"]
Sep 16 12:12:26.411574 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:26.411551    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r59mq" podUID="8916a652-fa6a-4e6b-bd0f-38d393fc695a" containerName="discovery" containerID="cri-o://e1eed9d769e8549db33a7eb47c86302e66508877dc1738b2ee254151a2643a03" gracePeriod=30
Sep 16 12:12:26.423430 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:26.423403    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:12:26.658525 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:26.658502    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r59mq"
Sep 16 12:12:26.684636 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:26.684612    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8916a652-fa6a-4e6b-bd0f-38d393fc695a-istio-token\") pod \"8916a652-fa6a-4e6b-bd0f-38d393fc695a\" (UID: \"8916a652-fa6a-4e6b-bd0f-38d393fc695a\") "
Sep 16 12:12:26.684976 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:26.684693    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x998c\" (UniqueName: \"kubernetes.io/projected/8916a652-fa6a-4e6b-bd0f-38d393fc695a-kube-api-access-x998c\") pod \"8916a652-fa6a-4e6b-bd0f-38d393fc695a\" (UID: \"8916a652-fa6a-4e6b-bd0f-38d393fc695a\") "
Sep 16 12:12:26.684976 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:26.684727    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8916a652-fa6a-4e6b-bd0f-38d393fc695a-istio-csr-ca-configmap\") pod \"8916a652-fa6a-4e6b-bd0f-38d393fc695a\" (UID: \"8916a652-fa6a-4e6b-bd0f-38d393fc695a\") "
Sep 16 12:12:26.684976 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:26.684749    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8916a652-fa6a-4e6b-bd0f-38d393fc695a-istio-csr-dns-cert\") pod \"8916a652-fa6a-4e6b-bd0f-38d393fc695a\" (UID: \"8916a652-fa6a-4e6b-bd0f-38d393fc695a\") "
Sep 16 12:12:26.684976 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:26.684769    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8916a652-fa6a-4e6b-bd0f-38d393fc695a-cacerts\") pod \"8916a652-fa6a-4e6b-bd0f-38d393fc695a\" (UID: \"8916a652-fa6a-4e6b-bd0f-38d393fc695a\") "
Sep 16 12:12:26.684976 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:26.684793    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8916a652-fa6a-4e6b-bd0f-38d393fc695a-istio-kubeconfig\") pod \"8916a652-fa6a-4e6b-bd0f-38d393fc695a\" (UID: \"8916a652-fa6a-4e6b-bd0f-38d393fc695a\") "
Sep 16 12:12:26.684976 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:26.684809    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8916a652-fa6a-4e6b-bd0f-38d393fc695a-local-certs\") pod \"8916a652-fa6a-4e6b-bd0f-38d393fc695a\" (UID: \"8916a652-fa6a-4e6b-bd0f-38d393fc695a\") "
Sep 16 12:12:26.685365 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:26.685120    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8916a652-fa6a-4e6b-bd0f-38d393fc695a-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "8916a652-fa6a-4e6b-bd0f-38d393fc695a" (UID: "8916a652-fa6a-4e6b-bd0f-38d393fc695a"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:12:26.687286 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:26.687253    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8916a652-fa6a-4e6b-bd0f-38d393fc695a-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "8916a652-fa6a-4e6b-bd0f-38d393fc695a" (UID: "8916a652-fa6a-4e6b-bd0f-38d393fc695a"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 12:12:26.687433 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:26.687408    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8916a652-fa6a-4e6b-bd0f-38d393fc695a-cacerts" (OuterVolumeSpecName: "cacerts") pod "8916a652-fa6a-4e6b-bd0f-38d393fc695a" (UID: "8916a652-fa6a-4e6b-bd0f-38d393fc695a"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 12:12:26.687500 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:26.687448    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8916a652-fa6a-4e6b-bd0f-38d393fc695a-local-certs" (OuterVolumeSpecName: "local-certs") pod "8916a652-fa6a-4e6b-bd0f-38d393fc695a" (UID: "8916a652-fa6a-4e6b-bd0f-38d393fc695a"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:12:26.687500 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:26.687475    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8916a652-fa6a-4e6b-bd0f-38d393fc695a-istio-token" (OuterVolumeSpecName: "istio-token") pod "8916a652-fa6a-4e6b-bd0f-38d393fc695a" (UID: "8916a652-fa6a-4e6b-bd0f-38d393fc695a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:12:26.687601 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:26.687550    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8916a652-fa6a-4e6b-bd0f-38d393fc695a-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "8916a652-fa6a-4e6b-bd0f-38d393fc695a" (UID: "8916a652-fa6a-4e6b-bd0f-38d393fc695a"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 12:12:26.687865 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:26.687850    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8916a652-fa6a-4e6b-bd0f-38d393fc695a-kube-api-access-x998c" (OuterVolumeSpecName: "kube-api-access-x998c") pod "8916a652-fa6a-4e6b-bd0f-38d393fc695a" (UID: "8916a652-fa6a-4e6b-bd0f-38d393fc695a"). InnerVolumeSpecName "kube-api-access-x998c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:12:26.786192 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:26.786158    2559 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8916a652-fa6a-4e6b-bd0f-38d393fc695a-istio-kubeconfig\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:12:26.786192 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:26.786186    2559 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8916a652-fa6a-4e6b-bd0f-38d393fc695a-local-certs\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:12:26.786192 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:26.786198    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8916a652-fa6a-4e6b-bd0f-38d393fc695a-istio-token\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:12:26.786411 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:26.786210    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x998c\" (UniqueName: \"kubernetes.io/projected/8916a652-fa6a-4e6b-bd0f-38d393fc695a-kube-api-access-x998c\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:12:26.786411 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:26.786223    2559 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8916a652-fa6a-4e6b-bd0f-38d393fc695a-istio-csr-ca-configmap\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:12:26.786411 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:26.786234    2559 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8916a652-fa6a-4e6b-bd0f-38d393fc695a-istio-csr-dns-cert\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:12:26.786411 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:26.786245    2559 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8916a652-fa6a-4e6b-bd0f-38d393fc695a-cacerts\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:12:27.468881 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:27.468852    2559 generic.go:356] "Generic (PLEG): container finished" podID="8916a652-fa6a-4e6b-bd0f-38d393fc695a" containerID="e1eed9d769e8549db33a7eb47c86302e66508877dc1738b2ee254151a2643a03" exitCode=0
Sep 16 12:12:27.469049 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:27.468898    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r59mq"
Sep 16 12:12:27.469049 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:27.468936    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r59mq" event={"ID":"8916a652-fa6a-4e6b-bd0f-38d393fc695a","Type":"ContainerDied","Data":"e1eed9d769e8549db33a7eb47c86302e66508877dc1738b2ee254151a2643a03"}
Sep 16 12:12:27.469049 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:27.468989    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r59mq" event={"ID":"8916a652-fa6a-4e6b-bd0f-38d393fc695a","Type":"ContainerDied","Data":"088436e87b6073aa3fee8f697ab46b0ce2dd23806af767fbc62b111fac8057f1"}
Sep 16 12:12:27.469049 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:27.469010    2559 scope.go:117] "RemoveContainer" containerID="e1eed9d769e8549db33a7eb47c86302e66508877dc1738b2ee254151a2643a03"
Sep 16 12:12:27.481672 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:27.481654    2559 scope.go:117] "RemoveContainer" containerID="e1eed9d769e8549db33a7eb47c86302e66508877dc1738b2ee254151a2643a03"
Sep 16 12:12:27.481984 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:12:27.481963    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1eed9d769e8549db33a7eb47c86302e66508877dc1738b2ee254151a2643a03\": container with ID starting with e1eed9d769e8549db33a7eb47c86302e66508877dc1738b2ee254151a2643a03 not found: ID does not exist" containerID="e1eed9d769e8549db33a7eb47c86302e66508877dc1738b2ee254151a2643a03"
Sep 16 12:12:27.482033 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:27.481992    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1eed9d769e8549db33a7eb47c86302e66508877dc1738b2ee254151a2643a03"} err="failed to get container status \"e1eed9d769e8549db33a7eb47c86302e66508877dc1738b2ee254151a2643a03\": rpc error: code = NotFound desc = could not find container \"e1eed9d769e8549db33a7eb47c86302e66508877dc1738b2ee254151a2643a03\": container with ID starting with e1eed9d769e8549db33a7eb47c86302e66508877dc1738b2ee254151a2643a03 not found: ID does not exist"
Sep 16 12:12:27.492089 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:27.492067    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r59mq"]
Sep 16 12:12:27.495706 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:27.495677    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r59mq"]
Sep 16 12:12:27.939724 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:27.939692    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8916a652-fa6a-4e6b-bd0f-38d393fc695a" path="/var/lib/kubelet/pods/8916a652-fa6a-4e6b-bd0f-38d393fc695a/volumes"
Sep 16 12:12:35.460886 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:12:35.460851    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-c7f7d6d7f-g866v"
Sep 16 12:13:05.132985 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:05.132950    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:13:16.720932 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:16.720898    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:13:16.816016 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:16.815980    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:13:31.244387 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:31.244347    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:13:33.302345 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:33.302308    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-wvxcn"]
Sep 16 12:13:33.302806 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:33.302756    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8916a652-fa6a-4e6b-bd0f-38d393fc695a" containerName="discovery"
Sep 16 12:13:33.302806 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:33.302774    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8916a652-fa6a-4e6b-bd0f-38d393fc695a" containerName="discovery"
Sep 16 12:13:33.302915 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:33.302863    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="8916a652-fa6a-4e6b-bd0f-38d393fc695a" containerName="discovery"
Sep 16 12:13:33.305843 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:33.305821    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-wvxcn"
Sep 16 12:13:33.308869 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:33.308846    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 16 12:13:33.308976 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:33.308898    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 16 12:13:33.308976 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:33.308900    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-wtf95\""
Sep 16 12:13:33.308976 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:33.308936    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 16 12:13:33.327825 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:33.327792    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-wvxcn"]
Sep 16 12:13:33.354342 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:33.354309    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctdtt\" (UniqueName: \"kubernetes.io/projected/1265b402-10a5-4c22-b004-30c116fa3556-kube-api-access-ctdtt\") pod \"dns-operator-controller-manager-7b84cd7c9c-wvxcn\" (UID: \"1265b402-10a5-4c22-b004-30c116fa3556\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-wvxcn"
Sep 16 12:13:33.455649 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:33.455616    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctdtt\" (UniqueName: \"kubernetes.io/projected/1265b402-10a5-4c22-b004-30c116fa3556-kube-api-access-ctdtt\") pod \"dns-operator-controller-manager-7b84cd7c9c-wvxcn\" (UID: \"1265b402-10a5-4c22-b004-30c116fa3556\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-wvxcn"
Sep 16 12:13:33.464305 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:33.464280    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctdtt\" (UniqueName: \"kubernetes.io/projected/1265b402-10a5-4c22-b004-30c116fa3556-kube-api-access-ctdtt\") pod \"dns-operator-controller-manager-7b84cd7c9c-wvxcn\" (UID: \"1265b402-10a5-4c22-b004-30c116fa3556\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-wvxcn"
Sep 16 12:13:33.616122 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:33.616037    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-wvxcn"
Sep 16 12:13:33.889682 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:33.889662    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-wvxcn"]
Sep 16 12:13:33.892045 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:13:33.892008    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1265b402_10a5_4c22_b004_30c116fa3556.slice/crio-c9c8a85712241a85405fe24753f8cd695b2d088b2dd6c5b1f93e38e09424a64d WatchSource:0}: Error finding container c9c8a85712241a85405fe24753f8cd695b2d088b2dd6c5b1f93e38e09424a64d: Status 404 returned error can't find the container with id c9c8a85712241a85405fe24753f8cd695b2d088b2dd6c5b1f93e38e09424a64d
Sep 16 12:13:34.041285 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:34.041250    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:13:34.761957 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:34.761916    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-wvxcn" event={"ID":"1265b402-10a5-4c22-b004-30c116fa3556","Type":"ContainerStarted","Data":"c9c8a85712241a85405fe24753f8cd695b2d088b2dd6c5b1f93e38e09424a64d"}
Sep 16 12:13:35.417718 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:35.417681    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-7rh67"]
Sep 16 12:13:35.422301 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:35.422273    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-7rh67"
Sep 16 12:13:35.425766 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:35.425740    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-fcjrh\""
Sep 16 12:13:35.438325 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:35.438295    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-7rh67"]
Sep 16 12:13:35.473922 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:35.473867    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fc4qd\" (UniqueName: \"kubernetes.io/projected/a2390211-27de-4978-8069-c2fbc9122158-kube-api-access-fc4qd\") pod \"limitador-operator-controller-manager-74495c69f8-7rh67\" (UID: \"a2390211-27de-4978-8069-c2fbc9122158\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-7rh67"
Sep 16 12:13:35.574669 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:35.574594    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fc4qd\" (UniqueName: \"kubernetes.io/projected/a2390211-27de-4978-8069-c2fbc9122158-kube-api-access-fc4qd\") pod \"limitador-operator-controller-manager-74495c69f8-7rh67\" (UID: \"a2390211-27de-4978-8069-c2fbc9122158\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-7rh67"
Sep 16 12:13:35.589926 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:35.589897    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fc4qd\" (UniqueName: \"kubernetes.io/projected/a2390211-27de-4978-8069-c2fbc9122158-kube-api-access-fc4qd\") pod \"limitador-operator-controller-manager-74495c69f8-7rh67\" (UID: \"a2390211-27de-4978-8069-c2fbc9122158\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-7rh67"
Sep 16 12:13:35.733862 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:35.733781    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-7rh67"
Sep 16 12:13:35.841125 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:35.841084    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:13:36.082417 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:36.082316    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:13:36.237270 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:36.237234    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:13:36.484969 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:36.484946    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 16 12:13:36.680822 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:36.680748    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-7rh67"]
Sep 16 12:13:36.684121 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:13:36.684093    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2390211_27de_4978_8069_c2fbc9122158.slice/crio-07fad4e40726de66237817d6604ba791c54061f9a99d82f6eea62a0fc804b26d WatchSource:0}: Error finding container 07fad4e40726de66237817d6604ba791c54061f9a99d82f6eea62a0fc804b26d: Status 404 returned error can't find the container with id 07fad4e40726de66237817d6604ba791c54061f9a99d82f6eea62a0fc804b26d
Sep 16 12:13:36.772284 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:36.772231    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-wvxcn" event={"ID":"1265b402-10a5-4c22-b004-30c116fa3556","Type":"ContainerStarted","Data":"113d3bfd2eb70bb4a21e05c16a4500ef927ec165f55d0600b695b2116a84bd28"}
Sep 16 12:13:36.772463 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:36.772352    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-wvxcn"
Sep 16 12:13:36.773538 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:36.773515    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-7rh67" event={"ID":"a2390211-27de-4978-8069-c2fbc9122158","Type":"ContainerStarted","Data":"07fad4e40726de66237817d6604ba791c54061f9a99d82f6eea62a0fc804b26d"}
Sep 16 12:13:36.816651 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:36.815886    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-wvxcn" podStartSLOduration=1.2276534080000001 podStartE2EDuration="3.815865188s" totalImagesPullingTime="2.58821178s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:13:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:13:36.815027707 +0000 UTC m=+783.435347024" watchObservedRunningTime="2026-09-16 12:13:36.815865188 +0000 UTC m=+783.436184498"
Sep 16 12:13:36.912664 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:36.912632    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:13:37.293434 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:37.293402    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:13:38.291982 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:38.291949    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:13:38.393284 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:38.393248    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:13:38.784720 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:38.784685    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-7rh67" event={"ID":"a2390211-27de-4978-8069-c2fbc9122158","Type":"ContainerStarted","Data":"e130ca2e900b11af8aeb8370c0924061009258821d266cda950327dabdb12078"}
Sep 16 12:13:38.784905 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:38.784769    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-7rh67"
Sep 16 12:13:38.807419 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:38.807364    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-7rh67" podStartSLOduration=2.332209089 podStartE2EDuration="3.807347816s" totalImagesPullingTime="1.475138727s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:13:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:13:38.807152649 +0000 UTC m=+785.427471955" watchObservedRunningTime="2026-09-16 12:13:38.807347816 +0000 UTC m=+785.427667131"
Sep 16 12:13:39.881759 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:39.881718    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6m8lm"]
Sep 16 12:13:39.885217 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:39.885200    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6m8lm"
Sep 16 12:13:39.887871 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:39.887852    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-mpnm2\""
Sep 16 12:13:39.898277 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:39.898252    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6m8lm"]
Sep 16 12:13:40.021374 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:40.021338    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/253b7005-0061-48b6-9a78-0fe8d6f8fb15-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-6m8lm\" (UID: \"253b7005-0061-48b6-9a78-0fe8d6f8fb15\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6m8lm"
Sep 16 12:13:40.021542 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:40.021425    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4n9r6\" (UniqueName: \"kubernetes.io/projected/253b7005-0061-48b6-9a78-0fe8d6f8fb15-kube-api-access-4n9r6\") pod \"kuadrant-operator-controller-manager-76f8f686bf-6m8lm\" (UID: \"253b7005-0061-48b6-9a78-0fe8d6f8fb15\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6m8lm"
Sep 16 12:13:40.024077 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:40.024046    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:13:40.122551 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:40.122506    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4n9r6\" (UniqueName: \"kubernetes.io/projected/253b7005-0061-48b6-9a78-0fe8d6f8fb15-kube-api-access-4n9r6\") pod \"kuadrant-operator-controller-manager-76f8f686bf-6m8lm\" (UID: \"253b7005-0061-48b6-9a78-0fe8d6f8fb15\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6m8lm"
Sep 16 12:13:40.122715 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:40.122589    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/253b7005-0061-48b6-9a78-0fe8d6f8fb15-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-6m8lm\" (UID: \"253b7005-0061-48b6-9a78-0fe8d6f8fb15\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6m8lm"
Sep 16 12:13:40.122958 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:40.122939    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/253b7005-0061-48b6-9a78-0fe8d6f8fb15-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-6m8lm\" (UID: \"253b7005-0061-48b6-9a78-0fe8d6f8fb15\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6m8lm"
Sep 16 12:13:40.133834 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:40.133773    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4n9r6\" (UniqueName: \"kubernetes.io/projected/253b7005-0061-48b6-9a78-0fe8d6f8fb15-kube-api-access-4n9r6\") pod \"kuadrant-operator-controller-manager-76f8f686bf-6m8lm\" (UID: \"253b7005-0061-48b6-9a78-0fe8d6f8fb15\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6m8lm"
Sep 16 12:13:40.196364 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:40.196327    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6m8lm"
Sep 16 12:13:40.449486 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:40.449449    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:13:40.476246 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:40.476208    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6m8lm"]
Sep 16 12:13:40.480201 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:13:40.480173    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod253b7005_0061_48b6_9a78_0fe8d6f8fb15.slice/crio-4ad439c4dfcd4b1a761ad9cacb1d7d1a23706ebc2ad27d3371263858dabd2a46 WatchSource:0}: Error finding container 4ad439c4dfcd4b1a761ad9cacb1d7d1a23706ebc2ad27d3371263858dabd2a46: Status 404 returned error can't find the container with id 4ad439c4dfcd4b1a761ad9cacb1d7d1a23706ebc2ad27d3371263858dabd2a46
Sep 16 12:13:40.794450 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:40.794367    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6m8lm" event={"ID":"253b7005-0061-48b6-9a78-0fe8d6f8fb15","Type":"ContainerStarted","Data":"4ad439c4dfcd4b1a761ad9cacb1d7d1a23706ebc2ad27d3371263858dabd2a46"}
Sep 16 12:13:42.279437 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:42.279384    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:13:42.320992 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:42.320961    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-74vxx"]
Sep 16 12:13:42.324539 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:42.324514    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-74vxx"
Sep 16 12:13:42.327344 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:42.327317    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-kmr24\""
Sep 16 12:13:42.347102 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:42.347077    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-74vxx"]
Sep 16 12:13:42.443876 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:42.443842    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjgg6\" (UniqueName: \"kubernetes.io/projected/f0e06372-a6f9-41bf-8f9a-59cceec9e6ec-kube-api-access-fjgg6\") pod \"authorino-operator-76b478bd78-74vxx\" (UID: \"f0e06372-a6f9-41bf-8f9a-59cceec9e6ec\") " pod="kuadrant-system/authorino-operator-76b478bd78-74vxx"
Sep 16 12:13:42.545111 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:42.545021    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjgg6\" (UniqueName: \"kubernetes.io/projected/f0e06372-a6f9-41bf-8f9a-59cceec9e6ec-kube-api-access-fjgg6\") pod \"authorino-operator-76b478bd78-74vxx\" (UID: \"f0e06372-a6f9-41bf-8f9a-59cceec9e6ec\") " pod="kuadrant-system/authorino-operator-76b478bd78-74vxx"
Sep 16 12:13:42.555915 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:42.555884    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjgg6\" (UniqueName: \"kubernetes.io/projected/f0e06372-a6f9-41bf-8f9a-59cceec9e6ec-kube-api-access-fjgg6\") pod \"authorino-operator-76b478bd78-74vxx\" (UID: \"f0e06372-a6f9-41bf-8f9a-59cceec9e6ec\") " pod="kuadrant-system/authorino-operator-76b478bd78-74vxx"
Sep 16 12:13:42.638080 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:42.638045    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-74vxx"
Sep 16 12:13:42.918857 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:42.918822    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-74vxx"]
Sep 16 12:13:42.921350 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:13:42.921317    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0e06372_a6f9_41bf_8f9a_59cceec9e6ec.slice/crio-9f9da501ef95d5f8a7f7bbba94af224754bc04b12a1561777fa023a6b72e6caf WatchSource:0}: Error finding container 9f9da501ef95d5f8a7f7bbba94af224754bc04b12a1561777fa023a6b72e6caf: Status 404 returned error can't find the container with id 9f9da501ef95d5f8a7f7bbba94af224754bc04b12a1561777fa023a6b72e6caf
Sep 16 12:13:43.812471 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:43.812428    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-74vxx" event={"ID":"f0e06372-a6f9-41bf-8f9a-59cceec9e6ec","Type":"ContainerStarted","Data":"9f9da501ef95d5f8a7f7bbba94af224754bc04b12a1561777fa023a6b72e6caf"}
Sep 16 12:13:43.854881 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:43.854842    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:13:43.953145 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:43.953088    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:13:44.818686 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:44.818657    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6m8lm" event={"ID":"253b7005-0061-48b6-9a78-0fe8d6f8fb15","Type":"ContainerStarted","Data":"129861ee96b5ff71f44386d8bb447d6c3269782def93e19af764705e5e18ae8a"}
Sep 16 12:13:44.819039 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:44.818771    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6m8lm"
Sep 16 12:13:44.840660 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:44.840601    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6m8lm" podStartSLOduration=1.574027122 podStartE2EDuration="5.84057937s" totalImagesPullingTime="4.266552248s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:13:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:13:44.837022015 +0000 UTC m=+791.457341332" watchObservedRunningTime="2026-09-16 12:13:44.84057937 +0000 UTC m=+791.460898688"
Sep 16 12:13:47.522671 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:47.522631    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:13:47.638347 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:47.638313    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:13:47.739896 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:47.739835    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:13:47.781167 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:47.781071    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-wvxcn"
Sep 16 12:13:48.384194 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:48.384160    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:13:48.838295 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:48.838252    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-74vxx" event={"ID":"f0e06372-a6f9-41bf-8f9a-59cceec9e6ec","Type":"ContainerStarted","Data":"91b57d3159c9d1022cdc907143ee33b14048b1255c1c0e5cdb35813da407e427"}
Sep 16 12:13:48.838780 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:48.838387    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-74vxx"
Sep 16 12:13:48.855996 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:48.855948    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-74vxx" podStartSLOduration=1.48480042 podStartE2EDuration="6.855934731s" totalImagesPullingTime="5.371134311s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:13:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:13:48.855602636 +0000 UTC m=+795.475921950" watchObservedRunningTime="2026-09-16 12:13:48.855934731 +0000 UTC m=+795.476254047"
Sep 16 12:13:49.791479 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:49.791447    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-7rh67"
Sep 16 12:13:51.450785 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:51.450749    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:13:51.550255 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:51.550222    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:13:51.649787 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:51.649751    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:13:51.772455 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:51.772365    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:13:55.825521 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:55.825490    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6m8lm"
Sep 16 12:13:57.458706 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:57.458671    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-4k8mk"]
Sep 16 12:13:57.462207 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:57.462184    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-4k8mk"
Sep 16 12:13:57.478322 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:57.478287    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-4k8mk"]
Sep 16 12:13:57.481719 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:57.481687    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mv7l7\" (UniqueName: \"kubernetes.io/projected/026cec6e-0822-4b46-aa77-c7ba27e51ab7-kube-api-access-mv7l7\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-4k8mk\" (UID: \"026cec6e-0822-4b46-aa77-c7ba27e51ab7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-4k8mk"
Sep 16 12:13:57.481859 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:57.481766    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/026cec6e-0822-4b46-aa77-c7ba27e51ab7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-4k8mk\" (UID: \"026cec6e-0822-4b46-aa77-c7ba27e51ab7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-4k8mk"
Sep 16 12:13:57.582846 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:57.582807    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mv7l7\" (UniqueName: \"kubernetes.io/projected/026cec6e-0822-4b46-aa77-c7ba27e51ab7-kube-api-access-mv7l7\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-4k8mk\" (UID: \"026cec6e-0822-4b46-aa77-c7ba27e51ab7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-4k8mk"
Sep 16 12:13:57.582994 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:57.582873    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/026cec6e-0822-4b46-aa77-c7ba27e51ab7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-4k8mk\" (UID: \"026cec6e-0822-4b46-aa77-c7ba27e51ab7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-4k8mk"
Sep 16 12:13:57.583257 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:57.583240    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/026cec6e-0822-4b46-aa77-c7ba27e51ab7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-4k8mk\" (UID: \"026cec6e-0822-4b46-aa77-c7ba27e51ab7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-4k8mk"
Sep 16 12:13:57.595544 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:57.595509    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mv7l7\" (UniqueName: \"kubernetes.io/projected/026cec6e-0822-4b46-aa77-c7ba27e51ab7-kube-api-access-mv7l7\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-4k8mk\" (UID: \"026cec6e-0822-4b46-aa77-c7ba27e51ab7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-4k8mk"
Sep 16 12:13:57.780631 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:57.780530    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-4k8mk"
Sep 16 12:13:57.947659 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:57.947624    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6m8lm"]
Sep 16 12:13:57.947863 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:57.947818    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6m8lm" podUID="253b7005-0061-48b6-9a78-0fe8d6f8fb15" containerName="manager" containerID="cri-o://129861ee96b5ff71f44386d8bb447d6c3269782def93e19af764705e5e18ae8a" gracePeriod=2
Sep 16 12:13:57.954370 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:57.954341    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6m8lm"]
Sep 16 12:13:57.974680 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:57.974654    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-4k8mk"]
Sep 16 12:13:57.994170 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:57.994144    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-4k8mk"]
Sep 16 12:13:58.036592 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:58.036504    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-7rh67"]
Sep 16 12:13:58.036758 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:58.036731    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-7rh67" podUID="a2390211-27de-4978-8069-c2fbc9122158" containerName="manager" containerID="cri-o://e130ca2e900b11af8aeb8370c0924061009258821d266cda950327dabdb12078" gracePeriod=2
Sep 16 12:13:58.038074 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:58.038041    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-tqw2p"]
Sep 16 12:13:58.038419 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:58.038404    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="253b7005-0061-48b6-9a78-0fe8d6f8fb15" containerName="manager"
Sep 16 12:13:58.038498 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:58.038420    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="253b7005-0061-48b6-9a78-0fe8d6f8fb15" containerName="manager"
Sep 16 12:13:58.038498 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:58.038487    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="253b7005-0061-48b6-9a78-0fe8d6f8fb15" containerName="manager"
Sep 16 12:13:58.039210 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:13:58.039178    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-6m8lm\" is forbidden: User \"system:node:ip-10-0-138-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-251.ec2.internal' and this object" podUID="253b7005-0061-48b6-9a78-0fe8d6f8fb15" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6m8lm"
Sep 16 12:13:58.041986 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:58.041957    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-tqw2p"
Sep 16 12:13:58.044900 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:58.044862    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-7rh67"]
Sep 16 12:13:58.047055 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:13:58.047024    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-7rh67\" is forbidden: User \"system:node:ip-10-0-138-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-251.ec2.internal' and this object" podUID="a2390211-27de-4978-8069-c2fbc9122158" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-7rh67"
Sep 16 12:13:58.058959 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:58.058935    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-tqw2p"]
Sep 16 12:13:58.070873 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:58.070841    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-6mfcs"]
Sep 16 12:13:58.071559 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:58.071530    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2390211-27de-4978-8069-c2fbc9122158" containerName="manager"
Sep 16 12:13:58.071559 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:58.071555    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2390211-27de-4978-8069-c2fbc9122158" containerName="manager"
Sep 16 12:13:58.071710 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:58.071656    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2390211-27de-4978-8069-c2fbc9122158" containerName="manager"
Sep 16 12:13:58.074833 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:58.074811    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-6mfcs"
Sep 16 12:13:58.080142 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:13:58.080105    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-6m8lm\" is forbidden: User \"system:node:ip-10-0-138-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-251.ec2.internal' and this object" podUID="253b7005-0061-48b6-9a78-0fe8d6f8fb15" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6m8lm"
Sep 16 12:13:58.082246 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:13:58.082221    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-7rh67\" is forbidden: User \"system:node:ip-10-0-138-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-251.ec2.internal' and this object" podUID="a2390211-27de-4978-8069-c2fbc9122158" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-7rh67"
Sep 16 12:13:58.085999 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:58.085971    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0d02beb6-bd0f-4a8e-9dc2-c7a310ec9077-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-tqw2p\" (UID: \"0d02beb6-bd0f-4a8e-9dc2-c7a310ec9077\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-tqw2p"
Sep 16 12:13:58.086117 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:58.086027    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4t9q\" (UniqueName: \"kubernetes.io/projected/0d02beb6-bd0f-4a8e-9dc2-c7a310ec9077-kube-api-access-w4t9q\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-tqw2p\" (UID: \"0d02beb6-bd0f-4a8e-9dc2-c7a310ec9077\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-tqw2p"
Sep 16 12:13:58.086117 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:58.086086    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4vhk\" (UniqueName: \"kubernetes.io/projected/7c2f6b89-cbba-4cb3-afaa-abd3da15579f-kube-api-access-l4vhk\") pod \"limitador-operator-controller-manager-74495c69f8-6mfcs\" (UID: \"7c2f6b89-cbba-4cb3-afaa-abd3da15579f\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-6mfcs"
Sep 16 12:13:58.087525 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:58.087505    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-6mfcs"]
Sep 16 12:13:58.103405 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:13:58.103330    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-6m8lm\" is forbidden: User \"system:node:ip-10-0-138-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-251.ec2.internal' and this object" podUID="253b7005-0061-48b6-9a78-0fe8d6f8fb15" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6m8lm"
Sep 16 12:13:58.187023 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:58.186988    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4vhk\" (UniqueName: \"kubernetes.io/projected/7c2f6b89-cbba-4cb3-afaa-abd3da15579f-kube-api-access-l4vhk\") pod \"limitador-operator-controller-manager-74495c69f8-6mfcs\" (UID: \"7c2f6b89-cbba-4cb3-afaa-abd3da15579f\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-6mfcs"
Sep 16 12:13:58.187223 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:58.187153    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0d02beb6-bd0f-4a8e-9dc2-c7a310ec9077-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-tqw2p\" (UID: \"0d02beb6-bd0f-4a8e-9dc2-c7a310ec9077\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-tqw2p"
Sep 16 12:13:58.187223 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:58.187206    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4t9q\" (UniqueName: \"kubernetes.io/projected/0d02beb6-bd0f-4a8e-9dc2-c7a310ec9077-kube-api-access-w4t9q\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-tqw2p\" (UID: \"0d02beb6-bd0f-4a8e-9dc2-c7a310ec9077\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-tqw2p"
Sep 16 12:13:58.187568 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:58.187547    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0d02beb6-bd0f-4a8e-9dc2-c7a310ec9077-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-tqw2p\" (UID: \"0d02beb6-bd0f-4a8e-9dc2-c7a310ec9077\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-tqw2p"
Sep 16 12:13:58.196620 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:58.196583    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4vhk\" (UniqueName: \"kubernetes.io/projected/7c2f6b89-cbba-4cb3-afaa-abd3da15579f-kube-api-access-l4vhk\") pod \"limitador-operator-controller-manager-74495c69f8-6mfcs\" (UID: \"7c2f6b89-cbba-4cb3-afaa-abd3da15579f\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-6mfcs"
Sep 16 12:13:58.196720 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:58.196678    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4t9q\" (UniqueName: \"kubernetes.io/projected/0d02beb6-bd0f-4a8e-9dc2-c7a310ec9077-kube-api-access-w4t9q\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-tqw2p\" (UID: \"0d02beb6-bd0f-4a8e-9dc2-c7a310ec9077\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-tqw2p"
Sep 16 12:13:58.197741 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:13:58.197712    2559 log.go:32] "RunPodSandbox from runtime service failed" err=<
Sep 16 12:13:58.197741 ip-10-0-138-251 kubenswrapper[2559]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-7978cbdfbc-4k8mk_kuadrant-system_026cec6e-0822-4b46-aa77-c7ba27e51ab7_0(f839a136d95bab7cf56c947f1b2c2b3572b9ed950dd274a88c5748e03d8b1b98): error adding pod kuadrant-system_kuadrant-operator-controller-manager-7978cbdfbc-4k8mk to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"f839a136d95bab7cf56c947f1b2c2b3572b9ed950dd274a88c5748e03d8b1b98" Netns:"/var/run/netns/c8a0eb86-899a-4671-9af0-1124650680a5" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-7978cbdfbc-4k8mk;K8S_POD_INFRA_CONTAINER_ID=f839a136d95bab7cf56c947f1b2c2b3572b9ed950dd274a88c5748e03d8b1b98;K8S_POD_UID=026cec6e-0822-4b46-aa77-c7ba27e51ab7" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-4k8mk] networking: [kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-4k8mk/026cec6e-0822-4b46-aa77-c7ba27e51ab7:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-4k8mk f839a136d95bab7cf56c947f1b2c2b3572b9ed950dd274a88c5748e03d8b1b98 network default NAD default NAD key default] failed to configure pod interface: pod deleted waiting for OVS port binding for 0a:58:0a:84:00:1d [10.132.0.29/23]
Sep 16 12:13:58.197741 ip-10-0-138-251 kubenswrapper[2559]:         '
Sep 16 12:13:58.197741 ip-10-0-138-251 kubenswrapper[2559]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Sep 16 12:13:58.197741 ip-10-0-138-251 kubenswrapper[2559]:  >
Sep 16 12:13:58.197966 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:13:58.197772    2559 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=<
Sep 16 12:13:58.197966 ip-10-0-138-251 kubenswrapper[2559]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-7978cbdfbc-4k8mk_kuadrant-system_026cec6e-0822-4b46-aa77-c7ba27e51ab7_0(f839a136d95bab7cf56c947f1b2c2b3572b9ed950dd274a88c5748e03d8b1b98): error adding pod kuadrant-system_kuadrant-operator-controller-manager-7978cbdfbc-4k8mk to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"f839a136d95bab7cf56c947f1b2c2b3572b9ed950dd274a88c5748e03d8b1b98" Netns:"/var/run/netns/c8a0eb86-899a-4671-9af0-1124650680a5" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-7978cbdfbc-4k8mk;K8S_POD_INFRA_CONTAINER_ID=f839a136d95bab7cf56c947f1b2c2b3572b9ed950dd274a88c5748e03d8b1b98;K8S_POD_UID=026cec6e-0822-4b46-aa77-c7ba27e51ab7" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-4k8mk] networking: [kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-4k8mk/026cec6e-0822-4b46-aa77-c7ba27e51ab7:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-4k8mk f839a136d95bab7cf56c947f1b2c2b3572b9ed950dd274a88c5748e03d8b1b98 network default NAD default NAD key default] failed to configure pod interface: pod deleted waiting for OVS port binding for 0a:58:0a:84:00:1d [10.132.0.29/23]
Sep 16 12:13:58.197966 ip-10-0-138-251 kubenswrapper[2559]:         '
Sep 16 12:13:58.197966 ip-10-0-138-251 kubenswrapper[2559]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Sep 16 12:13:58.197966 ip-10-0-138-251 kubenswrapper[2559]:  > pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-4k8mk"
Sep 16 12:13:58.263026 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:58.263000    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6m8lm"
Sep 16 12:13:58.265652 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:13:58.265617    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-6m8lm\" is forbidden: User \"system:node:ip-10-0-138-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-251.ec2.internal' and this object" podUID="253b7005-0061-48b6-9a78-0fe8d6f8fb15" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6m8lm"
Sep 16 12:13:58.267691 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:13:58.267667    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-7rh67\" is forbidden: User \"system:node:ip-10-0-138-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-251.ec2.internal' and this object" podUID="a2390211-27de-4978-8069-c2fbc9122158" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-7rh67"
Sep 16 12:13:58.268730 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:58.268712    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-7rh67"
Sep 16 12:13:58.270869 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:13:58.270846    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-6m8lm\" is forbidden: User \"system:node:ip-10-0-138-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-251.ec2.internal' and this object" podUID="253b7005-0061-48b6-9a78-0fe8d6f8fb15" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6m8lm"
Sep 16 12:13:58.273031 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:13:58.273010    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-7rh67\" is forbidden: User \"system:node:ip-10-0-138-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-251.ec2.internal' and this object" podUID="a2390211-27de-4978-8069-c2fbc9122158" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-7rh67"
Sep 16 12:13:58.288466 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:58.288422    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/253b7005-0061-48b6-9a78-0fe8d6f8fb15-extensions-socket-volume\") pod \"253b7005-0061-48b6-9a78-0fe8d6f8fb15\" (UID: \"253b7005-0061-48b6-9a78-0fe8d6f8fb15\") "
Sep 16 12:13:58.288513 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:58.288474    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fc4qd\" (UniqueName: \"kubernetes.io/projected/a2390211-27de-4978-8069-c2fbc9122158-kube-api-access-fc4qd\") pod \"a2390211-27de-4978-8069-c2fbc9122158\" (UID: \"a2390211-27de-4978-8069-c2fbc9122158\") "
Sep 16 12:13:58.288513 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:58.288497    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4n9r6\" (UniqueName: \"kubernetes.io/projected/253b7005-0061-48b6-9a78-0fe8d6f8fb15-kube-api-access-4n9r6\") pod \"253b7005-0061-48b6-9a78-0fe8d6f8fb15\" (UID: \"253b7005-0061-48b6-9a78-0fe8d6f8fb15\") "
Sep 16 12:13:58.288936 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:58.288916    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/253b7005-0061-48b6-9a78-0fe8d6f8fb15-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "253b7005-0061-48b6-9a78-0fe8d6f8fb15" (UID: "253b7005-0061-48b6-9a78-0fe8d6f8fb15"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:13:58.290659 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:58.290635    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2390211-27de-4978-8069-c2fbc9122158-kube-api-access-fc4qd" (OuterVolumeSpecName: "kube-api-access-fc4qd") pod "a2390211-27de-4978-8069-c2fbc9122158" (UID: "a2390211-27de-4978-8069-c2fbc9122158"). InnerVolumeSpecName "kube-api-access-fc4qd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:13:58.290732 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:58.290661    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/253b7005-0061-48b6-9a78-0fe8d6f8fb15-kube-api-access-4n9r6" (OuterVolumeSpecName: "kube-api-access-4n9r6") pod "253b7005-0061-48b6-9a78-0fe8d6f8fb15" (UID: "253b7005-0061-48b6-9a78-0fe8d6f8fb15"). InnerVolumeSpecName "kube-api-access-4n9r6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:13:58.389281 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:58.389248    2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/253b7005-0061-48b6-9a78-0fe8d6f8fb15-extensions-socket-volume\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:13:58.389281 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:58.389278    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fc4qd\" (UniqueName: \"kubernetes.io/projected/a2390211-27de-4978-8069-c2fbc9122158-kube-api-access-fc4qd\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:13:58.389281 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:58.389287    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4n9r6\" (UniqueName: \"kubernetes.io/projected/253b7005-0061-48b6-9a78-0fe8d6f8fb15-kube-api-access-4n9r6\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:13:58.414084 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:58.414056    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-tqw2p"
Sep 16 12:13:58.420070 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:58.420053    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-6mfcs"
Sep 16 12:13:58.690956 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:58.690926    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-tqw2p"]
Sep 16 12:13:58.693005 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:13:58.692977    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d02beb6_bd0f_4a8e_9dc2_c7a310ec9077.slice/crio-7cf91de98d22470c6ac4c92d9025a6bb22d465340b3e382658e9741e47921f2b WatchSource:0}: Error finding container 7cf91de98d22470c6ac4c92d9025a6bb22d465340b3e382658e9741e47921f2b: Status 404 returned error can't find the container with id 7cf91de98d22470c6ac4c92d9025a6bb22d465340b3e382658e9741e47921f2b
Sep 16 12:13:58.698354 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:58.698320    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-6mfcs"]
Sep 16 12:13:58.701432 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:13:58.701410    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c2f6b89_cbba_4cb3_afaa_abd3da15579f.slice/crio-aad3a391985851fdf7f57a1c324233f5f38c69c1ed2ed9607384af9186d4038d WatchSource:0}: Error finding container aad3a391985851fdf7f57a1c324233f5f38c69c1ed2ed9607384af9186d4038d: Status 404 returned error can't find the container with id aad3a391985851fdf7f57a1c324233f5f38c69c1ed2ed9607384af9186d4038d
Sep 16 12:13:58.887387 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:58.887291    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-6mfcs" event={"ID":"7c2f6b89-cbba-4cb3-afaa-abd3da15579f","Type":"ContainerStarted","Data":"647a50d7ef88b27b7d78c739be5381ce8788766680452cd08b7b8184ec2ec6cd"}
Sep 16 12:13:58.887387 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:58.887349    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-6mfcs" event={"ID":"7c2f6b89-cbba-4cb3-afaa-abd3da15579f","Type":"ContainerStarted","Data":"aad3a391985851fdf7f57a1c324233f5f38c69c1ed2ed9607384af9186d4038d"}
Sep 16 12:13:58.887603 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:58.887465    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-6mfcs"
Sep 16 12:13:58.888645 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:58.888622    2559 generic.go:356] "Generic (PLEG): container finished" podID="a2390211-27de-4978-8069-c2fbc9122158" containerID="e130ca2e900b11af8aeb8370c0924061009258821d266cda950327dabdb12078" exitCode=0
Sep 16 12:13:58.888735 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:58.888655    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-7rh67"
Sep 16 12:13:58.888735 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:58.888715    2559 scope.go:117] "RemoveContainer" containerID="e130ca2e900b11af8aeb8370c0924061009258821d266cda950327dabdb12078"
Sep 16 12:13:58.889696 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:13:58.889673    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-6m8lm\" is forbidden: User \"system:node:ip-10-0-138-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-251.ec2.internal' and this object" podUID="253b7005-0061-48b6-9a78-0fe8d6f8fb15" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6m8lm"
Sep 16 12:13:58.890887 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:58.890851    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-tqw2p" event={"ID":"0d02beb6-bd0f-4a8e-9dc2-c7a310ec9077","Type":"ContainerStarted","Data":"40686acdae913b8b306053301148c51135db8a6e664c021a13e0bae998be8504"}
Sep 16 12:13:58.891100 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:58.890895    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-tqw2p" event={"ID":"0d02beb6-bd0f-4a8e-9dc2-c7a310ec9077","Type":"ContainerStarted","Data":"7cf91de98d22470c6ac4c92d9025a6bb22d465340b3e382658e9741e47921f2b"}
Sep 16 12:13:58.891100 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:58.890926    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-tqw2p"
Sep 16 12:13:58.891725 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:13:58.891688    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-7rh67\" is forbidden: User \"system:node:ip-10-0-138-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-251.ec2.internal' and this object" podUID="a2390211-27de-4978-8069-c2fbc9122158" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-7rh67"
Sep 16 12:13:58.892434 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:58.892414    2559 generic.go:356] "Generic (PLEG): container finished" podID="253b7005-0061-48b6-9a78-0fe8d6f8fb15" containerID="129861ee96b5ff71f44386d8bb447d6c3269782def93e19af764705e5e18ae8a" exitCode=0
Sep 16 12:13:58.892528 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:58.892456    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6m8lm"
Sep 16 12:13:58.892649 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:58.892634    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-4k8mk"
Sep 16 12:13:58.899004 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:58.898960    2559 scope.go:117] "RemoveContainer" containerID="e130ca2e900b11af8aeb8370c0924061009258821d266cda950327dabdb12078"
Sep 16 12:13:58.899353 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:13:58.899323    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e130ca2e900b11af8aeb8370c0924061009258821d266cda950327dabdb12078\": container with ID starting with e130ca2e900b11af8aeb8370c0924061009258821d266cda950327dabdb12078 not found: ID does not exist" containerID="e130ca2e900b11af8aeb8370c0924061009258821d266cda950327dabdb12078"
Sep 16 12:13:58.899472 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:58.899357    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e130ca2e900b11af8aeb8370c0924061009258821d266cda950327dabdb12078"} err="failed to get container status \"e130ca2e900b11af8aeb8370c0924061009258821d266cda950327dabdb12078\": rpc error: code = NotFound desc = could not find container \"e130ca2e900b11af8aeb8370c0924061009258821d266cda950327dabdb12078\": container with ID starting with e130ca2e900b11af8aeb8370c0924061009258821d266cda950327dabdb12078 not found: ID does not exist"
Sep 16 12:13:58.899472 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:58.899372    2559 scope.go:117] "RemoveContainer" containerID="129861ee96b5ff71f44386d8bb447d6c3269782def93e19af764705e5e18ae8a"
Sep 16 12:13:58.900930 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:58.900910    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-4k8mk"
Sep 16 12:13:58.906784 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:58.906768    2559 scope.go:117] "RemoveContainer" containerID="129861ee96b5ff71f44386d8bb447d6c3269782def93e19af764705e5e18ae8a"
Sep 16 12:13:58.907058 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:13:58.907038    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"129861ee96b5ff71f44386d8bb447d6c3269782def93e19af764705e5e18ae8a\": container with ID starting with 129861ee96b5ff71f44386d8bb447d6c3269782def93e19af764705e5e18ae8a not found: ID does not exist" containerID="129861ee96b5ff71f44386d8bb447d6c3269782def93e19af764705e5e18ae8a"
Sep 16 12:13:58.907102 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:58.907064    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"129861ee96b5ff71f44386d8bb447d6c3269782def93e19af764705e5e18ae8a"} err="failed to get container status \"129861ee96b5ff71f44386d8bb447d6c3269782def93e19af764705e5e18ae8a\": rpc error: code = NotFound desc = could not find container \"129861ee96b5ff71f44386d8bb447d6c3269782def93e19af764705e5e18ae8a\": container with ID starting with 129861ee96b5ff71f44386d8bb447d6c3269782def93e19af764705e5e18ae8a not found: ID does not exist"
Sep 16 12:13:58.911086 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:58.911047    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-6mfcs" podStartSLOduration=0.911034332 podStartE2EDuration="911.034332ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:13:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:13:58.910253682 +0000 UTC m=+805.530573000" watchObservedRunningTime="2026-09-16 12:13:58.911034332 +0000 UTC m=+805.531353647"
Sep 16 12:13:58.912264 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:13:58.912242    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-6m8lm\" is forbidden: User \"system:node:ip-10-0-138-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-251.ec2.internal' and this object" podUID="253b7005-0061-48b6-9a78-0fe8d6f8fb15" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6m8lm"
Sep 16 12:13:58.914281 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:13:58.914260    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-7978cbdfbc-4k8mk\" is forbidden: User \"system:node:ip-10-0-138-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-251.ec2.internal' and this object" podUID="026cec6e-0822-4b46-aa77-c7ba27e51ab7" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-4k8mk"
Sep 16 12:13:58.916248 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:13:58.916227    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-7rh67\" is forbidden: User \"system:node:ip-10-0-138-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-251.ec2.internal' and this object" podUID="a2390211-27de-4978-8069-c2fbc9122158" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-7rh67"
Sep 16 12:13:58.941785 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:58.941738    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-tqw2p" podStartSLOduration=1.941724555 podStartE2EDuration="1.941724555s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:13:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:13:58.940353025 +0000 UTC m=+805.560672342" watchObservedRunningTime="2026-09-16 12:13:58.941724555 +0000 UTC m=+805.562043870"
Sep 16 12:13:58.993402 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:58.993378    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/026cec6e-0822-4b46-aa77-c7ba27e51ab7-extensions-socket-volume\") pod \"026cec6e-0822-4b46-aa77-c7ba27e51ab7\" (UID: \"026cec6e-0822-4b46-aa77-c7ba27e51ab7\") "
Sep 16 12:13:58.993564 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:58.993468    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mv7l7\" (UniqueName: \"kubernetes.io/projected/026cec6e-0822-4b46-aa77-c7ba27e51ab7-kube-api-access-mv7l7\") pod \"026cec6e-0822-4b46-aa77-c7ba27e51ab7\" (UID: \"026cec6e-0822-4b46-aa77-c7ba27e51ab7\") "
Sep 16 12:13:58.993655 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:58.993620    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/026cec6e-0822-4b46-aa77-c7ba27e51ab7-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "026cec6e-0822-4b46-aa77-c7ba27e51ab7" (UID: "026cec6e-0822-4b46-aa77-c7ba27e51ab7"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:13:58.994108 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:58.994076    2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/026cec6e-0822-4b46-aa77-c7ba27e51ab7-extensions-socket-volume\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:13:58.996017 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:58.995997    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/026cec6e-0822-4b46-aa77-c7ba27e51ab7-kube-api-access-mv7l7" (OuterVolumeSpecName: "kube-api-access-mv7l7") pod "026cec6e-0822-4b46-aa77-c7ba27e51ab7" (UID: "026cec6e-0822-4b46-aa77-c7ba27e51ab7"). InnerVolumeSpecName "kube-api-access-mv7l7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:13:59.094493 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:59.094463    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mv7l7\" (UniqueName: \"kubernetes.io/projected/026cec6e-0822-4b46-aa77-c7ba27e51ab7-kube-api-access-mv7l7\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:13:59.844637 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:59.844608    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-74vxx"
Sep 16 12:13:59.847076 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:13:59.847045    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-6m8lm\" is forbidden: User \"system:node:ip-10-0-138-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-251.ec2.internal' and this object" podUID="253b7005-0061-48b6-9a78-0fe8d6f8fb15" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6m8lm"
Sep 16 12:13:59.849283 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:13:59.849262    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-7978cbdfbc-4k8mk\" is forbidden: User \"system:node:ip-10-0-138-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-251.ec2.internal' and this object" podUID="026cec6e-0822-4b46-aa77-c7ba27e51ab7" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-4k8mk"
Sep 16 12:13:59.873079 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:13:59.873015    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-7rh67\" is forbidden: User \"system:node:ip-10-0-138-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-251.ec2.internal' and this object" podUID="a2390211-27de-4978-8069-c2fbc9122158" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-7rh67"
Sep 16 12:13:59.906244 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:59.906203    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-4k8mk"
Sep 16 12:13:59.909076 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:13:59.909044    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-6m8lm\" is forbidden: User \"system:node:ip-10-0-138-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-251.ec2.internal' and this object" podUID="253b7005-0061-48b6-9a78-0fe8d6f8fb15" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6m8lm"
Sep 16 12:13:59.911255 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:13:59.911227    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-7978cbdfbc-4k8mk\" is forbidden: User \"system:node:ip-10-0-138-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-251.ec2.internal' and this object" podUID="026cec6e-0822-4b46-aa77-c7ba27e51ab7" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-4k8mk"
Sep 16 12:13:59.913438 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:13:59.913412    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-7rh67\" is forbidden: User \"system:node:ip-10-0-138-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-251.ec2.internal' and this object" podUID="a2390211-27de-4978-8069-c2fbc9122158" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-7rh67"
Sep 16 12:13:59.915693 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:13:59.915672    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-6m8lm\" is forbidden: User \"system:node:ip-10-0-138-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-251.ec2.internal' and this object" podUID="253b7005-0061-48b6-9a78-0fe8d6f8fb15" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-6m8lm"
Sep 16 12:13:59.917816 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:13:59.917784    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-7978cbdfbc-4k8mk\" is forbidden: User \"system:node:ip-10-0-138-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-251.ec2.internal' and this object" podUID="026cec6e-0822-4b46-aa77-c7ba27e51ab7" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-4k8mk"
Sep 16 12:13:59.920046 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:13:59.920026    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-7rh67\" is forbidden: User \"system:node:ip-10-0-138-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-251.ec2.internal' and this object" podUID="a2390211-27de-4978-8069-c2fbc9122158" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-7rh67"
Sep 16 12:13:59.937591 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:59.937564    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="026cec6e-0822-4b46-aa77-c7ba27e51ab7" path="/var/lib/kubelet/pods/026cec6e-0822-4b46-aa77-c7ba27e51ab7/volumes"
Sep 16 12:13:59.937892 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:59.937873    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="253b7005-0061-48b6-9a78-0fe8d6f8fb15" path="/var/lib/kubelet/pods/253b7005-0061-48b6-9a78-0fe8d6f8fb15/volumes"
Sep 16 12:13:59.938255 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:13:59.938237    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2390211-27de-4978-8069-c2fbc9122158" path="/var/lib/kubelet/pods/a2390211-27de-4978-8069-c2fbc9122158/volumes"
Sep 16 12:14:00.270607 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:00.270571    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:14:00.367730 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:00.367701    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:14:00.468858 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:00.468819    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:14:02.841817 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:02.841778    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:14:02.943401 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:02.943364    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:14:06.051733 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:06.051697    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:14:06.268213 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:06.268184    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:14:09.908735 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:09.908704    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-6mfcs"
Sep 16 12:14:09.909188 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:09.908794    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-tqw2p"
Sep 16 12:14:10.498697 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:10.498618    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:14:10.620205 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:10.620173    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:14:10.798547 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:10.798466    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:14:10.957595 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:10.957565    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:14:11.130227 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:11.130122    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:14:19.268091 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:19.268057    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:14:19.361917 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:19.361883    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:14:22.784386 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:22.784342    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-tqw2p"]
Sep 16 12:14:22.784918 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:22.784596    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-tqw2p" podUID="0d02beb6-bd0f-4a8e-9dc2-c7a310ec9077" containerName="manager" containerID="cri-o://40686acdae913b8b306053301148c51135db8a6e664c021a13e0bae998be8504" gracePeriod=10
Sep 16 12:14:23.009197 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:23.009162    2559 generic.go:356] "Generic (PLEG): container finished" podID="0d02beb6-bd0f-4a8e-9dc2-c7a310ec9077" containerID="40686acdae913b8b306053301148c51135db8a6e664c021a13e0bae998be8504" exitCode=0
Sep 16 12:14:23.009355 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:23.009226    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-tqw2p" event={"ID":"0d02beb6-bd0f-4a8e-9dc2-c7a310ec9077","Type":"ContainerDied","Data":"40686acdae913b8b306053301148c51135db8a6e664c021a13e0bae998be8504"}
Sep 16 12:14:23.037582 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:23.037518    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-tqw2p"
Sep 16 12:14:23.101895 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:23.101859    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w4t9q\" (UniqueName: \"kubernetes.io/projected/0d02beb6-bd0f-4a8e-9dc2-c7a310ec9077-kube-api-access-w4t9q\") pod \"0d02beb6-bd0f-4a8e-9dc2-c7a310ec9077\" (UID: \"0d02beb6-bd0f-4a8e-9dc2-c7a310ec9077\") "
Sep 16 12:14:23.102067 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:23.101921    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0d02beb6-bd0f-4a8e-9dc2-c7a310ec9077-extensions-socket-volume\") pod \"0d02beb6-bd0f-4a8e-9dc2-c7a310ec9077\" (UID: \"0d02beb6-bd0f-4a8e-9dc2-c7a310ec9077\") "
Sep 16 12:14:23.102332 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:23.102301    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d02beb6-bd0f-4a8e-9dc2-c7a310ec9077-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0d02beb6-bd0f-4a8e-9dc2-c7a310ec9077" (UID: "0d02beb6-bd0f-4a8e-9dc2-c7a310ec9077"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:14:23.104013 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:23.103987    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d02beb6-bd0f-4a8e-9dc2-c7a310ec9077-kube-api-access-w4t9q" (OuterVolumeSpecName: "kube-api-access-w4t9q") pod "0d02beb6-bd0f-4a8e-9dc2-c7a310ec9077" (UID: "0d02beb6-bd0f-4a8e-9dc2-c7a310ec9077"). InnerVolumeSpecName "kube-api-access-w4t9q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:14:23.202637 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:23.202597    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w4t9q\" (UniqueName: \"kubernetes.io/projected/0d02beb6-bd0f-4a8e-9dc2-c7a310ec9077-kube-api-access-w4t9q\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:14:23.202637 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:23.202631    2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0d02beb6-bd0f-4a8e-9dc2-c7a310ec9077-extensions-socket-volume\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:14:24.015425 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:24.015396    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-tqw2p"
Sep 16 12:14:24.015425 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:24.015424    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-tqw2p" event={"ID":"0d02beb6-bd0f-4a8e-9dc2-c7a310ec9077","Type":"ContainerDied","Data":"7cf91de98d22470c6ac4c92d9025a6bb22d465340b3e382658e9741e47921f2b"}
Sep 16 12:14:24.015979 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:24.015479    2559 scope.go:117] "RemoveContainer" containerID="40686acdae913b8b306053301148c51135db8a6e664c021a13e0bae998be8504"
Sep 16 12:14:24.034904 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:24.034873    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-tqw2p"]
Sep 16 12:14:24.038686 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:24.038664    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-tqw2p"]
Sep 16 12:14:25.936793 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:25.936759    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d02beb6-bd0f-4a8e-9dc2-c7a310ec9077" path="/var/lib/kubelet/pods/0d02beb6-bd0f-4a8e-9dc2-c7a310ec9077/volumes"
Sep 16 12:14:26.486740 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:26.486700    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:14:26.829399 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:26.829311    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:14:32.415913 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:32.415865    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:14:39.593342 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:39.593309    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-th8tn"]
Sep 16 12:14:39.593771 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:39.593667    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d02beb6-bd0f-4a8e-9dc2-c7a310ec9077" containerName="manager"
Sep 16 12:14:39.593771 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:39.593679    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d02beb6-bd0f-4a8e-9dc2-c7a310ec9077" containerName="manager"
Sep 16 12:14:39.593771 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:39.593739    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d02beb6-bd0f-4a8e-9dc2-c7a310ec9077" containerName="manager"
Sep 16 12:14:39.596529 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:39.596503    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:14:39.597858 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:39.597842    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-th8tn"
Sep 16 12:14:39.600427 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:39.600409    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 16 12:14:39.600509 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:39.600409    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-bm6lh\""
Sep 16 12:14:39.604885 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:39.604859    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-th8tn"]
Sep 16 12:14:39.691127 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:39.691097    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-th8tn"]
Sep 16 12:14:39.696662 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:39.696631    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:14:39.742005 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:39.741974    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d5e90cf2-b5f1-4dc1-a0aa-023ab65657b3-config-file\") pod \"limitador-limitador-8588749977-th8tn\" (UID: \"d5e90cf2-b5f1-4dc1-a0aa-023ab65657b3\") " pod="kuadrant-system/limitador-limitador-8588749977-th8tn"
Sep 16 12:14:39.742171 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:39.742009    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6d9n\" (UniqueName: \"kubernetes.io/projected/d5e90cf2-b5f1-4dc1-a0aa-023ab65657b3-kube-api-access-p6d9n\") pod \"limitador-limitador-8588749977-th8tn\" (UID: \"d5e90cf2-b5f1-4dc1-a0aa-023ab65657b3\") " pod="kuadrant-system/limitador-limitador-8588749977-th8tn"
Sep 16 12:14:39.759474 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:39.759447    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:14:39.842941 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:39.842906    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d5e90cf2-b5f1-4dc1-a0aa-023ab65657b3-config-file\") pod \"limitador-limitador-8588749977-th8tn\" (UID: \"d5e90cf2-b5f1-4dc1-a0aa-023ab65657b3\") " pod="kuadrant-system/limitador-limitador-8588749977-th8tn"
Sep 16 12:14:39.842941 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:39.842944    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6d9n\" (UniqueName: \"kubernetes.io/projected/d5e90cf2-b5f1-4dc1-a0aa-023ab65657b3-kube-api-access-p6d9n\") pod \"limitador-limitador-8588749977-th8tn\" (UID: \"d5e90cf2-b5f1-4dc1-a0aa-023ab65657b3\") " pod="kuadrant-system/limitador-limitador-8588749977-th8tn"
Sep 16 12:14:39.843683 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:39.843629    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d5e90cf2-b5f1-4dc1-a0aa-023ab65657b3-config-file\") pod \"limitador-limitador-8588749977-th8tn\" (UID: \"d5e90cf2-b5f1-4dc1-a0aa-023ab65657b3\") " pod="kuadrant-system/limitador-limitador-8588749977-th8tn"
Sep 16 12:14:39.851043 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:39.851018    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6d9n\" (UniqueName: \"kubernetes.io/projected/d5e90cf2-b5f1-4dc1-a0aa-023ab65657b3-kube-api-access-p6d9n\") pod \"limitador-limitador-8588749977-th8tn\" (UID: \"d5e90cf2-b5f1-4dc1-a0aa-023ab65657b3\") " pod="kuadrant-system/limitador-limitador-8588749977-th8tn"
Sep 16 12:14:39.895816 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:39.895790    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:14:39.899076 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:39.899055    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"
Sep 16 12:14:39.909491 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:39.909464    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:14:39.909818 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:39.909793    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-th8tn"
Sep 16 12:14:39.922919 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:39.922883    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:14:40.044657 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:40.044624    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wzth\" (UniqueName: \"kubernetes.io/projected/48634b09-3960-4620-a20d-5a8ee4907fe0-kube-api-access-6wzth\") pod \"limitador-limitador-84994f7ffc-ssnhk\" (UID: \"48634b09-3960-4620-a20d-5a8ee4907fe0\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"
Sep 16 12:14:40.044835 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:40.044666    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/48634b09-3960-4620-a20d-5a8ee4907fe0-config-file\") pod \"limitador-limitador-84994f7ffc-ssnhk\" (UID: \"48634b09-3960-4620-a20d-5a8ee4907fe0\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"
Sep 16 12:14:40.145991 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:40.145905    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wzth\" (UniqueName: \"kubernetes.io/projected/48634b09-3960-4620-a20d-5a8ee4907fe0-kube-api-access-6wzth\") pod \"limitador-limitador-84994f7ffc-ssnhk\" (UID: \"48634b09-3960-4620-a20d-5a8ee4907fe0\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"
Sep 16 12:14:40.145991 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:40.145947    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/48634b09-3960-4620-a20d-5a8ee4907fe0-config-file\") pod \"limitador-limitador-84994f7ffc-ssnhk\" (UID: \"48634b09-3960-4620-a20d-5a8ee4907fe0\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"
Sep 16 12:14:40.146576 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:40.146559    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/48634b09-3960-4620-a20d-5a8ee4907fe0-config-file\") pod \"limitador-limitador-84994f7ffc-ssnhk\" (UID: \"48634b09-3960-4620-a20d-5a8ee4907fe0\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"
Sep 16 12:14:40.154593 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:40.154565    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wzth\" (UniqueName: \"kubernetes.io/projected/48634b09-3960-4620-a20d-5a8ee4907fe0-kube-api-access-6wzth\") pod \"limitador-limitador-84994f7ffc-ssnhk\" (UID: \"48634b09-3960-4620-a20d-5a8ee4907fe0\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"
Sep 16 12:14:40.182714 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:40.182685    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-th8tn"]
Sep 16 12:14:40.186578 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:14:40.186552    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5e90cf2_b5f1_4dc1_a0aa_023ab65657b3.slice/crio-8dcd807b9a382e29b19ba31d6537fd7fa6372d8276de40c244b025867c98f1b4 WatchSource:0}: Error finding container 8dcd807b9a382e29b19ba31d6537fd7fa6372d8276de40c244b025867c98f1b4: Status 404 returned error can't find the container with id 8dcd807b9a382e29b19ba31d6537fd7fa6372d8276de40c244b025867c98f1b4
Sep 16 12:14:40.212776 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:40.212755    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"
Sep 16 12:14:40.415949 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:40.415899    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:14:40.482278 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:40.482247    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:14:40.484654 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:14:40.484629    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48634b09_3960_4620_a20d_5a8ee4907fe0.slice/crio-9ffbf85313d6f886db33baa3b2419a1f3c81cd827a6eb0a37c550ca9d8bd7359 WatchSource:0}: Error finding container 9ffbf85313d6f886db33baa3b2419a1f3c81cd827a6eb0a37c550ca9d8bd7359: Status 404 returned error can't find the container with id 9ffbf85313d6f886db33baa3b2419a1f3c81cd827a6eb0a37c550ca9d8bd7359
Sep 16 12:14:40.486201 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:40.486173    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:14:40.585620 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:40.585590    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59c974bd48-7dq7c"]
Sep 16 12:14:40.589985 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:40.589964    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-7dq7c"
Sep 16 12:14:40.592724 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:40.592679    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-4xxz4\""
Sep 16 12:14:40.594399 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:40.594371    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-7dq7c"]
Sep 16 12:14:40.751231 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:40.751117    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bm54b\" (UniqueName: \"kubernetes.io/projected/f9d61ce6-d8d6-43e5-81b5-1fdb02ae9573-kube-api-access-bm54b\") pod \"authorino-59c974bd48-7dq7c\" (UID: \"f9d61ce6-d8d6-43e5-81b5-1fdb02ae9573\") " pod="kuadrant-system/authorino-59c974bd48-7dq7c"
Sep 16 12:14:40.852444 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:40.852405    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bm54b\" (UniqueName: \"kubernetes.io/projected/f9d61ce6-d8d6-43e5-81b5-1fdb02ae9573-kube-api-access-bm54b\") pod \"authorino-59c974bd48-7dq7c\" (UID: \"f9d61ce6-d8d6-43e5-81b5-1fdb02ae9573\") " pod="kuadrant-system/authorino-59c974bd48-7dq7c"
Sep 16 12:14:40.862108 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:40.862082    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bm54b\" (UniqueName: \"kubernetes.io/projected/f9d61ce6-d8d6-43e5-81b5-1fdb02ae9573-kube-api-access-bm54b\") pod \"authorino-59c974bd48-7dq7c\" (UID: \"f9d61ce6-d8d6-43e5-81b5-1fdb02ae9573\") " pod="kuadrant-system/authorino-59c974bd48-7dq7c"
Sep 16 12:14:40.909036 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:40.909000    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-7dq7c"
Sep 16 12:14:41.099406 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:41.099278    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-ssnhk" event={"ID":"48634b09-3960-4620-a20d-5a8ee4907fe0","Type":"ContainerStarted","Data":"9ffbf85313d6f886db33baa3b2419a1f3c81cd827a6eb0a37c550ca9d8bd7359"}
Sep 16 12:14:41.102409 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:41.102376    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-th8tn" event={"ID":"d5e90cf2-b5f1-4dc1-a0aa-023ab65657b3","Type":"ContainerStarted","Data":"8dcd807b9a382e29b19ba31d6537fd7fa6372d8276de40c244b025867c98f1b4"}
Sep 16 12:14:41.180878 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:41.180850    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-7dq7c"]
Sep 16 12:14:41.184469 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:14:41.184431    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf9d61ce6_d8d6_43e5_81b5_1fdb02ae9573.slice/crio-6d53d80771f78877c63a148a7afea4a7e4a45d77ebcfed0222d6a565b4f6593f WatchSource:0}: Error finding container 6d53d80771f78877c63a148a7afea4a7e4a45d77ebcfed0222d6a565b4f6593f: Status 404 returned error can't find the container with id 6d53d80771f78877c63a148a7afea4a7e4a45d77ebcfed0222d6a565b4f6593f
Sep 16 12:14:42.109058 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:42.109023    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-7dq7c" event={"ID":"f9d61ce6-d8d6-43e5-81b5-1fdb02ae9573","Type":"ContainerStarted","Data":"6d53d80771f78877c63a148a7afea4a7e4a45d77ebcfed0222d6a565b4f6593f"}
Sep 16 12:14:42.110764 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:42.110733    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-ssnhk" event={"ID":"48634b09-3960-4620-a20d-5a8ee4907fe0","Type":"ContainerStarted","Data":"6ca3ccee3b09e3d38c4e430fe14c80f74124eabfd8b8207805142f00db58e9cf"}
Sep 16 12:14:42.110922 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:42.110902    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"
Sep 16 12:14:42.112516 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:42.112490    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-th8tn" event={"ID":"d5e90cf2-b5f1-4dc1-a0aa-023ab65657b3","Type":"ContainerStarted","Data":"b1fcf06df9f318542c26a11cbf51ae0af0c97b7b7c93484b25566d51d3b22dbe"}
Sep 16 12:14:42.112650 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:42.112635    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-th8tn"
Sep 16 12:14:42.128809 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:42.128755    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-ssnhk" podStartSLOduration=2.151998565 podStartE2EDuration="3.128738233s" totalImagesPullingTime="976.739668ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:14:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:14:42.127249754 +0000 UTC m=+848.747569070" watchObservedRunningTime="2026-09-16 12:14:42.128738233 +0000 UTC m=+848.749057542"
Sep 16 12:14:42.142296 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:42.142214    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-th8tn" podStartSLOduration=1.869412685 podStartE2EDuration="3.142196546s" totalImagesPullingTime="1.272783861s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:14:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:14:42.141491086 +0000 UTC m=+848.761810407" watchObservedRunningTime="2026-09-16 12:14:42.142196546 +0000 UTC m=+848.762515863"
Sep 16 12:14:43.127483 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:43.127372    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-7dq7c" event={"ID":"f9d61ce6-d8d6-43e5-81b5-1fdb02ae9573","Type":"ContainerStarted","Data":"a8b5c6de8a991ee4cb527313cfa318adbee35d215fc77bd32d517ac38abd6506"}
Sep 16 12:14:43.143773 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:43.143726    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59c974bd48-7dq7c" podStartSLOduration=1.6488064869999999 podStartE2EDuration="3.143711246s" totalImagesPullingTime="1.494904759s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:14:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:14:43.142708219 +0000 UTC m=+849.763027536" watchObservedRunningTime="2026-09-16 12:14:43.143711246 +0000 UTC m=+849.764030563"
Sep 16 12:14:45.030915 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:45.030876    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:14:45.131439 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:45.131404    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:14:53.128178 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:53.128124    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"
Sep 16 12:14:53.128763 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:53.128315    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-th8tn"
Sep 16 12:14:53.196775 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:53.196741    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-th8tn"]
Sep 16 12:14:53.196953 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:53.196905    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-th8tn" podUID="d5e90cf2-b5f1-4dc1-a0aa-023ab65657b3" containerName="limitador" containerID="cri-o://b1fcf06df9f318542c26a11cbf51ae0af0c97b7b7c93484b25566d51d3b22dbe" gracePeriod=30
Sep 16 12:14:53.742746 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:53.742718    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-th8tn"
Sep 16 12:14:53.776198 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:53.776088    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d5e90cf2-b5f1-4dc1-a0aa-023ab65657b3-config-file\") pod \"d5e90cf2-b5f1-4dc1-a0aa-023ab65657b3\" (UID: \"d5e90cf2-b5f1-4dc1-a0aa-023ab65657b3\") "
Sep 16 12:14:53.776198 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:53.776180    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p6d9n\" (UniqueName: \"kubernetes.io/projected/d5e90cf2-b5f1-4dc1-a0aa-023ab65657b3-kube-api-access-p6d9n\") pod \"d5e90cf2-b5f1-4dc1-a0aa-023ab65657b3\" (UID: \"d5e90cf2-b5f1-4dc1-a0aa-023ab65657b3\") "
Sep 16 12:14:53.776625 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:53.776590    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5e90cf2-b5f1-4dc1-a0aa-023ab65657b3-config-file" (OuterVolumeSpecName: "config-file") pod "d5e90cf2-b5f1-4dc1-a0aa-023ab65657b3" (UID: "d5e90cf2-b5f1-4dc1-a0aa-023ab65657b3"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:14:53.778814 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:53.778793    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5e90cf2-b5f1-4dc1-a0aa-023ab65657b3-kube-api-access-p6d9n" (OuterVolumeSpecName: "kube-api-access-p6d9n") pod "d5e90cf2-b5f1-4dc1-a0aa-023ab65657b3" (UID: "d5e90cf2-b5f1-4dc1-a0aa-023ab65657b3"). InnerVolumeSpecName "kube-api-access-p6d9n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:14:53.877369 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:53.877336    2559 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d5e90cf2-b5f1-4dc1-a0aa-023ab65657b3-config-file\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:14:53.877369 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:53.877366    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p6d9n\" (UniqueName: \"kubernetes.io/projected/d5e90cf2-b5f1-4dc1-a0aa-023ab65657b3-kube-api-access-p6d9n\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:14:54.180055 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:54.180024    2559 generic.go:356] "Generic (PLEG): container finished" podID="d5e90cf2-b5f1-4dc1-a0aa-023ab65657b3" containerID="b1fcf06df9f318542c26a11cbf51ae0af0c97b7b7c93484b25566d51d3b22dbe" exitCode=0
Sep 16 12:14:54.180479 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:54.180071    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-th8tn"
Sep 16 12:14:54.180479 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:54.180070    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-th8tn" event={"ID":"d5e90cf2-b5f1-4dc1-a0aa-023ab65657b3","Type":"ContainerDied","Data":"b1fcf06df9f318542c26a11cbf51ae0af0c97b7b7c93484b25566d51d3b22dbe"}
Sep 16 12:14:54.180479 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:54.180118    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-th8tn" event={"ID":"d5e90cf2-b5f1-4dc1-a0aa-023ab65657b3","Type":"ContainerDied","Data":"8dcd807b9a382e29b19ba31d6537fd7fa6372d8276de40c244b025867c98f1b4"}
Sep 16 12:14:54.180479 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:54.180159    2559 scope.go:117] "RemoveContainer" containerID="b1fcf06df9f318542c26a11cbf51ae0af0c97b7b7c93484b25566d51d3b22dbe"
Sep 16 12:14:54.188204 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:54.188191    2559 scope.go:117] "RemoveContainer" containerID="b1fcf06df9f318542c26a11cbf51ae0af0c97b7b7c93484b25566d51d3b22dbe"
Sep 16 12:14:54.188451 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:14:54.188432    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1fcf06df9f318542c26a11cbf51ae0af0c97b7b7c93484b25566d51d3b22dbe\": container with ID starting with b1fcf06df9f318542c26a11cbf51ae0af0c97b7b7c93484b25566d51d3b22dbe not found: ID does not exist" containerID="b1fcf06df9f318542c26a11cbf51ae0af0c97b7b7c93484b25566d51d3b22dbe"
Sep 16 12:14:54.188513 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:54.188461    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1fcf06df9f318542c26a11cbf51ae0af0c97b7b7c93484b25566d51d3b22dbe"} err="failed to get container status \"b1fcf06df9f318542c26a11cbf51ae0af0c97b7b7c93484b25566d51d3b22dbe\": rpc error: code = NotFound desc = could not find container \"b1fcf06df9f318542c26a11cbf51ae0af0c97b7b7c93484b25566d51d3b22dbe\": container with ID starting with b1fcf06df9f318542c26a11cbf51ae0af0c97b7b7c93484b25566d51d3b22dbe not found: ID does not exist"
Sep 16 12:14:54.196221 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:54.196196    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-th8tn"]
Sep 16 12:14:54.199558 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:54.199537    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-th8tn"]
Sep 16 12:14:55.256861 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:55.256827    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:14:55.353410 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:55.353381    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:14:55.730180 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:55.730124    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-dmzkd"]
Sep 16 12:14:55.730499 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:55.730482    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5e90cf2-b5f1-4dc1-a0aa-023ab65657b3" containerName="limitador"
Sep 16 12:14:55.730499 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:55.730500    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5e90cf2-b5f1-4dc1-a0aa-023ab65657b3" containerName="limitador"
Sep 16 12:14:55.730640 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:55.730568    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5e90cf2-b5f1-4dc1-a0aa-023ab65657b3" containerName="limitador"
Sep 16 12:14:55.735029 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:55.735005    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dmzkd"
Sep 16 12:14:55.737798 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:55.737775    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 16 12:14:55.737930 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:55.737783    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-947hq\""
Sep 16 12:14:55.737930 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:55.737818    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 16 12:14:55.738735 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:55.738718    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 16 12:14:55.741236 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:55.741216    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-dmzkd"]
Sep 16 12:14:55.768832 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:55.768797    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:14:55.796119 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:55.796091    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/fde3f460-e4ce-46b4-b08c-d61c2b5400e9-data\") pod \"postgres-69fb4594cf-dmzkd\" (UID: \"fde3f460-e4ce-46b4-b08c-d61c2b5400e9\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dmzkd"
Sep 16 12:14:55.796234 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:55.796152    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldmzf\" (UniqueName: \"kubernetes.io/projected/fde3f460-e4ce-46b4-b08c-d61c2b5400e9-kube-api-access-ldmzf\") pod \"postgres-69fb4594cf-dmzkd\" (UID: \"fde3f460-e4ce-46b4-b08c-d61c2b5400e9\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dmzkd"
Sep 16 12:14:55.897187 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:55.897151    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/fde3f460-e4ce-46b4-b08c-d61c2b5400e9-data\") pod \"postgres-69fb4594cf-dmzkd\" (UID: \"fde3f460-e4ce-46b4-b08c-d61c2b5400e9\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dmzkd"
Sep 16 12:14:55.897345 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:55.897207    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldmzf\" (UniqueName: \"kubernetes.io/projected/fde3f460-e4ce-46b4-b08c-d61c2b5400e9-kube-api-access-ldmzf\") pod \"postgres-69fb4594cf-dmzkd\" (UID: \"fde3f460-e4ce-46b4-b08c-d61c2b5400e9\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dmzkd"
Sep 16 12:14:55.897544 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:55.897522    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/fde3f460-e4ce-46b4-b08c-d61c2b5400e9-data\") pod \"postgres-69fb4594cf-dmzkd\" (UID: \"fde3f460-e4ce-46b4-b08c-d61c2b5400e9\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dmzkd"
Sep 16 12:14:55.914241 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:55.914211    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldmzf\" (UniqueName: \"kubernetes.io/projected/fde3f460-e4ce-46b4-b08c-d61c2b5400e9-kube-api-access-ldmzf\") pod \"postgres-69fb4594cf-dmzkd\" (UID: \"fde3f460-e4ce-46b4-b08c-d61c2b5400e9\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dmzkd"
Sep 16 12:14:55.938099 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:55.938072    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5e90cf2-b5f1-4dc1-a0aa-023ab65657b3" path="/var/lib/kubelet/pods/d5e90cf2-b5f1-4dc1-a0aa-023ab65657b3/volumes"
Sep 16 12:14:56.047421 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:56.047321    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dmzkd"
Sep 16 12:14:56.317599 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:56.317578    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-dmzkd"]
Sep 16 12:14:56.319545 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:14:56.319514    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfde3f460_e4ce_46b4_b08c_d61c2b5400e9.slice/crio-d74701f677fdf1f22390394ef43d73be989dbff6b74feb10cde6e8fce631e60d WatchSource:0}: Error finding container d74701f677fdf1f22390394ef43d73be989dbff6b74feb10cde6e8fce631e60d: Status 404 returned error can't find the container with id d74701f677fdf1f22390394ef43d73be989dbff6b74feb10cde6e8fce631e60d
Sep 16 12:14:57.197094 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:14:57.197059    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dmzkd" event={"ID":"fde3f460-e4ce-46b4-b08c-d61c2b5400e9","Type":"ContainerStarted","Data":"d74701f677fdf1f22390394ef43d73be989dbff6b74feb10cde6e8fce631e60d"}
Sep 16 12:15:02.230687 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:02.230650    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dmzkd" event={"ID":"fde3f460-e4ce-46b4-b08c-d61c2b5400e9","Type":"ContainerStarted","Data":"de0b6c2fc3993e6869cf0450f71af1b7a75a279cc039945e825638c8f916cc29"}
Sep 16 12:15:02.231070 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:02.230720    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dmzkd"
Sep 16 12:15:02.246550 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:02.246500    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dmzkd" podStartSLOduration=2.050421897 podStartE2EDuration="7.246480199s" totalImagesPullingTime="5.196058302s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:14:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:15:02.24472912 +0000 UTC m=+868.865048432" watchObservedRunningTime="2026-09-16 12:15:02.246480199 +0000 UTC m=+868.866799514"
Sep 16 12:15:06.256689 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:06.256652    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:15:06.356618 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:06.356579    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:15:08.264225 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:08.264194    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dmzkd"
Sep 16 12:15:08.618872 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:08.618775    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:15:08.724450 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:08.724419    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:15:10.754595 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:10.754560    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-7dq7c"]
Sep 16 12:15:10.755033 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:10.754728    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-59c974bd48-7dq7c" podUID="f9d61ce6-d8d6-43e5-81b5-1fdb02ae9573" containerName="authorino" containerID="cri-o://a8b5c6de8a991ee4cb527313cfa318adbee35d215fc77bd32d517ac38abd6506" gracePeriod=30
Sep 16 12:15:10.999397 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:10.999368    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-7dq7c"
Sep 16 12:15:11.130944 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:11.130863    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bm54b\" (UniqueName: \"kubernetes.io/projected/f9d61ce6-d8d6-43e5-81b5-1fdb02ae9573-kube-api-access-bm54b\") pod \"f9d61ce6-d8d6-43e5-81b5-1fdb02ae9573\" (UID: \"f9d61ce6-d8d6-43e5-81b5-1fdb02ae9573\") "
Sep 16 12:15:11.132774 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:11.132751    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9d61ce6-d8d6-43e5-81b5-1fdb02ae9573-kube-api-access-bm54b" (OuterVolumeSpecName: "kube-api-access-bm54b") pod "f9d61ce6-d8d6-43e5-81b5-1fdb02ae9573" (UID: "f9d61ce6-d8d6-43e5-81b5-1fdb02ae9573"). InnerVolumeSpecName "kube-api-access-bm54b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:15:11.232382 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:11.232349    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bm54b\" (UniqueName: \"kubernetes.io/projected/f9d61ce6-d8d6-43e5-81b5-1fdb02ae9573-kube-api-access-bm54b\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:15:11.280662 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:11.280616    2559 generic.go:356] "Generic (PLEG): container finished" podID="f9d61ce6-d8d6-43e5-81b5-1fdb02ae9573" containerID="a8b5c6de8a991ee4cb527313cfa318adbee35d215fc77bd32d517ac38abd6506" exitCode=0
Sep 16 12:15:11.280662 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:11.280660    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-7dq7c"
Sep 16 12:15:11.280897 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:11.280685    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-7dq7c" event={"ID":"f9d61ce6-d8d6-43e5-81b5-1fdb02ae9573","Type":"ContainerDied","Data":"a8b5c6de8a991ee4cb527313cfa318adbee35d215fc77bd32d517ac38abd6506"}
Sep 16 12:15:11.280897 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:11.280739    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-7dq7c" event={"ID":"f9d61ce6-d8d6-43e5-81b5-1fdb02ae9573","Type":"ContainerDied","Data":"6d53d80771f78877c63a148a7afea4a7e4a45d77ebcfed0222d6a565b4f6593f"}
Sep 16 12:15:11.280897 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:11.280759    2559 scope.go:117] "RemoveContainer" containerID="a8b5c6de8a991ee4cb527313cfa318adbee35d215fc77bd32d517ac38abd6506"
Sep 16 12:15:11.290177 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:11.290160    2559 scope.go:117] "RemoveContainer" containerID="a8b5c6de8a991ee4cb527313cfa318adbee35d215fc77bd32d517ac38abd6506"
Sep 16 12:15:11.290519 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:15:11.290496    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8b5c6de8a991ee4cb527313cfa318adbee35d215fc77bd32d517ac38abd6506\": container with ID starting with a8b5c6de8a991ee4cb527313cfa318adbee35d215fc77bd32d517ac38abd6506 not found: ID does not exist" containerID="a8b5c6de8a991ee4cb527313cfa318adbee35d215fc77bd32d517ac38abd6506"
Sep 16 12:15:11.290583 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:11.290532    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8b5c6de8a991ee4cb527313cfa318adbee35d215fc77bd32d517ac38abd6506"} err="failed to get container status \"a8b5c6de8a991ee4cb527313cfa318adbee35d215fc77bd32d517ac38abd6506\": rpc error: code = NotFound desc = could not find container \"a8b5c6de8a991ee4cb527313cfa318adbee35d215fc77bd32d517ac38abd6506\": container with ID starting with a8b5c6de8a991ee4cb527313cfa318adbee35d215fc77bd32d517ac38abd6506 not found: ID does not exist"
Sep 16 12:15:11.314235 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:11.313992    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-7dq7c"]
Sep 16 12:15:11.315949 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:11.315927    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59c974bd48-7dq7c"]
Sep 16 12:15:11.937720 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:11.937685    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9d61ce6-d8d6-43e5-81b5-1fdb02ae9573" path="/var/lib/kubelet/pods/f9d61ce6-d8d6-43e5-81b5-1fdb02ae9573/volumes"
Sep 16 12:15:15.630346 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:15.630312    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:15:15.777604 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:15.777571    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:15:15.844751 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:15.844720    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:15:15.892401 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:15.892323    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7fb697d85d-nwqzj"]
Sep 16 12:15:15.892673 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:15.892661    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9d61ce6-d8d6-43e5-81b5-1fdb02ae9573" containerName="authorino"
Sep 16 12:15:15.892729 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:15.892675    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9d61ce6-d8d6-43e5-81b5-1fdb02ae9573" containerName="authorino"
Sep 16 12:15:15.892792 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:15.892781    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9d61ce6-d8d6-43e5-81b5-1fdb02ae9573" containerName="authorino"
Sep 16 12:15:16.112015 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:16.111982    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7fb697d85d-nwqzj"]
Sep 16 12:15:16.112233 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:16.112098    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7fb697d85d-nwqzj"
Sep 16 12:15:16.122577 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:16.122545    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 16 12:15:16.122760 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:16.122577    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-57f78\""
Sep 16 12:15:16.122841 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:16.122593    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 16 12:15:16.122911 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:16.122649    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 16 12:15:16.278220 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:16.278184    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3867ffc4-e220-4c14-9981-1a586fb4bd70-metrics-certs\") pod \"maas-controller-7fb697d85d-nwqzj\" (UID: \"3867ffc4-e220-4c14-9981-1a586fb4bd70\") " pod="opendatahub/maas-controller-7fb697d85d-nwqzj"
Sep 16 12:15:16.278220 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:16.278222    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9qqs\" (UniqueName: \"kubernetes.io/projected/3867ffc4-e220-4c14-9981-1a586fb4bd70-kube-api-access-v9qqs\") pod \"maas-controller-7fb697d85d-nwqzj\" (UID: \"3867ffc4-e220-4c14-9981-1a586fb4bd70\") " pod="opendatahub/maas-controller-7fb697d85d-nwqzj"
Sep 16 12:15:16.278458 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:16.278249    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3867ffc4-e220-4c14-9981-1a586fb4bd70-webhook-cert\") pod \"maas-controller-7fb697d85d-nwqzj\" (UID: \"3867ffc4-e220-4c14-9981-1a586fb4bd70\") " pod="opendatahub/maas-controller-7fb697d85d-nwqzj"
Sep 16 12:15:16.379528 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:16.379499    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3867ffc4-e220-4c14-9981-1a586fb4bd70-metrics-certs\") pod \"maas-controller-7fb697d85d-nwqzj\" (UID: \"3867ffc4-e220-4c14-9981-1a586fb4bd70\") " pod="opendatahub/maas-controller-7fb697d85d-nwqzj"
Sep 16 12:15:16.379670 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:16.379537    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9qqs\" (UniqueName: \"kubernetes.io/projected/3867ffc4-e220-4c14-9981-1a586fb4bd70-kube-api-access-v9qqs\") pod \"maas-controller-7fb697d85d-nwqzj\" (UID: \"3867ffc4-e220-4c14-9981-1a586fb4bd70\") " pod="opendatahub/maas-controller-7fb697d85d-nwqzj"
Sep 16 12:15:16.379670 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:16.379563    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3867ffc4-e220-4c14-9981-1a586fb4bd70-webhook-cert\") pod \"maas-controller-7fb697d85d-nwqzj\" (UID: \"3867ffc4-e220-4c14-9981-1a586fb4bd70\") " pod="opendatahub/maas-controller-7fb697d85d-nwqzj"
Sep 16 12:15:16.381959 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:16.381930    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3867ffc4-e220-4c14-9981-1a586fb4bd70-metrics-certs\") pod \"maas-controller-7fb697d85d-nwqzj\" (UID: \"3867ffc4-e220-4c14-9981-1a586fb4bd70\") " pod="opendatahub/maas-controller-7fb697d85d-nwqzj"
Sep 16 12:15:16.382097 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:16.382076    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3867ffc4-e220-4c14-9981-1a586fb4bd70-webhook-cert\") pod \"maas-controller-7fb697d85d-nwqzj\" (UID: \"3867ffc4-e220-4c14-9981-1a586fb4bd70\") " pod="opendatahub/maas-controller-7fb697d85d-nwqzj"
Sep 16 12:15:16.387786 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:16.387769    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9qqs\" (UniqueName: \"kubernetes.io/projected/3867ffc4-e220-4c14-9981-1a586fb4bd70-kube-api-access-v9qqs\") pod \"maas-controller-7fb697d85d-nwqzj\" (UID: \"3867ffc4-e220-4c14-9981-1a586fb4bd70\") " pod="opendatahub/maas-controller-7fb697d85d-nwqzj"
Sep 16 12:15:16.432810 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:16.432775    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7fb697d85d-nwqzj"
Sep 16 12:15:16.700983 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:16.700955    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7fb697d85d-nwqzj"]
Sep 16 12:15:16.702956 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:15:16.702925    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3867ffc4_e220_4c14_9981_1a586fb4bd70.slice/crio-77bc08bb28708c15377d21ce415481ab5a180351ec64ba56763720138114ab72 WatchSource:0}: Error finding container 77bc08bb28708c15377d21ce415481ab5a180351ec64ba56763720138114ab72: Status 404 returned error can't find the container with id 77bc08bb28708c15377d21ce415481ab5a180351ec64ba56763720138114ab72
Sep 16 12:15:17.309967 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:17.309932    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7fb697d85d-nwqzj" event={"ID":"3867ffc4-e220-4c14-9981-1a586fb4bd70","Type":"ContainerStarted","Data":"77bc08bb28708c15377d21ce415481ab5a180351ec64ba56763720138114ab72"}
Sep 16 12:15:19.217784 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:19.217753    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:15:19.317292 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:19.317249    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:15:19.321202 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:19.321171    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7fb697d85d-nwqzj" event={"ID":"3867ffc4-e220-4c14-9981-1a586fb4bd70","Type":"ContainerStarted","Data":"0bc1a559f0ef4d53c58e36cf9959902fa624c57f736721b8d19ddf822dbdd1d2"}
Sep 16 12:15:19.321346 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:19.321235    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7fb697d85d-nwqzj"
Sep 16 12:15:19.342365 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:19.342310    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7fb697d85d-nwqzj" podStartSLOduration=1.8693501810000002 podStartE2EDuration="4.342288959s" totalImagesPullingTime="2.472938778s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:15:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:15:19.340833205 +0000 UTC m=+885.961152523" watchObservedRunningTime="2026-09-16 12:15:19.342288959 +0000 UTC m=+885.962608276"
Sep 16 12:15:30.328746 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:30.328665    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7fb697d85d-nwqzj"
Sep 16 12:15:33.869725 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:33.869699    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-hrvzp_63ee784a-3b40-4259-9923-74a24d0203a0/console-operator/5.log"
Sep 16 12:15:33.870183 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:33.869951    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-hrvzp_63ee784a-3b40-4259-9923-74a24d0203a0/console-operator/5.log"
Sep 16 12:15:39.234079 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:39.234038    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:15:39.335726 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:39.335694    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:15:41.203862 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:41.203819    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:15:50.836189 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:50.836109    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:15:50.932155 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:50.932105    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:15:52.228675 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:52.228638    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:15:52.329301 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:52.329263    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:15:52.435808 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:52.435776    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:15:52.881375 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:52.881342    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:15:52.978161 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:52.978101    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:15:52.990330 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:52.990302    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-ltqcv"]
Sep 16 12:15:52.996303 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:52.996279    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-ltqcv"
Sep 16 12:15:52.998989 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:52.998969    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 16 12:15:52.999119 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:52.999010    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 16 12:15:52.999119 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:52.999064    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 16 12:15:53.004055 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:53.003860    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-ltqcv"]
Sep 16 12:15:53.078690 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:53.078650    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:15:53.102841 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:53.102807    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nl4h\" (UniqueName: \"kubernetes.io/projected/00903936-23e1-4ffe-a6ec-0bbe98320a3e-kube-api-access-6nl4h\") pod \"payload-processing-5b54b7fbb7-ltqcv\" (UID: \"00903936-23e1-4ffe-a6ec-0bbe98320a3e\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-ltqcv"
Sep 16 12:15:53.103000 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:53.102890    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/00903936-23e1-4ffe-a6ec-0bbe98320a3e-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-ltqcv\" (UID: \"00903936-23e1-4ffe-a6ec-0bbe98320a3e\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-ltqcv"
Sep 16 12:15:53.112052 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:53.112017    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:15:53.204180 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:53.204120    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nl4h\" (UniqueName: \"kubernetes.io/projected/00903936-23e1-4ffe-a6ec-0bbe98320a3e-kube-api-access-6nl4h\") pod \"payload-processing-5b54b7fbb7-ltqcv\" (UID: \"00903936-23e1-4ffe-a6ec-0bbe98320a3e\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-ltqcv"
Sep 16 12:15:53.204377 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:53.204276    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/00903936-23e1-4ffe-a6ec-0bbe98320a3e-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-ltqcv\" (UID: \"00903936-23e1-4ffe-a6ec-0bbe98320a3e\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-ltqcv"
Sep 16 12:15:53.205216 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:53.205179    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/00903936-23e1-4ffe-a6ec-0bbe98320a3e-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-ltqcv\" (UID: \"00903936-23e1-4ffe-a6ec-0bbe98320a3e\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-ltqcv"
Sep 16 12:15:53.213145 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:53.213112    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nl4h\" (UniqueName: \"kubernetes.io/projected/00903936-23e1-4ffe-a6ec-0bbe98320a3e-kube-api-access-6nl4h\") pod \"payload-processing-5b54b7fbb7-ltqcv\" (UID: \"00903936-23e1-4ffe-a6ec-0bbe98320a3e\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-ltqcv"
Sep 16 12:15:53.308060 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:53.308020    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-ltqcv"
Sep 16 12:15:53.577366 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:53.577337    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-ltqcv"]
Sep 16 12:15:53.579392 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:15:53.579342    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00903936_23e1_4ffe_a6ec_0bbe98320a3e.slice/crio-f760f5be6de585b1d25bd53883dcbdcab48710fbffe9b5d737e88d463426b25c WatchSource:0}: Error finding container f760f5be6de585b1d25bd53883dcbdcab48710fbffe9b5d737e88d463426b25c: Status 404 returned error can't find the container with id f760f5be6de585b1d25bd53883dcbdcab48710fbffe9b5d737e88d463426b25c
Sep 16 12:15:54.487774 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:54.487725    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-ltqcv" event={"ID":"00903936-23e1-4ffe-a6ec-0bbe98320a3e","Type":"ContainerStarted","Data":"f760f5be6de585b1d25bd53883dcbdcab48710fbffe9b5d737e88d463426b25c"}
Sep 16 12:15:56.500619 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:56.500578    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-ltqcv" event={"ID":"00903936-23e1-4ffe-a6ec-0bbe98320a3e","Type":"ContainerStarted","Data":"9abd4bc1e784bbeec3298f7d395e768ff28570f27cb6bb54902b01d5bc1a32c8"}
Sep 16 12:15:56.501013 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:56.500685    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-ltqcv"
Sep 16 12:15:56.517588 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:15:56.517540    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-ltqcv" podStartSLOduration=2.096151745 podStartE2EDuration="4.517523924s" totalImagesPullingTime="2.421372179s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:15:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:15:56.515670579 +0000 UTC m=+923.135989897" watchObservedRunningTime="2026-09-16 12:15:56.517523924 +0000 UTC m=+923.137843239"
Sep 16 12:16:04.037295 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:16:04.037260    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:16:05.962162 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:16:05.962115    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:16:07.508719 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:16:07.508687    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-ltqcv"
Sep 16 12:16:23.007467 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:16:23.007432    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:16:23.648436 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:16:23.648400    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:16:34.396510 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:16:34.396474    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:16:35.001339 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:16:35.001298    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:16:39.595630 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:16:39.595597    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zgrfj"]
Sep 16 12:16:39.599467 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:16:39.599442    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zgrfj"
Sep 16 12:16:39.603304 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:16:39.603285    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 16 12:16:39.603426 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:16:39.603354    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-jfdlt\""
Sep 16 12:16:39.603426 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:16:39.603386    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 16 12:16:39.603426 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:16:39.603395    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 16 12:16:39.610241 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:16:39.610214    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zgrfj"]
Sep 16 12:16:39.634701 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:16:39.634677    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:16:39.727790 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:16:39.727761    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b7ac3e55-00b1-4e00-8d74-79884ccad3a1-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-zgrfj\" (UID: \"b7ac3e55-00b1-4e00-8d74-79884ccad3a1\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zgrfj"
Sep 16 12:16:39.727790 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:16:39.727791    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b7ac3e55-00b1-4e00-8d74-79884ccad3a1-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-zgrfj\" (UID: \"b7ac3e55-00b1-4e00-8d74-79884ccad3a1\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zgrfj"
Sep 16 12:16:39.728026 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:16:39.727815    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b7ac3e55-00b1-4e00-8d74-79884ccad3a1-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-zgrfj\" (UID: \"b7ac3e55-00b1-4e00-8d74-79884ccad3a1\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zgrfj"
Sep 16 12:16:39.728026 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:16:39.727837    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b7ac3e55-00b1-4e00-8d74-79884ccad3a1-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-zgrfj\" (UID: \"b7ac3e55-00b1-4e00-8d74-79884ccad3a1\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zgrfj"
Sep 16 12:16:39.728026 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:16:39.727891    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wd5q8\" (UniqueName: \"kubernetes.io/projected/b7ac3e55-00b1-4e00-8d74-79884ccad3a1-kube-api-access-wd5q8\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-zgrfj\" (UID: \"b7ac3e55-00b1-4e00-8d74-79884ccad3a1\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zgrfj"
Sep 16 12:16:39.728026 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:16:39.727922    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b7ac3e55-00b1-4e00-8d74-79884ccad3a1-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-zgrfj\" (UID: \"b7ac3e55-00b1-4e00-8d74-79884ccad3a1\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zgrfj"
Sep 16 12:16:39.829463 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:16:39.829419    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b7ac3e55-00b1-4e00-8d74-79884ccad3a1-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-zgrfj\" (UID: \"b7ac3e55-00b1-4e00-8d74-79884ccad3a1\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zgrfj"
Sep 16 12:16:39.829661 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:16:39.829536    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b7ac3e55-00b1-4e00-8d74-79884ccad3a1-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-zgrfj\" (UID: \"b7ac3e55-00b1-4e00-8d74-79884ccad3a1\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zgrfj"
Sep 16 12:16:39.829661 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:16:39.829563    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b7ac3e55-00b1-4e00-8d74-79884ccad3a1-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-zgrfj\" (UID: \"b7ac3e55-00b1-4e00-8d74-79884ccad3a1\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zgrfj"
Sep 16 12:16:39.829661 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:16:39.829592    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b7ac3e55-00b1-4e00-8d74-79884ccad3a1-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-zgrfj\" (UID: \"b7ac3e55-00b1-4e00-8d74-79884ccad3a1\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zgrfj"
Sep 16 12:16:39.829661 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:16:39.829613    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b7ac3e55-00b1-4e00-8d74-79884ccad3a1-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-zgrfj\" (UID: \"b7ac3e55-00b1-4e00-8d74-79884ccad3a1\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zgrfj"
Sep 16 12:16:39.829661 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:16:39.829647    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wd5q8\" (UniqueName: \"kubernetes.io/projected/b7ac3e55-00b1-4e00-8d74-79884ccad3a1-kube-api-access-wd5q8\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-zgrfj\" (UID: \"b7ac3e55-00b1-4e00-8d74-79884ccad3a1\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zgrfj"
Sep 16 12:16:39.829934 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:16:39.829899    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b7ac3e55-00b1-4e00-8d74-79884ccad3a1-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-zgrfj\" (UID: \"b7ac3e55-00b1-4e00-8d74-79884ccad3a1\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zgrfj"
Sep 16 12:16:39.829934 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:16:39.829918    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b7ac3e55-00b1-4e00-8d74-79884ccad3a1-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-zgrfj\" (UID: \"b7ac3e55-00b1-4e00-8d74-79884ccad3a1\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zgrfj"
Sep 16 12:16:39.830034 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:16:39.830008    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b7ac3e55-00b1-4e00-8d74-79884ccad3a1-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-zgrfj\" (UID: \"b7ac3e55-00b1-4e00-8d74-79884ccad3a1\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zgrfj"
Sep 16 12:16:39.831948 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:16:39.831918    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b7ac3e55-00b1-4e00-8d74-79884ccad3a1-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-zgrfj\" (UID: \"b7ac3e55-00b1-4e00-8d74-79884ccad3a1\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zgrfj"
Sep 16 12:16:39.832180 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:16:39.832161    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b7ac3e55-00b1-4e00-8d74-79884ccad3a1-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-zgrfj\" (UID: \"b7ac3e55-00b1-4e00-8d74-79884ccad3a1\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zgrfj"
Sep 16 12:16:39.837850 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:16:39.837828    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wd5q8\" (UniqueName: \"kubernetes.io/projected/b7ac3e55-00b1-4e00-8d74-79884ccad3a1-kube-api-access-wd5q8\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-zgrfj\" (UID: \"b7ac3e55-00b1-4e00-8d74-79884ccad3a1\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zgrfj"
Sep 16 12:16:39.914562 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:16:39.914527    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zgrfj"
Sep 16 12:16:40.187685 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:16:40.187656    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zgrfj"]
Sep 16 12:16:40.189960 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:16:40.189931    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7ac3e55_00b1_4e00_8d74_79884ccad3a1.slice/crio-00de8a6ea4b309dd9100db4003483f28ac6579fabb4148460d7e657d837af823 WatchSource:0}: Error finding container 00de8a6ea4b309dd9100db4003483f28ac6579fabb4148460d7e657d837af823: Status 404 returned error can't find the container with id 00de8a6ea4b309dd9100db4003483f28ac6579fabb4148460d7e657d837af823
Sep 16 12:16:40.204272 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:16:40.204246    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:16:40.703390 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:16:40.703355    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zgrfj" event={"ID":"b7ac3e55-00b1-4e00-8d74-79884ccad3a1","Type":"ContainerStarted","Data":"00de8a6ea4b309dd9100db4003483f28ac6579fabb4148460d7e657d837af823"}
Sep 16 12:16:41.708839 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:16:41.708796    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zgrfj" event={"ID":"b7ac3e55-00b1-4e00-8d74-79884ccad3a1","Type":"ContainerStarted","Data":"12c2b1f17c77cc65fa8116031f1d59fb3d35096c21aa1185e0eee964884def3f"}
Sep 16 12:16:41.725846 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:16:41.725801    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zgrfj" podStartSLOduration=1.790092321 podStartE2EDuration="2.725777607s" totalImagesPullingTime="935.685286ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:16:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:16:41.72416086 +0000 UTC m=+968.344480176" watchObservedRunningTime="2026-09-16 12:16:41.725777607 +0000 UTC m=+968.346096923"
Sep 16 12:16:49.915095 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:16:49.915054    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zgrfj"
Sep 16 12:16:49.915611 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:16:49.915153    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zgrfj"
Sep 16 12:16:49.927320 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:16:49.927291    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zgrfj"
Sep 16 12:16:50.760392 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:16:50.760361    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zgrfj"
Sep 16 12:16:59.910055 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:16:59.909855    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-jnvh5"]
Sep 16 12:16:59.913604 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:16:59.913580    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jnvh5"
Sep 16 12:16:59.916189 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:16:59.916164    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 16 12:16:59.928797 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:16:59.928773    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-jnvh5"]
Sep 16 12:16:59.950526 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:16:59.950485    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:17:00.007122 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:17:00.007084    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1755a474-204d-4cce-ab32-a3bc95066cf5-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jnvh5\" (UID: \"1755a474-204d-4cce-ab32-a3bc95066cf5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jnvh5"
Sep 16 12:17:00.007291 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:17:00.007164    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1755a474-204d-4cce-ab32-a3bc95066cf5-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jnvh5\" (UID: \"1755a474-204d-4cce-ab32-a3bc95066cf5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jnvh5"
Sep 16 12:17:00.007291 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:17:00.007212    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1755a474-204d-4cce-ab32-a3bc95066cf5-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jnvh5\" (UID: \"1755a474-204d-4cce-ab32-a3bc95066cf5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jnvh5"
Sep 16 12:17:00.007291 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:17:00.007271    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1755a474-204d-4cce-ab32-a3bc95066cf5-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jnvh5\" (UID: \"1755a474-204d-4cce-ab32-a3bc95066cf5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jnvh5"
Sep 16 12:17:00.007415 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:17:00.007310    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1755a474-204d-4cce-ab32-a3bc95066cf5-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jnvh5\" (UID: \"1755a474-204d-4cce-ab32-a3bc95066cf5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jnvh5"
Sep 16 12:17:00.007415 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:17:00.007328    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bpb8\" (UniqueName: \"kubernetes.io/projected/1755a474-204d-4cce-ab32-a3bc95066cf5-kube-api-access-6bpb8\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jnvh5\" (UID: \"1755a474-204d-4cce-ab32-a3bc95066cf5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jnvh5"
Sep 16 12:17:00.107885 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:17:00.107845    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1755a474-204d-4cce-ab32-a3bc95066cf5-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jnvh5\" (UID: \"1755a474-204d-4cce-ab32-a3bc95066cf5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jnvh5"
Sep 16 12:17:00.107885 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:17:00.107898    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1755a474-204d-4cce-ab32-a3bc95066cf5-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jnvh5\" (UID: \"1755a474-204d-4cce-ab32-a3bc95066cf5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jnvh5"
Sep 16 12:17:00.108172 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:17:00.107917    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1755a474-204d-4cce-ab32-a3bc95066cf5-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jnvh5\" (UID: \"1755a474-204d-4cce-ab32-a3bc95066cf5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jnvh5"
Sep 16 12:17:00.108172 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:17:00.108097    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1755a474-204d-4cce-ab32-a3bc95066cf5-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jnvh5\" (UID: \"1755a474-204d-4cce-ab32-a3bc95066cf5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jnvh5"
Sep 16 12:17:00.108172 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:17:00.108162    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1755a474-204d-4cce-ab32-a3bc95066cf5-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jnvh5\" (UID: \"1755a474-204d-4cce-ab32-a3bc95066cf5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jnvh5"
Sep 16 12:17:00.108337 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:17:00.108187    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bpb8\" (UniqueName: \"kubernetes.io/projected/1755a474-204d-4cce-ab32-a3bc95066cf5-kube-api-access-6bpb8\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jnvh5\" (UID: \"1755a474-204d-4cce-ab32-a3bc95066cf5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jnvh5"
Sep 16 12:17:00.108431 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:17:00.108410    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1755a474-204d-4cce-ab32-a3bc95066cf5-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jnvh5\" (UID: \"1755a474-204d-4cce-ab32-a3bc95066cf5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jnvh5"
Sep 16 12:17:00.108482 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:17:00.108442    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1755a474-204d-4cce-ab32-a3bc95066cf5-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jnvh5\" (UID: \"1755a474-204d-4cce-ab32-a3bc95066cf5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jnvh5"
Sep 16 12:17:00.108552 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:17:00.108520    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1755a474-204d-4cce-ab32-a3bc95066cf5-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jnvh5\" (UID: \"1755a474-204d-4cce-ab32-a3bc95066cf5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jnvh5"
Sep 16 12:17:00.110280 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:17:00.110262    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1755a474-204d-4cce-ab32-a3bc95066cf5-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jnvh5\" (UID: \"1755a474-204d-4cce-ab32-a3bc95066cf5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jnvh5"
Sep 16 12:17:00.110545 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:17:00.110528    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1755a474-204d-4cce-ab32-a3bc95066cf5-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jnvh5\" (UID: \"1755a474-204d-4cce-ab32-a3bc95066cf5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jnvh5"
Sep 16 12:17:00.115968 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:17:00.115943    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bpb8\" (UniqueName: \"kubernetes.io/projected/1755a474-204d-4cce-ab32-a3bc95066cf5-kube-api-access-6bpb8\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jnvh5\" (UID: \"1755a474-204d-4cce-ab32-a3bc95066cf5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jnvh5"
Sep 16 12:17:00.224153 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:17:00.224046    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jnvh5"
Sep 16 12:17:00.494966 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:17:00.494940    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-jnvh5"]
Sep 16 12:17:00.497076 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:17:00.497051    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1755a474_204d_4cce_ab32_a3bc95066cf5.slice/crio-7c8169fbcba85dbdba4f0579f8a86cdf341b2fd3d203d67ea124facf5b482700 WatchSource:0}: Error finding container 7c8169fbcba85dbdba4f0579f8a86cdf341b2fd3d203d67ea124facf5b482700: Status 404 returned error can't find the container with id 7c8169fbcba85dbdba4f0579f8a86cdf341b2fd3d203d67ea124facf5b482700
Sep 16 12:17:00.498913 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:17:00.498895    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 12:17:00.798951 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:17:00.798918    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jnvh5" event={"ID":"1755a474-204d-4cce-ab32-a3bc95066cf5","Type":"ContainerStarted","Data":"26122b5c344787bcafcfc0cc093370f9a0c1a63bb6bd72093ddc541e8fdd37cb"}
Sep 16 12:17:00.799115 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:17:00.798970    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jnvh5" event={"ID":"1755a474-204d-4cce-ab32-a3bc95066cf5","Type":"ContainerStarted","Data":"7c8169fbcba85dbdba4f0579f8a86cdf341b2fd3d203d67ea124facf5b482700"}
Sep 16 12:17:00.819652 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:17:00.819602    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jnvh5" podStartSLOduration=1.6075979569999999 podStartE2EDuration="1.819586302s" totalImagesPullingTime="211.988345ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:16:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:17:00.818714873 +0000 UTC m=+987.439034188" watchObservedRunningTime="2026-09-16 12:17:00.819586302 +0000 UTC m=+987.439905651"
Sep 16 12:17:01.107759 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:17:01.107688    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:17:10.224498 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:17:10.224459    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jnvh5"
Sep 16 12:17:10.224987 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:17:10.224534    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jnvh5"
Sep 16 12:17:10.236694 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:17:10.236667    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jnvh5"
Sep 16 12:17:10.856345 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:17:10.856313    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jnvh5"
Sep 16 12:17:11.119371 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:17:11.119284    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:17:12.506177 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:17:12.506127    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:17:23.644678 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:17:23.644644    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:17:25.404684 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:17:25.404650    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:17:34.007583 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:17:34.007549    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:17:36.208353 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:17:36.208315    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:18:17.436352 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:18:17.436315    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:18:25.498475 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:18:25.498419    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:18:25.599052 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:18:25.599018    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:18:38.292973 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:18:38.292891    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:18:38.393080 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:18:38.393049    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:19:00.458592 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:00.458553    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:19:00.560653 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:00.560620    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:19:01.692171 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:01.692120    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:19:01.789885 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:01.789852    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:19:05.353861 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:05.353825    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:19:45.169048 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:45.169010    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:19:45.267478 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:45.267441    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:19:45.517953 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:45.517875    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:19:45.614716 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:45.614680    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn"]
Sep 16 12:19:45.623406 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:45.623377    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:19:45.624863 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:45.624841    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn"
Sep 16 12:19:45.628525 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:45.628500    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-9a49af-openshift-default-dockercfg-xnx7x\""
Sep 16 12:19:45.628651 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:45.628567    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 16 12:19:45.629159 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:45.629121    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn"]
Sep 16 12:19:45.670365 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:45.670329    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/906351b2-188c-4513-992d-db47f5faa810-istio-token\") pod \"e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn\" (UID: \"906351b2-188c-4513-992d-db47f5faa810\") " pod="openshift-ingress/e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn"
Sep 16 12:19:45.670365 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:45.670364    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvx6t\" (UniqueName: \"kubernetes.io/projected/906351b2-188c-4513-992d-db47f5faa810-kube-api-access-bvx6t\") pod \"e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn\" (UID: \"906351b2-188c-4513-992d-db47f5faa810\") " pod="openshift-ingress/e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn"
Sep 16 12:19:45.670584 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:45.670395    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/906351b2-188c-4513-992d-db47f5faa810-istiod-ca-cert\") pod \"e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn\" (UID: \"906351b2-188c-4513-992d-db47f5faa810\") " pod="openshift-ingress/e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn"
Sep 16 12:19:45.670584 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:45.670425    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/906351b2-188c-4513-992d-db47f5faa810-workload-socket\") pod \"e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn\" (UID: \"906351b2-188c-4513-992d-db47f5faa810\") " pod="openshift-ingress/e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn"
Sep 16 12:19:45.670584 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:45.670451    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/906351b2-188c-4513-992d-db47f5faa810-istio-data\") pod \"e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn\" (UID: \"906351b2-188c-4513-992d-db47f5faa810\") " pod="openshift-ingress/e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn"
Sep 16 12:19:45.670584 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:45.670484    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/906351b2-188c-4513-992d-db47f5faa810-istio-envoy\") pod \"e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn\" (UID: \"906351b2-188c-4513-992d-db47f5faa810\") " pod="openshift-ingress/e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn"
Sep 16 12:19:45.670846 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:45.670593    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/906351b2-188c-4513-992d-db47f5faa810-istio-podinfo\") pod \"e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn\" (UID: \"906351b2-188c-4513-992d-db47f5faa810\") " pod="openshift-ingress/e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn"
Sep 16 12:19:45.670846 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:45.670653    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/906351b2-188c-4513-992d-db47f5faa810-workload-certs\") pod \"e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn\" (UID: \"906351b2-188c-4513-992d-db47f5faa810\") " pod="openshift-ingress/e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn"
Sep 16 12:19:45.670846 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:45.670758    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/906351b2-188c-4513-992d-db47f5faa810-credential-socket\") pod \"e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn\" (UID: \"906351b2-188c-4513-992d-db47f5faa810\") " pod="openshift-ingress/e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn"
Sep 16 12:19:45.724094 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:45.724060    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:19:45.771787 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:45.771699    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/906351b2-188c-4513-992d-db47f5faa810-istiod-ca-cert\") pod \"e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn\" (UID: \"906351b2-188c-4513-992d-db47f5faa810\") " pod="openshift-ingress/e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn"
Sep 16 12:19:45.771787 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:45.771736    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/906351b2-188c-4513-992d-db47f5faa810-workload-socket\") pod \"e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn\" (UID: \"906351b2-188c-4513-992d-db47f5faa810\") " pod="openshift-ingress/e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn"
Sep 16 12:19:45.771787 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:45.771765    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/906351b2-188c-4513-992d-db47f5faa810-istio-data\") pod \"e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn\" (UID: \"906351b2-188c-4513-992d-db47f5faa810\") " pod="openshift-ingress/e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn"
Sep 16 12:19:45.772144 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:45.771896    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/906351b2-188c-4513-992d-db47f5faa810-istio-envoy\") pod \"e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn\" (UID: \"906351b2-188c-4513-992d-db47f5faa810\") " pod="openshift-ingress/e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn"
Sep 16 12:19:45.772219 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:45.772160    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/906351b2-188c-4513-992d-db47f5faa810-istio-podinfo\") pod \"e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn\" (UID: \"906351b2-188c-4513-992d-db47f5faa810\") " pod="openshift-ingress/e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn"
Sep 16 12:19:45.772219 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:45.772189    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/906351b2-188c-4513-992d-db47f5faa810-workload-socket\") pod \"e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn\" (UID: \"906351b2-188c-4513-992d-db47f5faa810\") " pod="openshift-ingress/e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn"
Sep 16 12:19:45.772333 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:45.772220    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/906351b2-188c-4513-992d-db47f5faa810-istio-data\") pod \"e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn\" (UID: \"906351b2-188c-4513-992d-db47f5faa810\") " pod="openshift-ingress/e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn"
Sep 16 12:19:45.772446 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:45.772426    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/906351b2-188c-4513-992d-db47f5faa810-workload-certs\") pod \"e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn\" (UID: \"906351b2-188c-4513-992d-db47f5faa810\") " pod="openshift-ingress/e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn"
Sep 16 12:19:45.772561 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:45.772542    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/906351b2-188c-4513-992d-db47f5faa810-credential-socket\") pod \"e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn\" (UID: \"906351b2-188c-4513-992d-db47f5faa810\") " pod="openshift-ingress/e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn"
Sep 16 12:19:45.772716 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:45.772698    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/906351b2-188c-4513-992d-db47f5faa810-istiod-ca-cert\") pod \"e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn\" (UID: \"906351b2-188c-4513-992d-db47f5faa810\") " pod="openshift-ingress/e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn"
Sep 16 12:19:45.772778 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:45.772729    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/906351b2-188c-4513-992d-db47f5faa810-workload-certs\") pod \"e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn\" (UID: \"906351b2-188c-4513-992d-db47f5faa810\") " pod="openshift-ingress/e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn"
Sep 16 12:19:45.772842 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:45.772788    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/906351b2-188c-4513-992d-db47f5faa810-istio-token\") pod \"e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn\" (UID: \"906351b2-188c-4513-992d-db47f5faa810\") " pod="openshift-ingress/e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn"
Sep 16 12:19:45.772842 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:45.772820    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvx6t\" (UniqueName: \"kubernetes.io/projected/906351b2-188c-4513-992d-db47f5faa810-kube-api-access-bvx6t\") pod \"e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn\" (UID: \"906351b2-188c-4513-992d-db47f5faa810\") " pod="openshift-ingress/e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn"
Sep 16 12:19:45.772913 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:45.772822    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/906351b2-188c-4513-992d-db47f5faa810-credential-socket\") pod \"e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn\" (UID: \"906351b2-188c-4513-992d-db47f5faa810\") " pod="openshift-ingress/e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn"
Sep 16 12:19:45.774469 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:45.774448    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/906351b2-188c-4513-992d-db47f5faa810-istio-envoy\") pod \"e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn\" (UID: \"906351b2-188c-4513-992d-db47f5faa810\") " pod="openshift-ingress/e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn"
Sep 16 12:19:45.774604 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:45.774588    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/906351b2-188c-4513-992d-db47f5faa810-istio-podinfo\") pod \"e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn\" (UID: \"906351b2-188c-4513-992d-db47f5faa810\") " pod="openshift-ingress/e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn"
Sep 16 12:19:45.786186 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:45.786165    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/906351b2-188c-4513-992d-db47f5faa810-istio-token\") pod \"e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn\" (UID: \"906351b2-188c-4513-992d-db47f5faa810\") " pod="openshift-ingress/e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn"
Sep 16 12:19:45.786271 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:45.786229    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvx6t\" (UniqueName: \"kubernetes.io/projected/906351b2-188c-4513-992d-db47f5faa810-kube-api-access-bvx6t\") pod \"e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn\" (UID: \"906351b2-188c-4513-992d-db47f5faa810\") " pod="openshift-ingress/e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn"
Sep 16 12:19:45.853013 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:45.852983    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:19:45.937780 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:45.937749    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn"
Sep 16 12:19:45.945070 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:45.945042    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:19:46.045886 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:46.045812    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:19:46.212000 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:46.211970    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn"]
Sep 16 12:19:46.213640 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:19:46.213620    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod906351b2_188c_4513_992d_db47f5faa810.slice/crio-cbc8c1459d59f117c3f7cb656066e702031676e70b799cb3546f18f178fb013d WatchSource:0}: Error finding container cbc8c1459d59f117c3f7cb656066e702031676e70b799cb3546f18f178fb013d: Status 404 returned error can't find the container with id cbc8c1459d59f117c3f7cb656066e702031676e70b799cb3546f18f178fb013d
Sep 16 12:19:46.578405 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:46.578372    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn" event={"ID":"906351b2-188c-4513-992d-db47f5faa810","Type":"ContainerStarted","Data":"cbc8c1459d59f117c3f7cb656066e702031676e70b799cb3546f18f178fb013d"}
Sep 16 12:19:46.608320 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:46.608279    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:19:46.707099 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:46.707061    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:19:47.096741 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:47.096707    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:19:48.343974 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:48.343941    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:19:48.377434 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:48.377361    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:19:48.464218 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:48.464170    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:19:49.000644 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:49.000606    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:19:49.000771 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:49.000695    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:19:49.000771 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:49.000742    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:19:49.598450 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:49.598408    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn" event={"ID":"906351b2-188c-4513-992d-db47f5faa810","Type":"ContainerStarted","Data":"c8b92a046ceab4e03fbb3dc7248e82c995bec501e762f9e41732c7dfb629ea2f"}
Sep 16 12:19:49.625831 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:49.625771    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn" podStartSLOduration=1.841180675 podStartE2EDuration="4.625753324s" totalImagesPullingTime="2.784572649s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:19:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:19:49.623471973 +0000 UTC m=+1156.243791290" watchObservedRunningTime="2026-09-16 12:19:49.625753324 +0000 UTC m=+1156.246072641"
Sep 16 12:19:49.632781 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:49.632743    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:19:49.695273 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:49.695240    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:19:49.877899 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:49.877812    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:19:49.938638 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:49.938611    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn"
Sep 16 12:19:50.107724 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:50.107691    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:19:50.204864 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:50.204834    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:19:50.239852 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:50.239823    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-7a4d5c-5dd74ddd9f-tnrs8"]
Sep 16 12:19:50.243269 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:50.243254    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-7a4d5c-5dd74ddd9f-tnrs8"
Sep 16 12:19:50.245936 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:50.245917    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w4-7a4d5c\""
Sep 16 12:19:50.246116 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:50.246099    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w4-7a4d5c-dockercfg-xd7kh\""
Sep 16 12:19:50.253535 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:50.253513    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-7a4d5c-5dd74ddd9f-tnrs8"]
Sep 16 12:19:50.279832 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:50.279810    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-7a4d5c-7b54999db-828tz"]
Sep 16 12:19:50.283258 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:50.283243    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-7a4d5c-7b54999db-828tz"
Sep 16 12:19:50.295112 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:50.295089    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-7a4d5c-7b54999db-828tz"]
Sep 16 12:19:50.318273 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:50.318244    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k79b5\" (UniqueName: \"kubernetes.io/projected/833e2257-98b1-4f6b-a5ab-41e7fd8efbb8-kube-api-access-k79b5\") pod \"payload-processing-e2e-worker-w4-7a4d5c-5dd74ddd9f-tnrs8\" (UID: \"833e2257-98b1-4f6b-a5ab-41e7fd8efbb8\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-7a4d5c-5dd74ddd9f-tnrs8"
Sep 16 12:19:50.318429 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:50.318303    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/833e2257-98b1-4f6b-a5ab-41e7fd8efbb8-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-7a4d5c-5dd74ddd9f-tnrs8\" (UID: \"833e2257-98b1-4f6b-a5ab-41e7fd8efbb8\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-7a4d5c-5dd74ddd9f-tnrs8"
Sep 16 12:19:50.419349 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:50.419311    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k79b5\" (UniqueName: \"kubernetes.io/projected/833e2257-98b1-4f6b-a5ab-41e7fd8efbb8-kube-api-access-k79b5\") pod \"payload-processing-e2e-worker-w4-7a4d5c-5dd74ddd9f-tnrs8\" (UID: \"833e2257-98b1-4f6b-a5ab-41e7fd8efbb8\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-7a4d5c-5dd74ddd9f-tnrs8"
Sep 16 12:19:50.419535 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:50.419358    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tngh\" (UniqueName: \"kubernetes.io/projected/97eab9bf-a543-42c3-9f9c-abae5e34a2e3-kube-api-access-6tngh\") pod \"payload-pre-processing-e2e-worker-w4-7a4d5c-7b54999db-828tz\" (UID: \"97eab9bf-a543-42c3-9f9c-abae5e34a2e3\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-7a4d5c-7b54999db-828tz"
Sep 16 12:19:50.419535 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:50.419427    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/97eab9bf-a543-42c3-9f9c-abae5e34a2e3-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-7a4d5c-7b54999db-828tz\" (UID: \"97eab9bf-a543-42c3-9f9c-abae5e34a2e3\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-7a4d5c-7b54999db-828tz"
Sep 16 12:19:50.419535 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:50.419462    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/833e2257-98b1-4f6b-a5ab-41e7fd8efbb8-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-7a4d5c-5dd74ddd9f-tnrs8\" (UID: \"833e2257-98b1-4f6b-a5ab-41e7fd8efbb8\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-7a4d5c-5dd74ddd9f-tnrs8"
Sep 16 12:19:50.420352 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:50.420326    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/833e2257-98b1-4f6b-a5ab-41e7fd8efbb8-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-7a4d5c-5dd74ddd9f-tnrs8\" (UID: \"833e2257-98b1-4f6b-a5ab-41e7fd8efbb8\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-7a4d5c-5dd74ddd9f-tnrs8"
Sep 16 12:19:50.428118 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:50.428086    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k79b5\" (UniqueName: \"kubernetes.io/projected/833e2257-98b1-4f6b-a5ab-41e7fd8efbb8-kube-api-access-k79b5\") pod \"payload-processing-e2e-worker-w4-7a4d5c-5dd74ddd9f-tnrs8\" (UID: \"833e2257-98b1-4f6b-a5ab-41e7fd8efbb8\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-7a4d5c-5dd74ddd9f-tnrs8"
Sep 16 12:19:50.520358 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:50.520268    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/97eab9bf-a543-42c3-9f9c-abae5e34a2e3-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-7a4d5c-7b54999db-828tz\" (UID: \"97eab9bf-a543-42c3-9f9c-abae5e34a2e3\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-7a4d5c-7b54999db-828tz"
Sep 16 12:19:50.520493 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:50.520363    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tngh\" (UniqueName: \"kubernetes.io/projected/97eab9bf-a543-42c3-9f9c-abae5e34a2e3-kube-api-access-6tngh\") pod \"payload-pre-processing-e2e-worker-w4-7a4d5c-7b54999db-828tz\" (UID: \"97eab9bf-a543-42c3-9f9c-abae5e34a2e3\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-7a4d5c-7b54999db-828tz"
Sep 16 12:19:50.520986 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:50.520966    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/97eab9bf-a543-42c3-9f9c-abae5e34a2e3-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-7a4d5c-7b54999db-828tz\" (UID: \"97eab9bf-a543-42c3-9f9c-abae5e34a2e3\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-7a4d5c-7b54999db-828tz"
Sep 16 12:19:50.531491 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:50.531463    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tngh\" (UniqueName: \"kubernetes.io/projected/97eab9bf-a543-42c3-9f9c-abae5e34a2e3-kube-api-access-6tngh\") pod \"payload-pre-processing-e2e-worker-w4-7a4d5c-7b54999db-828tz\" (UID: \"97eab9bf-a543-42c3-9f9c-abae5e34a2e3\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-7a4d5c-7b54999db-828tz"
Sep 16 12:19:50.534886 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:50.534859    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:19:50.554775 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:50.554742    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-7a4d5c-5dd74ddd9f-tnrs8"
Sep 16 12:19:50.593048 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:50.593015    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-7a4d5c-7b54999db-828tz"
Sep 16 12:19:50.841498 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:50.841467    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-7a4d5c-5dd74ddd9f-tnrs8"]
Sep 16 12:19:50.842447 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:19:50.842424    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod833e2257_98b1_4f6b_a5ab_41e7fd8efbb8.slice/crio-f0b0868920d55dff9fbaf0c1efba17dbcf8a59b2c197cc90961ec033d93940b1 WatchSource:0}: Error finding container f0b0868920d55dff9fbaf0c1efba17dbcf8a59b2c197cc90961ec033d93940b1: Status 404 returned error can't find the container with id f0b0868920d55dff9fbaf0c1efba17dbcf8a59b2c197cc90961ec033d93940b1
Sep 16 12:19:50.882209 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:50.882083    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-7a4d5c-7b54999db-828tz"]
Sep 16 12:19:50.885072 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:19:50.885040    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97eab9bf_a543_42c3_9f9c_abae5e34a2e3.slice/crio-178a4b80921defeeaa5a8b1f03651825cda30bc7b5036afbc8be5703d2c9bf93 WatchSource:0}: Error finding container 178a4b80921defeeaa5a8b1f03651825cda30bc7b5036afbc8be5703d2c9bf93: Status 404 returned error can't find the container with id 178a4b80921defeeaa5a8b1f03651825cda30bc7b5036afbc8be5703d2c9bf93
Sep 16 12:19:50.943462 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:50.943432    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn"
Sep 16 12:19:51.317613 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:51.317569    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:19:51.418886 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:51.418850    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:19:51.551073 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:51.551045    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:19:51.613048 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:51.612955    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-7a4d5c-7b54999db-828tz" event={"ID":"97eab9bf-a543-42c3-9f9c-abae5e34a2e3","Type":"ContainerStarted","Data":"5861a8308b619487c9c79cae4ad26a8795512603a9aa5a899afdfc73453665e6"}
Sep 16 12:19:51.613048 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:51.613003    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-7a4d5c-7b54999db-828tz" event={"ID":"97eab9bf-a543-42c3-9f9c-abae5e34a2e3","Type":"ContainerStarted","Data":"178a4b80921defeeaa5a8b1f03651825cda30bc7b5036afbc8be5703d2c9bf93"}
Sep 16 12:19:51.613280 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:51.613115    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-7a4d5c-7b54999db-828tz"
Sep 16 12:19:51.614568 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:51.614542    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-7a4d5c-5dd74ddd9f-tnrs8" event={"ID":"833e2257-98b1-4f6b-a5ab-41e7fd8efbb8","Type":"ContainerStarted","Data":"14740b7e1fa513994b8d680829fd983bcf2875a3af20a21c1bf85cb7bc14bbf1"}
Sep 16 12:19:51.614725 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:51.614582    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-7a4d5c-5dd74ddd9f-tnrs8" event={"ID":"833e2257-98b1-4f6b-a5ab-41e7fd8efbb8","Type":"ContainerStarted","Data":"f0b0868920d55dff9fbaf0c1efba17dbcf8a59b2c197cc90961ec033d93940b1"}
Sep 16 12:19:51.614725 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:51.614612    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn"
Sep 16 12:19:51.614725 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:51.614634    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-7a4d5c-5dd74ddd9f-tnrs8"
Sep 16 12:19:51.615719 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:51.615700    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn"
Sep 16 12:19:51.631234 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:51.631188    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-7a4d5c-7b54999db-828tz" podStartSLOduration=1.6311734900000001 podStartE2EDuration="1.63117349s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:19:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:19:51.629607691 +0000 UTC m=+1158.249927009" watchObservedRunningTime="2026-09-16 12:19:51.63117349 +0000 UTC m=+1158.251492806"
Sep 16 12:19:51.633567 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:51.633548    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:19:51.669165 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:51.669090    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w4-7a4d5c-5dd74ddd9f-tnrs8" podStartSLOduration=1.669069313 podStartE2EDuration="1.669069313s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:19:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:19:51.666584518 +0000 UTC m=+1158.286903832" watchObservedRunningTime="2026-09-16 12:19:51.669069313 +0000 UTC m=+1158.289388630"
Sep 16 12:19:51.908516 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:51.908478    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:19:52.020285 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:52.020252    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:19:52.057369 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:52.057334    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-0e8ffe-7fb6ff6d7-npsrh"]
Sep 16 12:19:52.061461 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:52.061435    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-0e8ffe-7fb6ff6d7-npsrh"
Sep 16 12:19:52.064453 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:52.064431    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w0-0e8ffe\""
Sep 16 12:19:52.137143 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:52.137112    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vc9l4\" (UniqueName: \"kubernetes.io/projected/a59c0689-d95b-4076-b66f-4f8c0e515024-kube-api-access-vc9l4\") pod \"payload-processing-e2e-worker-w0-0e8ffe-7fb6ff6d7-npsrh\" (UID: \"a59c0689-d95b-4076-b66f-4f8c0e515024\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-0e8ffe-7fb6ff6d7-npsrh"
Sep 16 12:19:52.137347 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:52.137239    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a59c0689-d95b-4076-b66f-4f8c0e515024-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-0e8ffe-7fb6ff6d7-npsrh\" (UID: \"a59c0689-d95b-4076-b66f-4f8c0e515024\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-0e8ffe-7fb6ff6d7-npsrh"
Sep 16 12:19:52.148063 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:52.148033    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-0e8ffe-7fb6ff6d7-npsrh"]
Sep 16 12:19:52.238450 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:52.238350    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a59c0689-d95b-4076-b66f-4f8c0e515024-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-0e8ffe-7fb6ff6d7-npsrh\" (UID: \"a59c0689-d95b-4076-b66f-4f8c0e515024\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-0e8ffe-7fb6ff6d7-npsrh"
Sep 16 12:19:52.238450 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:52.238418    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vc9l4\" (UniqueName: \"kubernetes.io/projected/a59c0689-d95b-4076-b66f-4f8c0e515024-kube-api-access-vc9l4\") pod \"payload-processing-e2e-worker-w0-0e8ffe-7fb6ff6d7-npsrh\" (UID: \"a59c0689-d95b-4076-b66f-4f8c0e515024\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-0e8ffe-7fb6ff6d7-npsrh"
Sep 16 12:19:52.239101 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:52.239074    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a59c0689-d95b-4076-b66f-4f8c0e515024-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-0e8ffe-7fb6ff6d7-npsrh\" (UID: \"a59c0689-d95b-4076-b66f-4f8c0e515024\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-0e8ffe-7fb6ff6d7-npsrh"
Sep 16 12:19:52.251214 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:52.251179    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vc9l4\" (UniqueName: \"kubernetes.io/projected/a59c0689-d95b-4076-b66f-4f8c0e515024-kube-api-access-vc9l4\") pod \"payload-processing-e2e-worker-w0-0e8ffe-7fb6ff6d7-npsrh\" (UID: \"a59c0689-d95b-4076-b66f-4f8c0e515024\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-0e8ffe-7fb6ff6d7-npsrh"
Sep 16 12:19:52.375501 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:52.375461    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-0e8ffe-7fb6ff6d7-npsrh"
Sep 16 12:19:52.552275 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:52.552187    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:19:52.649033 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:52.648900    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-0e8ffe-7fb6ff6d7-npsrh"]
Sep 16 12:19:52.652174 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:19:52.652123    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda59c0689_d95b_4076_b66f_4f8c0e515024.slice/crio-d586af39cd2bb7498cd00343f7342e0f683e9162ec062a3600480dce9fed0292 WatchSource:0}: Error finding container d586af39cd2bb7498cd00343f7342e0f683e9162ec062a3600480dce9fed0292: Status 404 returned error can't find the container with id d586af39cd2bb7498cd00343f7342e0f683e9162ec062a3600480dce9fed0292
Sep 16 12:19:53.369108 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:53.369068    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:19:53.547406 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:53.547374    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:19:53.626274 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:53.626185    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-0e8ffe-7fb6ff6d7-npsrh" event={"ID":"a59c0689-d95b-4076-b66f-4f8c0e515024","Type":"ContainerStarted","Data":"38c893d602806c616ac0a74914a9fc5d0b9a87546d37c316aba2f6f12453c61f"}
Sep 16 12:19:53.626274 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:53.626271    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-0e8ffe-7fb6ff6d7-npsrh" event={"ID":"a59c0689-d95b-4076-b66f-4f8c0e515024","Type":"ContainerStarted","Data":"d586af39cd2bb7498cd00343f7342e0f683e9162ec062a3600480dce9fed0292"}
Sep 16 12:19:53.626450 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:53.626430    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-0e8ffe-7fb6ff6d7-npsrh"
Sep 16 12:19:53.641234 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:53.641202    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:19:53.648697 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:53.648650    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w0-0e8ffe-7fb6ff6d7-npsrh" podStartSLOduration=1.64863408 podStartE2EDuration="1.64863408s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:19:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:19:53.647155157 +0000 UTC m=+1160.267474557" watchObservedRunningTime="2026-09-16 12:19:53.64863408 +0000 UTC m=+1160.268953396"
Sep 16 12:19:53.707738 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:53.707706    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:19:53.810052 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:53.810019    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:19:53.950148 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:53.950103    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:19:54.053831 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:54.053792    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:19:54.069526 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:54.069497    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-9a49af-75f44ddf58-q2hkn"]
Sep 16 12:19:54.073223 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:54.073201    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-9a49af-7cb84c6757-cdftt"]
Sep 16 12:19:54.073336 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:54.073320    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-9a49af-75f44ddf58-q2hkn"
Sep 16 12:19:54.076006 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:54.075985    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-9a49af\""
Sep 16 12:19:54.076580 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:54.076561    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-9a49af-7cb84c6757-cdftt"
Sep 16 12:19:54.084368 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:54.084340    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-9a49af-75f44ddf58-q2hkn"]
Sep 16 12:19:54.086299 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:54.086279    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-9a49af-7cb84c6757-cdftt"]
Sep 16 12:19:54.123567 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:54.123535    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:19:54.158417 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:54.158391    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/06ce496b-8053-4770-8068-f09f6b1a1364-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-9a49af-75f44ddf58-q2hkn\" (UID: \"06ce496b-8053-4770-8068-f09f6b1a1364\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-9a49af-75f44ddf58-q2hkn"
Sep 16 12:19:54.158570 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:54.158423    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3f3f32c2-21a0-4b0c-b9b9-afa883c14733-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-9a49af-7cb84c6757-cdftt\" (UID: \"3f3f32c2-21a0-4b0c-b9b9-afa883c14733\") " pod="openshift-ingress/payload-processing-e2e-inf-a-9a49af-7cb84c6757-cdftt"
Sep 16 12:19:54.158570 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:54.158447    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2kgp\" (UniqueName: \"kubernetes.io/projected/3f3f32c2-21a0-4b0c-b9b9-afa883c14733-kube-api-access-r2kgp\") pod \"payload-processing-e2e-inf-a-9a49af-7cb84c6757-cdftt\" (UID: \"3f3f32c2-21a0-4b0c-b9b9-afa883c14733\") " pod="openshift-ingress/payload-processing-e2e-inf-a-9a49af-7cb84c6757-cdftt"
Sep 16 12:19:54.158706 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:54.158646    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqkfx\" (UniqueName: \"kubernetes.io/projected/06ce496b-8053-4770-8068-f09f6b1a1364-kube-api-access-rqkfx\") pod \"payload-pre-processing-e2e-inf-a-9a49af-75f44ddf58-q2hkn\" (UID: \"06ce496b-8053-4770-8068-f09f6b1a1364\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-9a49af-75f44ddf58-q2hkn"
Sep 16 12:19:54.260352 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:54.260265    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqkfx\" (UniqueName: \"kubernetes.io/projected/06ce496b-8053-4770-8068-f09f6b1a1364-kube-api-access-rqkfx\") pod \"payload-pre-processing-e2e-inf-a-9a49af-75f44ddf58-q2hkn\" (UID: \"06ce496b-8053-4770-8068-f09f6b1a1364\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-9a49af-75f44ddf58-q2hkn"
Sep 16 12:19:54.260352 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:54.260306    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/06ce496b-8053-4770-8068-f09f6b1a1364-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-9a49af-75f44ddf58-q2hkn\" (UID: \"06ce496b-8053-4770-8068-f09f6b1a1364\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-9a49af-75f44ddf58-q2hkn"
Sep 16 12:19:54.260352 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:54.260332    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3f3f32c2-21a0-4b0c-b9b9-afa883c14733-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-9a49af-7cb84c6757-cdftt\" (UID: \"3f3f32c2-21a0-4b0c-b9b9-afa883c14733\") " pod="openshift-ingress/payload-processing-e2e-inf-a-9a49af-7cb84c6757-cdftt"
Sep 16 12:19:54.260631 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:54.260362    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2kgp\" (UniqueName: \"kubernetes.io/projected/3f3f32c2-21a0-4b0c-b9b9-afa883c14733-kube-api-access-r2kgp\") pod \"payload-processing-e2e-inf-a-9a49af-7cb84c6757-cdftt\" (UID: \"3f3f32c2-21a0-4b0c-b9b9-afa883c14733\") " pod="openshift-ingress/payload-processing-e2e-inf-a-9a49af-7cb84c6757-cdftt"
Sep 16 12:19:54.261092 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:54.261068    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/06ce496b-8053-4770-8068-f09f6b1a1364-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-9a49af-75f44ddf58-q2hkn\" (UID: \"06ce496b-8053-4770-8068-f09f6b1a1364\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-9a49af-75f44ddf58-q2hkn"
Sep 16 12:19:54.261203 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:54.261113    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3f3f32c2-21a0-4b0c-b9b9-afa883c14733-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-9a49af-7cb84c6757-cdftt\" (UID: \"3f3f32c2-21a0-4b0c-b9b9-afa883c14733\") " pod="openshift-ingress/payload-processing-e2e-inf-a-9a49af-7cb84c6757-cdftt"
Sep 16 12:19:54.268578 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:54.268557    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2kgp\" (UniqueName: \"kubernetes.io/projected/3f3f32c2-21a0-4b0c-b9b9-afa883c14733-kube-api-access-r2kgp\") pod \"payload-processing-e2e-inf-a-9a49af-7cb84c6757-cdftt\" (UID: \"3f3f32c2-21a0-4b0c-b9b9-afa883c14733\") " pod="openshift-ingress/payload-processing-e2e-inf-a-9a49af-7cb84c6757-cdftt"
Sep 16 12:19:54.268660 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:54.268625    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqkfx\" (UniqueName: \"kubernetes.io/projected/06ce496b-8053-4770-8068-f09f6b1a1364-kube-api-access-rqkfx\") pod \"payload-pre-processing-e2e-inf-a-9a49af-75f44ddf58-q2hkn\" (UID: \"06ce496b-8053-4770-8068-f09f6b1a1364\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-9a49af-75f44ddf58-q2hkn"
Sep 16 12:19:54.387467 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:54.387436    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-9a49af-75f44ddf58-q2hkn"
Sep 16 12:19:54.394426 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:54.394400    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-9a49af-7cb84c6757-cdftt"
Sep 16 12:19:54.434904 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:54.434806    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:19:54.668099 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:54.668072    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-9a49af-75f44ddf58-q2hkn"]
Sep 16 12:19:54.670332 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:19:54.670301    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06ce496b_8053_4770_8068_f09f6b1a1364.slice/crio-e1fc055c47bf20664ea1a0e6797fae2b1ddc314b7dddbfb6f7c375be99d67e2e WatchSource:0}: Error finding container e1fc055c47bf20664ea1a0e6797fae2b1ddc314b7dddbfb6f7c375be99d67e2e: Status 404 returned error can't find the container with id e1fc055c47bf20664ea1a0e6797fae2b1ddc314b7dddbfb6f7c375be99d67e2e
Sep 16 12:19:54.675606 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:54.675585    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-9a49af-7cb84c6757-cdftt"]
Sep 16 12:19:54.676982 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:19:54.676954    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f3f32c2_21a0_4b0c_b9b9_afa883c14733.slice/crio-9ae3338ea6742454756363f17df0ab35379c63f32ad8ffa8f3e281a268a22018 WatchSource:0}: Error finding container 9ae3338ea6742454756363f17df0ab35379c63f32ad8ffa8f3e281a268a22018: Status 404 returned error can't find the container with id 9ae3338ea6742454756363f17df0ab35379c63f32ad8ffa8f3e281a268a22018
Sep 16 12:19:54.932121 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:54.932034    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:19:55.029263 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:55.029224    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:19:55.284196 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:55.284106    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:19:55.379170 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:55.379116    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:19:55.585474 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:55.585394    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:19:55.639883 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:55.639834    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-9a49af-7cb84c6757-cdftt" event={"ID":"3f3f32c2-21a0-4b0c-b9b9-afa883c14733","Type":"ContainerStarted","Data":"3e2975ed14bcb16039d6d190f816ec570ad42328f001dc7e49e6f3dfe64b90f8"}
Sep 16 12:19:55.640050 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:55.639906    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-9a49af-7cb84c6757-cdftt" event={"ID":"3f3f32c2-21a0-4b0c-b9b9-afa883c14733","Type":"ContainerStarted","Data":"9ae3338ea6742454756363f17df0ab35379c63f32ad8ffa8f3e281a268a22018"}
Sep 16 12:19:55.640228 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:55.640184    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-9a49af-7cb84c6757-cdftt"
Sep 16 12:19:55.641640 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:55.641611    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-9a49af-75f44ddf58-q2hkn" event={"ID":"06ce496b-8053-4770-8068-f09f6b1a1364","Type":"ContainerStarted","Data":"244af1e26180456563f589296315b6d58ecffea6a866dbc8fff73beee1f141ed"}
Sep 16 12:19:55.641779 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:55.641653    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-9a49af-75f44ddf58-q2hkn" event={"ID":"06ce496b-8053-4770-8068-f09f6b1a1364","Type":"ContainerStarted","Data":"e1fc055c47bf20664ea1a0e6797fae2b1ddc314b7dddbfb6f7c375be99d67e2e"}
Sep 16 12:19:55.641779 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:55.641680    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-9a49af-75f44ddf58-q2hkn"
Sep 16 12:19:55.664465 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:55.664381    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-9a49af-7cb84c6757-cdftt" podStartSLOduration=1.664361421 podStartE2EDuration="1.664361421s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:19:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:19:55.66327891 +0000 UTC m=+1162.283598227" watchObservedRunningTime="2026-09-16 12:19:55.664361421 +0000 UTC m=+1162.284680740"
Sep 16 12:19:55.682090 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:55.682037    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-9a49af-75f44ddf58-q2hkn" podStartSLOduration=1.682023424 podStartE2EDuration="1.682023424s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:19:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:19:55.679924025 +0000 UTC m=+1162.300243332" watchObservedRunningTime="2026-09-16 12:19:55.682023424 +0000 UTC m=+1162.302342734"
Sep 16 12:19:55.910233 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:55.910196    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:19:56.226483 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:56.226360    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:19:56.559122 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:56.559011    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:19:56.655406 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:56.655364    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:19:57.384371 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:57.384339    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:19:57.896812 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:57.896775    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:19:57.993260 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:57.993227    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:19:58.422675 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:58.422617    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:19:59.100758 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:59.100723    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:19:59.930078 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:59.930040    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:19:59.999596 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:19:59.999568    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:00.256374 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:00.256288    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:00.383249 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:00.383216    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:00.490172 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:00.490124    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:00.531306 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:00.531222    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-1ce21877-649bdfcd9f-ljrfk"]
Sep 16 12:20:00.534890 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:00.534871    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-1ce21877-649bdfcd9f-ljrfk"
Sep 16 12:20:00.537977 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:00.537956    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-1ce21877-dockercfg-8mqs6\""
Sep 16 12:20:00.538088 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:00.537973    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-1ce21877\""
Sep 16 12:20:00.545528 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:00.545502    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-1ce21877-649bdfcd9f-ljrfk"]
Sep 16 12:20:00.622439 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:00.622405    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf72f392-e61f-4658-8199-03c994a75254-plugins-config-volume\") pod \"payload-processing-e2e-ait-1ce21877-649bdfcd9f-ljrfk\" (UID: \"cf72f392-e61f-4658-8199-03c994a75254\") " pod="openshift-ingress/payload-processing-e2e-ait-1ce21877-649bdfcd9f-ljrfk"
Sep 16 12:20:00.622642 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:00.622487    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtgbb\" (UniqueName: \"kubernetes.io/projected/cf72f392-e61f-4658-8199-03c994a75254-kube-api-access-qtgbb\") pod \"payload-processing-e2e-ait-1ce21877-649bdfcd9f-ljrfk\" (UID: \"cf72f392-e61f-4658-8199-03c994a75254\") " pod="openshift-ingress/payload-processing-e2e-ait-1ce21877-649bdfcd9f-ljrfk"
Sep 16 12:20:00.723927 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:00.723884    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtgbb\" (UniqueName: \"kubernetes.io/projected/cf72f392-e61f-4658-8199-03c994a75254-kube-api-access-qtgbb\") pod \"payload-processing-e2e-ait-1ce21877-649bdfcd9f-ljrfk\" (UID: \"cf72f392-e61f-4658-8199-03c994a75254\") " pod="openshift-ingress/payload-processing-e2e-ait-1ce21877-649bdfcd9f-ljrfk"
Sep 16 12:20:00.724208 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:00.724002    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf72f392-e61f-4658-8199-03c994a75254-plugins-config-volume\") pod \"payload-processing-e2e-ait-1ce21877-649bdfcd9f-ljrfk\" (UID: \"cf72f392-e61f-4658-8199-03c994a75254\") " pod="openshift-ingress/payload-processing-e2e-ait-1ce21877-649bdfcd9f-ljrfk"
Sep 16 12:20:00.724795 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:00.724769    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf72f392-e61f-4658-8199-03c994a75254-plugins-config-volume\") pod \"payload-processing-e2e-ait-1ce21877-649bdfcd9f-ljrfk\" (UID: \"cf72f392-e61f-4658-8199-03c994a75254\") " pod="openshift-ingress/payload-processing-e2e-ait-1ce21877-649bdfcd9f-ljrfk"
Sep 16 12:20:00.731842 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:00.731814    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtgbb\" (UniqueName: \"kubernetes.io/projected/cf72f392-e61f-4658-8199-03c994a75254-kube-api-access-qtgbb\") pod \"payload-processing-e2e-ait-1ce21877-649bdfcd9f-ljrfk\" (UID: \"cf72f392-e61f-4658-8199-03c994a75254\") " pod="openshift-ingress/payload-processing-e2e-ait-1ce21877-649bdfcd9f-ljrfk"
Sep 16 12:20:00.847160 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:00.847037    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-1ce21877-649bdfcd9f-ljrfk"
Sep 16 12:20:00.935636 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:00.935604    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:01.123315 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:01.123275    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-1ce21877-649bdfcd9f-ljrfk"]
Sep 16 12:20:01.125601 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:20:01.125572    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf72f392_e61f_4658_8199_03c994a75254.slice/crio-6d9731a7d0552f9c0e4d897aba4e6f56f000ed8c8e99cf8a935db77f4d467d0d WatchSource:0}: Error finding container 6d9731a7d0552f9c0e4d897aba4e6f56f000ed8c8e99cf8a935db77f4d467d0d: Status 404 returned error can't find the container with id 6d9731a7d0552f9c0e4d897aba4e6f56f000ed8c8e99cf8a935db77f4d467d0d
Sep 16 12:20:01.685046 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:01.685008    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-1ce21877-649bdfcd9f-ljrfk" event={"ID":"cf72f392-e61f-4658-8199-03c994a75254","Type":"ContainerStarted","Data":"2f36b1322a4eca3d2475c2bd584d9f19fa1db2b53874a64ada5a9a4c93c2ac1c"}
Sep 16 12:20:01.685480 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:01.685104    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-1ce21877-649bdfcd9f-ljrfk" event={"ID":"cf72f392-e61f-4658-8199-03c994a75254","Type":"ContainerStarted","Data":"6d9731a7d0552f9c0e4d897aba4e6f56f000ed8c8e99cf8a935db77f4d467d0d"}
Sep 16 12:20:01.685480 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:01.685283    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-1ce21877-649bdfcd9f-ljrfk"
Sep 16 12:20:01.709019 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:01.708950    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-1ce21877-649bdfcd9f-ljrfk" podStartSLOduration=1.708926816 podStartE2EDuration="1.708926816s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:20:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:20:01.706904378 +0000 UTC m=+1168.327223698" watchObservedRunningTime="2026-09-16 12:20:01.708926816 +0000 UTC m=+1168.329246133"
Sep 16 12:20:01.739263 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:01.739216    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:01.840632 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:01.840588    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:02.007616 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:02.007530    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:02.438523 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:02.438484    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:02.516648 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:02.516617    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:02.536701 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:02.536664    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-7c3429-76f68fd846-45s9p"]
Sep 16 12:20:02.540897 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:02.540873    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-7c3429-8475798fc-2k76r"]
Sep 16 12:20:02.541024 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:02.540971    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-7c3429-76f68fd846-45s9p"
Sep 16 12:20:02.544372 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:02.544349    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-7c3429-8475798fc-2k76r"
Sep 16 12:20:02.545399 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:02.545381    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-7c3429\""
Sep 16 12:20:02.554884 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:02.554531    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-7c3429-76f68fd846-45s9p"]
Sep 16 12:20:02.557574 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:02.557550    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-7c3429-8475798fc-2k76r"]
Sep 16 12:20:02.621512 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:02.621481    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-7a4d5c-5dd74ddd9f-tnrs8"
Sep 16 12:20:02.621679 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:02.621664    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-7a4d5c-7b54999db-828tz"
Sep 16 12:20:02.641590 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:02.641548    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6057fe2e-64b4-4388-a7dc-a3b5242e130c-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-7c3429-76f68fd846-45s9p\" (UID: \"6057fe2e-64b4-4388-a7dc-a3b5242e130c\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-7c3429-76f68fd846-45s9p"
Sep 16 12:20:02.641777 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:02.641608    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6d2f\" (UniqueName: \"kubernetes.io/projected/6057fe2e-64b4-4388-a7dc-a3b5242e130c-kube-api-access-t6d2f\") pod \"payload-pre-processing-e2e-autores-7c3429-76f68fd846-45s9p\" (UID: \"6057fe2e-64b4-4388-a7dc-a3b5242e130c\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-7c3429-76f68fd846-45s9p"
Sep 16 12:20:02.641777 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:02.641733    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqnwd\" (UniqueName: \"kubernetes.io/projected/5ab0f214-d5cd-4570-b844-7e4b891a3d98-kube-api-access-kqnwd\") pod \"payload-processing-e2e-autores-7c3429-8475798fc-2k76r\" (UID: \"5ab0f214-d5cd-4570-b844-7e4b891a3d98\") " pod="openshift-ingress/payload-processing-e2e-autores-7c3429-8475798fc-2k76r"
Sep 16 12:20:02.641903 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:02.641780    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ab0f214-d5cd-4570-b844-7e4b891a3d98-plugins-config-volume\") pod \"payload-processing-e2e-autores-7c3429-8475798fc-2k76r\" (UID: \"5ab0f214-d5cd-4570-b844-7e4b891a3d98\") " pod="openshift-ingress/payload-processing-e2e-autores-7c3429-8475798fc-2k76r"
Sep 16 12:20:02.742520 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:02.742411    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6d2f\" (UniqueName: \"kubernetes.io/projected/6057fe2e-64b4-4388-a7dc-a3b5242e130c-kube-api-access-t6d2f\") pod \"payload-pre-processing-e2e-autores-7c3429-76f68fd846-45s9p\" (UID: \"6057fe2e-64b4-4388-a7dc-a3b5242e130c\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-7c3429-76f68fd846-45s9p"
Sep 16 12:20:02.742520 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:02.742461    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqnwd\" (UniqueName: \"kubernetes.io/projected/5ab0f214-d5cd-4570-b844-7e4b891a3d98-kube-api-access-kqnwd\") pod \"payload-processing-e2e-autores-7c3429-8475798fc-2k76r\" (UID: \"5ab0f214-d5cd-4570-b844-7e4b891a3d98\") " pod="openshift-ingress/payload-processing-e2e-autores-7c3429-8475798fc-2k76r"
Sep 16 12:20:02.742520 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:02.742484    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ab0f214-d5cd-4570-b844-7e4b891a3d98-plugins-config-volume\") pod \"payload-processing-e2e-autores-7c3429-8475798fc-2k76r\" (UID: \"5ab0f214-d5cd-4570-b844-7e4b891a3d98\") " pod="openshift-ingress/payload-processing-e2e-autores-7c3429-8475798fc-2k76r"
Sep 16 12:20:02.743122 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:02.742680    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6057fe2e-64b4-4388-a7dc-a3b5242e130c-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-7c3429-76f68fd846-45s9p\" (UID: \"6057fe2e-64b4-4388-a7dc-a3b5242e130c\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-7c3429-76f68fd846-45s9p"
Sep 16 12:20:02.743310 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:02.743287    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ab0f214-d5cd-4570-b844-7e4b891a3d98-plugins-config-volume\") pod \"payload-processing-e2e-autores-7c3429-8475798fc-2k76r\" (UID: \"5ab0f214-d5cd-4570-b844-7e4b891a3d98\") " pod="openshift-ingress/payload-processing-e2e-autores-7c3429-8475798fc-2k76r"
Sep 16 12:20:02.743454 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:02.743434    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6057fe2e-64b4-4388-a7dc-a3b5242e130c-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-7c3429-76f68fd846-45s9p\" (UID: \"6057fe2e-64b4-4388-a7dc-a3b5242e130c\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-7c3429-76f68fd846-45s9p"
Sep 16 12:20:02.752543 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:02.752516    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6d2f\" (UniqueName: \"kubernetes.io/projected/6057fe2e-64b4-4388-a7dc-a3b5242e130c-kube-api-access-t6d2f\") pod \"payload-pre-processing-e2e-autores-7c3429-76f68fd846-45s9p\" (UID: \"6057fe2e-64b4-4388-a7dc-a3b5242e130c\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-7c3429-76f68fd846-45s9p"
Sep 16 12:20:02.753225 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:02.753204    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqnwd\" (UniqueName: \"kubernetes.io/projected/5ab0f214-d5cd-4570-b844-7e4b891a3d98-kube-api-access-kqnwd\") pod \"payload-processing-e2e-autores-7c3429-8475798fc-2k76r\" (UID: \"5ab0f214-d5cd-4570-b844-7e4b891a3d98\") " pod="openshift-ingress/payload-processing-e2e-autores-7c3429-8475798fc-2k76r"
Sep 16 12:20:02.844120 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:02.844078    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:02.853993 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:02.853968    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-7c3429-76f68fd846-45s9p"
Sep 16 12:20:02.864477 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:02.864109    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-7c3429-8475798fc-2k76r"
Sep 16 12:20:03.064088 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:03.064004    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:03.132195 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:03.132168    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-7c3429-76f68fd846-45s9p"]
Sep 16 12:20:03.134213 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:20:03.134187    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6057fe2e_64b4_4388_a7dc_a3b5242e130c.slice/crio-0a26248262711687830114449d0767f63872c88bbba9522a5e1b3dd276d123b6 WatchSource:0}: Error finding container 0a26248262711687830114449d0767f63872c88bbba9522a5e1b3dd276d123b6: Status 404 returned error can't find the container with id 0a26248262711687830114449d0767f63872c88bbba9522a5e1b3dd276d123b6
Sep 16 12:20:03.159248 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:03.159226    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-7c3429-8475798fc-2k76r"]
Sep 16 12:20:03.161010 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:03.160988    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:03.164290 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:20:03.164267    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ab0f214_d5cd_4570_b844_7e4b891a3d98.slice/crio-55de96bee898d6f14bffe553bbf9c7967141937a15b76f98667bcb32b1982fb8 WatchSource:0}: Error finding container 55de96bee898d6f14bffe553bbf9c7967141937a15b76f98667bcb32b1982fb8: Status 404 returned error can't find the container with id 55de96bee898d6f14bffe553bbf9c7967141937a15b76f98667bcb32b1982fb8
Sep 16 12:20:03.572293 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:03.572258    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:03.700237 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:03.700195    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-7c3429-8475798fc-2k76r" event={"ID":"5ab0f214-d5cd-4570-b844-7e4b891a3d98","Type":"ContainerStarted","Data":"e53a2982339fa78974f6a31f89a0ab0e55fd610a36f99939354b677eecd2f50f"}
Sep 16 12:20:03.700443 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:03.700252    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-7c3429-8475798fc-2k76r" event={"ID":"5ab0f214-d5cd-4570-b844-7e4b891a3d98","Type":"ContainerStarted","Data":"55de96bee898d6f14bffe553bbf9c7967141937a15b76f98667bcb32b1982fb8"}
Sep 16 12:20:03.700443 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:03.700332    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-autores-7c3429-8475798fc-2k76r"
Sep 16 12:20:03.701855 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:03.701833    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-7c3429-76f68fd846-45s9p" event={"ID":"6057fe2e-64b4-4388-a7dc-a3b5242e130c","Type":"ContainerStarted","Data":"4e13b98a15cf7a4eb3633272038bae8eb014cab00b639ae2a85fe4a61aaf8a8d"}
Sep 16 12:20:03.701982 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:03.701871    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-7c3429-76f68fd846-45s9p" event={"ID":"6057fe2e-64b4-4388-a7dc-a3b5242e130c","Type":"ContainerStarted","Data":"0a26248262711687830114449d0767f63872c88bbba9522a5e1b3dd276d123b6"}
Sep 16 12:20:03.701982 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:03.701964    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-7c3429-76f68fd846-45s9p"
Sep 16 12:20:03.726372 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:03.726323    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-autores-7c3429-8475798fc-2k76r" podStartSLOduration=1.726306545 podStartE2EDuration="1.726306545s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:20:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:20:03.724725937 +0000 UTC m=+1170.345045255" watchObservedRunningTime="2026-09-16 12:20:03.726306545 +0000 UTC m=+1170.346625861"
Sep 16 12:20:03.753034 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:03.752975    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-autores-7c3429-76f68fd846-45s9p" podStartSLOduration=1.7529535630000002 podStartE2EDuration="1.752953563s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:20:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:20:03.751261056 +0000 UTC m=+1170.371580384" watchObservedRunningTime="2026-09-16 12:20:03.752953563 +0000 UTC m=+1170.373272887"
Sep 16 12:20:03.773180 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:03.773150    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:03.876459 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:03.876378    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:04.633908 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:04.633881    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-0e8ffe-7fb6ff6d7-npsrh"
Sep 16 12:20:04.738348 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:04.738293    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:05.414507 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:05.414476    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:05.593177 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:05.593143    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:05.811424 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:05.811310    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:05.906614 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:05.906571    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:06.004380 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:06.004345    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:06.217599 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:06.217566    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:06.321466 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:06.321433    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:06.648966 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:06.648940    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-9a49af-7cb84c6757-cdftt"
Sep 16 12:20:06.649407 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:06.649146    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-9a49af-75f44ddf58-q2hkn"
Sep 16 12:20:06.681323 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:06.681271    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:07.036903 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:07.036792    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:07.137491 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:07.137460    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:07.367127 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:07.367046    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:07.915749 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:07.915714    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:20:08.840199 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:08.840154    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:09.925201 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:09.925141    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:10.517103 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:10.517063    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:10.615173 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:10.615113    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:10.717890 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:10.717855    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:11.559545 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:11.559508    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:12.533417 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:12.533384    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:12.695670 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:12.695639    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-1ce21877-649bdfcd9f-ljrfk"
Sep 16 12:20:13.074915 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:13.074876    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:13.169096 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:13.169058    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:13.316394 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:13.316363    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:13.420582 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:13.420548    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:14.437690 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:14.437633    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:14.712437 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:14.712356    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-7c3429-76f68fd846-45s9p"
Sep 16 12:20:14.712576 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:14.712464    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-autores-7c3429-8475798fc-2k76r"
Sep 16 12:20:15.470520 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:15.470469    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:15.582306 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:15.582269    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:15.773232 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:15.773113    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:16.090590 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:16.090503    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:16.191128 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:16.191094    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:16.345934 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:16.345854    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:16.523035 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:16.523003    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:16.921210 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:16.921172    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:17.443907 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:17.443861    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:18.125693 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:18.125656    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:18.288905 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:18.288870    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ce21877-vfs7s"]
Sep 16 12:20:18.298030 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:18.297998    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ce21877-vfs7s"
Sep 16 12:20:18.300048 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:18.300022    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ce21877-vfs7s"]
Sep 16 12:20:18.300709 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:18.300681    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hvtv7\""
Sep 16 12:20:18.405973 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:18.405944    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/52dd4c7b-ef41-4850-94c1-bd8965cce2cd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-1ce21877-vfs7s\" (UID: \"52dd4c7b-ef41-4850-94c1-bd8965cce2cd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ce21877-vfs7s"
Sep 16 12:20:18.507079 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:18.507043    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/52dd4c7b-ef41-4850-94c1-bd8965cce2cd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-1ce21877-vfs7s\" (UID: \"52dd4c7b-ef41-4850-94c1-bd8965cce2cd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ce21877-vfs7s"
Sep 16 12:20:18.507757 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:18.507730    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/52dd4c7b-ef41-4850-94c1-bd8965cce2cd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-1ce21877-vfs7s\" (UID: \"52dd4c7b-ef41-4850-94c1-bd8965cce2cd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ce21877-vfs7s"
Sep 16 12:20:18.610077 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:18.610043    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ce21877-vfs7s"
Sep 16 12:20:18.883579 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:18.883553    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ce21877-vfs7s"]
Sep 16 12:20:18.886494 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:20:18.886463    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52dd4c7b_ef41_4850_94c1_bd8965cce2cd.slice/crio-2d9cf1a3822c5aa0d41ee48c4767953b3d41594ce586632a8eacdbf25ca04300 WatchSource:0}: Error finding container 2d9cf1a3822c5aa0d41ee48c4767953b3d41594ce586632a8eacdbf25ca04300: Status 404 returned error can't find the container with id 2d9cf1a3822c5aa0d41ee48c4767953b3d41594ce586632a8eacdbf25ca04300
Sep 16 12:20:19.030680 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:19.030599    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:19.511739 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:19.511706    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:19.625631 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:19.625546    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:19.718853 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:19.718820    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:19.808324 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:19.808287    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ce21877-vfs7s" event={"ID":"52dd4c7b-ef41-4850-94c1-bd8965cce2cd","Type":"ContainerStarted","Data":"2d9cf1a3822c5aa0d41ee48c4767953b3d41594ce586632a8eacdbf25ca04300"}
Sep 16 12:20:19.809946 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:19.809917    2559 generic.go:356] "Generic (PLEG): container finished" podID="906351b2-188c-4513-992d-db47f5faa810" containerID="c8b92a046ceab4e03fbb3dc7248e82c995bec501e762f9e41732c7dfb629ea2f" exitCode=0
Sep 16 12:20:19.810076 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:19.809978    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn" event={"ID":"906351b2-188c-4513-992d-db47f5faa810","Type":"ContainerDied","Data":"c8b92a046ceab4e03fbb3dc7248e82c995bec501e762f9e41732c7dfb629ea2f"}
Sep 16 12:20:19.810377 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:19.810362    2559 scope.go:117] "RemoveContainer" containerID="c8b92a046ceab4e03fbb3dc7248e82c995bec501e762f9e41732c7dfb629ea2f"
Sep 16 12:20:19.811465 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:19.811437    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:20:19.811528 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:19.811507    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:20:19.811568 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:19.811538    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:20:19.819639 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:19.819612    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:19.924327 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:19.924290    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:20.693391 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:20.693351    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:20.829880 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:20.829744    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn" event={"ID":"906351b2-188c-4513-992d-db47f5faa810","Type":"ContainerStarted","Data":"dd80817d742248ecd458e9f48d82434230decd0ec3acc35faed215820b693114"}
Sep 16 12:20:20.951227 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:20.949852    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn"
Sep 16 12:20:20.951227 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:20.950010    2559 patch_prober.go:28] interesting pod/e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Sep 16 12:20:20.951227 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:20.950057    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn" podUID="906351b2-188c-4513-992d-db47f5faa810" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Sep 16 12:20:21.615335 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:21.615300    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn"
Sep 16 12:20:21.664483 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:21.664417    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:21.940510 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:21.938236    2559 patch_prober.go:28] interesting pod/e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Sep 16 12:20:21.940510 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:21.938295    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn" podUID="906351b2-188c-4513-992d-db47f5faa810" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Sep 16 12:20:22.525147 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:22.525048    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:22.845698 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:22.845603    2559 generic.go:356] "Generic (PLEG): container finished" podID="52dd4c7b-ef41-4850-94c1-bd8965cce2cd" containerID="01b14386f84aa992d457bd6c4ea9a0e42f28ff7dd9dccedcdcd4966f50d9eb56" exitCode=0
Sep 16 12:20:22.845698 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:22.845686    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ce21877-vfs7s" event={"ID":"52dd4c7b-ef41-4850-94c1-bd8965cce2cd","Type":"ContainerDied","Data":"01b14386f84aa992d457bd6c4ea9a0e42f28ff7dd9dccedcdcd4966f50d9eb56"}
Sep 16 12:20:22.938208 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:22.938174    2559 patch_prober.go:28] interesting pod/e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Sep 16 12:20:22.938488 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:22.938460    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn" podUID="906351b2-188c-4513-992d-db47f5faa810" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Sep 16 12:20:23.342589 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:23.342542    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:23.947871 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:23.947538    2559 patch_prober.go:28] interesting pod/e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Sep 16 12:20:23.947871 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:23.947604    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn" podUID="906351b2-188c-4513-992d-db47f5faa810" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Sep 16 12:20:24.028655 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:24.028623    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ce21877-vfs7s"
Sep 16 12:20:24.065296 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:24.065219    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:24.187485 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:24.187457    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/52dd4c7b-ef41-4850-94c1-bd8965cce2cd-maas-api-service-ca\") pod \"52dd4c7b-ef41-4850-94c1-bd8965cce2cd\" (UID: \"52dd4c7b-ef41-4850-94c1-bd8965cce2cd\") "
Sep 16 12:20:24.187872 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:24.187850    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52dd4c7b-ef41-4850-94c1-bd8965cce2cd-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "52dd4c7b-ef41-4850-94c1-bd8965cce2cd" (UID: "52dd4c7b-ef41-4850-94c1-bd8965cce2cd"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:20:24.288417 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:24.288384    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/52dd4c7b-ef41-4850-94c1-bd8965cce2cd-maas-api-service-ca\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:20:24.858679 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:24.858648    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:24.866241 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:24.866217    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ce21877-vfs7s"
Sep 16 12:20:24.866388 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:24.866216    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ce21877-vfs7s" event={"ID":"52dd4c7b-ef41-4850-94c1-bd8965cce2cd","Type":"ContainerDied","Data":"2d9cf1a3822c5aa0d41ee48c4767953b3d41594ce586632a8eacdbf25ca04300"}
Sep 16 12:20:24.866388 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:24.866349    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2d9cf1a3822c5aa0d41ee48c4767953b3d41594ce586632a8eacdbf25ca04300"
Sep 16 12:20:24.939376 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:24.938905    2559 patch_prober.go:28] interesting pod/e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Sep 16 12:20:24.939376 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:24.938973    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn" podUID="906351b2-188c-4513-992d-db47f5faa810" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Sep 16 12:20:25.939537 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:25.939496    2559 patch_prober.go:28] interesting pod/e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Sep 16 12:20:25.940030 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:25.939567    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn" podUID="906351b2-188c-4513-992d-db47f5faa810" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Sep 16 12:20:26.100219 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:26.100184    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:26.175195 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:26.175161    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:26.942548 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:26.942517    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn"
Sep 16 12:20:26.943521 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:26.943504    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn"
Sep 16 12:20:28.802784 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:28.802748    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:28.825780 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:28.825739    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-1ce21877-649bdfcd9f-ljrfk"]
Sep 16 12:20:28.826075 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:28.826022    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-1ce21877-649bdfcd9f-ljrfk" podUID="cf72f392-e61f-4658-8199-03c994a75254" containerName="payload-processing" containerID="cri-o://2f36b1322a4eca3d2475c2bd584d9f19fa1db2b53874a64ada5a9a4c93c2ac1c" gracePeriod=30
Sep 16 12:20:28.903451 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:28.903421    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:28.991559 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:28.991521    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ce21877-vfs7s"]
Sep 16 12:20:28.993525 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:28.993499    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:28.995312 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:28.995289    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ce21877-vfs7s"]
Sep 16 12:20:29.061513 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:29.061411    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:29.094720 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:29.094690    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-1ce21877-649bdfcd9f-ljrfk"
Sep 16 12:20:29.155751 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:29.155714    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:29.237616 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:29.237586    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qtgbb\" (UniqueName: \"kubernetes.io/projected/cf72f392-e61f-4658-8199-03c994a75254-kube-api-access-qtgbb\") pod \"cf72f392-e61f-4658-8199-03c994a75254\" (UID: \"cf72f392-e61f-4658-8199-03c994a75254\") "
Sep 16 12:20:29.237801 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:29.237706    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf72f392-e61f-4658-8199-03c994a75254-plugins-config-volume\") pod \"cf72f392-e61f-4658-8199-03c994a75254\" (UID: \"cf72f392-e61f-4658-8199-03c994a75254\") "
Sep 16 12:20:29.238095 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:29.238075    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf72f392-e61f-4658-8199-03c994a75254-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cf72f392-e61f-4658-8199-03c994a75254" (UID: "cf72f392-e61f-4658-8199-03c994a75254"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:20:29.240011 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:29.239981    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf72f392-e61f-4658-8199-03c994a75254-kube-api-access-qtgbb" (OuterVolumeSpecName: "kube-api-access-qtgbb") pod "cf72f392-e61f-4658-8199-03c994a75254" (UID: "cf72f392-e61f-4658-8199-03c994a75254"). InnerVolumeSpecName "kube-api-access-qtgbb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:20:29.338608 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:29.338520    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qtgbb\" (UniqueName: \"kubernetes.io/projected/cf72f392-e61f-4658-8199-03c994a75254-kube-api-access-qtgbb\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:20:29.338608 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:29.338556    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf72f392-e61f-4658-8199-03c994a75254-plugins-config-volume\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:20:29.407593 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:29.407558    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:29.767361 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:29.767322    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:29.884613 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:29.884576    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:29.894523 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:29.894497    2559 generic.go:356] "Generic (PLEG): container finished" podID="cf72f392-e61f-4658-8199-03c994a75254" containerID="2f36b1322a4eca3d2475c2bd584d9f19fa1db2b53874a64ada5a9a4c93c2ac1c" exitCode=0
Sep 16 12:20:29.894686 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:29.894533    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-1ce21877-649bdfcd9f-ljrfk" event={"ID":"cf72f392-e61f-4658-8199-03c994a75254","Type":"ContainerDied","Data":"2f36b1322a4eca3d2475c2bd584d9f19fa1db2b53874a64ada5a9a4c93c2ac1c"}
Sep 16 12:20:29.894686 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:29.894558    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-1ce21877-649bdfcd9f-ljrfk"
Sep 16 12:20:29.894686 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:29.894575    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-1ce21877-649bdfcd9f-ljrfk" event={"ID":"cf72f392-e61f-4658-8199-03c994a75254","Type":"ContainerDied","Data":"6d9731a7d0552f9c0e4d897aba4e6f56f000ed8c8e99cf8a935db77f4d467d0d"}
Sep 16 12:20:29.894686 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:29.894599    2559 scope.go:117] "RemoveContainer" containerID="2f36b1322a4eca3d2475c2bd584d9f19fa1db2b53874a64ada5a9a4c93c2ac1c"
Sep 16 12:20:29.903622 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:29.903606    2559 scope.go:117] "RemoveContainer" containerID="2f36b1322a4eca3d2475c2bd584d9f19fa1db2b53874a64ada5a9a4c93c2ac1c"
Sep 16 12:20:29.903895 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:20:29.903877    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f36b1322a4eca3d2475c2bd584d9f19fa1db2b53874a64ada5a9a4c93c2ac1c\": container with ID starting with 2f36b1322a4eca3d2475c2bd584d9f19fa1db2b53874a64ada5a9a4c93c2ac1c not found: ID does not exist" containerID="2f36b1322a4eca3d2475c2bd584d9f19fa1db2b53874a64ada5a9a4c93c2ac1c"
Sep 16 12:20:29.903943 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:29.903907    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f36b1322a4eca3d2475c2bd584d9f19fa1db2b53874a64ada5a9a4c93c2ac1c"} err="failed to get container status \"2f36b1322a4eca3d2475c2bd584d9f19fa1db2b53874a64ada5a9a4c93c2ac1c\": rpc error: code = NotFound desc = could not find container \"2f36b1322a4eca3d2475c2bd584d9f19fa1db2b53874a64ada5a9a4c93c2ac1c\": container with ID starting with 2f36b1322a4eca3d2475c2bd584d9f19fa1db2b53874a64ada5a9a4c93c2ac1c not found: ID does not exist"
Sep 16 12:20:29.918621 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:29.918598    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-1ce21877-649bdfcd9f-ljrfk"]
Sep 16 12:20:29.925790 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:29.925767    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-1ce21877-649bdfcd9f-ljrfk"]
Sep 16 12:20:29.938934 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:29.938911    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52dd4c7b-ef41-4850-94c1-bd8965cce2cd" path="/var/lib/kubelet/pods/52dd4c7b-ef41-4850-94c1-bd8965cce2cd/volumes"
Sep 16 12:20:29.939337 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:29.939315    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf72f392-e61f-4658-8199-03c994a75254" path="/var/lib/kubelet/pods/cf72f392-e61f-4658-8199-03c994a75254/volumes"
Sep 16 12:20:29.975178 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:29.975115    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:30.240306 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:30.240277    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h"]
Sep 16 12:20:30.240780 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:30.240763    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf72f392-e61f-4658-8199-03c994a75254" containerName="payload-processing"
Sep 16 12:20:30.240870 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:30.240784    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf72f392-e61f-4658-8199-03c994a75254" containerName="payload-processing"
Sep 16 12:20:30.240870 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:30.240802    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52dd4c7b-ef41-4850-94c1-bd8965cce2cd" containerName="revoke-keys"
Sep 16 12:20:30.240870 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:30.240810    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="52dd4c7b-ef41-4850-94c1-bd8965cce2cd" containerName="revoke-keys"
Sep 16 12:20:30.241023 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:30.240927    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="52dd4c7b-ef41-4850-94c1-bd8965cce2cd" containerName="revoke-keys"
Sep 16 12:20:30.241023 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:30.240938    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf72f392-e61f-4658-8199-03c994a75254" containerName="payload-processing"
Sep 16 12:20:30.245423 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:30.245398    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h"
Sep 16 12:20:30.247996 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:30.247975    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-b6f4a170-gw-openshift-default-dockercfg-cm88c\""
Sep 16 12:20:30.260823 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:30.260799    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h"]
Sep 16 12:20:30.278144 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:30.278094    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:30.347737 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:30.347703    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9dd79bcd-8d42-4366-9223-9027c0d40901-istio-podinfo\") pod \"e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h\" (UID: \"9dd79bcd-8d42-4366-9223-9027c0d40901\") " pod="openshift-ingress/e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h"
Sep 16 12:20:30.347737 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:30.347738    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9dd79bcd-8d42-4366-9223-9027c0d40901-credential-socket\") pod \"e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h\" (UID: \"9dd79bcd-8d42-4366-9223-9027c0d40901\") " pod="openshift-ingress/e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h"
Sep 16 12:20:30.347938 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:30.347760    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fwqt\" (UniqueName: \"kubernetes.io/projected/9dd79bcd-8d42-4366-9223-9027c0d40901-kube-api-access-8fwqt\") pod \"e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h\" (UID: \"9dd79bcd-8d42-4366-9223-9027c0d40901\") " pod="openshift-ingress/e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h"
Sep 16 12:20:30.347938 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:30.347857    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9dd79bcd-8d42-4366-9223-9027c0d40901-istio-data\") pod \"e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h\" (UID: \"9dd79bcd-8d42-4366-9223-9027c0d40901\") " pod="openshift-ingress/e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h"
Sep 16 12:20:30.347938 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:30.347892    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9dd79bcd-8d42-4366-9223-9027c0d40901-workload-certs\") pod \"e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h\" (UID: \"9dd79bcd-8d42-4366-9223-9027c0d40901\") " pod="openshift-ingress/e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h"
Sep 16 12:20:30.348045 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:30.348000    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9dd79bcd-8d42-4366-9223-9027c0d40901-workload-socket\") pod \"e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h\" (UID: \"9dd79bcd-8d42-4366-9223-9027c0d40901\") " pod="openshift-ingress/e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h"
Sep 16 12:20:30.348080 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:30.348042    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9dd79bcd-8d42-4366-9223-9027c0d40901-istiod-ca-cert\") pod \"e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h\" (UID: \"9dd79bcd-8d42-4366-9223-9027c0d40901\") " pod="openshift-ingress/e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h"
Sep 16 12:20:30.348197 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:30.348180    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9dd79bcd-8d42-4366-9223-9027c0d40901-istio-token\") pod \"e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h\" (UID: \"9dd79bcd-8d42-4366-9223-9027c0d40901\") " pod="openshift-ingress/e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h"
Sep 16 12:20:30.348247 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:30.348231    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9dd79bcd-8d42-4366-9223-9027c0d40901-istio-envoy\") pod \"e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h\" (UID: \"9dd79bcd-8d42-4366-9223-9027c0d40901\") " pod="openshift-ingress/e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h"
Sep 16 12:20:30.375082 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:30.375049    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:30.449734 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:30.449693    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9dd79bcd-8d42-4366-9223-9027c0d40901-workload-socket\") pod \"e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h\" (UID: \"9dd79bcd-8d42-4366-9223-9027c0d40901\") " pod="openshift-ingress/e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h"
Sep 16 12:20:30.449734 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:30.449741    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9dd79bcd-8d42-4366-9223-9027c0d40901-istiod-ca-cert\") pod \"e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h\" (UID: \"9dd79bcd-8d42-4366-9223-9027c0d40901\") " pod="openshift-ingress/e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h"
Sep 16 12:20:30.450008 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:30.449783    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9dd79bcd-8d42-4366-9223-9027c0d40901-istio-token\") pod \"e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h\" (UID: \"9dd79bcd-8d42-4366-9223-9027c0d40901\") " pod="openshift-ingress/e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h"
Sep 16 12:20:30.450008 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:30.449814    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9dd79bcd-8d42-4366-9223-9027c0d40901-istio-envoy\") pod \"e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h\" (UID: \"9dd79bcd-8d42-4366-9223-9027c0d40901\") " pod="openshift-ingress/e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h"
Sep 16 12:20:30.450008 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:30.449961    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9dd79bcd-8d42-4366-9223-9027c0d40901-istio-podinfo\") pod \"e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h\" (UID: \"9dd79bcd-8d42-4366-9223-9027c0d40901\") " pod="openshift-ingress/e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h"
Sep 16 12:20:30.450008 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:30.449994    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9dd79bcd-8d42-4366-9223-9027c0d40901-credential-socket\") pod \"e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h\" (UID: \"9dd79bcd-8d42-4366-9223-9027c0d40901\") " pod="openshift-ingress/e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h"
Sep 16 12:20:30.450238 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:30.450025    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fwqt\" (UniqueName: \"kubernetes.io/projected/9dd79bcd-8d42-4366-9223-9027c0d40901-kube-api-access-8fwqt\") pod \"e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h\" (UID: \"9dd79bcd-8d42-4366-9223-9027c0d40901\") " pod="openshift-ingress/e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h"
Sep 16 12:20:30.450238 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:30.450072    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9dd79bcd-8d42-4366-9223-9027c0d40901-istio-data\") pod \"e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h\" (UID: \"9dd79bcd-8d42-4366-9223-9027c0d40901\") " pod="openshift-ingress/e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h"
Sep 16 12:20:30.450238 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:30.450105    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9dd79bcd-8d42-4366-9223-9027c0d40901-workload-certs\") pod \"e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h\" (UID: \"9dd79bcd-8d42-4366-9223-9027c0d40901\") " pod="openshift-ingress/e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h"
Sep 16 12:20:30.450238 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:30.450201    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9dd79bcd-8d42-4366-9223-9027c0d40901-workload-socket\") pod \"e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h\" (UID: \"9dd79bcd-8d42-4366-9223-9027c0d40901\") " pod="openshift-ingress/e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h"
Sep 16 12:20:30.450407 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:30.450378    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9dd79bcd-8d42-4366-9223-9027c0d40901-credential-socket\") pod \"e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h\" (UID: \"9dd79bcd-8d42-4366-9223-9027c0d40901\") " pod="openshift-ingress/e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h"
Sep 16 12:20:30.450476 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:30.450433    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9dd79bcd-8d42-4366-9223-9027c0d40901-istio-data\") pod \"e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h\" (UID: \"9dd79bcd-8d42-4366-9223-9027c0d40901\") " pod="openshift-ingress/e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h"
Sep 16 12:20:30.450537 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:30.450521    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9dd79bcd-8d42-4366-9223-9027c0d40901-workload-certs\") pod \"e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h\" (UID: \"9dd79bcd-8d42-4366-9223-9027c0d40901\") " pod="openshift-ingress/e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h"
Sep 16 12:20:30.450794 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:30.450776    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9dd79bcd-8d42-4366-9223-9027c0d40901-istiod-ca-cert\") pod \"e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h\" (UID: \"9dd79bcd-8d42-4366-9223-9027c0d40901\") " pod="openshift-ingress/e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h"
Sep 16 12:20:30.452108 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:30.452084    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9dd79bcd-8d42-4366-9223-9027c0d40901-istio-envoy\") pod \"e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h\" (UID: \"9dd79bcd-8d42-4366-9223-9027c0d40901\") " pod="openshift-ingress/e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h"
Sep 16 12:20:30.452389 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:30.452373    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9dd79bcd-8d42-4366-9223-9027c0d40901-istio-podinfo\") pod \"e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h\" (UID: \"9dd79bcd-8d42-4366-9223-9027c0d40901\") " pod="openshift-ingress/e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h"
Sep 16 12:20:30.458501 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:30.458481    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fwqt\" (UniqueName: \"kubernetes.io/projected/9dd79bcd-8d42-4366-9223-9027c0d40901-kube-api-access-8fwqt\") pod \"e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h\" (UID: \"9dd79bcd-8d42-4366-9223-9027c0d40901\") " pod="openshift-ingress/e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h"
Sep 16 12:20:30.458589 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:30.458568    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9dd79bcd-8d42-4366-9223-9027c0d40901-istio-token\") pod \"e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h\" (UID: \"9dd79bcd-8d42-4366-9223-9027c0d40901\") " pod="openshift-ingress/e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h"
Sep 16 12:20:30.471480 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:30.471458    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:30.557248 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:30.557161    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h"
Sep 16 12:20:30.835967 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:30.835932    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h"]
Sep 16 12:20:30.836368 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:20:30.836342    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9dd79bcd_8d42_4366_9223_9027c0d40901.slice/crio-14ffa531a0dddab0b6de450868f7e09b234d761f2f9f9c60c515eb50e666d90f WatchSource:0}: Error finding container 14ffa531a0dddab0b6de450868f7e09b234d761f2f9f9c60c515eb50e666d90f: Status 404 returned error can't find the container with id 14ffa531a0dddab0b6de450868f7e09b234d761f2f9f9c60c515eb50e666d90f
Sep 16 12:20:30.838610 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:30.838579    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:20:30.838688 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:30.838645    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:20:30.838688 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:30.838675    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:20:30.901814 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:30.901782    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h" event={"ID":"9dd79bcd-8d42-4366-9223-9027c0d40901","Type":"ContainerStarted","Data":"864b9b08c578ea22a2bdb4d8ecc291506d5f574e9b228b3c6d595e5bca672652"}
Sep 16 12:20:30.902180 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:30.901892    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h" event={"ID":"9dd79bcd-8d42-4366-9223-9027c0d40901","Type":"ContainerStarted","Data":"14ffa531a0dddab0b6de450868f7e09b234d761f2f9f9c60c515eb50e666d90f"}
Sep 16 12:20:30.924279 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:30.924205    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h" podStartSLOduration=0.924180334 podStartE2EDuration="924.180334ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:20:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:20:30.923533517 +0000 UTC m=+1197.543852848" watchObservedRunningTime="2026-09-16 12:20:30.924180334 +0000 UTC m=+1197.544499647"
Sep 16 12:20:31.329859 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:31.329814    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:31.557910 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:31.557874    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h"
Sep 16 12:20:31.563542 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:31.563518    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h"
Sep 16 12:20:31.914733 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:31.914694    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h"
Sep 16 12:20:31.915591 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:31.915572    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h"
Sep 16 12:20:32.031359 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:32.031324    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:32.476082 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:32.476042    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:32.539970 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:32.539937    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:32.923191 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:32.923162    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:33.728880 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:33.728849    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:33.905797 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:33.905766    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-hrvzp_63ee784a-3b40-4259-9923-74a24d0203a0/console-operator/5.log"
Sep 16 12:20:33.906012 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:33.906000    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-hrvzp_63ee784a-3b40-4259-9923-74a24d0203a0/console-operator/5.log"
Sep 16 12:20:34.401440 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:34.401408    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:35.033920 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:35.033887    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:35.133899 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:35.133865    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:35.342329 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:35.342235    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:35.506071 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:35.506029    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:35.601484 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:35.601385    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:35.680110 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:35.680062    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:36.015202 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:36.015173    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:20:36.044294 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:36.044256    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:36.858126 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:36.858092    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:37.698721 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:37.698683    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:38.431276 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:38.431225    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:50.806432 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:50.806397    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:20:53.399856 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:53.399806    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:55.034571 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:55.034535    2559 generic.go:356] "Generic (PLEG): container finished" podID="9dd79bcd-8d42-4366-9223-9027c0d40901" containerID="864b9b08c578ea22a2bdb4d8ecc291506d5f574e9b228b3c6d595e5bca672652" exitCode=0
Sep 16 12:20:55.035111 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:55.034580    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h" event={"ID":"9dd79bcd-8d42-4366-9223-9027c0d40901","Type":"ContainerDied","Data":"864b9b08c578ea22a2bdb4d8ecc291506d5f574e9b228b3c6d595e5bca672652"}
Sep 16 12:20:55.035111 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:55.035079    2559 scope.go:117] "RemoveContainer" containerID="864b9b08c578ea22a2bdb4d8ecc291506d5f574e9b228b3c6d595e5bca672652"
Sep 16 12:20:55.036323 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:55.036293    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:20:55.036436 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:55.036373    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:20:55.036436 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:55.036419    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:20:55.938155 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:55.935396    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:56.048820 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:56.048785    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h" event={"ID":"9dd79bcd-8d42-4366-9223-9027c0d40901","Type":"ContainerStarted","Data":"6f705641611dd089325246cd0f648cd736685a46ddf1dbaba6dde6c4a01e748e"}
Sep 16 12:20:56.557888 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:56.557854    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h"
Sep 16 12:20:56.558299 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:56.558204    2559 patch_prober.go:28] interesting pod/e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Sep 16 12:20:56.558486 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:56.558462    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h" podUID="9dd79bcd-8d42-4366-9223-9027c0d40901" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Sep 16 12:20:57.267783 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:57.267746    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:57.434895 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:57.434862    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b6f4a170-28x9n"]
Sep 16 12:20:57.439475 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:57.439450    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b6f4a170-28x9n"
Sep 16 12:20:57.445144 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:57.445105    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hvtv7\""
Sep 16 12:20:57.449907 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:57.449820    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b6f4a170-28x9n"]
Sep 16 12:20:57.524031 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:57.523946    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb22b652-748a-48c8-a36c-67f027243693-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-b6f4a170-28x9n\" (UID: \"fb22b652-748a-48c8-a36c-67f027243693\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b6f4a170-28x9n"
Sep 16 12:20:57.560576 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:57.560542    2559 patch_prober.go:28] interesting pod/e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Sep 16 12:20:57.560765 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:57.560598    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h" podUID="9dd79bcd-8d42-4366-9223-9027c0d40901" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Sep 16 12:20:57.625467 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:57.625432    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb22b652-748a-48c8-a36c-67f027243693-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-b6f4a170-28x9n\" (UID: \"fb22b652-748a-48c8-a36c-67f027243693\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b6f4a170-28x9n"
Sep 16 12:20:57.626084 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:57.626063    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb22b652-748a-48c8-a36c-67f027243693-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-b6f4a170-28x9n\" (UID: \"fb22b652-748a-48c8-a36c-67f027243693\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b6f4a170-28x9n"
Sep 16 12:20:57.764763 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:57.764730    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b6f4a170-28x9n"
Sep 16 12:20:58.039166 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:58.035957    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b6f4a170-28x9n"]
Sep 16 12:20:58.074371 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:58.074333    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b6f4a170-28x9n" event={"ID":"fb22b652-748a-48c8-a36c-67f027243693","Type":"ContainerStarted","Data":"ed911d500df439df47ae5c7b9a6eb608fa38329ae84790568625330419630e4e"}
Sep 16 12:20:58.246847 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:58.246724    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:58.558291 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:58.557774    2559 patch_prober.go:28] interesting pod/e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Sep 16 12:20:58.558291 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:58.557840    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h" podUID="9dd79bcd-8d42-4366-9223-9027c0d40901" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Sep 16 12:20:59.081147 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:59.081101    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b6f4a170-28x9n" event={"ID":"fb22b652-748a-48c8-a36c-67f027243693","Type":"ContainerStarted","Data":"4cc850a87ad9051cd324bb6060d71476bec5989a1129b0a08f4eee44c0cc590f"}
Sep 16 12:20:59.096290 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:59.096250    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b6f4a170-28x9n" podStartSLOduration=2.096236127 podStartE2EDuration="2.096236127s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:20:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:20:59.095504601 +0000 UTC m=+1225.715823933" watchObservedRunningTime="2026-09-16 12:20:59.096236127 +0000 UTC m=+1225.716555443"
Sep 16 12:20:59.151779 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:59.150995    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:20:59.557656 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:59.557619    2559 patch_prober.go:28] interesting pod/e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Sep 16 12:20:59.557980 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:59.557940    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h" podUID="9dd79bcd-8d42-4366-9223-9027c0d40901" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Sep 16 12:20:59.845307 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:20:59.845207    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:21:00.088809 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:00.088775    2559 generic.go:356] "Generic (PLEG): container finished" podID="fb22b652-748a-48c8-a36c-67f027243693" containerID="4cc850a87ad9051cd324bb6060d71476bec5989a1129b0a08f4eee44c0cc590f" exitCode=0
Sep 16 12:21:00.088998 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:00.088826    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b6f4a170-28x9n" event={"ID":"fb22b652-748a-48c8-a36c-67f027243693","Type":"ContainerDied","Data":"4cc850a87ad9051cd324bb6060d71476bec5989a1129b0a08f4eee44c0cc590f"}
Sep 16 12:21:00.548097 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:00.548050    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:21:00.558712 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:00.558674    2559 patch_prober.go:28] interesting pod/e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Sep 16 12:21:00.558878 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:00.558756    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h" podUID="9dd79bcd-8d42-4366-9223-9027c0d40901" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Sep 16 12:21:01.223024 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:01.222991    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:21:01.248115 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:01.248084    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b6f4a170-28x9n"
Sep 16 12:21:01.373973 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:01.373887    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb22b652-748a-48c8-a36c-67f027243693-maas-api-service-ca\") pod \"fb22b652-748a-48c8-a36c-67f027243693\" (UID: \"fb22b652-748a-48c8-a36c-67f027243693\") "
Sep 16 12:21:01.374250 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:01.374225    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb22b652-748a-48c8-a36c-67f027243693-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "fb22b652-748a-48c8-a36c-67f027243693" (UID: "fb22b652-748a-48c8-a36c-67f027243693"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:21:01.475072 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:01.475043    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb22b652-748a-48c8-a36c-67f027243693-maas-api-service-ca\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:21:01.562307 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:01.562276    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h"
Sep 16 12:21:01.562681 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:01.562655    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h"
Sep 16 12:21:01.563544 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:01.563526    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h"
Sep 16 12:21:01.863331 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:01.863295    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:21:02.102310 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:02.102270    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b6f4a170-28x9n" event={"ID":"fb22b652-748a-48c8-a36c-67f027243693","Type":"ContainerDied","Data":"ed911d500df439df47ae5c7b9a6eb608fa38329ae84790568625330419630e4e"}
Sep 16 12:21:02.102310 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:02.102293    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b6f4a170-28x9n"
Sep 16 12:21:02.102511 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:02.102326    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ed911d500df439df47ae5c7b9a6eb608fa38329ae84790568625330419630e4e"
Sep 16 12:21:02.462474 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:02.462442    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:21:03.617698 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:03.617667    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:21:04.153039 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:04.152989    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:21:04.220599 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:04.220564    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:21:04.281160 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:04.281100    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:21:04.314703 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:04.314670    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b6f4a170-28x9n"]
Sep 16 12:21:04.318040 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:04.318015    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b6f4a170-28x9n"]
Sep 16 12:21:04.382985 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:04.382917    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:21:04.459827 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:04.459728    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h"]
Sep 16 12:21:04.460062 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:04.460032    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h" podUID="9dd79bcd-8d42-4366-9223-9027c0d40901" containerName="istio-proxy" containerID="cri-o://6f705641611dd089325246cd0f648cd736685a46ddf1dbaba6dde6c4a01e748e" gracePeriod=30
Sep 16 12:21:04.482875 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:04.482846    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:21:04.735914 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:04.735821    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:21:04.922974 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:04.922930    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:21:05.222378 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:05.222345    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:21:05.431498 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:05.431465    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:21:05.572119 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:05.572036    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:21:05.938574 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:05.938546    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb22b652-748a-48c8-a36c-67f027243693" path="/var/lib/kubelet/pods/fb22b652-748a-48c8-a36c-67f027243693/volumes"
Sep 16 12:21:06.412874 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:06.412845    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:21:08.135150 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:08.135110    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:21:08.321279 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:08.321246    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:21:08.957869 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:08.957834    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:21:09.632775 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:09.632735    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:21:09.695521 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:09.695493    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:21:09.717847 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:09.717826    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h"
Sep 16 12:21:09.759169 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:09.759038    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9dd79bcd-8d42-4366-9223-9027c0d40901-workload-socket\") pod \"9dd79bcd-8d42-4366-9223-9027c0d40901\" (UID: \"9dd79bcd-8d42-4366-9223-9027c0d40901\") "
Sep 16 12:21:09.759344 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:09.759171    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9dd79bcd-8d42-4366-9223-9027c0d40901-istio-token\") pod \"9dd79bcd-8d42-4366-9223-9027c0d40901\" (UID: \"9dd79bcd-8d42-4366-9223-9027c0d40901\") "
Sep 16 12:21:09.759344 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:09.759210    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9dd79bcd-8d42-4366-9223-9027c0d40901-workload-certs\") pod \"9dd79bcd-8d42-4366-9223-9027c0d40901\" (UID: \"9dd79bcd-8d42-4366-9223-9027c0d40901\") "
Sep 16 12:21:09.759344 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:09.759240    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9dd79bcd-8d42-4366-9223-9027c0d40901-istio-envoy\") pod \"9dd79bcd-8d42-4366-9223-9027c0d40901\" (UID: \"9dd79bcd-8d42-4366-9223-9027c0d40901\") "
Sep 16 12:21:09.759344 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:09.759283    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9dd79bcd-8d42-4366-9223-9027c0d40901-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9dd79bcd-8d42-4366-9223-9027c0d40901" (UID: "9dd79bcd-8d42-4366-9223-9027c0d40901"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:21:09.759344 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:09.759339    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8fwqt\" (UniqueName: \"kubernetes.io/projected/9dd79bcd-8d42-4366-9223-9027c0d40901-kube-api-access-8fwqt\") pod \"9dd79bcd-8d42-4366-9223-9027c0d40901\" (UID: \"9dd79bcd-8d42-4366-9223-9027c0d40901\") "
Sep 16 12:21:09.760471 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:09.759368    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9dd79bcd-8d42-4366-9223-9027c0d40901-istio-podinfo\") pod \"9dd79bcd-8d42-4366-9223-9027c0d40901\" (UID: \"9dd79bcd-8d42-4366-9223-9027c0d40901\") "
Sep 16 12:21:09.760471 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:09.759397    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9dd79bcd-8d42-4366-9223-9027c0d40901-istio-data\") pod \"9dd79bcd-8d42-4366-9223-9027c0d40901\" (UID: \"9dd79bcd-8d42-4366-9223-9027c0d40901\") "
Sep 16 12:21:09.760471 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:09.759426    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9dd79bcd-8d42-4366-9223-9027c0d40901-credential-socket\") pod \"9dd79bcd-8d42-4366-9223-9027c0d40901\" (UID: \"9dd79bcd-8d42-4366-9223-9027c0d40901\") "
Sep 16 12:21:09.760471 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:09.759456    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9dd79bcd-8d42-4366-9223-9027c0d40901-istiod-ca-cert\") pod \"9dd79bcd-8d42-4366-9223-9027c0d40901\" (UID: \"9dd79bcd-8d42-4366-9223-9027c0d40901\") "
Sep 16 12:21:09.760471 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:09.759475    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9dd79bcd-8d42-4366-9223-9027c0d40901-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9dd79bcd-8d42-4366-9223-9027c0d40901" (UID: "9dd79bcd-8d42-4366-9223-9027c0d40901"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:21:09.760471 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:09.759759    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9dd79bcd-8d42-4366-9223-9027c0d40901-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9dd79bcd-8d42-4366-9223-9027c0d40901" (UID: "9dd79bcd-8d42-4366-9223-9027c0d40901"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:21:09.760471 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:09.759774    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9dd79bcd-8d42-4366-9223-9027c0d40901-workload-socket\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:21:09.760471 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:09.759813    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9dd79bcd-8d42-4366-9223-9027c0d40901-workload-certs\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:21:09.760471 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:09.760048    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9dd79bcd-8d42-4366-9223-9027c0d40901-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9dd79bcd-8d42-4366-9223-9027c0d40901" (UID: "9dd79bcd-8d42-4366-9223-9027c0d40901"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:21:09.760471 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:09.759679    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9dd79bcd-8d42-4366-9223-9027c0d40901-istio-data" (OuterVolumeSpecName: "istio-data") pod "9dd79bcd-8d42-4366-9223-9027c0d40901" (UID: "9dd79bcd-8d42-4366-9223-9027c0d40901"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:21:09.762045 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:09.762019    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9dd79bcd-8d42-4366-9223-9027c0d40901-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9dd79bcd-8d42-4366-9223-9027c0d40901" (UID: "9dd79bcd-8d42-4366-9223-9027c0d40901"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:21:09.762121 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:09.762055    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9dd79bcd-8d42-4366-9223-9027c0d40901-kube-api-access-8fwqt" (OuterVolumeSpecName: "kube-api-access-8fwqt") pod "9dd79bcd-8d42-4366-9223-9027c0d40901" (UID: "9dd79bcd-8d42-4366-9223-9027c0d40901"). InnerVolumeSpecName "kube-api-access-8fwqt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:21:09.762121 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:09.762059    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9dd79bcd-8d42-4366-9223-9027c0d40901-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9dd79bcd-8d42-4366-9223-9027c0d40901" (UID: "9dd79bcd-8d42-4366-9223-9027c0d40901"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 12:21:09.762284 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:09.762261    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9dd79bcd-8d42-4366-9223-9027c0d40901-istio-token" (OuterVolumeSpecName: "istio-token") pod "9dd79bcd-8d42-4366-9223-9027c0d40901" (UID: "9dd79bcd-8d42-4366-9223-9027c0d40901"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:21:09.861170 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:09.861117    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8fwqt\" (UniqueName: \"kubernetes.io/projected/9dd79bcd-8d42-4366-9223-9027c0d40901-kube-api-access-8fwqt\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:21:09.861170 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:09.861168    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9dd79bcd-8d42-4366-9223-9027c0d40901-istio-podinfo\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:21:09.861170 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:09.861177    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9dd79bcd-8d42-4366-9223-9027c0d40901-istio-data\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:21:09.861395 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:09.861186    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9dd79bcd-8d42-4366-9223-9027c0d40901-credential-socket\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:21:09.861395 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:09.861194    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9dd79bcd-8d42-4366-9223-9027c0d40901-istiod-ca-cert\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:21:09.861395 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:09.861202    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9dd79bcd-8d42-4366-9223-9027c0d40901-istio-token\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:21:09.861395 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:09.861209    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9dd79bcd-8d42-4366-9223-9027c0d40901-istio-envoy\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:21:09.900606 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:09.900571    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:21:10.124126 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:10.124035    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:21:10.149220 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:10.149187    2559 generic.go:356] "Generic (PLEG): container finished" podID="9dd79bcd-8d42-4366-9223-9027c0d40901" containerID="6f705641611dd089325246cd0f648cd736685a46ddf1dbaba6dde6c4a01e748e" exitCode=0
Sep 16 12:21:10.149375 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:10.149259    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h"
Sep 16 12:21:10.149375 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:10.149273    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h" event={"ID":"9dd79bcd-8d42-4366-9223-9027c0d40901","Type":"ContainerDied","Data":"6f705641611dd089325246cd0f648cd736685a46ddf1dbaba6dde6c4a01e748e"}
Sep 16 12:21:10.149375 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:10.149328    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h" event={"ID":"9dd79bcd-8d42-4366-9223-9027c0d40901","Type":"ContainerDied","Data":"14ffa531a0dddab0b6de450868f7e09b234d761f2f9f9c60c515eb50e666d90f"}
Sep 16 12:21:10.149375 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:10.149352    2559 scope.go:117] "RemoveContainer" containerID="6f705641611dd089325246cd0f648cd736685a46ddf1dbaba6dde6c4a01e748e"
Sep 16 12:21:10.159988 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:10.159966    2559 scope.go:117] "RemoveContainer" containerID="864b9b08c578ea22a2bdb4d8ecc291506d5f574e9b228b3c6d595e5bca672652"
Sep 16 12:21:10.167197 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:10.167166    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h"]
Sep 16 12:21:10.170325 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:10.170301    2559 scope.go:117] "RemoveContainer" containerID="6f705641611dd089325246cd0f648cd736685a46ddf1dbaba6dde6c4a01e748e"
Sep 16 12:21:10.170899 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:21:10.170719    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f705641611dd089325246cd0f648cd736685a46ddf1dbaba6dde6c4a01e748e\": container with ID starting with 6f705641611dd089325246cd0f648cd736685a46ddf1dbaba6dde6c4a01e748e not found: ID does not exist" containerID="6f705641611dd089325246cd0f648cd736685a46ddf1dbaba6dde6c4a01e748e"
Sep 16 12:21:10.170899 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:10.170769    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f705641611dd089325246cd0f648cd736685a46ddf1dbaba6dde6c4a01e748e"} err="failed to get container status \"6f705641611dd089325246cd0f648cd736685a46ddf1dbaba6dde6c4a01e748e\": rpc error: code = NotFound desc = could not find container \"6f705641611dd089325246cd0f648cd736685a46ddf1dbaba6dde6c4a01e748e\": container with ID starting with 6f705641611dd089325246cd0f648cd736685a46ddf1dbaba6dde6c4a01e748e not found: ID does not exist"
Sep 16 12:21:10.170899 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:10.170792    2559 scope.go:117] "RemoveContainer" containerID="864b9b08c578ea22a2bdb4d8ecc291506d5f574e9b228b3c6d595e5bca672652"
Sep 16 12:21:10.171276 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:21:10.171219    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"864b9b08c578ea22a2bdb4d8ecc291506d5f574e9b228b3c6d595e5bca672652\": container with ID starting with 864b9b08c578ea22a2bdb4d8ecc291506d5f574e9b228b3c6d595e5bca672652 not found: ID does not exist" containerID="864b9b08c578ea22a2bdb4d8ecc291506d5f574e9b228b3c6d595e5bca672652"
Sep 16 12:21:10.171276 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:10.171260    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"864b9b08c578ea22a2bdb4d8ecc291506d5f574e9b228b3c6d595e5bca672652"} err="failed to get container status \"864b9b08c578ea22a2bdb4d8ecc291506d5f574e9b228b3c6d595e5bca672652\": rpc error: code = NotFound desc = could not find container \"864b9b08c578ea22a2bdb4d8ecc291506d5f574e9b228b3c6d595e5bca672652\": container with ID starting with 864b9b08c578ea22a2bdb4d8ecc291506d5f574e9b228b3c6d595e5bca672652 not found: ID does not exist"
Sep 16 12:21:10.173269 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:10.173249    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-b6f4a170-gw-openshift-default-ddf4b9bb4-d4h9h"]
Sep 16 12:21:10.190191 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:10.190168    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:21:10.522401 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:10.522363    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:21:11.308899 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:11.308870    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:21:11.938351 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:11.938313    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9dd79bcd-8d42-4366-9223-9027c0d40901" path="/var/lib/kubelet/pods/9dd79bcd-8d42-4366-9223-9027c0d40901/volumes"
Sep 16 12:21:12.018808 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:12.018778    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:21:12.634222 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:12.634191    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:21:14.283406 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:14.283375    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:21:28.411667 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:28.411575    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:21:30.516274 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:30.516237    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:21:31.737834 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:31.737800    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:21:32.504200 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:32.504170    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:21:32.771159 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:32.771068    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:21:33.124093 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:33.123999    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:21:33.291188 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:33.291126    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f6101af5-pljrw"]
Sep 16 12:21:33.291643 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:33.291625    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb22b652-748a-48c8-a36c-67f027243693" containerName="revoke-keys"
Sep 16 12:21:33.291643 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:33.291641    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb22b652-748a-48c8-a36c-67f027243693" containerName="revoke-keys"
Sep 16 12:21:33.291796 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:33.291658    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9dd79bcd-8d42-4366-9223-9027c0d40901" containerName="istio-proxy"
Sep 16 12:21:33.291796 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:33.291663    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9dd79bcd-8d42-4366-9223-9027c0d40901" containerName="istio-proxy"
Sep 16 12:21:33.291796 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:33.291671    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9dd79bcd-8d42-4366-9223-9027c0d40901" containerName="istio-proxy"
Sep 16 12:21:33.291796 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:33.291676    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9dd79bcd-8d42-4366-9223-9027c0d40901" containerName="istio-proxy"
Sep 16 12:21:33.291796 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:33.291734    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb22b652-748a-48c8-a36c-67f027243693" containerName="revoke-keys"
Sep 16 12:21:33.291796 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:33.291743    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9dd79bcd-8d42-4366-9223-9027c0d40901" containerName="istio-proxy"
Sep 16 12:21:33.294852 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:33.294831    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f6101af5-pljrw"
Sep 16 12:21:33.297309 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:33.297292    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hvtv7\""
Sep 16 12:21:33.302769 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:33.302642    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f6101af5-pljrw"]
Sep 16 12:21:33.389946 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:33.389853    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b0d3832-6f11-4ef3-865a-9d5109a5b43e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f6101af5-pljrw\" (UID: \"1b0d3832-6f11-4ef3-865a-9d5109a5b43e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f6101af5-pljrw"
Sep 16 12:21:33.491348 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:33.491310    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b0d3832-6f11-4ef3-865a-9d5109a5b43e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f6101af5-pljrw\" (UID: \"1b0d3832-6f11-4ef3-865a-9d5109a5b43e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f6101af5-pljrw"
Sep 16 12:21:33.491940 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:33.491919    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b0d3832-6f11-4ef3-865a-9d5109a5b43e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f6101af5-pljrw\" (UID: \"1b0d3832-6f11-4ef3-865a-9d5109a5b43e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f6101af5-pljrw"
Sep 16 12:21:33.607339 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:33.607302    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f6101af5-pljrw"
Sep 16 12:21:33.876890 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:33.876733    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f6101af5-pljrw"]
Sep 16 12:21:33.879223 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:21:33.879191    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b0d3832_6f11_4ef3_865a_9d5109a5b43e.slice/crio-8f2cec0859d900da9f006b227c35a094e161f19feb1ed0e881910df7961bb526 WatchSource:0}: Error finding container 8f2cec0859d900da9f006b227c35a094e161f19feb1ed0e881910df7961bb526: Status 404 returned error can't find the container with id 8f2cec0859d900da9f006b227c35a094e161f19feb1ed0e881910df7961bb526
Sep 16 12:21:33.971223 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:33.971195    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:21:34.278197 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:34.278087    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f6101af5-pljrw" event={"ID":"1b0d3832-6f11-4ef3-865a-9d5109a5b43e","Type":"ContainerStarted","Data":"4d8734aa82e13742973c0f9af75f074efb120ff551a6f130c5e9e28fb05b05cd"}
Sep 16 12:21:34.278197 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:34.278166    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f6101af5-pljrw" event={"ID":"1b0d3832-6f11-4ef3-865a-9d5109a5b43e","Type":"ContainerStarted","Data":"8f2cec0859d900da9f006b227c35a094e161f19feb1ed0e881910df7961bb526"}
Sep 16 12:21:34.295584 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:34.295535    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f6101af5-pljrw" podStartSLOduration=1.295519378 podStartE2EDuration="1.295519378s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:21:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:21:34.293593694 +0000 UTC m=+1260.913913000" watchObservedRunningTime="2026-09-16 12:21:34.295519378 +0000 UTC m=+1260.915838695"
Sep 16 12:21:34.563121 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:34.563088    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:21:35.284746 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:35.284714    2559 generic.go:356] "Generic (PLEG): container finished" podID="1b0d3832-6f11-4ef3-865a-9d5109a5b43e" containerID="4d8734aa82e13742973c0f9af75f074efb120ff551a6f130c5e9e28fb05b05cd" exitCode=0
Sep 16 12:21:35.285179 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:35.284799    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f6101af5-pljrw" event={"ID":"1b0d3832-6f11-4ef3-865a-9d5109a5b43e","Type":"ContainerDied","Data":"4d8734aa82e13742973c0f9af75f074efb120ff551a6f130c5e9e28fb05b05cd"}
Sep 16 12:21:35.317868 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:35.317839    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:21:35.907896 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:35.907867    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:21:36.436279 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:36.436253    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f6101af5-pljrw"
Sep 16 12:21:36.523727 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:36.523698    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b0d3832-6f11-4ef3-865a-9d5109a5b43e-maas-api-service-ca\") pod \"1b0d3832-6f11-4ef3-865a-9d5109a5b43e\" (UID: \"1b0d3832-6f11-4ef3-865a-9d5109a5b43e\") "
Sep 16 12:21:36.524070 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:36.524045    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b0d3832-6f11-4ef3-865a-9d5109a5b43e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1b0d3832-6f11-4ef3-865a-9d5109a5b43e" (UID: "1b0d3832-6f11-4ef3-865a-9d5109a5b43e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:21:36.529505 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:36.529477    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:21:36.625078 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:36.625001    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b0d3832-6f11-4ef3-865a-9d5109a5b43e-maas-api-service-ca\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:21:37.280712 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:37.280680    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:21:37.297361 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:37.297336    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f6101af5-pljrw"
Sep 16 12:21:37.297525 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:37.297332    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f6101af5-pljrw" event={"ID":"1b0d3832-6f11-4ef3-865a-9d5109a5b43e","Type":"ContainerDied","Data":"8f2cec0859d900da9f006b227c35a094e161f19feb1ed0e881910df7961bb526"}
Sep 16 12:21:37.297525 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:37.297508    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8f2cec0859d900da9f006b227c35a094e161f19feb1ed0e881910df7961bb526"
Sep 16 12:21:37.891834 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:37.891798    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:21:38.683063 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:38.683030    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:21:39.234864 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:39.234831    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:21:39.335884 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:39.335845    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:21:39.423692 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:39.423658    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f6101af5-pljrw"]
Sep 16 12:21:39.425606 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:39.425579    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f6101af5-pljrw"]
Sep 16 12:21:39.425847 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:39.425664    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:21:39.488937 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:39.488835    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:21:39.798921 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:39.798814    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:21:39.938672 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:39.938638    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b0d3832-6f11-4ef3-865a-9d5109a5b43e" path="/var/lib/kubelet/pods/1b0d3832-6f11-4ef3-865a-9d5109a5b43e/volumes"
Sep 16 12:21:40.566402 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:40.566348    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:21:40.719622 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:40.719580    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:21:41.157764 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:41.157723    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:21:41.260160 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:41.260116    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:21:41.476293 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:41.476205    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb"]
Sep 16 12:21:41.476672 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:41.476656    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b0d3832-6f11-4ef3-865a-9d5109a5b43e" containerName="revoke-keys"
Sep 16 12:21:41.476672 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:41.476670    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b0d3832-6f11-4ef3-865a-9d5109a5b43e" containerName="revoke-keys"
Sep 16 12:21:41.476769 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:41.476743    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9dd79bcd-8d42-4366-9223-9027c0d40901" containerName="istio-proxy"
Sep 16 12:21:41.476769 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:41.476756    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b0d3832-6f11-4ef3-865a-9d5109a5b43e" containerName="revoke-keys"
Sep 16 12:21:41.480001 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:41.479985    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb"
Sep 16 12:21:41.482897 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:41.482872    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-d6af8fa6-openshift-default-dockercfg-v2jms\""
Sep 16 12:21:41.494550 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:41.494528    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb"]
Sep 16 12:21:41.500271 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:41.500246    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:21:41.678651 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:41.678611    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bq8pp\" (UniqueName: \"kubernetes.io/projected/3293c9d9-365a-4b8b-95a0-9867b00c9b95-kube-api-access-bq8pp\") pod \"e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb\" (UID: \"3293c9d9-365a-4b8b-95a0-9867b00c9b95\") " pod="openshift-ingress/e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb"
Sep 16 12:21:41.679061 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:41.678656    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3293c9d9-365a-4b8b-95a0-9867b00c9b95-workload-certs\") pod \"e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb\" (UID: \"3293c9d9-365a-4b8b-95a0-9867b00c9b95\") " pod="openshift-ingress/e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb"
Sep 16 12:21:41.679061 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:41.678714    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3293c9d9-365a-4b8b-95a0-9867b00c9b95-istio-podinfo\") pod \"e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb\" (UID: \"3293c9d9-365a-4b8b-95a0-9867b00c9b95\") " pod="openshift-ingress/e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb"
Sep 16 12:21:41.679061 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:41.678773    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3293c9d9-365a-4b8b-95a0-9867b00c9b95-istio-token\") pod \"e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb\" (UID: \"3293c9d9-365a-4b8b-95a0-9867b00c9b95\") " pod="openshift-ingress/e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb"
Sep 16 12:21:41.679061 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:41.678810    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3293c9d9-365a-4b8b-95a0-9867b00c9b95-credential-socket\") pod \"e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb\" (UID: \"3293c9d9-365a-4b8b-95a0-9867b00c9b95\") " pod="openshift-ingress/e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb"
Sep 16 12:21:41.679061 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:41.678852    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3293c9d9-365a-4b8b-95a0-9867b00c9b95-istiod-ca-cert\") pod \"e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb\" (UID: \"3293c9d9-365a-4b8b-95a0-9867b00c9b95\") " pod="openshift-ingress/e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb"
Sep 16 12:21:41.679061 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:41.678868    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3293c9d9-365a-4b8b-95a0-9867b00c9b95-istio-envoy\") pod \"e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb\" (UID: \"3293c9d9-365a-4b8b-95a0-9867b00c9b95\") " pod="openshift-ingress/e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb"
Sep 16 12:21:41.679061 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:41.678965    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3293c9d9-365a-4b8b-95a0-9867b00c9b95-istio-data\") pod \"e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb\" (UID: \"3293c9d9-365a-4b8b-95a0-9867b00c9b95\") " pod="openshift-ingress/e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb"
Sep 16 12:21:41.679061 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:41.679005    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3293c9d9-365a-4b8b-95a0-9867b00c9b95-workload-socket\") pod \"e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb\" (UID: \"3293c9d9-365a-4b8b-95a0-9867b00c9b95\") " pod="openshift-ingress/e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb"
Sep 16 12:21:41.779507 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:41.779431    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3293c9d9-365a-4b8b-95a0-9867b00c9b95-istio-podinfo\") pod \"e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb\" (UID: \"3293c9d9-365a-4b8b-95a0-9867b00c9b95\") " pod="openshift-ingress/e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb"
Sep 16 12:21:41.779507 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:41.779473    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3293c9d9-365a-4b8b-95a0-9867b00c9b95-istio-token\") pod \"e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb\" (UID: \"3293c9d9-365a-4b8b-95a0-9867b00c9b95\") " pod="openshift-ingress/e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb"
Sep 16 12:21:41.779507 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:41.779496    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3293c9d9-365a-4b8b-95a0-9867b00c9b95-credential-socket\") pod \"e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb\" (UID: \"3293c9d9-365a-4b8b-95a0-9867b00c9b95\") " pod="openshift-ingress/e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb"
Sep 16 12:21:41.779805 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:41.779534    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3293c9d9-365a-4b8b-95a0-9867b00c9b95-istiod-ca-cert\") pod \"e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb\" (UID: \"3293c9d9-365a-4b8b-95a0-9867b00c9b95\") " pod="openshift-ingress/e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb"
Sep 16 12:21:41.779805 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:41.779549    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3293c9d9-365a-4b8b-95a0-9867b00c9b95-istio-envoy\") pod \"e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb\" (UID: \"3293c9d9-365a-4b8b-95a0-9867b00c9b95\") " pod="openshift-ingress/e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb"
Sep 16 12:21:41.779805 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:41.779579    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3293c9d9-365a-4b8b-95a0-9867b00c9b95-istio-data\") pod \"e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb\" (UID: \"3293c9d9-365a-4b8b-95a0-9867b00c9b95\") " pod="openshift-ingress/e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb"
Sep 16 12:21:41.779805 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:41.779615    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3293c9d9-365a-4b8b-95a0-9867b00c9b95-workload-socket\") pod \"e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb\" (UID: \"3293c9d9-365a-4b8b-95a0-9867b00c9b95\") " pod="openshift-ingress/e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb"
Sep 16 12:21:41.779805 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:41.779672    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bq8pp\" (UniqueName: \"kubernetes.io/projected/3293c9d9-365a-4b8b-95a0-9867b00c9b95-kube-api-access-bq8pp\") pod \"e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb\" (UID: \"3293c9d9-365a-4b8b-95a0-9867b00c9b95\") " pod="openshift-ingress/e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb"
Sep 16 12:21:41.779805 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:41.779701    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3293c9d9-365a-4b8b-95a0-9867b00c9b95-workload-certs\") pod \"e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb\" (UID: \"3293c9d9-365a-4b8b-95a0-9867b00c9b95\") " pod="openshift-ingress/e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb"
Sep 16 12:21:41.780146 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:41.779974    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3293c9d9-365a-4b8b-95a0-9867b00c9b95-credential-socket\") pod \"e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb\" (UID: \"3293c9d9-365a-4b8b-95a0-9867b00c9b95\") " pod="openshift-ingress/e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb"
Sep 16 12:21:41.780146 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:41.780063    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3293c9d9-365a-4b8b-95a0-9867b00c9b95-workload-certs\") pod \"e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb\" (UID: \"3293c9d9-365a-4b8b-95a0-9867b00c9b95\") " pod="openshift-ingress/e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb"
Sep 16 12:21:41.780146 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:41.780084    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3293c9d9-365a-4b8b-95a0-9867b00c9b95-workload-socket\") pod \"e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb\" (UID: \"3293c9d9-365a-4b8b-95a0-9867b00c9b95\") " pod="openshift-ingress/e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb"
Sep 16 12:21:41.780419 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:41.780396    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3293c9d9-365a-4b8b-95a0-9867b00c9b95-istiod-ca-cert\") pod \"e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb\" (UID: \"3293c9d9-365a-4b8b-95a0-9867b00c9b95\") " pod="openshift-ingress/e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb"
Sep 16 12:21:41.780460 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:41.780445    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3293c9d9-365a-4b8b-95a0-9867b00c9b95-istio-data\") pod \"e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb\" (UID: \"3293c9d9-365a-4b8b-95a0-9867b00c9b95\") " pod="openshift-ingress/e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb"
Sep 16 12:21:41.781845 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:41.781824    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3293c9d9-365a-4b8b-95a0-9867b00c9b95-istio-envoy\") pod \"e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb\" (UID: \"3293c9d9-365a-4b8b-95a0-9867b00c9b95\") " pod="openshift-ingress/e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb"
Sep 16 12:21:41.781968 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:41.781951    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3293c9d9-365a-4b8b-95a0-9867b00c9b95-istio-podinfo\") pod \"e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb\" (UID: \"3293c9d9-365a-4b8b-95a0-9867b00c9b95\") " pod="openshift-ingress/e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb"
Sep 16 12:21:41.794927 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:41.794904    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bq8pp\" (UniqueName: \"kubernetes.io/projected/3293c9d9-365a-4b8b-95a0-9867b00c9b95-kube-api-access-bq8pp\") pod \"e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb\" (UID: \"3293c9d9-365a-4b8b-95a0-9867b00c9b95\") " pod="openshift-ingress/e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb"
Sep 16 12:21:41.794927 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:41.794915    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3293c9d9-365a-4b8b-95a0-9867b00c9b95-istio-token\") pod \"e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb\" (UID: \"3293c9d9-365a-4b8b-95a0-9867b00c9b95\") " pod="openshift-ingress/e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb"
Sep 16 12:21:41.909177 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:41.909117    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:21:42.090689 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:42.090605    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb"
Sep 16 12:21:42.226478 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:42.226445    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:21:42.363821 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:42.363796    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb"]
Sep 16 12:21:42.365610 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:21:42.365583    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3293c9d9_365a_4b8b_95a0_9867b00c9b95.slice/crio-89eefb00a203a294a15866892e34ad5fe82a9b85d82aa5f70e15005386609297 WatchSource:0}: Error finding container 89eefb00a203a294a15866892e34ad5fe82a9b85d82aa5f70e15005386609297: Status 404 returned error can't find the container with id 89eefb00a203a294a15866892e34ad5fe82a9b85d82aa5f70e15005386609297
Sep 16 12:21:42.367795 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:42.367763    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:21:42.367859 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:42.367830    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:21:42.367897 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:42.367858    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:21:42.903013 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:42.902933    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:21:43.334624 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:43.334527    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb" event={"ID":"3293c9d9-365a-4b8b-95a0-9867b00c9b95","Type":"ContainerStarted","Data":"ee69e9ee7288edbe304b4dace1a02cbbe586eb924d2e553a259865940dc962a1"}
Sep 16 12:21:43.334624 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:43.334593    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb" event={"ID":"3293c9d9-365a-4b8b-95a0-9867b00c9b95","Type":"ContainerStarted","Data":"89eefb00a203a294a15866892e34ad5fe82a9b85d82aa5f70e15005386609297"}
Sep 16 12:21:43.358872 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:43.358825    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb" podStartSLOduration=2.358809291 podStartE2EDuration="2.358809291s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:21:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:21:43.356982056 +0000 UTC m=+1269.977301388" watchObservedRunningTime="2026-09-16 12:21:43.358809291 +0000 UTC m=+1269.979128606"
Sep 16 12:21:43.536503 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:43.536461    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:21:44.091705 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:44.091674    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb"
Sep 16 12:21:44.097915 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:44.097889    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb"
Sep 16 12:21:44.208720 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:44.208684    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:21:44.340673 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:44.340635    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb"
Sep 16 12:21:44.341479 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:44.341460    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb"
Sep 16 12:21:44.708866 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:44.708818    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:21:44.811608 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:44.811572    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:21:45.031566 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:45.031470    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:21:45.826857 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:45.826824    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:21:46.722904 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:46.722867    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:21:47.366435 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:47.366406    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:21:47.499658 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:47.499624    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:21:48.139879 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:48.139841    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:21:48.415838 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:48.415808    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:21:48.829949 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:48.829853    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:21:48.932967 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:48.932932    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:21:49.138412 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:49.138321    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:21:49.371389 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:49.371346    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:21:49.471428 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:21:49.471391    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:22:04.897246 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:04.897209    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:22:10.827583 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:10.827549    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:22:11.527533 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:11.527493    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:22:12.208014 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:12.207977    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:22:13.041988 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:13.041925    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:22:13.729040 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:13.729010    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:22:14.461369 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:14.461331    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:22:14.736826 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:14.736733    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d6af8fa6-r4bqf"]
Sep 16 12:22:14.741364 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:14.741330    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d6af8fa6-r4bqf"
Sep 16 12:22:14.744102 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:14.744078    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hvtv7\""
Sep 16 12:22:14.749379 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:14.749353    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d6af8fa6-r4bqf"]
Sep 16 12:22:14.904828 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:14.904792    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c9c9247-957a-49ab-b967-e1f124c2e57b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-d6af8fa6-r4bqf\" (UID: \"1c9c9247-957a-49ab-b967-e1f124c2e57b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d6af8fa6-r4bqf"
Sep 16 12:22:15.005640 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:15.005545    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c9c9247-957a-49ab-b967-e1f124c2e57b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-d6af8fa6-r4bqf\" (UID: \"1c9c9247-957a-49ab-b967-e1f124c2e57b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d6af8fa6-r4bqf"
Sep 16 12:22:15.006224 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:15.006205    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c9c9247-957a-49ab-b967-e1f124c2e57b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-d6af8fa6-r4bqf\" (UID: \"1c9c9247-957a-49ab-b967-e1f124c2e57b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d6af8fa6-r4bqf"
Sep 16 12:22:15.068588 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:15.068551    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d6af8fa6-r4bqf"
Sep 16 12:22:15.343426 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:15.343325    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d6af8fa6-r4bqf"]
Sep 16 12:22:15.360126 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:15.360085    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:22:15.508338 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:15.508295    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d6af8fa6-r4bqf" event={"ID":"1c9c9247-957a-49ab-b967-e1f124c2e57b","Type":"ContainerStarted","Data":"2cbfad2e8973d990192d5361c354ef70394ad4139b00cb745f33e0c40be67f6a"}
Sep 16 12:22:16.147283 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:16.147152    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:22:16.515843 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:16.515813    2559 generic.go:356] "Generic (PLEG): container finished" podID="1c9c9247-957a-49ab-b967-e1f124c2e57b" containerID="7815dd7948827dfadfe75730baca720b5067d8f21088e867843fb47bc30d4704" exitCode=0
Sep 16 12:22:16.516034 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:16.515906    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d6af8fa6-r4bqf" event={"ID":"1c9c9247-957a-49ab-b967-e1f124c2e57b","Type":"ContainerDied","Data":"7815dd7948827dfadfe75730baca720b5067d8f21088e867843fb47bc30d4704"}
Sep 16 12:22:16.937543 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:16.937508    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:22:17.614613 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:17.614545    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:22:17.685247 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:17.685216    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d6af8fa6-r4bqf"
Sep 16 12:22:17.831630 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:17.831543    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c9c9247-957a-49ab-b967-e1f124c2e57b-maas-api-service-ca\") pod \"1c9c9247-957a-49ab-b967-e1f124c2e57b\" (UID: \"1c9c9247-957a-49ab-b967-e1f124c2e57b\") "
Sep 16 12:22:17.831886 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:17.831858    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c9c9247-957a-49ab-b967-e1f124c2e57b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1c9c9247-957a-49ab-b967-e1f124c2e57b" (UID: "1c9c9247-957a-49ab-b967-e1f124c2e57b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:22:17.932403 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:17.932367    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c9c9247-957a-49ab-b967-e1f124c2e57b-maas-api-service-ca\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:22:18.265901 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:18.265872    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:22:18.530935 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:18.530843    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d6af8fa6-r4bqf" event={"ID":"1c9c9247-957a-49ab-b967-e1f124c2e57b","Type":"ContainerDied","Data":"2cbfad2e8973d990192d5361c354ef70394ad4139b00cb745f33e0c40be67f6a"}
Sep 16 12:22:18.530935 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:18.530877    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d6af8fa6-r4bqf"
Sep 16 12:22:18.530935 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:18.530900    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2cbfad2e8973d990192d5361c354ef70394ad4139b00cb745f33e0c40be67f6a"
Sep 16 12:22:18.861590 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:18.861502    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:22:19.535487 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:19.535429    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:22:20.544351 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:20.544318    2559 generic.go:356] "Generic (PLEG): container finished" podID="3293c9d9-365a-4b8b-95a0-9867b00c9b95" containerID="ee69e9ee7288edbe304b4dace1a02cbbe586eb924d2e553a259865940dc962a1" exitCode=0
Sep 16 12:22:20.544775 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:20.544370    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb" event={"ID":"3293c9d9-365a-4b8b-95a0-9867b00c9b95","Type":"ContainerDied","Data":"ee69e9ee7288edbe304b4dace1a02cbbe586eb924d2e553a259865940dc962a1"}
Sep 16 12:22:20.544775 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:20.544752    2559 scope.go:117] "RemoveContainer" containerID="ee69e9ee7288edbe304b4dace1a02cbbe586eb924d2e553a259865940dc962a1"
Sep 16 12:22:20.545963 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:20.545937    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:22:20.546039 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:20.546000    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:22:20.546039 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:20.546030    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:22:21.558841 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:21.558798    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb" event={"ID":"3293c9d9-365a-4b8b-95a0-9867b00c9b95","Type":"ContainerStarted","Data":"8f04af207e2ba54361bcef9a182f4dd780d37344f65608c8250ad5de97302b41"}
Sep 16 12:22:22.090742 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:22.090700    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb"
Sep 16 12:22:22.091008 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:22.090983    2559 patch_prober.go:28] interesting pod/e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Sep 16 12:22:22.091059 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:22.091041    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb" podUID="3293c9d9-365a-4b8b-95a0-9867b00c9b95" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Sep 16 12:22:23.091213 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:23.091178    2559 patch_prober.go:28] interesting pod/e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Sep 16 12:22:23.091619 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:23.091233    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb" podUID="3293c9d9-365a-4b8b-95a0-9867b00c9b95" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Sep 16 12:22:24.091829 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:24.091795    2559 patch_prober.go:28] interesting pod/e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Sep 16 12:22:24.092234 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:24.091850    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb" podUID="3293c9d9-365a-4b8b-95a0-9867b00c9b95" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Sep 16 12:22:24.232803 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:24.232763    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:22:25.091288 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:25.091252    2559 patch_prober.go:28] interesting pod/e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Sep 16 12:22:25.091505 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:25.091332    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb" podUID="3293c9d9-365a-4b8b-95a0-9867b00c9b95" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Sep 16 12:22:26.015006 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:26.014963    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:22:26.091424 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:26.091385    2559 patch_prober.go:28] interesting pod/e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Sep 16 12:22:26.091602 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:26.091445    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb" podUID="3293c9d9-365a-4b8b-95a0-9867b00c9b95" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Sep 16 12:22:26.705521 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:26.705491    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:22:26.779368 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:26.779339    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:22:26.840582 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:26.840541    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:22:26.902118 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:26.902085    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d6af8fa6-r4bqf"]
Sep 16 12:22:26.906825 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:26.906801    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d6af8fa6-r4bqf"]
Sep 16 12:22:26.908739 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:26.908713    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:22:26.972798 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:26.972710    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:22:27.034627 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:27.034595    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb"]
Sep 16 12:22:27.035018 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:27.034840    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb" podUID="3293c9d9-365a-4b8b-95a0-9867b00c9b95" containerName="istio-proxy" containerID="cri-o://8f04af207e2ba54361bcef9a182f4dd780d37344f65608c8250ad5de97302b41" gracePeriod=30
Sep 16 12:22:27.058605 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:27.058554    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:22:27.302405 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:27.302322    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:22:27.752392 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:27.752359    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:22:27.854362 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:27.854326    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:22:27.939271 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:27.939239    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c9c9247-957a-49ab-b967-e1f124c2e57b" path="/var/lib/kubelet/pods/1c9c9247-957a-49ab-b967-e1f124c2e57b/volumes"
Sep 16 12:22:27.956277 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:27.956252    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:22:28.343058 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:28.343028    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:22:28.983841 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:28.983805    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:22:29.340615 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:29.340532    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb"
Sep 16 12:22:29.435047 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:29.435013    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:22:29.752319 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:29.752279    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:22:30.422957 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:30.422907    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:22:31.011170 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:31.011124    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:22:31.195489 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:31.195448    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:22:32.297383 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:32.297323    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb"
Sep 16 12:22:32.371574 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:32.371547    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3293c9d9-365a-4b8b-95a0-9867b00c9b95-credential-socket\") pod \"3293c9d9-365a-4b8b-95a0-9867b00c9b95\" (UID: \"3293c9d9-365a-4b8b-95a0-9867b00c9b95\") "
Sep 16 12:22:32.371794 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:32.371618    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3293c9d9-365a-4b8b-95a0-9867b00c9b95-istiod-ca-cert\") pod \"3293c9d9-365a-4b8b-95a0-9867b00c9b95\" (UID: \"3293c9d9-365a-4b8b-95a0-9867b00c9b95\") "
Sep 16 12:22:32.371794 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:32.371742    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bq8pp\" (UniqueName: \"kubernetes.io/projected/3293c9d9-365a-4b8b-95a0-9867b00c9b95-kube-api-access-bq8pp\") pod \"3293c9d9-365a-4b8b-95a0-9867b00c9b95\" (UID: \"3293c9d9-365a-4b8b-95a0-9867b00c9b95\") "
Sep 16 12:22:32.371794 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:32.371785    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3293c9d9-365a-4b8b-95a0-9867b00c9b95-istio-data\") pod \"3293c9d9-365a-4b8b-95a0-9867b00c9b95\" (UID: \"3293c9d9-365a-4b8b-95a0-9867b00c9b95\") "
Sep 16 12:22:32.371980 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:32.371801    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3293c9d9-365a-4b8b-95a0-9867b00c9b95-workload-socket\") pod \"3293c9d9-365a-4b8b-95a0-9867b00c9b95\" (UID: \"3293c9d9-365a-4b8b-95a0-9867b00c9b95\") "
Sep 16 12:22:32.371980 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:32.371820    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3293c9d9-365a-4b8b-95a0-9867b00c9b95-istio-envoy\") pod \"3293c9d9-365a-4b8b-95a0-9867b00c9b95\" (UID: \"3293c9d9-365a-4b8b-95a0-9867b00c9b95\") "
Sep 16 12:22:32.371980 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:32.371840    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3293c9d9-365a-4b8b-95a0-9867b00c9b95-workload-certs\") pod \"3293c9d9-365a-4b8b-95a0-9867b00c9b95\" (UID: \"3293c9d9-365a-4b8b-95a0-9867b00c9b95\") "
Sep 16 12:22:32.371980 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:32.371877    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3293c9d9-365a-4b8b-95a0-9867b00c9b95-istio-token\") pod \"3293c9d9-365a-4b8b-95a0-9867b00c9b95\" (UID: \"3293c9d9-365a-4b8b-95a0-9867b00c9b95\") "
Sep 16 12:22:32.371980 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:32.371873    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3293c9d9-365a-4b8b-95a0-9867b00c9b95-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3293c9d9-365a-4b8b-95a0-9867b00c9b95" (UID: "3293c9d9-365a-4b8b-95a0-9867b00c9b95"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:22:32.371980 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:32.371935    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3293c9d9-365a-4b8b-95a0-9867b00c9b95-istio-podinfo\") pod \"3293c9d9-365a-4b8b-95a0-9867b00c9b95\" (UID: \"3293c9d9-365a-4b8b-95a0-9867b00c9b95\") "
Sep 16 12:22:32.372296 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:32.372041    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3293c9d9-365a-4b8b-95a0-9867b00c9b95-istio-data" (OuterVolumeSpecName: "istio-data") pod "3293c9d9-365a-4b8b-95a0-9867b00c9b95" (UID: "3293c9d9-365a-4b8b-95a0-9867b00c9b95"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:22:32.372296 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:32.372073    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3293c9d9-365a-4b8b-95a0-9867b00c9b95-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3293c9d9-365a-4b8b-95a0-9867b00c9b95" (UID: "3293c9d9-365a-4b8b-95a0-9867b00c9b95"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:22:32.372296 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:32.372101    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3293c9d9-365a-4b8b-95a0-9867b00c9b95-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3293c9d9-365a-4b8b-95a0-9867b00c9b95" (UID: "3293c9d9-365a-4b8b-95a0-9867b00c9b95"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:22:32.372296 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:32.372173    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3293c9d9-365a-4b8b-95a0-9867b00c9b95-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3293c9d9-365a-4b8b-95a0-9867b00c9b95" (UID: "3293c9d9-365a-4b8b-95a0-9867b00c9b95"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:22:32.372483 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:32.372391    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3293c9d9-365a-4b8b-95a0-9867b00c9b95-istio-data\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:22:32.372483 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:32.372408    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3293c9d9-365a-4b8b-95a0-9867b00c9b95-workload-socket\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:22:32.372483 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:32.372423    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3293c9d9-365a-4b8b-95a0-9867b00c9b95-workload-certs\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:22:32.372483 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:32.372436    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3293c9d9-365a-4b8b-95a0-9867b00c9b95-credential-socket\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:22:32.372483 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:32.372448    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3293c9d9-365a-4b8b-95a0-9867b00c9b95-istiod-ca-cert\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:22:32.374046 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:32.374019    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3293c9d9-365a-4b8b-95a0-9867b00c9b95-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3293c9d9-365a-4b8b-95a0-9867b00c9b95" (UID: "3293c9d9-365a-4b8b-95a0-9867b00c9b95"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:22:32.374178 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:32.374090    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3293c9d9-365a-4b8b-95a0-9867b00c9b95-kube-api-access-bq8pp" (OuterVolumeSpecName: "kube-api-access-bq8pp") pod "3293c9d9-365a-4b8b-95a0-9867b00c9b95" (UID: "3293c9d9-365a-4b8b-95a0-9867b00c9b95"). InnerVolumeSpecName "kube-api-access-bq8pp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:22:32.374439 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:32.374407    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3293c9d9-365a-4b8b-95a0-9867b00c9b95-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3293c9d9-365a-4b8b-95a0-9867b00c9b95" (UID: "3293c9d9-365a-4b8b-95a0-9867b00c9b95"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 12:22:32.374439 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:32.374430    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3293c9d9-365a-4b8b-95a0-9867b00c9b95-istio-token" (OuterVolumeSpecName: "istio-token") pod "3293c9d9-365a-4b8b-95a0-9867b00c9b95" (UID: "3293c9d9-365a-4b8b-95a0-9867b00c9b95"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:22:32.473675 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:32.473639    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bq8pp\" (UniqueName: \"kubernetes.io/projected/3293c9d9-365a-4b8b-95a0-9867b00c9b95-kube-api-access-bq8pp\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:22:32.473675 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:32.473670    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3293c9d9-365a-4b8b-95a0-9867b00c9b95-istio-envoy\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:22:32.473875 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:32.473684    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3293c9d9-365a-4b8b-95a0-9867b00c9b95-istio-token\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:22:32.473875 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:32.473696    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3293c9d9-365a-4b8b-95a0-9867b00c9b95-istio-podinfo\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:22:32.619584 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:32.619496    2559 generic.go:356] "Generic (PLEG): container finished" podID="3293c9d9-365a-4b8b-95a0-9867b00c9b95" containerID="8f04af207e2ba54361bcef9a182f4dd780d37344f65608c8250ad5de97302b41" exitCode=0
Sep 16 12:22:32.619584 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:32.619552    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb"
Sep 16 12:22:32.619831 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:32.619615    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb" event={"ID":"3293c9d9-365a-4b8b-95a0-9867b00c9b95","Type":"ContainerDied","Data":"8f04af207e2ba54361bcef9a182f4dd780d37344f65608c8250ad5de97302b41"}
Sep 16 12:22:32.619831 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:32.619680    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb" event={"ID":"3293c9d9-365a-4b8b-95a0-9867b00c9b95","Type":"ContainerDied","Data":"89eefb00a203a294a15866892e34ad5fe82a9b85d82aa5f70e15005386609297"}
Sep 16 12:22:32.619831 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:32.619711    2559 scope.go:117] "RemoveContainer" containerID="8f04af207e2ba54361bcef9a182f4dd780d37344f65608c8250ad5de97302b41"
Sep 16 12:22:32.629500 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:32.629483    2559 scope.go:117] "RemoveContainer" containerID="ee69e9ee7288edbe304b4dace1a02cbbe586eb924d2e553a259865940dc962a1"
Sep 16 12:22:32.637471 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:32.637452    2559 scope.go:117] "RemoveContainer" containerID="8f04af207e2ba54361bcef9a182f4dd780d37344f65608c8250ad5de97302b41"
Sep 16 12:22:32.637740 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:22:32.637716    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f04af207e2ba54361bcef9a182f4dd780d37344f65608c8250ad5de97302b41\": container with ID starting with 8f04af207e2ba54361bcef9a182f4dd780d37344f65608c8250ad5de97302b41 not found: ID does not exist" containerID="8f04af207e2ba54361bcef9a182f4dd780d37344f65608c8250ad5de97302b41"
Sep 16 12:22:32.637790 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:32.637749    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f04af207e2ba54361bcef9a182f4dd780d37344f65608c8250ad5de97302b41"} err="failed to get container status \"8f04af207e2ba54361bcef9a182f4dd780d37344f65608c8250ad5de97302b41\": rpc error: code = NotFound desc = could not find container \"8f04af207e2ba54361bcef9a182f4dd780d37344f65608c8250ad5de97302b41\": container with ID starting with 8f04af207e2ba54361bcef9a182f4dd780d37344f65608c8250ad5de97302b41 not found: ID does not exist"
Sep 16 12:22:32.637790 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:32.637768    2559 scope.go:117] "RemoveContainer" containerID="ee69e9ee7288edbe304b4dace1a02cbbe586eb924d2e553a259865940dc962a1"
Sep 16 12:22:32.638017 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:22:32.638002    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee69e9ee7288edbe304b4dace1a02cbbe586eb924d2e553a259865940dc962a1\": container with ID starting with ee69e9ee7288edbe304b4dace1a02cbbe586eb924d2e553a259865940dc962a1 not found: ID does not exist" containerID="ee69e9ee7288edbe304b4dace1a02cbbe586eb924d2e553a259865940dc962a1"
Sep 16 12:22:32.638070 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:32.638021    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee69e9ee7288edbe304b4dace1a02cbbe586eb924d2e553a259865940dc962a1"} err="failed to get container status \"ee69e9ee7288edbe304b4dace1a02cbbe586eb924d2e553a259865940dc962a1\": rpc error: code = NotFound desc = could not find container \"ee69e9ee7288edbe304b4dace1a02cbbe586eb924d2e553a259865940dc962a1\": container with ID starting with ee69e9ee7288edbe304b4dace1a02cbbe586eb924d2e553a259865940dc962a1 not found: ID does not exist"
Sep 16 12:22:32.641414 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:32.641393    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb"]
Sep 16 12:22:32.643279 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:32.643260    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-d6af8fa6-openshift-default-5c784979b8-sj5qb"]
Sep 16 12:22:33.938787 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:33.938755    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3293c9d9-365a-4b8b-95a0-9867b00c9b95" path="/var/lib/kubelet/pods/3293c9d9-365a-4b8b-95a0-9867b00c9b95/volumes"
Sep 16 12:22:35.122267 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:35.122231    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:22:35.192297 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:35.192262    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:22:35.368339 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:35.368300    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:22:35.471746 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:35.471714    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:22:35.923829 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:35.923796    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:22:52.436266 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:52.436233    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:22:56.905425 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:56.905327    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-7c3429-ktqjv"]
Sep 16 12:22:56.905889 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:56.905815    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c9c9247-957a-49ab-b967-e1f124c2e57b" containerName="revoke-keys"
Sep 16 12:22:56.905889 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:56.905828    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c9c9247-957a-49ab-b967-e1f124c2e57b" containerName="revoke-keys"
Sep 16 12:22:56.905889 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:56.905842    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3293c9d9-365a-4b8b-95a0-9867b00c9b95" containerName="istio-proxy"
Sep 16 12:22:56.905889 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:56.905848    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3293c9d9-365a-4b8b-95a0-9867b00c9b95" containerName="istio-proxy"
Sep 16 12:22:56.906118 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:56.905922    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3293c9d9-365a-4b8b-95a0-9867b00c9b95" containerName="istio-proxy"
Sep 16 12:22:56.906118 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:56.905931    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3293c9d9-365a-4b8b-95a0-9867b00c9b95" containerName="istio-proxy"
Sep 16 12:22:56.906118 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:56.905939    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c9c9247-957a-49ab-b967-e1f124c2e57b" containerName="revoke-keys"
Sep 16 12:22:56.910175 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:56.910152    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-7c3429-ktqjv"
Sep 16 12:22:56.912749 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:56.912723    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hvtv7\""
Sep 16 12:22:56.912887 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:56.912786    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e8cb8f6-f204-4881-8c62-2d4fa4f17598-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-7c3429-ktqjv\" (UID: \"7e8cb8f6-f204-4881-8c62-2d4fa4f17598\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-7c3429-ktqjv"
Sep 16 12:22:56.917252 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:56.917229    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-7c3429-ktqjv"]
Sep 16 12:22:57.013566 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:57.013531    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e8cb8f6-f204-4881-8c62-2d4fa4f17598-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-7c3429-ktqjv\" (UID: \"7e8cb8f6-f204-4881-8c62-2d4fa4f17598\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-7c3429-ktqjv"
Sep 16 12:22:57.014174 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:57.014154    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e8cb8f6-f204-4881-8c62-2d4fa4f17598-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-7c3429-ktqjv\" (UID: \"7e8cb8f6-f204-4881-8c62-2d4fa4f17598\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-7c3429-ktqjv"
Sep 16 12:22:57.099098 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:57.099053    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:22:57.223258 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:57.223174    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-7c3429-ktqjv"
Sep 16 12:22:57.493633 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:57.493605    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-7c3429-ktqjv"]
Sep 16 12:22:57.496253 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:22:57.496224    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e8cb8f6_f204_4881_8c62_2d4fa4f17598.slice/crio-945ce0ccb7dc0c518c0614967a720e83eb045a4ceca0a73a676cd0c0f1f0aafb WatchSource:0}: Error finding container 945ce0ccb7dc0c518c0614967a720e83eb045a4ceca0a73a676cd0c0f1f0aafb: Status 404 returned error can't find the container with id 945ce0ccb7dc0c518c0614967a720e83eb045a4ceca0a73a676cd0c0f1f0aafb
Sep 16 12:22:57.753317 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:57.753288    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-7c3429-ktqjv" event={"ID":"7e8cb8f6-f204-4881-8c62-2d4fa4f17598","Type":"ContainerStarted","Data":"945ce0ccb7dc0c518c0614967a720e83eb045a4ceca0a73a676cd0c0f1f0aafb"}
Sep 16 12:22:57.848244 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:57.848211    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:22:58.530615 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:58.530580    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:22:58.760506 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:58.760472    2559 generic.go:356] "Generic (PLEG): container finished" podID="7e8cb8f6-f204-4881-8c62-2d4fa4f17598" containerID="9a8613e376ca5712c9b77f025d2ecaebcc8425d58b6d0e481fb4666a4b6765bc" exitCode=0
Sep 16 12:22:58.760720 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:58.760571    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-7c3429-ktqjv" event={"ID":"7e8cb8f6-f204-4881-8c62-2d4fa4f17598","Type":"ContainerDied","Data":"9a8613e376ca5712c9b77f025d2ecaebcc8425d58b6d0e481fb4666a4b6765bc"}
Sep 16 12:22:59.132437 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:59.132410    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:22:59.601922 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:59.601885    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:22:59.905685 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:59.905659    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-7c3429-ktqjv"
Sep 16 12:22:59.936724 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:59.936688    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:22:59.942994 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:59.942969    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e8cb8f6-f204-4881-8c62-2d4fa4f17598-maas-api-service-ca\") pod \"7e8cb8f6-f204-4881-8c62-2d4fa4f17598\" (UID: \"7e8cb8f6-f204-4881-8c62-2d4fa4f17598\") "
Sep 16 12:22:59.943341 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:59.943320    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e8cb8f6-f204-4881-8c62-2d4fa4f17598-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7e8cb8f6-f204-4881-8c62-2d4fa4f17598" (UID: "7e8cb8f6-f204-4881-8c62-2d4fa4f17598"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:22:59.943426 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:22:59.943407    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e8cb8f6-f204-4881-8c62-2d4fa4f17598-maas-api-service-ca\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:23:00.623562 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:00.623525    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:23:00.773203 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:00.773170    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-7c3429-ktqjv"
Sep 16 12:23:00.773203 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:00.773191    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-7c3429-ktqjv" event={"ID":"7e8cb8f6-f204-4881-8c62-2d4fa4f17598","Type":"ContainerDied","Data":"945ce0ccb7dc0c518c0614967a720e83eb045a4ceca0a73a676cd0c0f1f0aafb"}
Sep 16 12:23:00.773411 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:00.773240    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="945ce0ccb7dc0c518c0614967a720e83eb045a4ceca0a73a676cd0c0f1f0aafb"
Sep 16 12:23:01.302746 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:01.302716    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:23:07.493363 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:07.493323    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:23:07.518092 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:07.518059    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-7c3429-8475798fc-2k76r"]
Sep 16 12:23:07.518317 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:07.518289    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-autores-7c3429-8475798fc-2k76r" podUID="5ab0f214-d5cd-4570-b844-7e4b891a3d98" containerName="payload-processing" containerID="cri-o://e53a2982339fa78974f6a31f89a0ab0e55fd610a36f99939354b677eecd2f50f" gracePeriod=30
Sep 16 12:23:07.524293 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:07.524261    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-7c3429-76f68fd846-45s9p"]
Sep 16 12:23:07.524493 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:07.524462    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-autores-7c3429-76f68fd846-45s9p" podUID="6057fe2e-64b4-4388-a7dc-a3b5242e130c" containerName="payload-pre-processing" containerID="cri-o://4e13b98a15cf7a4eb3633272038bae8eb014cab00b639ae2a85fe4a61aaf8a8d" gracePeriod=30
Sep 16 12:23:07.557312 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:07.557265    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:23:07.715086 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:07.715041    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:23:07.761221 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:07.761187    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-7c3429-ktqjv"]
Sep 16 12:23:07.769571 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:07.769538    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-7c3429-ktqjv"]
Sep 16 12:23:07.788105 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:07.788079    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:23:07.813685 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:07.813653    2559 generic.go:356] "Generic (PLEG): container finished" podID="5ab0f214-d5cd-4570-b844-7e4b891a3d98" containerID="e53a2982339fa78974f6a31f89a0ab0e55fd610a36f99939354b677eecd2f50f" exitCode=0
Sep 16 12:23:07.813799 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:07.813724    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-7c3429-8475798fc-2k76r" event={"ID":"5ab0f214-d5cd-4570-b844-7e4b891a3d98","Type":"ContainerDied","Data":"e53a2982339fa78974f6a31f89a0ab0e55fd610a36f99939354b677eecd2f50f"}
Sep 16 12:23:07.813876 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:07.813841    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-7c3429-8475798fc-2k76r" event={"ID":"5ab0f214-d5cd-4570-b844-7e4b891a3d98","Type":"ContainerDied","Data":"55de96bee898d6f14bffe553bbf9c7967141937a15b76f98667bcb32b1982fb8"}
Sep 16 12:23:07.813876 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:07.813871    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="55de96bee898d6f14bffe553bbf9c7967141937a15b76f98667bcb32b1982fb8"
Sep 16 12:23:07.815259 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:07.815233    2559 generic.go:356] "Generic (PLEG): container finished" podID="6057fe2e-64b4-4388-a7dc-a3b5242e130c" containerID="4e13b98a15cf7a4eb3633272038bae8eb014cab00b639ae2a85fe4a61aaf8a8d" exitCode=0
Sep 16 12:23:07.815359 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:07.815311    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-7c3429-76f68fd846-45s9p" event={"ID":"6057fe2e-64b4-4388-a7dc-a3b5242e130c","Type":"ContainerDied","Data":"4e13b98a15cf7a4eb3633272038bae8eb014cab00b639ae2a85fe4a61aaf8a8d"}
Sep 16 12:23:07.815402 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:07.815380    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-7c3429-76f68fd846-45s9p" event={"ID":"6057fe2e-64b4-4388-a7dc-a3b5242e130c","Type":"ContainerDied","Data":"0a26248262711687830114449d0767f63872c88bbba9522a5e1b3dd276d123b6"}
Sep 16 12:23:07.815437 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:07.815409    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0a26248262711687830114449d0767f63872c88bbba9522a5e1b3dd276d123b6"
Sep 16 12:23:07.828444 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:07.828423    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-7c3429-8475798fc-2k76r"
Sep 16 12:23:07.831431 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:07.831408    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-7c3429-76f68fd846-45s9p"
Sep 16 12:23:07.920372 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:07.920343    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ab0f214-d5cd-4570-b844-7e4b891a3d98-plugins-config-volume\") pod \"5ab0f214-d5cd-4570-b844-7e4b891a3d98\" (UID: \"5ab0f214-d5cd-4570-b844-7e4b891a3d98\") "
Sep 16 12:23:07.920563 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:07.920380    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t6d2f\" (UniqueName: \"kubernetes.io/projected/6057fe2e-64b4-4388-a7dc-a3b5242e130c-kube-api-access-t6d2f\") pod \"6057fe2e-64b4-4388-a7dc-a3b5242e130c\" (UID: \"6057fe2e-64b4-4388-a7dc-a3b5242e130c\") "
Sep 16 12:23:07.920563 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:07.920425    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kqnwd\" (UniqueName: \"kubernetes.io/projected/5ab0f214-d5cd-4570-b844-7e4b891a3d98-kube-api-access-kqnwd\") pod \"5ab0f214-d5cd-4570-b844-7e4b891a3d98\" (UID: \"5ab0f214-d5cd-4570-b844-7e4b891a3d98\") "
Sep 16 12:23:07.920563 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:07.920449    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6057fe2e-64b4-4388-a7dc-a3b5242e130c-plugins-config-volume\") pod \"6057fe2e-64b4-4388-a7dc-a3b5242e130c\" (UID: \"6057fe2e-64b4-4388-a7dc-a3b5242e130c\") "
Sep 16 12:23:07.920819 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:07.920792    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ab0f214-d5cd-4570-b844-7e4b891a3d98-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5ab0f214-d5cd-4570-b844-7e4b891a3d98" (UID: "5ab0f214-d5cd-4570-b844-7e4b891a3d98"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:23:07.920900 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:07.920875    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6057fe2e-64b4-4388-a7dc-a3b5242e130c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6057fe2e-64b4-4388-a7dc-a3b5242e130c" (UID: "6057fe2e-64b4-4388-a7dc-a3b5242e130c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:23:07.922525 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:07.922506    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6057fe2e-64b4-4388-a7dc-a3b5242e130c-kube-api-access-t6d2f" (OuterVolumeSpecName: "kube-api-access-t6d2f") pod "6057fe2e-64b4-4388-a7dc-a3b5242e130c" (UID: "6057fe2e-64b4-4388-a7dc-a3b5242e130c"). InnerVolumeSpecName "kube-api-access-t6d2f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:23:07.922611 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:07.922538    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ab0f214-d5cd-4570-b844-7e4b891a3d98-kube-api-access-kqnwd" (OuterVolumeSpecName: "kube-api-access-kqnwd") pod "5ab0f214-d5cd-4570-b844-7e4b891a3d98" (UID: "5ab0f214-d5cd-4570-b844-7e4b891a3d98"). InnerVolumeSpecName "kube-api-access-kqnwd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:23:07.938332 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:07.938307    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e8cb8f6-f204-4881-8c62-2d4fa4f17598" path="/var/lib/kubelet/pods/7e8cb8f6-f204-4881-8c62-2d4fa4f17598/volumes"
Sep 16 12:23:08.021706 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:08.021603    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ab0f214-d5cd-4570-b844-7e4b891a3d98-plugins-config-volume\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:23:08.021706 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:08.021637    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t6d2f\" (UniqueName: \"kubernetes.io/projected/6057fe2e-64b4-4388-a7dc-a3b5242e130c-kube-api-access-t6d2f\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:23:08.021706 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:08.021650    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kqnwd\" (UniqueName: \"kubernetes.io/projected/5ab0f214-d5cd-4570-b844-7e4b891a3d98-kube-api-access-kqnwd\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:23:08.021706 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:08.021663    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6057fe2e-64b4-4388-a7dc-a3b5242e130c-plugins-config-volume\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:23:08.231051 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:08.231016    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:23:08.821268 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:08.821235    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-7c3429-76f68fd846-45s9p"
Sep 16 12:23:08.821640 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:08.821235    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-7c3429-8475798fc-2k76r"
Sep 16 12:23:08.846046 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:08.846011    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-7c3429-8475798fc-2k76r"]
Sep 16 12:23:08.848871 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:08.848846    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-7c3429-8475798fc-2k76r"]
Sep 16 12:23:08.850623 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:08.850598    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:23:08.858947 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:08.858921    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-7c3429-76f68fd846-45s9p"]
Sep 16 12:23:08.862372 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:08.862350    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-7c3429-76f68fd846-45s9p"]
Sep 16 12:23:09.510335 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:09.510303    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:23:09.938762 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:09.938734    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ab0f214-d5cd-4570-b844-7e4b891a3d98" path="/var/lib/kubelet/pods/5ab0f214-d5cd-4570-b844-7e4b891a3d98/volumes"
Sep 16 12:23:09.939148 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:09.939103    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6057fe2e-64b4-4388-a7dc-a3b5242e130c" path="/var/lib/kubelet/pods/6057fe2e-64b4-4388-a7dc-a3b5242e130c/volumes"
Sep 16 12:23:10.230446 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:10.230359    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:23:10.845485 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:10.845432    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:23:18.145658 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:18.145624    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:23:21.870847 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:21.870805    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:23:22.798414 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:22.798376    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:23:23.174238 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:23.174204    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:23:24.418582 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:24.418545    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:23:24.522749 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:24.522707    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-0e8ffe-57xvf"]
Sep 16 12:23:24.523195 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:24.523179    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6057fe2e-64b4-4388-a7dc-a3b5242e130c" containerName="payload-pre-processing"
Sep 16 12:23:24.523265 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:24.523198    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6057fe2e-64b4-4388-a7dc-a3b5242e130c" containerName="payload-pre-processing"
Sep 16 12:23:24.523265 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:24.523213    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3293c9d9-365a-4b8b-95a0-9867b00c9b95" containerName="istio-proxy"
Sep 16 12:23:24.523265 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:24.523221    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3293c9d9-365a-4b8b-95a0-9867b00c9b95" containerName="istio-proxy"
Sep 16 12:23:24.523265 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:24.523241    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e8cb8f6-f204-4881-8c62-2d4fa4f17598" containerName="revoke-keys"
Sep 16 12:23:24.523265 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:24.523248    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e8cb8f6-f204-4881-8c62-2d4fa4f17598" containerName="revoke-keys"
Sep 16 12:23:24.523265 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:24.523260    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ab0f214-d5cd-4570-b844-7e4b891a3d98" containerName="payload-processing"
Sep 16 12:23:24.523265 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:24.523265    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ab0f214-d5cd-4570-b844-7e4b891a3d98" containerName="payload-processing"
Sep 16 12:23:24.523496 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:24.523335    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e8cb8f6-f204-4881-8c62-2d4fa4f17598" containerName="revoke-keys"
Sep 16 12:23:24.523496 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:24.523344    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ab0f214-d5cd-4570-b844-7e4b891a3d98" containerName="payload-processing"
Sep 16 12:23:24.523496 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:24.523354    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6057fe2e-64b4-4388-a7dc-a3b5242e130c" containerName="payload-pre-processing"
Sep 16 12:23:24.527842 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:24.527821    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-0e8ffe-57xvf"
Sep 16 12:23:24.530994 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:24.530966    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hvtv7\""
Sep 16 12:23:24.532962 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:24.532938    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-0e8ffe-57xvf"]
Sep 16 12:23:24.687264 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:24.687180    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/63bd25ea-f17c-48f4-8710-63080d00cb1c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-0e8ffe-57xvf\" (UID: \"63bd25ea-f17c-48f4-8710-63080d00cb1c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-0e8ffe-57xvf"
Sep 16 12:23:24.788655 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:24.788616    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/63bd25ea-f17c-48f4-8710-63080d00cb1c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-0e8ffe-57xvf\" (UID: \"63bd25ea-f17c-48f4-8710-63080d00cb1c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-0e8ffe-57xvf"
Sep 16 12:23:24.789322 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:24.789292    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/63bd25ea-f17c-48f4-8710-63080d00cb1c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-0e8ffe-57xvf\" (UID: \"63bd25ea-f17c-48f4-8710-63080d00cb1c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-0e8ffe-57xvf"
Sep 16 12:23:24.793060 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:24.793037    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:23:24.841447 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:24.841425    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-0e8ffe-57xvf"
Sep 16 12:23:25.111837 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:25.111807    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-0e8ffe-57xvf"]
Sep 16 12:23:25.113913 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:23:25.113881    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63bd25ea_f17c_48f4_8710_63080d00cb1c.slice/crio-7249f60e2719e69dd595ae71db7b1de203405394b69451f6cea72f5be1cdf034 WatchSource:0}: Error finding container 7249f60e2719e69dd595ae71db7b1de203405394b69451f6cea72f5be1cdf034: Status 404 returned error can't find the container with id 7249f60e2719e69dd595ae71db7b1de203405394b69451f6cea72f5be1cdf034
Sep 16 12:23:25.408942 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:25.408893    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:23:25.921458 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:25.921424    2559 generic.go:356] "Generic (PLEG): container finished" podID="63bd25ea-f17c-48f4-8710-63080d00cb1c" containerID="6404e64b357277cdad5e5baa00d312138d876c326b09b17949e0ea03d3a37508" exitCode=0
Sep 16 12:23:25.921861 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:25.921508    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-0e8ffe-57xvf" event={"ID":"63bd25ea-f17c-48f4-8710-63080d00cb1c","Type":"ContainerDied","Data":"6404e64b357277cdad5e5baa00d312138d876c326b09b17949e0ea03d3a37508"}
Sep 16 12:23:25.921861 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:25.921567    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-0e8ffe-57xvf" event={"ID":"63bd25ea-f17c-48f4-8710-63080d00cb1c","Type":"ContainerStarted","Data":"7249f60e2719e69dd595ae71db7b1de203405394b69451f6cea72f5be1cdf034"}
Sep 16 12:23:26.104787 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:26.104706    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:23:26.822251 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:26.822212    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:23:27.063006 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:27.062978    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-0e8ffe-57xvf"
Sep 16 12:23:27.212899 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:27.212867    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/63bd25ea-f17c-48f4-8710-63080d00cb1c-maas-api-service-ca\") pod \"63bd25ea-f17c-48f4-8710-63080d00cb1c\" (UID: \"63bd25ea-f17c-48f4-8710-63080d00cb1c\") "
Sep 16 12:23:27.213232 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:27.213211    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63bd25ea-f17c-48f4-8710-63080d00cb1c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "63bd25ea-f17c-48f4-8710-63080d00cb1c" (UID: "63bd25ea-f17c-48f4-8710-63080d00cb1c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:23:27.313701 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:27.313665    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/63bd25ea-f17c-48f4-8710-63080d00cb1c-maas-api-service-ca\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:23:27.543084 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:27.542999    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:23:27.933143 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:27.933102    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-0e8ffe-57xvf"
Sep 16 12:23:27.938118 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:27.938086    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-0e8ffe-57xvf" event={"ID":"63bd25ea-f17c-48f4-8710-63080d00cb1c","Type":"ContainerDied","Data":"7249f60e2719e69dd595ae71db7b1de203405394b69451f6cea72f5be1cdf034"}
Sep 16 12:23:27.938386 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:27.938145    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7249f60e2719e69dd595ae71db7b1de203405394b69451f6cea72f5be1cdf034"
Sep 16 12:23:28.036878 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:28.036839    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:23:28.115495 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:28.115459    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:23:28.254791 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:28.254692    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:23:28.355705 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:28.355675    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:23:29.493278 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:29.493246    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:23:32.732304 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:32.732272    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:23:34.949785 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:34.949749    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:23:34.967611 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:34.967579    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-0e8ffe-7fb6ff6d7-npsrh"]
Sep 16 12:23:34.967810 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:34.967781    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w0-0e8ffe-7fb6ff6d7-npsrh" podUID="a59c0689-d95b-4076-b66f-4f8c0e515024" containerName="payload-processing" containerID="cri-o://38c893d602806c616ac0a74914a9fc5d0b9a87546d37c316aba2f6f12453c61f" gracePeriod=30
Sep 16 12:23:35.050457 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:35.050415    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:23:35.116318 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:35.116283    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-0e8ffe-57xvf"]
Sep 16 12:23:35.120700 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:35.120675    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:23:35.122294 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:35.122273    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-0e8ffe-57xvf"]
Sep 16 12:23:35.193021 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:35.192990    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:23:35.237328 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:35.237301    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-0e8ffe-7fb6ff6d7-npsrh"
Sep 16 12:23:35.394578 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:35.394549    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vc9l4\" (UniqueName: \"kubernetes.io/projected/a59c0689-d95b-4076-b66f-4f8c0e515024-kube-api-access-vc9l4\") pod \"a59c0689-d95b-4076-b66f-4f8c0e515024\" (UID: \"a59c0689-d95b-4076-b66f-4f8c0e515024\") "
Sep 16 12:23:35.394578 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:35.394581    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a59c0689-d95b-4076-b66f-4f8c0e515024-plugins-config-volume\") pod \"a59c0689-d95b-4076-b66f-4f8c0e515024\" (UID: \"a59c0689-d95b-4076-b66f-4f8c0e515024\") "
Sep 16 12:23:35.394985 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:35.394959    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a59c0689-d95b-4076-b66f-4f8c0e515024-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a59c0689-d95b-4076-b66f-4f8c0e515024" (UID: "a59c0689-d95b-4076-b66f-4f8c0e515024"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:23:35.396639 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:35.396619    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a59c0689-d95b-4076-b66f-4f8c0e515024-kube-api-access-vc9l4" (OuterVolumeSpecName: "kube-api-access-vc9l4") pod "a59c0689-d95b-4076-b66f-4f8c0e515024" (UID: "a59c0689-d95b-4076-b66f-4f8c0e515024"). InnerVolumeSpecName "kube-api-access-vc9l4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:23:35.496425 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:35.495743    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vc9l4\" (UniqueName: \"kubernetes.io/projected/a59c0689-d95b-4076-b66f-4f8c0e515024-kube-api-access-vc9l4\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:23:35.496425 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:35.495776    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a59c0689-d95b-4076-b66f-4f8c0e515024-plugins-config-volume\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:23:35.508097 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:35.508066    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:23:35.609474 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:35.609440    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:23:35.937858 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:35.937826    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63bd25ea-f17c-48f4-8710-63080d00cb1c" path="/var/lib/kubelet/pods/63bd25ea-f17c-48f4-8710-63080d00cb1c/volumes"
Sep 16 12:23:35.976692 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:35.976661    2559 generic.go:356] "Generic (PLEG): container finished" podID="a59c0689-d95b-4076-b66f-4f8c0e515024" containerID="38c893d602806c616ac0a74914a9fc5d0b9a87546d37c316aba2f6f12453c61f" exitCode=0
Sep 16 12:23:35.977115 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:35.976710    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-0e8ffe-7fb6ff6d7-npsrh" event={"ID":"a59c0689-d95b-4076-b66f-4f8c0e515024","Type":"ContainerDied","Data":"38c893d602806c616ac0a74914a9fc5d0b9a87546d37c316aba2f6f12453c61f"}
Sep 16 12:23:35.977115 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:35.976718    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-0e8ffe-7fb6ff6d7-npsrh"
Sep 16 12:23:35.977115 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:35.976750    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-0e8ffe-7fb6ff6d7-npsrh" event={"ID":"a59c0689-d95b-4076-b66f-4f8c0e515024","Type":"ContainerDied","Data":"d586af39cd2bb7498cd00343f7342e0f683e9162ec062a3600480dce9fed0292"}
Sep 16 12:23:35.977115 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:35.976772    2559 scope.go:117] "RemoveContainer" containerID="38c893d602806c616ac0a74914a9fc5d0b9a87546d37c316aba2f6f12453c61f"
Sep 16 12:23:35.985890 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:35.985875    2559 scope.go:117] "RemoveContainer" containerID="38c893d602806c616ac0a74914a9fc5d0b9a87546d37c316aba2f6f12453c61f"
Sep 16 12:23:35.986172 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:23:35.986150    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38c893d602806c616ac0a74914a9fc5d0b9a87546d37c316aba2f6f12453c61f\": container with ID starting with 38c893d602806c616ac0a74914a9fc5d0b9a87546d37c316aba2f6f12453c61f not found: ID does not exist" containerID="38c893d602806c616ac0a74914a9fc5d0b9a87546d37c316aba2f6f12453c61f"
Sep 16 12:23:35.986241 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:35.986180    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38c893d602806c616ac0a74914a9fc5d0b9a87546d37c316aba2f6f12453c61f"} err="failed to get container status \"38c893d602806c616ac0a74914a9fc5d0b9a87546d37c316aba2f6f12453c61f\": rpc error: code = NotFound desc = could not find container \"38c893d602806c616ac0a74914a9fc5d0b9a87546d37c316aba2f6f12453c61f\": container with ID starting with 38c893d602806c616ac0a74914a9fc5d0b9a87546d37c316aba2f6f12453c61f not found: ID does not exist"
Sep 16 12:23:35.993127 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:35.993108    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-0e8ffe-7fb6ff6d7-npsrh"]
Sep 16 12:23:35.997821 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:35.997794    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-0e8ffe-7fb6ff6d7-npsrh"]
Sep 16 12:23:36.214682 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:36.214589    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:23:36.850362 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:36.850327    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:23:37.537980 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:37.537941    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:23:37.938104 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:37.938071    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a59c0689-d95b-4076-b66f-4f8c0e515024" path="/var/lib/kubelet/pods/a59c0689-d95b-4076-b66f-4f8c0e515024/volumes"
Sep 16 12:23:39.104467 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:39.104439    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:23:41.290891 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:41.290855    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:23:41.350602 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:41.350570    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:23:41.562970 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:41.562873    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:23:44.090278 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:44.090240    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:23:49.824822 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:49.824785    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:23:49.884272 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:49.884236    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:23:49.973054 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:49.973020    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:23:50.072600 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:50.072561    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:23:51.854926 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:51.854895    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:23:53.082449 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:53.082415    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:23:56.904224 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:56.904182    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:23:58.236395 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:23:58.236366    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:24:00.267030 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:00.266992    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:24:00.563559 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:00.563467    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:24:00.723946 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:00.723910    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:24:01.051949 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:01.051913    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:24:01.367531 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:01.367443    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2"]
Sep 16 12:24:01.367920 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:01.367904    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63bd25ea-f17c-48f4-8710-63080d00cb1c" containerName="revoke-keys"
Sep 16 12:24:01.367980 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:01.367923    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="63bd25ea-f17c-48f4-8710-63080d00cb1c" containerName="revoke-keys"
Sep 16 12:24:01.367980 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:01.367935    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a59c0689-d95b-4076-b66f-4f8c0e515024" containerName="payload-processing"
Sep 16 12:24:01.367980 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:01.367942    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a59c0689-d95b-4076-b66f-4f8c0e515024" containerName="payload-processing"
Sep 16 12:24:01.368097 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:01.368023    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a59c0689-d95b-4076-b66f-4f8c0e515024" containerName="payload-processing"
Sep 16 12:24:01.368097 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:01.368032    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="63bd25ea-f17c-48f4-8710-63080d00cb1c" containerName="revoke-keys"
Sep 16 12:24:01.378563 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:01.378537    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2"
Sep 16 12:24:01.382965 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:01.382940    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-4915f8-openshift-default-dockercfg-6jbcb\""
Sep 16 12:24:01.401397 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:01.401372    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2"]
Sep 16 12:24:01.401994 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:01.401969    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:24:01.429215 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:01.429183    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1add6fff-84d3-4c7a-b4e2-aea9fafbe257-workload-certs\") pod \"e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2\" (UID: \"1add6fff-84d3-4c7a-b4e2-aea9fafbe257\") " pod="openshift-ingress/e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2"
Sep 16 12:24:01.429343 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:01.429221    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1add6fff-84d3-4c7a-b4e2-aea9fafbe257-istio-token\") pod \"e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2\" (UID: \"1add6fff-84d3-4c7a-b4e2-aea9fafbe257\") " pod="openshift-ingress/e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2"
Sep 16 12:24:01.429343 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:01.429248    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1add6fff-84d3-4c7a-b4e2-aea9fafbe257-istio-envoy\") pod \"e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2\" (UID: \"1add6fff-84d3-4c7a-b4e2-aea9fafbe257\") " pod="openshift-ingress/e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2"
Sep 16 12:24:01.429343 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:01.429283    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmg48\" (UniqueName: \"kubernetes.io/projected/1add6fff-84d3-4c7a-b4e2-aea9fafbe257-kube-api-access-rmg48\") pod \"e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2\" (UID: \"1add6fff-84d3-4c7a-b4e2-aea9fafbe257\") " pod="openshift-ingress/e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2"
Sep 16 12:24:01.429343 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:01.429303    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1add6fff-84d3-4c7a-b4e2-aea9fafbe257-istio-data\") pod \"e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2\" (UID: \"1add6fff-84d3-4c7a-b4e2-aea9fafbe257\") " pod="openshift-ingress/e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2"
Sep 16 12:24:01.429343 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:01.429317    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1add6fff-84d3-4c7a-b4e2-aea9fafbe257-istio-podinfo\") pod \"e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2\" (UID: \"1add6fff-84d3-4c7a-b4e2-aea9fafbe257\") " pod="openshift-ingress/e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2"
Sep 16 12:24:01.429510 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:01.429343    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1add6fff-84d3-4c7a-b4e2-aea9fafbe257-credential-socket\") pod \"e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2\" (UID: \"1add6fff-84d3-4c7a-b4e2-aea9fafbe257\") " pod="openshift-ingress/e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2"
Sep 16 12:24:01.429510 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:01.429368    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1add6fff-84d3-4c7a-b4e2-aea9fafbe257-workload-socket\") pod \"e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2\" (UID: \"1add6fff-84d3-4c7a-b4e2-aea9fafbe257\") " pod="openshift-ingress/e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2"
Sep 16 12:24:01.429510 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:01.429420    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1add6fff-84d3-4c7a-b4e2-aea9fafbe257-istiod-ca-cert\") pod \"e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2\" (UID: \"1add6fff-84d3-4c7a-b4e2-aea9fafbe257\") " pod="openshift-ingress/e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2"
Sep 16 12:24:01.530626 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:01.530583    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1add6fff-84d3-4c7a-b4e2-aea9fafbe257-workload-certs\") pod \"e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2\" (UID: \"1add6fff-84d3-4c7a-b4e2-aea9fafbe257\") " pod="openshift-ingress/e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2"
Sep 16 12:24:01.530842 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:01.530649    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1add6fff-84d3-4c7a-b4e2-aea9fafbe257-istio-token\") pod \"e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2\" (UID: \"1add6fff-84d3-4c7a-b4e2-aea9fafbe257\") " pod="openshift-ingress/e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2"
Sep 16 12:24:01.530842 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:01.530682    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1add6fff-84d3-4c7a-b4e2-aea9fafbe257-istio-envoy\") pod \"e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2\" (UID: \"1add6fff-84d3-4c7a-b4e2-aea9fafbe257\") " pod="openshift-ingress/e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2"
Sep 16 12:24:01.530842 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:01.530722    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmg48\" (UniqueName: \"kubernetes.io/projected/1add6fff-84d3-4c7a-b4e2-aea9fafbe257-kube-api-access-rmg48\") pod \"e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2\" (UID: \"1add6fff-84d3-4c7a-b4e2-aea9fafbe257\") " pod="openshift-ingress/e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2"
Sep 16 12:24:01.530842 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:01.530751    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1add6fff-84d3-4c7a-b4e2-aea9fafbe257-istio-data\") pod \"e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2\" (UID: \"1add6fff-84d3-4c7a-b4e2-aea9fafbe257\") " pod="openshift-ingress/e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2"
Sep 16 12:24:01.530842 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:01.530782    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1add6fff-84d3-4c7a-b4e2-aea9fafbe257-istio-podinfo\") pod \"e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2\" (UID: \"1add6fff-84d3-4c7a-b4e2-aea9fafbe257\") " pod="openshift-ingress/e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2"
Sep 16 12:24:01.530842 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:01.530809    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1add6fff-84d3-4c7a-b4e2-aea9fafbe257-credential-socket\") pod \"e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2\" (UID: \"1add6fff-84d3-4c7a-b4e2-aea9fafbe257\") " pod="openshift-ingress/e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2"
Sep 16 12:24:01.531225 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:01.530845    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1add6fff-84d3-4c7a-b4e2-aea9fafbe257-workload-socket\") pod \"e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2\" (UID: \"1add6fff-84d3-4c7a-b4e2-aea9fafbe257\") " pod="openshift-ingress/e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2"
Sep 16 12:24:01.531225 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:01.530918    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1add6fff-84d3-4c7a-b4e2-aea9fafbe257-istiod-ca-cert\") pod \"e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2\" (UID: \"1add6fff-84d3-4c7a-b4e2-aea9fafbe257\") " pod="openshift-ingress/e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2"
Sep 16 12:24:01.531225 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:01.531080    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1add6fff-84d3-4c7a-b4e2-aea9fafbe257-workload-certs\") pod \"e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2\" (UID: \"1add6fff-84d3-4c7a-b4e2-aea9fafbe257\") " pod="openshift-ingress/e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2"
Sep 16 12:24:01.531620 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:01.531586    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1add6fff-84d3-4c7a-b4e2-aea9fafbe257-credential-socket\") pod \"e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2\" (UID: \"1add6fff-84d3-4c7a-b4e2-aea9fafbe257\") " pod="openshift-ingress/e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2"
Sep 16 12:24:01.531759 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:01.531632    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1add6fff-84d3-4c7a-b4e2-aea9fafbe257-workload-socket\") pod \"e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2\" (UID: \"1add6fff-84d3-4c7a-b4e2-aea9fafbe257\") " pod="openshift-ingress/e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2"
Sep 16 12:24:01.531759 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:01.531703    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1add6fff-84d3-4c7a-b4e2-aea9fafbe257-istiod-ca-cert\") pod \"e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2\" (UID: \"1add6fff-84d3-4c7a-b4e2-aea9fafbe257\") " pod="openshift-ingress/e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2"
Sep 16 12:24:01.531759 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:01.531706    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1add6fff-84d3-4c7a-b4e2-aea9fafbe257-istio-data\") pod \"e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2\" (UID: \"1add6fff-84d3-4c7a-b4e2-aea9fafbe257\") " pod="openshift-ingress/e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2"
Sep 16 12:24:01.533071 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:01.533047    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1add6fff-84d3-4c7a-b4e2-aea9fafbe257-istio-envoy\") pod \"e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2\" (UID: \"1add6fff-84d3-4c7a-b4e2-aea9fafbe257\") " pod="openshift-ingress/e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2"
Sep 16 12:24:01.533768 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:01.533748    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1add6fff-84d3-4c7a-b4e2-aea9fafbe257-istio-podinfo\") pod \"e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2\" (UID: \"1add6fff-84d3-4c7a-b4e2-aea9fafbe257\") " pod="openshift-ingress/e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2"
Sep 16 12:24:01.538385 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:01.538331    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:24:01.541414 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:01.541358    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1add6fff-84d3-4c7a-b4e2-aea9fafbe257-istio-token\") pod \"e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2\" (UID: \"1add6fff-84d3-4c7a-b4e2-aea9fafbe257\") " pod="openshift-ingress/e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2"
Sep 16 12:24:01.541766 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:01.541747    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmg48\" (UniqueName: \"kubernetes.io/projected/1add6fff-84d3-4c7a-b4e2-aea9fafbe257-kube-api-access-rmg48\") pod \"e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2\" (UID: \"1add6fff-84d3-4c7a-b4e2-aea9fafbe257\") " pod="openshift-ingress/e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2"
Sep 16 12:24:01.638489 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:01.638398    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:24:01.689493 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:01.689457    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2"
Sep 16 12:24:01.964814 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:01.964790    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2"]
Sep 16 12:24:01.966414 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:24:01.966388    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1add6fff_84d3_4c7a_b4e2_aea9fafbe257.slice/crio-4e78a018e7d7f9aebcf920b7cc7b3dfc09316209879040882b5686f849081fa0 WatchSource:0}: Error finding container 4e78a018e7d7f9aebcf920b7cc7b3dfc09316209879040882b5686f849081fa0: Status 404 returned error can't find the container with id 4e78a018e7d7f9aebcf920b7cc7b3dfc09316209879040882b5686f849081fa0
Sep 16 12:24:01.968755 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:01.968722    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:24:01.968869 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:01.968787    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:24:01.968869 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:01.968818    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:24:02.120861 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:02.120825    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2" event={"ID":"1add6fff-84d3-4c7a-b4e2-aea9fafbe257","Type":"ContainerStarted","Data":"408688780f37cf98761b245e0c9c980af6c010877004e7b2512ae501e068ceed"}
Sep 16 12:24:02.121025 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:02.120887    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2" event={"ID":"1add6fff-84d3-4c7a-b4e2-aea9fafbe257","Type":"ContainerStarted","Data":"4e78a018e7d7f9aebcf920b7cc7b3dfc09316209879040882b5686f849081fa0"}
Sep 16 12:24:02.138853 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:02.138793    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2" podStartSLOduration=1.138770016 podStartE2EDuration="1.138770016s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:24:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:24:02.137763191 +0000 UTC m=+1408.758082512" watchObservedRunningTime="2026-09-16 12:24:02.138770016 +0000 UTC m=+1408.759089334"
Sep 16 12:24:02.689808 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:02.689775    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2"
Sep 16 12:24:03.695110 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:03.695075    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2"
Sep 16 12:24:03.915104 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:03.915069    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:24:04.114124 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:04.114040    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:24:04.132199 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:04.132173    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2"
Sep 16 12:24:04.133206 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:04.133185    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2"
Sep 16 12:24:04.217883 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:04.217850    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:24:04.655713 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:04.655675    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:24:05.440009 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:05.439971    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:24:06.256099 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:06.256067    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:24:06.309731 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:06.309691    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:24:06.479449 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:06.479422    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:24:06.807496 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:06.807463    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:24:06.904800 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:06.904772    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:24:07.223475 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:07.223443    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:24:07.860970 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:07.860935    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:24:08.215288 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:08.215249    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:24:08.325635 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:08.325604    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:24:08.419190 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:08.419161    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:24:08.518998 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:08.518911    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:24:09.207418 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:09.207382    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:24:09.307733 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:09.307699    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:24:09.406868 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:09.406834    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:24:11.007192 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:11.007116    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:24:13.463269 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:13.463235    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:24:13.563228 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:13.563175    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:24:16.974284 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:16.974246    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:24:17.022143 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:17.022094    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:24:17.075122 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:17.075086    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:24:17.670876 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:17.670840    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:24:23.416708 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:23.416666    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:24:23.492278 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:23.492227    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:24:23.672402 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:23.672315    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:24:23.997532 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:23.997446    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk"]
Sep 16 12:24:24.001262 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:24.001245    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk"
Sep 16 12:24:24.004127 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:24.004110    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-f2bc0450-openshift-default-dockercfg-dtrgx\""
Sep 16 12:24:24.047303 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:24.047278    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk"]
Sep 16 12:24:24.051011 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:24.050575    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b-istio-envoy\") pod \"e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk\" (UID: \"447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b\") " pod="openshift-ingress/e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk"
Sep 16 12:24:24.051011 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:24.050645    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hr9ks\" (UniqueName: \"kubernetes.io/projected/447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b-kube-api-access-hr9ks\") pod \"e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk\" (UID: \"447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b\") " pod="openshift-ingress/e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk"
Sep 16 12:24:24.051011 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:24.050687    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b-istio-token\") pod \"e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk\" (UID: \"447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b\") " pod="openshift-ingress/e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk"
Sep 16 12:24:24.051011 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:24.050729    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b-istiod-ca-cert\") pod \"e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk\" (UID: \"447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b\") " pod="openshift-ingress/e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk"
Sep 16 12:24:24.051011 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:24.050769    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b-workload-socket\") pod \"e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk\" (UID: \"447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b\") " pod="openshift-ingress/e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk"
Sep 16 12:24:24.051011 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:24.050802    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b-credential-socket\") pod \"e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk\" (UID: \"447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b\") " pod="openshift-ingress/e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk"
Sep 16 12:24:24.051011 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:24.050845    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b-istio-data\") pod \"e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk\" (UID: \"447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b\") " pod="openshift-ingress/e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk"
Sep 16 12:24:24.051011 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:24.050871    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b-istio-podinfo\") pod \"e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk\" (UID: \"447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b\") " pod="openshift-ingress/e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk"
Sep 16 12:24:24.051011 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:24.050897    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b-workload-certs\") pod \"e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk\" (UID: \"447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b\") " pod="openshift-ingress/e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk"
Sep 16 12:24:24.060812 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:24.060693    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:24:24.152382 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:24.152343    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b-istio-data\") pod \"e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk\" (UID: \"447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b\") " pod="openshift-ingress/e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk"
Sep 16 12:24:24.152382 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:24.152382    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b-istio-podinfo\") pod \"e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk\" (UID: \"447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b\") " pod="openshift-ingress/e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk"
Sep 16 12:24:24.152625 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:24.152402    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b-workload-certs\") pod \"e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk\" (UID: \"447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b\") " pod="openshift-ingress/e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk"
Sep 16 12:24:24.152625 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:24.152457    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b-istio-envoy\") pod \"e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk\" (UID: \"447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b\") " pod="openshift-ingress/e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk"
Sep 16 12:24:24.152625 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:24.152525    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hr9ks\" (UniqueName: \"kubernetes.io/projected/447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b-kube-api-access-hr9ks\") pod \"e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk\" (UID: \"447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b\") " pod="openshift-ingress/e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk"
Sep 16 12:24:24.152625 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:24.152559    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b-istio-token\") pod \"e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk\" (UID: \"447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b\") " pod="openshift-ingress/e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk"
Sep 16 12:24:24.152625 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:24.152605    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b-istiod-ca-cert\") pod \"e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk\" (UID: \"447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b\") " pod="openshift-ingress/e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk"
Sep 16 12:24:24.152868 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:24.152648    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b-workload-socket\") pod \"e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk\" (UID: \"447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b\") " pod="openshift-ingress/e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk"
Sep 16 12:24:24.152868 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:24.152684    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b-credential-socket\") pod \"e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk\" (UID: \"447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b\") " pod="openshift-ingress/e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk"
Sep 16 12:24:24.152868 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:24.152809    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b-istio-data\") pod \"e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk\" (UID: \"447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b\") " pod="openshift-ingress/e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk"
Sep 16 12:24:24.153059 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:24.153015    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b-credential-socket\") pod \"e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk\" (UID: \"447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b\") " pod="openshift-ingress/e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk"
Sep 16 12:24:24.153115 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:24.153094    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b-workload-socket\") pod \"e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk\" (UID: \"447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b\") " pod="openshift-ingress/e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk"
Sep 16 12:24:24.153397 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:24.153376    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b-workload-certs\") pod \"e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk\" (UID: \"447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b\") " pod="openshift-ingress/e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk"
Sep 16 12:24:24.153527 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:24.153503    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b-istiod-ca-cert\") pod \"e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk\" (UID: \"447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b\") " pod="openshift-ingress/e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk"
Sep 16 12:24:24.154793 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:24.154772    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b-istio-envoy\") pod \"e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk\" (UID: \"447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b\") " pod="openshift-ingress/e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk"
Sep 16 12:24:24.155178 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:24.155155    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b-istio-podinfo\") pod \"e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk\" (UID: \"447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b\") " pod="openshift-ingress/e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk"
Sep 16 12:24:24.161793 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:24.161764    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hr9ks\" (UniqueName: \"kubernetes.io/projected/447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b-kube-api-access-hr9ks\") pod \"e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk\" (UID: \"447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b\") " pod="openshift-ingress/e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk"
Sep 16 12:24:24.162186 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:24.162169    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b-istio-token\") pod \"e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk\" (UID: \"447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b\") " pod="openshift-ingress/e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk"
Sep 16 12:24:24.241586 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:24.241556    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:24:24.312572 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:24.312543    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk"
Sep 16 12:24:24.609756 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:24:24.609726    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod447a1a44_fa4f_4dc1_a8cf_38fd9be61b9b.slice/crio-649bce74d53e1af12efad2769bcd6fef5e0d1d888423535fcdfa703f8f8bd56e WatchSource:0}: Error finding container 649bce74d53e1af12efad2769bcd6fef5e0d1d888423535fcdfa703f8f8bd56e: Status 404 returned error can't find the container with id 649bce74d53e1af12efad2769bcd6fef5e0d1d888423535fcdfa703f8f8bd56e
Sep 16 12:24:24.610329 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:24.610306    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk"]
Sep 16 12:24:24.612249 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:24.612213    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:24:24.612342 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:24.612280    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:24:24.612342 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:24.612311    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:24:25.263302 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:25.263267    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk" event={"ID":"447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b","Type":"ContainerStarted","Data":"ed571544f9bff0acf2a050744aa1f8c33e623aefacf3e3b160c94d25b433fe56"}
Sep 16 12:24:25.263498 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:25.263327    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk" event={"ID":"447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b","Type":"ContainerStarted","Data":"649bce74d53e1af12efad2769bcd6fef5e0d1d888423535fcdfa703f8f8bd56e"}
Sep 16 12:24:25.288423 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:25.288372    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk" podStartSLOduration=2.288355508 podStartE2EDuration="2.288355508s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:24:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:24:25.285832759 +0000 UTC m=+1431.906152076" watchObservedRunningTime="2026-09-16 12:24:25.288355508 +0000 UTC m=+1431.908674823"
Sep 16 12:24:25.312824 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:25.312787    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk"
Sep 16 12:24:25.319260 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:25.319233    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk"
Sep 16 12:24:26.268761 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:26.268688    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk"
Sep 16 12:24:26.269725 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:26.269699    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk"
Sep 16 12:24:27.276625 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:27.276581    2559 generic.go:356] "Generic (PLEG): container finished" podID="1add6fff-84d3-4c7a-b4e2-aea9fafbe257" containerID="408688780f37cf98761b245e0c9c980af6c010877004e7b2512ae501e068ceed" exitCode=0
Sep 16 12:24:27.277144 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:27.276662    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2" event={"ID":"1add6fff-84d3-4c7a-b4e2-aea9fafbe257","Type":"ContainerDied","Data":"408688780f37cf98761b245e0c9c980af6c010877004e7b2512ae501e068ceed"}
Sep 16 12:24:27.277306 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:27.277288    2559 scope.go:117] "RemoveContainer" containerID="408688780f37cf98761b245e0c9c980af6c010877004e7b2512ae501e068ceed"
Sep 16 12:24:27.278419 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:27.278391    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:24:27.278525 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:27.278487    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:24:27.278590 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:27.278534    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:24:28.284551 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:28.284513    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2" event={"ID":"1add6fff-84d3-4c7a-b4e2-aea9fafbe257","Type":"ContainerStarted","Data":"eedef8cefd0e382bc43dab14d4c0b935eca198491326f46bbed66495bee4004f"}
Sep 16 12:24:28.638560 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:28.638456    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:24:28.690382 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:28.690345    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2"
Sep 16 12:24:28.690642 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:28.690618    2559 patch_prober.go:28] interesting pod/e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Sep 16 12:24:28.690694 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:28.690672    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2" podUID="1add6fff-84d3-4c7a-b4e2-aea9fafbe257" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Sep 16 12:24:29.118902 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:29.118868    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:24:29.323606 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:29.323570    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:24:29.690199 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:29.690163    2559 patch_prober.go:28] interesting pod/e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Sep 16 12:24:29.690388 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:29.690235    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2" podUID="1add6fff-84d3-4c7a-b4e2-aea9fafbe257" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Sep 16 12:24:30.151680 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:30.151633    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:24:30.639890 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:30.639790    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:24:30.690855 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:30.690815    2559 patch_prober.go:28] interesting pod/e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Sep 16 12:24:30.691038 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:30.690870    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2" podUID="1add6fff-84d3-4c7a-b4e2-aea9fafbe257" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Sep 16 12:24:30.770228 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:30.770194    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:24:31.172439 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:31.172403    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:24:31.690450 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:31.690412    2559 patch_prober.go:28] interesting pod/e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Sep 16 12:24:31.690845 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:31.690487    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2" podUID="1add6fff-84d3-4c7a-b4e2-aea9fafbe257" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Sep 16 12:24:32.045417 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:32.045320    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:24:32.110598 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:32.110566    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:24:32.690485 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:32.690448    2559 patch_prober.go:28] interesting pod/e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Sep 16 12:24:32.690862 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:32.690528    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2" podUID="1add6fff-84d3-4c7a-b4e2-aea9fafbe257" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Sep 16 12:24:32.912445 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:32.912414    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:24:33.012790 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:33.012693    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:24:33.065968 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:33.065934    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:24:33.369236 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:33.369128    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:24:33.458940 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:33.458906    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:24:33.556552 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:33.556520    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:24:33.694980 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:33.694954    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2"
Sep 16 12:24:33.695384 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:33.695363    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2"
Sep 16 12:24:33.696126 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:33.696111    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2"
Sep 16 12:24:33.742646 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:33.742605    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:24:34.503877 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:34.503840    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:24:35.121805 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:35.121775    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:24:37.651627 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:37.651593    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:24:51.416740 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:51.416709    2559 generic.go:356] "Generic (PLEG): container finished" podID="447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b" containerID="ed571544f9bff0acf2a050744aa1f8c33e623aefacf3e3b160c94d25b433fe56" exitCode=0
Sep 16 12:24:51.417284 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:51.416781    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk" event={"ID":"447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b","Type":"ContainerDied","Data":"ed571544f9bff0acf2a050744aa1f8c33e623aefacf3e3b160c94d25b433fe56"}
Sep 16 12:24:51.417284 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:51.417213    2559 scope.go:117] "RemoveContainer" containerID="ed571544f9bff0acf2a050744aa1f8c33e623aefacf3e3b160c94d25b433fe56"
Sep 16 12:24:51.418516 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:51.418489    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:24:51.418576 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:51.418556    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:24:51.418616 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:51.418586    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:24:51.438559 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:51.438528    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:24:52.424812 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:52.424779    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk" event={"ID":"447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b","Type":"ContainerStarted","Data":"6d3d0c5219b8855a14d0355604d979c76fca692ba5bf8ff7e554fb8ad965f12d"}
Sep 16 12:24:52.610285 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:52.610251    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:24:53.312906 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:53.312874    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk"
Sep 16 12:24:53.314081 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:53.314050    2559 patch_prober.go:28] interesting pod/e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 16 12:24:53.314248 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:53.314110    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk" podUID="447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 16 12:24:54.313034 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:54.312997    2559 patch_prober.go:28] interesting pod/e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 16 12:24:54.313489 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:54.313059    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk" podUID="447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 16 12:24:55.312963 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:55.312921    2559 patch_prober.go:28] interesting pod/e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 16 12:24:55.313204 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:55.313004    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk" podUID="447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 16 12:24:55.581905 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:55.581822    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:24:55.682718 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:55.682677    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:24:56.230337 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:56.230302    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:24:56.268777 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:56.268735    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk"
Sep 16 12:24:56.313289 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:56.313255    2559 patch_prober.go:28] interesting pod/e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 16 12:24:56.313630 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:56.313315    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk" podUID="447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 16 12:24:56.325635 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:56.325609    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:24:56.424008 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:56.423976    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:24:56.680120 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:56.680089    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:24:57.152989 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:57.152957    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:24:57.313821 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:57.313787    2559 patch_prober.go:28] interesting pod/e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 16 12:24:57.314335 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:57.313865    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk" podUID="447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 16 12:24:57.846496 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:57.846461    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:24:58.318249 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:58.318219    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk"
Sep 16 12:24:58.319418 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:58.319392    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk"
Sep 16 12:24:58.625912 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:24:58.625824    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:00.091905 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:00.091876    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:02.478398 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:02.478341    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:02.588691 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:02.588656    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:02.851811 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:02.851731    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f2bc0450-sp66j"]
Sep 16 12:25:02.855223 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:02.855202    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f2bc0450-sp66j"
Sep 16 12:25:02.857616 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:02.857597    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hvtv7\""
Sep 16 12:25:02.861864 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:02.861802    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f2bc0450-sp66j"]
Sep 16 12:25:02.958700 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:02.958657    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a30f77c2-7913-4352-8dd4-f66f1d34e92f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-f2bc0450-sp66j\" (UID: \"a30f77c2-7913-4352-8dd4-f66f1d34e92f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f2bc0450-sp66j"
Sep 16 12:25:03.060363 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:03.060322    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a30f77c2-7913-4352-8dd4-f66f1d34e92f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-f2bc0450-sp66j\" (UID: \"a30f77c2-7913-4352-8dd4-f66f1d34e92f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f2bc0450-sp66j"
Sep 16 12:25:03.060974 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:03.060953    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a30f77c2-7913-4352-8dd4-f66f1d34e92f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-f2bc0450-sp66j\" (UID: \"a30f77c2-7913-4352-8dd4-f66f1d34e92f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f2bc0450-sp66j"
Sep 16 12:25:03.169723 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:03.169680    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f2bc0450-sp66j"
Sep 16 12:25:03.446417 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:03.446351    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f2bc0450-sp66j"]
Sep 16 12:25:03.449174 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:25:03.449118    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda30f77c2_7913_4352_8dd4_f66f1d34e92f.slice/crio-6df6b7d60d4822409f8dce1922bda07d4f5bc253d15f419a56707719885f640c WatchSource:0}: Error finding container 6df6b7d60d4822409f8dce1922bda07d4f5bc253d15f419a56707719885f640c: Status 404 returned error can't find the container with id 6df6b7d60d4822409f8dce1922bda07d4f5bc253d15f419a56707719885f640c
Sep 16 12:25:03.496813 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:03.496782    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f2bc0450-sp66j" event={"ID":"a30f77c2-7913-4352-8dd4-f66f1d34e92f","Type":"ContainerStarted","Data":"6df6b7d60d4822409f8dce1922bda07d4f5bc253d15f419a56707719885f640c"}
Sep 16 12:25:03.615361 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:03.615321    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:04.504596 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:04.504558    2559 generic.go:356] "Generic (PLEG): container finished" podID="a30f77c2-7913-4352-8dd4-f66f1d34e92f" containerID="9058f81647311c07f0ee85a935fe808d504e9b1e0af51760426015e01c84a2d7" exitCode=0
Sep 16 12:25:04.504596 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:04.504601    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f2bc0450-sp66j" event={"ID":"a30f77c2-7913-4352-8dd4-f66f1d34e92f","Type":"ContainerDied","Data":"9058f81647311c07f0ee85a935fe808d504e9b1e0af51760426015e01c84a2d7"}
Sep 16 12:25:04.707928 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:04.707897    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:04.935057 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:04.935026    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:05.637240 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:05.637216    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f2bc0450-sp66j"
Sep 16 12:25:05.686039 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:05.686011    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a30f77c2-7913-4352-8dd4-f66f1d34e92f-maas-api-service-ca\") pod \"a30f77c2-7913-4352-8dd4-f66f1d34e92f\" (UID: \"a30f77c2-7913-4352-8dd4-f66f1d34e92f\") "
Sep 16 12:25:05.686405 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:05.686383    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a30f77c2-7913-4352-8dd4-f66f1d34e92f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a30f77c2-7913-4352-8dd4-f66f1d34e92f" (UID: "a30f77c2-7913-4352-8dd4-f66f1d34e92f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:25:05.715017 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:05.714983    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:05.787760 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:05.787675    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a30f77c2-7913-4352-8dd4-f66f1d34e92f-maas-api-service-ca\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:25:06.312404 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:06.312374    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:06.516379 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:06.516355    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f2bc0450-sp66j"
Sep 16 12:25:06.516543 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:06.516389    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f2bc0450-sp66j" event={"ID":"a30f77c2-7913-4352-8dd4-f66f1d34e92f","Type":"ContainerDied","Data":"6df6b7d60d4822409f8dce1922bda07d4f5bc253d15f419a56707719885f640c"}
Sep 16 12:25:06.516543 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:06.516434    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6df6b7d60d4822409f8dce1922bda07d4f5bc253d15f419a56707719885f640c"
Sep 16 12:25:07.274271 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:07.274241    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:08.300027 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:08.299993    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:25:11.628769 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:11.628735    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:12.993754 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:12.993723    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:13.547683 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:13.547649    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:13.609841 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:13.609802    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:13.714171 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:13.714127    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f2bc0450-sp66j"]
Sep 16 12:25:13.716233 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:13.716209    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f2bc0450-sp66j"]
Sep 16 12:25:13.868381 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:13.868292    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:13.940006 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:13.939971    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a30f77c2-7913-4352-8dd4-f66f1d34e92f" path="/var/lib/kubelet/pods/a30f77c2-7913-4352-8dd4-f66f1d34e92f/volumes"
Sep 16 12:25:13.965023 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:13.964987    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:14.088408 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:14.088380    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:14.144326 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:14.144243    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:14.806122 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:14.806091    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:15.421783 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:15.421749    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:16.025825 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:16.025789    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:16.819590 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:16.819552    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:18.891738 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:18.891700    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:19.903580 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:19.903548    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:20.007258 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:20.007225    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:20.189635 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:20.189543    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk"]
Sep 16 12:25:20.189802 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:20.189762    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk" podUID="447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b" containerName="istio-proxy" containerID="cri-o://6d3d0c5219b8855a14d0355604d979c76fca692ba5bf8ff7e554fb8ad965f12d" gracePeriod=30
Sep 16 12:25:20.269389 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:20.269352    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:20.536765 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:20.536678    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:20.633229 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:20.633194    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:20.735244 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:20.735211    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:25.069476 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:25.069442    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-4915f8-89pqs"]
Sep 16 12:25:25.069980 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:25.069964    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a30f77c2-7913-4352-8dd4-f66f1d34e92f" containerName="revoke-keys"
Sep 16 12:25:25.070031 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:25.069982    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a30f77c2-7913-4352-8dd4-f66f1d34e92f" containerName="revoke-keys"
Sep 16 12:25:25.070074 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:25.070054    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a30f77c2-7913-4352-8dd4-f66f1d34e92f" containerName="revoke-keys"
Sep 16 12:25:25.072845 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:25.072831    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-4915f8-89pqs"
Sep 16 12:25:25.075159 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:25.075125    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hvtv7\""
Sep 16 12:25:25.079408 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:25.079376    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-4915f8-89pqs"]
Sep 16 12:25:25.178415 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:25.178379    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/732f0e6b-440d-41d9-bd78-3f2ffcaf5786-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-4915f8-89pqs\" (UID: \"732f0e6b-440d-41d9-bd78-3f2ffcaf5786\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-4915f8-89pqs"
Sep 16 12:25:25.279387 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:25.279351    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/732f0e6b-440d-41d9-bd78-3f2ffcaf5786-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-4915f8-89pqs\" (UID: \"732f0e6b-440d-41d9-bd78-3f2ffcaf5786\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-4915f8-89pqs"
Sep 16 12:25:25.280009 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:25.279990    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/732f0e6b-440d-41d9-bd78-3f2ffcaf5786-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-4915f8-89pqs\" (UID: \"732f0e6b-440d-41d9-bd78-3f2ffcaf5786\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-4915f8-89pqs"
Sep 16 12:25:25.385667 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:25.385635    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-4915f8-89pqs"
Sep 16 12:25:25.454737 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:25.454517    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk"
Sep 16 12:25:25.511317 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:25.511288    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:25.583617 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:25.583591    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b-workload-certs\") pod \"447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b\" (UID: \"447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b\") "
Sep 16 12:25:25.583783 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:25.583635    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b-workload-socket\") pod \"447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b\" (UID: \"447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b\") "
Sep 16 12:25:25.583783 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:25.583663    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b-istio-data\") pod \"447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b\" (UID: \"447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b\") "
Sep 16 12:25:25.583783 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:25.583722    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b-istio-envoy\") pod \"447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b\" (UID: \"447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b\") "
Sep 16 12:25:25.583783 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:25.583753    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b-istiod-ca-cert\") pod \"447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b\" (UID: \"447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b\") "
Sep 16 12:25:25.584020 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:25.583807    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hr9ks\" (UniqueName: \"kubernetes.io/projected/447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b-kube-api-access-hr9ks\") pod \"447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b\" (UID: \"447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b\") "
Sep 16 12:25:25.584020 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:25.583831    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b-credential-socket\") pod \"447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b\" (UID: \"447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b\") "
Sep 16 12:25:25.584020 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:25.583855    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b-istio-podinfo\") pod \"447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b\" (UID: \"447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b\") "
Sep 16 12:25:25.584020 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:25.583891    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b-istio-token\") pod \"447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b\" (UID: \"447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b\") "
Sep 16 12:25:25.584020 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:25.583948    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b" (UID: "447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:25:25.584020 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:25.583973    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b" (UID: "447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:25:25.584385 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:25.584102    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b" (UID: "447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:25:25.584385 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:25.584237    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b" (UID: "447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:25:25.584385 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:25.584360    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b-credential-socket\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:25:25.584385 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:25.584381    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b-workload-certs\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:25:25.584593 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:25.584395    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b-workload-socket\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:25:25.584593 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:25.584408    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b-istiod-ca-cert\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:25:25.584698 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:25.584616    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b-istio-data" (OuterVolumeSpecName: "istio-data") pod "447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b" (UID: "447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:25:25.585979 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:25.585954    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b-kube-api-access-hr9ks" (OuterVolumeSpecName: "kube-api-access-hr9ks") pod "447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b" (UID: "447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b"). InnerVolumeSpecName "kube-api-access-hr9ks". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:25:25.586121 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:25.586107    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b" (UID: "447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 12:25:25.586432 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:25.586412    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b-istio-token" (OuterVolumeSpecName: "istio-token") pod "447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b" (UID: "447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:25:25.586473 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:25.586410    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b" (UID: "447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:25:25.612665 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:25.612605    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:25.628203 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:25.628176    2559 generic.go:356] "Generic (PLEG): container finished" podID="447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b" containerID="6d3d0c5219b8855a14d0355604d979c76fca692ba5bf8ff7e554fb8ad965f12d" exitCode=0
Sep 16 12:25:25.628291 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:25.628236    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk"
Sep 16 12:25:25.628291 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:25.628254    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk" event={"ID":"447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b","Type":"ContainerDied","Data":"6d3d0c5219b8855a14d0355604d979c76fca692ba5bf8ff7e554fb8ad965f12d"}
Sep 16 12:25:25.628365 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:25.628309    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk" event={"ID":"447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b","Type":"ContainerDied","Data":"649bce74d53e1af12efad2769bcd6fef5e0d1d888423535fcdfa703f8f8bd56e"}
Sep 16 12:25:25.628365 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:25.628336    2559 scope.go:117] "RemoveContainer" containerID="6d3d0c5219b8855a14d0355604d979c76fca692ba5bf8ff7e554fb8ad965f12d"
Sep 16 12:25:25.637507 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:25.637491    2559 scope.go:117] "RemoveContainer" containerID="ed571544f9bff0acf2a050744aa1f8c33e623aefacf3e3b160c94d25b433fe56"
Sep 16 12:25:25.646264 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:25.646246    2559 scope.go:117] "RemoveContainer" containerID="6d3d0c5219b8855a14d0355604d979c76fca692ba5bf8ff7e554fb8ad965f12d"
Sep 16 12:25:25.646516 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:25:25.646498    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d3d0c5219b8855a14d0355604d979c76fca692ba5bf8ff7e554fb8ad965f12d\": container with ID starting with 6d3d0c5219b8855a14d0355604d979c76fca692ba5bf8ff7e554fb8ad965f12d not found: ID does not exist" containerID="6d3d0c5219b8855a14d0355604d979c76fca692ba5bf8ff7e554fb8ad965f12d"
Sep 16 12:25:25.646578 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:25.646526    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d3d0c5219b8855a14d0355604d979c76fca692ba5bf8ff7e554fb8ad965f12d"} err="failed to get container status \"6d3d0c5219b8855a14d0355604d979c76fca692ba5bf8ff7e554fb8ad965f12d\": rpc error: code = NotFound desc = could not find container \"6d3d0c5219b8855a14d0355604d979c76fca692ba5bf8ff7e554fb8ad965f12d\": container with ID starting with 6d3d0c5219b8855a14d0355604d979c76fca692ba5bf8ff7e554fb8ad965f12d not found: ID does not exist"
Sep 16 12:25:25.646578 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:25.646548    2559 scope.go:117] "RemoveContainer" containerID="ed571544f9bff0acf2a050744aa1f8c33e623aefacf3e3b160c94d25b433fe56"
Sep 16 12:25:25.646804 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:25:25.646785    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed571544f9bff0acf2a050744aa1f8c33e623aefacf3e3b160c94d25b433fe56\": container with ID starting with ed571544f9bff0acf2a050744aa1f8c33e623aefacf3e3b160c94d25b433fe56 not found: ID does not exist" containerID="ed571544f9bff0acf2a050744aa1f8c33e623aefacf3e3b160c94d25b433fe56"
Sep 16 12:25:25.646851 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:25.646810    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed571544f9bff0acf2a050744aa1f8c33e623aefacf3e3b160c94d25b433fe56"} err="failed to get container status \"ed571544f9bff0acf2a050744aa1f8c33e623aefacf3e3b160c94d25b433fe56\": rpc error: code = NotFound desc = could not find container \"ed571544f9bff0acf2a050744aa1f8c33e623aefacf3e3b160c94d25b433fe56\": container with ID starting with ed571544f9bff0acf2a050744aa1f8c33e623aefacf3e3b160c94d25b433fe56 not found: ID does not exist"
Sep 16 12:25:25.651174 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:25.651146    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk"]
Sep 16 12:25:25.653969 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:25.653947    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-f2bc0450-openshift-default-5845c6bf5b-fq2lk"]
Sep 16 12:25:25.661157 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:25.661118    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-4915f8-89pqs"]
Sep 16 12:25:25.662980 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:25:25.662959    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod732f0e6b_440d_41d9_bd78_3f2ffcaf5786.slice/crio-46d066ae718b2eb78aac40976bb1b3ab4151fb102345e9beed52dd6a3c24558f WatchSource:0}: Error finding container 46d066ae718b2eb78aac40976bb1b3ab4151fb102345e9beed52dd6a3c24558f: Status 404 returned error can't find the container with id 46d066ae718b2eb78aac40976bb1b3ab4151fb102345e9beed52dd6a3c24558f
Sep 16 12:25:25.685567 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:25.685547    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b-istio-data\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:25:25.685567 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:25.685567    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b-istio-envoy\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:25:25.685686 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:25.685576    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hr9ks\" (UniqueName: \"kubernetes.io/projected/447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b-kube-api-access-hr9ks\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:25:25.685686 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:25.685586    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b-istio-podinfo\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:25:25.685686 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:25.685594    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b-istio-token\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:25:25.939328 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:25.939299    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b" path="/var/lib/kubelet/pods/447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b/volumes"
Sep 16 12:25:26.208689 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:26.208563    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:26.635564 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:26.635471    2559 generic.go:356] "Generic (PLEG): container finished" podID="732f0e6b-440d-41d9-bd78-3f2ffcaf5786" containerID="2708953f9c10520425ee5d7a047c9bbe05dc91d45a22e477ce3197c22059d0c1" exitCode=0
Sep 16 12:25:26.635723 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:26.635562    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-4915f8-89pqs" event={"ID":"732f0e6b-440d-41d9-bd78-3f2ffcaf5786","Type":"ContainerDied","Data":"2708953f9c10520425ee5d7a047c9bbe05dc91d45a22e477ce3197c22059d0c1"}
Sep 16 12:25:26.635723 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:26.635621    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-4915f8-89pqs" event={"ID":"732f0e6b-440d-41d9-bd78-3f2ffcaf5786","Type":"ContainerStarted","Data":"46d066ae718b2eb78aac40976bb1b3ab4151fb102345e9beed52dd6a3c24558f"}
Sep 16 12:25:26.727565 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:26.727537    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:26.930431 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:26.930402    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:27.030771 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:27.030735    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:27.144063 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:27.144028    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:27.230703 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:27.230620    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:27.383189 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:27.383155    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:27.743176 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:27.743110    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:27.783804 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:27.783778    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-4915f8-89pqs"
Sep 16 12:25:27.906684 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:27.906664    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/732f0e6b-440d-41d9-bd78-3f2ffcaf5786-maas-api-service-ca\") pod \"732f0e6b-440d-41d9-bd78-3f2ffcaf5786\" (UID: \"732f0e6b-440d-41d9-bd78-3f2ffcaf5786\") "
Sep 16 12:25:27.907027 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:27.907006    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/732f0e6b-440d-41d9-bd78-3f2ffcaf5786-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "732f0e6b-440d-41d9-bd78-3f2ffcaf5786" (UID: "732f0e6b-440d-41d9-bd78-3f2ffcaf5786"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:25:28.007692 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:28.007659    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/732f0e6b-440d-41d9-bd78-3f2ffcaf5786-maas-api-service-ca\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:25:28.533854 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:28.533817    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:28.649848 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:28.649814    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-4915f8-89pqs"
Sep 16 12:25:28.649848 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:28.649837    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-4915f8-89pqs" event={"ID":"732f0e6b-440d-41d9-bd78-3f2ffcaf5786","Type":"ContainerDied","Data":"46d066ae718b2eb78aac40976bb1b3ab4151fb102345e9beed52dd6a3c24558f"}
Sep 16 12:25:28.650059 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:28.649880    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="46d066ae718b2eb78aac40976bb1b3ab4151fb102345e9beed52dd6a3c24558f"
Sep 16 12:25:29.285190 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:29.285152    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:31.500399 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:31.500363    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:25:33.069923 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:33.069889    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:33.173442 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:33.173411    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:33.951119 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:33.951091    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-hrvzp_63ee784a-3b40-4259-9923-74a24d0203a0/console-operator/5.log"
Sep 16 12:25:33.953387 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:33.953365    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-hrvzp_63ee784a-3b40-4259-9923-74a24d0203a0/console-operator/5.log"
Sep 16 12:25:33.981520 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:33.981489    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:34.272208 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:34.272121    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l"]
Sep 16 12:25:34.272550 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:34.272537    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="732f0e6b-440d-41d9-bd78-3f2ffcaf5786" containerName="revoke-keys"
Sep 16 12:25:34.272550 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:34.272550    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="732f0e6b-440d-41d9-bd78-3f2ffcaf5786" containerName="revoke-keys"
Sep 16 12:25:34.272626 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:34.272563    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b" containerName="istio-proxy"
Sep 16 12:25:34.272626 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:34.272568    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b" containerName="istio-proxy"
Sep 16 12:25:34.272626 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:34.272575    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b" containerName="istio-proxy"
Sep 16 12:25:34.272626 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:34.272581    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b" containerName="istio-proxy"
Sep 16 12:25:34.272754 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:34.272653    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b" containerName="istio-proxy"
Sep 16 12:25:34.272754 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:34.272660    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="732f0e6b-440d-41d9-bd78-3f2ffcaf5786" containerName="revoke-keys"
Sep 16 12:25:34.272754 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:34.272668    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="447a1a44-fa4f-4dc1-a8cf-38fd9be61b9b" containerName="istio-proxy"
Sep 16 12:25:34.275796 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:34.275780    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l"
Sep 16 12:25:34.278926 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:34.278907    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-65d8af-openshift-default-dockercfg-5tdvh\""
Sep 16 12:25:34.289084 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:34.289063    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l"]
Sep 16 12:25:34.294594 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:34.294567    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:34.366571 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:34.366531    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b515a3be-a1c2-457b-a82e-2367f9ccbcbd-istio-token\") pod \"e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l\" (UID: \"b515a3be-a1c2-457b-a82e-2367f9ccbcbd\") " pod="openshift-ingress/e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l"
Sep 16 12:25:34.366758 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:34.366612    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b515a3be-a1c2-457b-a82e-2367f9ccbcbd-credential-socket\") pod \"e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l\" (UID: \"b515a3be-a1c2-457b-a82e-2367f9ccbcbd\") " pod="openshift-ingress/e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l"
Sep 16 12:25:34.366758 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:34.366653    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b515a3be-a1c2-457b-a82e-2367f9ccbcbd-istio-data\") pod \"e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l\" (UID: \"b515a3be-a1c2-457b-a82e-2367f9ccbcbd\") " pod="openshift-ingress/e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l"
Sep 16 12:25:34.366758 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:34.366692    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b515a3be-a1c2-457b-a82e-2367f9ccbcbd-istiod-ca-cert\") pod \"e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l\" (UID: \"b515a3be-a1c2-457b-a82e-2367f9ccbcbd\") " pod="openshift-ingress/e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l"
Sep 16 12:25:34.366882 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:34.366788    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b515a3be-a1c2-457b-a82e-2367f9ccbcbd-workload-certs\") pod \"e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l\" (UID: \"b515a3be-a1c2-457b-a82e-2367f9ccbcbd\") " pod="openshift-ingress/e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l"
Sep 16 12:25:34.366882 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:34.366834    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b515a3be-a1c2-457b-a82e-2367f9ccbcbd-istio-podinfo\") pod \"e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l\" (UID: \"b515a3be-a1c2-457b-a82e-2367f9ccbcbd\") " pod="openshift-ingress/e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l"
Sep 16 12:25:34.366958 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:34.366884    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b515a3be-a1c2-457b-a82e-2367f9ccbcbd-workload-socket\") pod \"e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l\" (UID: \"b515a3be-a1c2-457b-a82e-2367f9ccbcbd\") " pod="openshift-ingress/e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l"
Sep 16 12:25:34.367002 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:34.366964    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ql8f\" (UniqueName: \"kubernetes.io/projected/b515a3be-a1c2-457b-a82e-2367f9ccbcbd-kube-api-access-8ql8f\") pod \"e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l\" (UID: \"b515a3be-a1c2-457b-a82e-2367f9ccbcbd\") " pod="openshift-ingress/e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l"
Sep 16 12:25:34.367040 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:34.366997    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b515a3be-a1c2-457b-a82e-2367f9ccbcbd-istio-envoy\") pod \"e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l\" (UID: \"b515a3be-a1c2-457b-a82e-2367f9ccbcbd\") " pod="openshift-ingress/e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l"
Sep 16 12:25:34.467877 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:34.467841    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b515a3be-a1c2-457b-a82e-2367f9ccbcbd-workload-certs\") pod \"e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l\" (UID: \"b515a3be-a1c2-457b-a82e-2367f9ccbcbd\") " pod="openshift-ingress/e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l"
Sep 16 12:25:34.467877 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:34.467879    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b515a3be-a1c2-457b-a82e-2367f9ccbcbd-istio-podinfo\") pod \"e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l\" (UID: \"b515a3be-a1c2-457b-a82e-2367f9ccbcbd\") " pod="openshift-ingress/e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l"
Sep 16 12:25:34.468119 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:34.467909    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b515a3be-a1c2-457b-a82e-2367f9ccbcbd-workload-socket\") pod \"e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l\" (UID: \"b515a3be-a1c2-457b-a82e-2367f9ccbcbd\") " pod="openshift-ingress/e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l"
Sep 16 12:25:34.468119 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:34.467940    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ql8f\" (UniqueName: \"kubernetes.io/projected/b515a3be-a1c2-457b-a82e-2367f9ccbcbd-kube-api-access-8ql8f\") pod \"e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l\" (UID: \"b515a3be-a1c2-457b-a82e-2367f9ccbcbd\") " pod="openshift-ingress/e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l"
Sep 16 12:25:34.468119 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:34.467957    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b515a3be-a1c2-457b-a82e-2367f9ccbcbd-istio-envoy\") pod \"e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l\" (UID: \"b515a3be-a1c2-457b-a82e-2367f9ccbcbd\") " pod="openshift-ingress/e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l"
Sep 16 12:25:34.468119 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:34.467986    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b515a3be-a1c2-457b-a82e-2367f9ccbcbd-istio-token\") pod \"e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l\" (UID: \"b515a3be-a1c2-457b-a82e-2367f9ccbcbd\") " pod="openshift-ingress/e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l"
Sep 16 12:25:34.468119 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:34.468019    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b515a3be-a1c2-457b-a82e-2367f9ccbcbd-credential-socket\") pod \"e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l\" (UID: \"b515a3be-a1c2-457b-a82e-2367f9ccbcbd\") " pod="openshift-ingress/e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l"
Sep 16 12:25:34.468119 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:34.468067    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b515a3be-a1c2-457b-a82e-2367f9ccbcbd-istio-data\") pod \"e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l\" (UID: \"b515a3be-a1c2-457b-a82e-2367f9ccbcbd\") " pod="openshift-ingress/e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l"
Sep 16 12:25:34.468119 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:34.468106    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b515a3be-a1c2-457b-a82e-2367f9ccbcbd-istiod-ca-cert\") pod \"e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l\" (UID: \"b515a3be-a1c2-457b-a82e-2367f9ccbcbd\") " pod="openshift-ingress/e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l"
Sep 16 12:25:34.468457 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:34.468310    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b515a3be-a1c2-457b-a82e-2367f9ccbcbd-workload-certs\") pod \"e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l\" (UID: \"b515a3be-a1c2-457b-a82e-2367f9ccbcbd\") " pod="openshift-ingress/e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l"
Sep 16 12:25:34.468457 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:34.468333    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b515a3be-a1c2-457b-a82e-2367f9ccbcbd-workload-socket\") pod \"e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l\" (UID: \"b515a3be-a1c2-457b-a82e-2367f9ccbcbd\") " pod="openshift-ingress/e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l"
Sep 16 12:25:34.468616 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:34.468595    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b515a3be-a1c2-457b-a82e-2367f9ccbcbd-credential-socket\") pod \"e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l\" (UID: \"b515a3be-a1c2-457b-a82e-2367f9ccbcbd\") " pod="openshift-ingress/e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l"
Sep 16 12:25:34.468688 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:34.468664    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b515a3be-a1c2-457b-a82e-2367f9ccbcbd-istio-data\") pod \"e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l\" (UID: \"b515a3be-a1c2-457b-a82e-2367f9ccbcbd\") " pod="openshift-ingress/e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l"
Sep 16 12:25:34.468796 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:34.468780    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b515a3be-a1c2-457b-a82e-2367f9ccbcbd-istiod-ca-cert\") pod \"e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l\" (UID: \"b515a3be-a1c2-457b-a82e-2367f9ccbcbd\") " pod="openshift-ingress/e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l"
Sep 16 12:25:34.470430 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:34.470408    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b515a3be-a1c2-457b-a82e-2367f9ccbcbd-istio-podinfo\") pod \"e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l\" (UID: \"b515a3be-a1c2-457b-a82e-2367f9ccbcbd\") " pod="openshift-ingress/e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l"
Sep 16 12:25:34.470504 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:34.470426    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b515a3be-a1c2-457b-a82e-2367f9ccbcbd-istio-envoy\") pod \"e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l\" (UID: \"b515a3be-a1c2-457b-a82e-2367f9ccbcbd\") " pod="openshift-ingress/e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l"
Sep 16 12:25:34.476317 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:34.476294    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b515a3be-a1c2-457b-a82e-2367f9ccbcbd-istio-token\") pod \"e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l\" (UID: \"b515a3be-a1c2-457b-a82e-2367f9ccbcbd\") " pod="openshift-ingress/e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l"
Sep 16 12:25:34.476572 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:34.476553    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ql8f\" (UniqueName: \"kubernetes.io/projected/b515a3be-a1c2-457b-a82e-2367f9ccbcbd-kube-api-access-8ql8f\") pod \"e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l\" (UID: \"b515a3be-a1c2-457b-a82e-2367f9ccbcbd\") " pod="openshift-ingress/e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l"
Sep 16 12:25:34.586187 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:34.586075    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l"
Sep 16 12:25:34.762787 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:34.762753    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:34.861799 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:34.861768    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l"]
Sep 16 12:25:34.864336 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:25:34.864301    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb515a3be_a1c2_457b_a82e_2367f9ccbcbd.slice/crio-0d4f6cde8f83844ed78a17eedce4b53e044e091d8b26b06b1dc444eb1c92f2dc WatchSource:0}: Error finding container 0d4f6cde8f83844ed78a17eedce4b53e044e091d8b26b06b1dc444eb1c92f2dc: Status 404 returned error can't find the container with id 0d4f6cde8f83844ed78a17eedce4b53e044e091d8b26b06b1dc444eb1c92f2dc
Sep 16 12:25:34.866769 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:34.866738    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:25:34.866858 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:34.866806    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:25:34.866858 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:34.866836    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:25:35.690155 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:35.690100    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l" event={"ID":"b515a3be-a1c2-457b-a82e-2367f9ccbcbd","Type":"ContainerStarted","Data":"acf50a9867230ffc53c9abff4db5247edc9f5c6782c9f25d7bec5558ede9856a"}
Sep 16 12:25:35.690603 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:35.690163    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l" event={"ID":"b515a3be-a1c2-457b-a82e-2367f9ccbcbd","Type":"ContainerStarted","Data":"0d4f6cde8f83844ed78a17eedce4b53e044e091d8b26b06b1dc444eb1c92f2dc"}
Sep 16 12:25:35.710770 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:35.710721    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l" podStartSLOduration=1.710705164 podStartE2EDuration="1.710705164s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:25:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:25:35.708361509 +0000 UTC m=+1502.328680826" watchObservedRunningTime="2026-09-16 12:25:35.710705164 +0000 UTC m=+1502.331024480"
Sep 16 12:25:35.765961 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:35.765926    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:35.834846 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:35.834784    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:35.901644 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:35.901600    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:35.938656 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:35.938626    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-4915f8-89pqs"]
Sep 16 12:25:35.940657 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:35.940603    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-4915f8-89pqs"]
Sep 16 12:25:35.959653 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:35.959624    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:36.333638 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:36.333551    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:36.434683 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:36.434627    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:36.586774 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:36.586687    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l"
Sep 16 12:25:36.591570 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:36.591547    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l"
Sep 16 12:25:36.696199 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:36.696170    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l"
Sep 16 12:25:36.697212 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:36.697189    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l"
Sep 16 12:25:37.224952 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:37.224919    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:37.865905 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:37.865865    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:37.943118 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:37.943082    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="732f0e6b-440d-41d9-bd78-3f2ffcaf5786" path="/var/lib/kubelet/pods/732f0e6b-440d-41d9-bd78-3f2ffcaf5786/volumes"
Sep 16 12:25:37.959901 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:37.959852    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:38.059570 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:38.059536    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:38.921699 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:38.921669    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:39.628454 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:39.628419    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:39.728382 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:39.728340    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:39.885049 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:39.884955    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:40.075032 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:40.075000    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:40.172284 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:40.172254    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:40.393026 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:40.392989    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:40.493829 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:40.493748    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:41.228088 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:41.228058    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:42.261380 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:42.261346    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:42.361539 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:42.361509    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:42.503185 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:42.503155    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2"]
Sep 16 12:25:42.503471 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:42.503444    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2" podUID="1add6fff-84d3-4c7a-b4e2-aea9fafbe257" containerName="istio-proxy" containerID="cri-o://eedef8cefd0e382bc43dab14d4c0b935eca198491326f46bbed66495bee4004f" gracePeriod=30
Sep 16 12:25:42.536714 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:42.536646    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:42.970864 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:42.970831    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:43.266381 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:43.266301    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-37953c-openshift-default-f575b9d4-k7tw9"]
Sep 16 12:25:43.270424 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:43.270402    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-37953c-openshift-default-f575b9d4-k7tw9"
Sep 16 12:25:43.273114 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:43.273090    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-37953c-openshift-default-dockercfg-5l22l\""
Sep 16 12:25:43.283454 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:43.283431    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-37953c-openshift-default-f575b9d4-k7tw9"]
Sep 16 12:25:43.298214 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:43.298191    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:43.363622 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:43.363592    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a4fded1b-9bf5-4b8d-ab3d-b050f69370de-istio-data\") pod \"e2e-noten-37953c-openshift-default-f575b9d4-k7tw9\" (UID: \"a4fded1b-9bf5-4b8d-ab3d-b050f69370de\") " pod="openshift-ingress/e2e-noten-37953c-openshift-default-f575b9d4-k7tw9"
Sep 16 12:25:43.363778 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:43.363640    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4fded1b-9bf5-4b8d-ab3d-b050f69370de-workload-socket\") pod \"e2e-noten-37953c-openshift-default-f575b9d4-k7tw9\" (UID: \"a4fded1b-9bf5-4b8d-ab3d-b050f69370de\") " pod="openshift-ingress/e2e-noten-37953c-openshift-default-f575b9d4-k7tw9"
Sep 16 12:25:43.363778 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:43.363712    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4jkv\" (UniqueName: \"kubernetes.io/projected/a4fded1b-9bf5-4b8d-ab3d-b050f69370de-kube-api-access-h4jkv\") pod \"e2e-noten-37953c-openshift-default-f575b9d4-k7tw9\" (UID: \"a4fded1b-9bf5-4b8d-ab3d-b050f69370de\") " pod="openshift-ingress/e2e-noten-37953c-openshift-default-f575b9d4-k7tw9"
Sep 16 12:25:43.363907 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:43.363796    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4fded1b-9bf5-4b8d-ab3d-b050f69370de-credential-socket\") pod \"e2e-noten-37953c-openshift-default-f575b9d4-k7tw9\" (UID: \"a4fded1b-9bf5-4b8d-ab3d-b050f69370de\") " pod="openshift-ingress/e2e-noten-37953c-openshift-default-f575b9d4-k7tw9"
Sep 16 12:25:43.363907 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:43.363891    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a4fded1b-9bf5-4b8d-ab3d-b050f69370de-workload-certs\") pod \"e2e-noten-37953c-openshift-default-f575b9d4-k7tw9\" (UID: \"a4fded1b-9bf5-4b8d-ab3d-b050f69370de\") " pod="openshift-ingress/e2e-noten-37953c-openshift-default-f575b9d4-k7tw9"
Sep 16 12:25:43.363990 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:43.363945    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a4fded1b-9bf5-4b8d-ab3d-b050f69370de-istio-token\") pod \"e2e-noten-37953c-openshift-default-f575b9d4-k7tw9\" (UID: \"a4fded1b-9bf5-4b8d-ab3d-b050f69370de\") " pod="openshift-ingress/e2e-noten-37953c-openshift-default-f575b9d4-k7tw9"
Sep 16 12:25:43.363990 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:43.363984    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a4fded1b-9bf5-4b8d-ab3d-b050f69370de-istio-podinfo\") pod \"e2e-noten-37953c-openshift-default-f575b9d4-k7tw9\" (UID: \"a4fded1b-9bf5-4b8d-ab3d-b050f69370de\") " pod="openshift-ingress/e2e-noten-37953c-openshift-default-f575b9d4-k7tw9"
Sep 16 12:25:43.364070 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:43.364048    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a4fded1b-9bf5-4b8d-ab3d-b050f69370de-istio-envoy\") pod \"e2e-noten-37953c-openshift-default-f575b9d4-k7tw9\" (UID: \"a4fded1b-9bf5-4b8d-ab3d-b050f69370de\") " pod="openshift-ingress/e2e-noten-37953c-openshift-default-f575b9d4-k7tw9"
Sep 16 12:25:43.364109 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:43.364099    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a4fded1b-9bf5-4b8d-ab3d-b050f69370de-istiod-ca-cert\") pod \"e2e-noten-37953c-openshift-default-f575b9d4-k7tw9\" (UID: \"a4fded1b-9bf5-4b8d-ab3d-b050f69370de\") " pod="openshift-ingress/e2e-noten-37953c-openshift-default-f575b9d4-k7tw9"
Sep 16 12:25:43.465592 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:43.465553    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a4fded1b-9bf5-4b8d-ab3d-b050f69370de-workload-certs\") pod \"e2e-noten-37953c-openshift-default-f575b9d4-k7tw9\" (UID: \"a4fded1b-9bf5-4b8d-ab3d-b050f69370de\") " pod="openshift-ingress/e2e-noten-37953c-openshift-default-f575b9d4-k7tw9"
Sep 16 12:25:43.465780 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:43.465600    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a4fded1b-9bf5-4b8d-ab3d-b050f69370de-istio-token\") pod \"e2e-noten-37953c-openshift-default-f575b9d4-k7tw9\" (UID: \"a4fded1b-9bf5-4b8d-ab3d-b050f69370de\") " pod="openshift-ingress/e2e-noten-37953c-openshift-default-f575b9d4-k7tw9"
Sep 16 12:25:43.465780 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:43.465632    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a4fded1b-9bf5-4b8d-ab3d-b050f69370de-istio-podinfo\") pod \"e2e-noten-37953c-openshift-default-f575b9d4-k7tw9\" (UID: \"a4fded1b-9bf5-4b8d-ab3d-b050f69370de\") " pod="openshift-ingress/e2e-noten-37953c-openshift-default-f575b9d4-k7tw9"
Sep 16 12:25:43.465780 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:43.465684    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a4fded1b-9bf5-4b8d-ab3d-b050f69370de-istio-envoy\") pod \"e2e-noten-37953c-openshift-default-f575b9d4-k7tw9\" (UID: \"a4fded1b-9bf5-4b8d-ab3d-b050f69370de\") " pod="openshift-ingress/e2e-noten-37953c-openshift-default-f575b9d4-k7tw9"
Sep 16 12:25:43.465780 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:43.465737    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a4fded1b-9bf5-4b8d-ab3d-b050f69370de-istiod-ca-cert\") pod \"e2e-noten-37953c-openshift-default-f575b9d4-k7tw9\" (UID: \"a4fded1b-9bf5-4b8d-ab3d-b050f69370de\") " pod="openshift-ingress/e2e-noten-37953c-openshift-default-f575b9d4-k7tw9"
Sep 16 12:25:43.465960 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:43.465928    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a4fded1b-9bf5-4b8d-ab3d-b050f69370de-istio-data\") pod \"e2e-noten-37953c-openshift-default-f575b9d4-k7tw9\" (UID: \"a4fded1b-9bf5-4b8d-ab3d-b050f69370de\") " pod="openshift-ingress/e2e-noten-37953c-openshift-default-f575b9d4-k7tw9"
Sep 16 12:25:43.466021 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:43.466002    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4fded1b-9bf5-4b8d-ab3d-b050f69370de-workload-socket\") pod \"e2e-noten-37953c-openshift-default-f575b9d4-k7tw9\" (UID: \"a4fded1b-9bf5-4b8d-ab3d-b050f69370de\") " pod="openshift-ingress/e2e-noten-37953c-openshift-default-f575b9d4-k7tw9"
Sep 16 12:25:43.466083 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:43.466030    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a4fded1b-9bf5-4b8d-ab3d-b050f69370de-workload-certs\") pod \"e2e-noten-37953c-openshift-default-f575b9d4-k7tw9\" (UID: \"a4fded1b-9bf5-4b8d-ab3d-b050f69370de\") " pod="openshift-ingress/e2e-noten-37953c-openshift-default-f575b9d4-k7tw9"
Sep 16 12:25:43.466083 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:43.466058    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4jkv\" (UniqueName: \"kubernetes.io/projected/a4fded1b-9bf5-4b8d-ab3d-b050f69370de-kube-api-access-h4jkv\") pod \"e2e-noten-37953c-openshift-default-f575b9d4-k7tw9\" (UID: \"a4fded1b-9bf5-4b8d-ab3d-b050f69370de\") " pod="openshift-ingress/e2e-noten-37953c-openshift-default-f575b9d4-k7tw9"
Sep 16 12:25:43.466303 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:43.466103    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4fded1b-9bf5-4b8d-ab3d-b050f69370de-credential-socket\") pod \"e2e-noten-37953c-openshift-default-f575b9d4-k7tw9\" (UID: \"a4fded1b-9bf5-4b8d-ab3d-b050f69370de\") " pod="openshift-ingress/e2e-noten-37953c-openshift-default-f575b9d4-k7tw9"
Sep 16 12:25:43.466363 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:43.466308    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a4fded1b-9bf5-4b8d-ab3d-b050f69370de-istio-data\") pod \"e2e-noten-37953c-openshift-default-f575b9d4-k7tw9\" (UID: \"a4fded1b-9bf5-4b8d-ab3d-b050f69370de\") " pod="openshift-ingress/e2e-noten-37953c-openshift-default-f575b9d4-k7tw9"
Sep 16 12:25:43.466363 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:43.466349    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4fded1b-9bf5-4b8d-ab3d-b050f69370de-workload-socket\") pod \"e2e-noten-37953c-openshift-default-f575b9d4-k7tw9\" (UID: \"a4fded1b-9bf5-4b8d-ab3d-b050f69370de\") " pod="openshift-ingress/e2e-noten-37953c-openshift-default-f575b9d4-k7tw9"
Sep 16 12:25:43.466465 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:43.466450    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4fded1b-9bf5-4b8d-ab3d-b050f69370de-credential-socket\") pod \"e2e-noten-37953c-openshift-default-f575b9d4-k7tw9\" (UID: \"a4fded1b-9bf5-4b8d-ab3d-b050f69370de\") " pod="openshift-ingress/e2e-noten-37953c-openshift-default-f575b9d4-k7tw9"
Sep 16 12:25:43.466515 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:43.466494    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a4fded1b-9bf5-4b8d-ab3d-b050f69370de-istiod-ca-cert\") pod \"e2e-noten-37953c-openshift-default-f575b9d4-k7tw9\" (UID: \"a4fded1b-9bf5-4b8d-ab3d-b050f69370de\") " pod="openshift-ingress/e2e-noten-37953c-openshift-default-f575b9d4-k7tw9"
Sep 16 12:25:43.468181 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:43.468151    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a4fded1b-9bf5-4b8d-ab3d-b050f69370de-istio-envoy\") pod \"e2e-noten-37953c-openshift-default-f575b9d4-k7tw9\" (UID: \"a4fded1b-9bf5-4b8d-ab3d-b050f69370de\") " pod="openshift-ingress/e2e-noten-37953c-openshift-default-f575b9d4-k7tw9"
Sep 16 12:25:43.468283 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:43.468160    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a4fded1b-9bf5-4b8d-ab3d-b050f69370de-istio-podinfo\") pod \"e2e-noten-37953c-openshift-default-f575b9d4-k7tw9\" (UID: \"a4fded1b-9bf5-4b8d-ab3d-b050f69370de\") " pod="openshift-ingress/e2e-noten-37953c-openshift-default-f575b9d4-k7tw9"
Sep 16 12:25:43.473711 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:43.473689    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4jkv\" (UniqueName: \"kubernetes.io/projected/a4fded1b-9bf5-4b8d-ab3d-b050f69370de-kube-api-access-h4jkv\") pod \"e2e-noten-37953c-openshift-default-f575b9d4-k7tw9\" (UID: \"a4fded1b-9bf5-4b8d-ab3d-b050f69370de\") " pod="openshift-ingress/e2e-noten-37953c-openshift-default-f575b9d4-k7tw9"
Sep 16 12:25:43.473818 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:43.473804    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a4fded1b-9bf5-4b8d-ab3d-b050f69370de-istio-token\") pod \"e2e-noten-37953c-openshift-default-f575b9d4-k7tw9\" (UID: \"a4fded1b-9bf5-4b8d-ab3d-b050f69370de\") " pod="openshift-ingress/e2e-noten-37953c-openshift-default-f575b9d4-k7tw9"
Sep 16 12:25:43.484889 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:43.484868    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:43.582225 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:43.582146    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-37953c-openshift-default-f575b9d4-k7tw9"
Sep 16 12:25:43.864211 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:43.861432    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-37953c-openshift-default-f575b9d4-k7tw9"]
Sep 16 12:25:43.864848 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:25:43.864822    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4fded1b_9bf5_4b8d_ab3d_b050f69370de.slice/crio-22aecb05bb5dd0b659b4dc048f1878b2122e5c8e6dde8a45f6c4867b38b8aaf8 WatchSource:0}: Error finding container 22aecb05bb5dd0b659b4dc048f1878b2122e5c8e6dde8a45f6c4867b38b8aaf8: Status 404 returned error can't find the container with id 22aecb05bb5dd0b659b4dc048f1878b2122e5c8e6dde8a45f6c4867b38b8aaf8
Sep 16 12:25:43.867345 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:43.867312    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:25:43.867456 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:43.867389    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:25:43.867456 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:43.867432    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:25:44.750309 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:44.750275    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-37953c-openshift-default-f575b9d4-k7tw9" event={"ID":"a4fded1b-9bf5-4b8d-ab3d-b050f69370de","Type":"ContainerStarted","Data":"95dc5f665fd4c53c11e34d91c0962aa28f02d5aa495485add60e43afdb46f0bd"}
Sep 16 12:25:44.750768 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:44.750326    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-37953c-openshift-default-f575b9d4-k7tw9" event={"ID":"a4fded1b-9bf5-4b8d-ab3d-b050f69370de","Type":"ContainerStarted","Data":"22aecb05bb5dd0b659b4dc048f1878b2122e5c8e6dde8a45f6c4867b38b8aaf8"}
Sep 16 12:25:44.794080 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:44.794033    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-37953c-openshift-default-f575b9d4-k7tw9" podStartSLOduration=1.7940157 podStartE2EDuration="1.7940157s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:25:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:25:44.792071258 +0000 UTC m=+1511.412390575" watchObservedRunningTime="2026-09-16 12:25:44.7940157 +0000 UTC m=+1511.414335015"
Sep 16 12:25:45.077955 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:45.077866    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:45.183693 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:45.183651    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:45.285114 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:45.285080    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:45.583338 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:45.583311    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-37953c-openshift-default-f575b9d4-k7tw9"
Sep 16 12:25:45.588787 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:45.588765    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-37953c-openshift-default-f575b9d4-k7tw9"
Sep 16 12:25:45.755712 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:45.755683    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-37953c-openshift-default-f575b9d4-k7tw9"
Sep 16 12:25:45.756584 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:45.756564    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-37953c-openshift-default-f575b9d4-k7tw9"
Sep 16 12:25:46.506523 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:46.506494    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:46.616409 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:46.616376    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9a49af-cthwf"]
Sep 16 12:25:46.619990 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:46.619971    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9a49af-cthwf"
Sep 16 12:25:46.622368 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:46.622350    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hvtv7\""
Sep 16 12:25:46.627736 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:46.627713    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9a49af-cthwf"]
Sep 16 12:25:46.701372 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:46.701338    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fcab6f4d-afc2-4881-a600-caaa08d8244e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-9a49af-cthwf\" (UID: \"fcab6f4d-afc2-4881-a600-caaa08d8244e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9a49af-cthwf"
Sep 16 12:25:46.802388 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:46.802295    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fcab6f4d-afc2-4881-a600-caaa08d8244e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-9a49af-cthwf\" (UID: \"fcab6f4d-afc2-4881-a600-caaa08d8244e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9a49af-cthwf"
Sep 16 12:25:46.802931 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:46.802911    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fcab6f4d-afc2-4881-a600-caaa08d8244e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-9a49af-cthwf\" (UID: \"fcab6f4d-afc2-4881-a600-caaa08d8244e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9a49af-cthwf"
Sep 16 12:25:46.933267 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:46.933233    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9a49af-cthwf"
Sep 16 12:25:46.988956 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:46.988913    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:47.227554 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:47.227526    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9a49af-cthwf"]
Sep 16 12:25:47.229633 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:25:47.229593    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcab6f4d_afc2_4881_a600_caaa08d8244e.slice/crio-ecb84f5a52ede7f21c31bb4c6e58e518559539b0b945227afe394614617f97f1 WatchSource:0}: Error finding container ecb84f5a52ede7f21c31bb4c6e58e518559539b0b945227afe394614617f97f1: Status 404 returned error can't find the container with id ecb84f5a52ede7f21c31bb4c6e58e518559539b0b945227afe394614617f97f1
Sep 16 12:25:47.777021 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:47.776623    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9a49af-cthwf" event={"ID":"fcab6f4d-afc2-4881-a600-caaa08d8244e","Type":"ContainerStarted","Data":"5b71f77c8a867c74b971cf1e892f04b4f0bc8747625b8fe9a3b488a894de007b"}
Sep 16 12:25:47.777218 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:47.777029    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9a49af-cthwf" event={"ID":"fcab6f4d-afc2-4881-a600-caaa08d8244e","Type":"ContainerStarted","Data":"ecb84f5a52ede7f21c31bb4c6e58e518559539b0b945227afe394614617f97f1"}
Sep 16 12:25:47.779089 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:47.779061    2559 generic.go:356] "Generic (PLEG): container finished" podID="1add6fff-84d3-4c7a-b4e2-aea9fafbe257" containerID="eedef8cefd0e382bc43dab14d4c0b935eca198491326f46bbed66495bee4004f" exitCode=0
Sep 16 12:25:47.779219 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:47.779153    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2" event={"ID":"1add6fff-84d3-4c7a-b4e2-aea9fafbe257","Type":"ContainerDied","Data":"eedef8cefd0e382bc43dab14d4c0b935eca198491326f46bbed66495bee4004f"}
Sep 16 12:25:47.779300 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:47.779224    2559 scope.go:117] "RemoveContainer" containerID="408688780f37cf98761b245e0c9c980af6c010877004e7b2512ae501e068ceed"
Sep 16 12:25:47.792463 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:47.792409    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9a49af-cthwf" podStartSLOduration=1.792394499 podStartE2EDuration="1.792394499s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:25:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:25:47.791350229 +0000 UTC m=+1514.411669547" watchObservedRunningTime="2026-09-16 12:25:47.792394499 +0000 UTC m=+1514.412713805"
Sep 16 12:25:47.803582 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:47.803561    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2"
Sep 16 12:25:47.825753 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:47.825723    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:47.915284 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:47.915256    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1add6fff-84d3-4c7a-b4e2-aea9fafbe257-workload-certs\") pod \"1add6fff-84d3-4c7a-b4e2-aea9fafbe257\" (UID: \"1add6fff-84d3-4c7a-b4e2-aea9fafbe257\") "
Sep 16 12:25:47.915487 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:47.915292    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1add6fff-84d3-4c7a-b4e2-aea9fafbe257-istio-podinfo\") pod \"1add6fff-84d3-4c7a-b4e2-aea9fafbe257\" (UID: \"1add6fff-84d3-4c7a-b4e2-aea9fafbe257\") "
Sep 16 12:25:47.915487 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:47.915314    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1add6fff-84d3-4c7a-b4e2-aea9fafbe257-istio-envoy\") pod \"1add6fff-84d3-4c7a-b4e2-aea9fafbe257\" (UID: \"1add6fff-84d3-4c7a-b4e2-aea9fafbe257\") "
Sep 16 12:25:47.915487 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:47.915331    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1add6fff-84d3-4c7a-b4e2-aea9fafbe257-credential-socket\") pod \"1add6fff-84d3-4c7a-b4e2-aea9fafbe257\" (UID: \"1add6fff-84d3-4c7a-b4e2-aea9fafbe257\") "
Sep 16 12:25:47.915487 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:47.915464    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1add6fff-84d3-4c7a-b4e2-aea9fafbe257-istio-data\") pod \"1add6fff-84d3-4c7a-b4e2-aea9fafbe257\" (UID: \"1add6fff-84d3-4c7a-b4e2-aea9fafbe257\") "
Sep 16 12:25:47.915716 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:47.915510    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1add6fff-84d3-4c7a-b4e2-aea9fafbe257-istio-token\") pod \"1add6fff-84d3-4c7a-b4e2-aea9fafbe257\" (UID: \"1add6fff-84d3-4c7a-b4e2-aea9fafbe257\") "
Sep 16 12:25:47.915716 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:47.915542    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rmg48\" (UniqueName: \"kubernetes.io/projected/1add6fff-84d3-4c7a-b4e2-aea9fafbe257-kube-api-access-rmg48\") pod \"1add6fff-84d3-4c7a-b4e2-aea9fafbe257\" (UID: \"1add6fff-84d3-4c7a-b4e2-aea9fafbe257\") "
Sep 16 12:25:47.915716 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:47.915543    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1add6fff-84d3-4c7a-b4e2-aea9fafbe257-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1add6fff-84d3-4c7a-b4e2-aea9fafbe257" (UID: "1add6fff-84d3-4c7a-b4e2-aea9fafbe257"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:25:47.915716 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:47.915668    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1add6fff-84d3-4c7a-b4e2-aea9fafbe257-workload-socket\") pod \"1add6fff-84d3-4c7a-b4e2-aea9fafbe257\" (UID: \"1add6fff-84d3-4c7a-b4e2-aea9fafbe257\") "
Sep 16 12:25:47.915716 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:47.915711    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1add6fff-84d3-4c7a-b4e2-aea9fafbe257-istiod-ca-cert\") pod \"1add6fff-84d3-4c7a-b4e2-aea9fafbe257\" (UID: \"1add6fff-84d3-4c7a-b4e2-aea9fafbe257\") "
Sep 16 12:25:47.915945 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:47.915665    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1add6fff-84d3-4c7a-b4e2-aea9fafbe257-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1add6fff-84d3-4c7a-b4e2-aea9fafbe257" (UID: "1add6fff-84d3-4c7a-b4e2-aea9fafbe257"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:25:47.915945 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:47.915767    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1add6fff-84d3-4c7a-b4e2-aea9fafbe257-istio-data" (OuterVolumeSpecName: "istio-data") pod "1add6fff-84d3-4c7a-b4e2-aea9fafbe257" (UID: "1add6fff-84d3-4c7a-b4e2-aea9fafbe257"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:25:47.916057 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:47.915884    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1add6fff-84d3-4c7a-b4e2-aea9fafbe257-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1add6fff-84d3-4c7a-b4e2-aea9fafbe257" (UID: "1add6fff-84d3-4c7a-b4e2-aea9fafbe257"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:25:47.916181 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:47.916122    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1add6fff-84d3-4c7a-b4e2-aea9fafbe257-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1add6fff-84d3-4c7a-b4e2-aea9fafbe257" (UID: "1add6fff-84d3-4c7a-b4e2-aea9fafbe257"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:25:47.916884 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:47.916865    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1add6fff-84d3-4c7a-b4e2-aea9fafbe257-istiod-ca-cert\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:25:47.916964 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:47.916889    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1add6fff-84d3-4c7a-b4e2-aea9fafbe257-workload-certs\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:25:47.916964 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:47.916905    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1add6fff-84d3-4c7a-b4e2-aea9fafbe257-credential-socket\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:25:47.916964 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:47.916920    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1add6fff-84d3-4c7a-b4e2-aea9fafbe257-istio-data\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:25:47.916964 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:47.916935    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1add6fff-84d3-4c7a-b4e2-aea9fafbe257-workload-socket\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:25:47.917578 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:47.917553    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1add6fff-84d3-4c7a-b4e2-aea9fafbe257-istio-token" (OuterVolumeSpecName: "istio-token") pod "1add6fff-84d3-4c7a-b4e2-aea9fafbe257" (UID: "1add6fff-84d3-4c7a-b4e2-aea9fafbe257"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:25:47.917905 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:47.917878    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1add6fff-84d3-4c7a-b4e2-aea9fafbe257-kube-api-access-rmg48" (OuterVolumeSpecName: "kube-api-access-rmg48") pod "1add6fff-84d3-4c7a-b4e2-aea9fafbe257" (UID: "1add6fff-84d3-4c7a-b4e2-aea9fafbe257"). InnerVolumeSpecName "kube-api-access-rmg48". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:25:47.917987 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:47.917932    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1add6fff-84d3-4c7a-b4e2-aea9fafbe257-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1add6fff-84d3-4c7a-b4e2-aea9fafbe257" (UID: "1add6fff-84d3-4c7a-b4e2-aea9fafbe257"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:25:47.917987 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:47.917941    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1add6fff-84d3-4c7a-b4e2-aea9fafbe257-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1add6fff-84d3-4c7a-b4e2-aea9fafbe257" (UID: "1add6fff-84d3-4c7a-b4e2-aea9fafbe257"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 12:25:48.018255 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:48.018226    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1add6fff-84d3-4c7a-b4e2-aea9fafbe257-istio-envoy\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:25:48.018255 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:48.018252    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1add6fff-84d3-4c7a-b4e2-aea9fafbe257-istio-token\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:25:48.018255 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:48.018262    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rmg48\" (UniqueName: \"kubernetes.io/projected/1add6fff-84d3-4c7a-b4e2-aea9fafbe257-kube-api-access-rmg48\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:25:48.018463 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:48.018271    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1add6fff-84d3-4c7a-b4e2-aea9fafbe257-istio-podinfo\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:25:48.544865 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:48.544777    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:48.786274 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:48.786244    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2"
Sep 16 12:25:48.786534 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:48.786285    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2" event={"ID":"1add6fff-84d3-4c7a-b4e2-aea9fafbe257","Type":"ContainerDied","Data":"4e78a018e7d7f9aebcf920b7cc7b3dfc09316209879040882b5686f849081fa0"}
Sep 16 12:25:48.786534 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:48.786340    2559 scope.go:117] "RemoveContainer" containerID="eedef8cefd0e382bc43dab14d4c0b935eca198491326f46bbed66495bee4004f"
Sep 16 12:25:48.788090 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:48.788064    2559 generic.go:356] "Generic (PLEG): container finished" podID="fcab6f4d-afc2-4881-a600-caaa08d8244e" containerID="5b71f77c8a867c74b971cf1e892f04b4f0bc8747625b8fe9a3b488a894de007b" exitCode=0
Sep 16 12:25:48.788216 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:48.788125    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9a49af-cthwf" event={"ID":"fcab6f4d-afc2-4881-a600-caaa08d8244e","Type":"ContainerDied","Data":"5b71f77c8a867c74b971cf1e892f04b4f0bc8747625b8fe9a3b488a894de007b"}
Sep 16 12:25:48.806093 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:48.806061    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2"]
Sep 16 12:25:48.810364 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:48.810341    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-4915f8-openshift-default-7f9c997876-fxxk2"]
Sep 16 12:25:49.251599 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:49.251513    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:49.965613 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:49.965580    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1add6fff-84d3-4c7a-b4e2-aea9fafbe257" path="/var/lib/kubelet/pods/1add6fff-84d3-4c7a-b4e2-aea9fafbe257/volumes"
Sep 16 12:25:49.986900 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:49.986882    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9a49af-cthwf"
Sep 16 12:25:50.032676 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:50.032612    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:50.062620 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:50.062533    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fcab6f4d-afc2-4881-a600-caaa08d8244e-maas-api-service-ca\") pod \"fcab6f4d-afc2-4881-a600-caaa08d8244e\" (UID: \"fcab6f4d-afc2-4881-a600-caaa08d8244e\") "
Sep 16 12:25:50.062921 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:50.062898    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fcab6f4d-afc2-4881-a600-caaa08d8244e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "fcab6f4d-afc2-4881-a600-caaa08d8244e" (UID: "fcab6f4d-afc2-4881-a600-caaa08d8244e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:25:50.164275 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:50.164243    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fcab6f4d-afc2-4881-a600-caaa08d8244e-maas-api-service-ca\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:25:50.801548 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:50.801518    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9a49af-cthwf"
Sep 16 12:25:50.801761 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:50.801558    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9a49af-cthwf" event={"ID":"fcab6f4d-afc2-4881-a600-caaa08d8244e","Type":"ContainerDied","Data":"ecb84f5a52ede7f21c31bb4c6e58e518559539b0b945227afe394614617f97f1"}
Sep 16 12:25:50.801761 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:50.801614    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ecb84f5a52ede7f21c31bb4c6e58e518559539b0b945227afe394614617f97f1"
Sep 16 12:25:50.925557 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:50.925497    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:51.605466 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:51.605434    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:52.392412 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:52.392373    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:52.608607 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:52.608570    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:52.737349 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:52.737294    2559 patch_prober.go:28] interesting pod/e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 16 12:25:52.737596 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:52.737367    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l" podUID="b515a3be-a1c2-457b-a82e-2367f9ccbcbd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 16 12:25:52.738576 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:52.738549    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:52.960633 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:52.960595    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:53.135094 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:53.135011    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:53.237304 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:53.237273    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z"]
Sep 16 12:25:53.237876 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:53.237857    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcab6f4d-afc2-4881-a600-caaa08d8244e" containerName="revoke-keys"
Sep 16 12:25:53.237876 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:53.237878    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcab6f4d-afc2-4881-a600-caaa08d8244e" containerName="revoke-keys"
Sep 16 12:25:53.238050 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:53.237900    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1add6fff-84d3-4c7a-b4e2-aea9fafbe257" containerName="istio-proxy"
Sep 16 12:25:53.238050 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:53.237908    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1add6fff-84d3-4c7a-b4e2-aea9fafbe257" containerName="istio-proxy"
Sep 16 12:25:53.238050 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:53.237930    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1add6fff-84d3-4c7a-b4e2-aea9fafbe257" containerName="istio-proxy"
Sep 16 12:25:53.238050 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:53.237939    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1add6fff-84d3-4c7a-b4e2-aea9fafbe257" containerName="istio-proxy"
Sep 16 12:25:53.238050 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:53.238034    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="fcab6f4d-afc2-4881-a600-caaa08d8244e" containerName="revoke-keys"
Sep 16 12:25:53.238050 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:53.238047    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1add6fff-84d3-4c7a-b4e2-aea9fafbe257" containerName="istio-proxy"
Sep 16 12:25:53.238362 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:53.238058    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1add6fff-84d3-4c7a-b4e2-aea9fafbe257" containerName="istio-proxy"
Sep 16 12:25:53.241685 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:53.241663    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z"
Sep 16 12:25:53.245680 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:53.245539    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-f9133e-openshift-default-dockercfg-m689f\""
Sep 16 12:25:53.255444 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:53.255418    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z"]
Sep 16 12:25:53.270783 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:53.270743    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:53.399962 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:53.399788    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e68e78d0-9fb4-477d-8e25-0ef8838b01ee-istio-envoy\") pod \"e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z\" (UID: \"e68e78d0-9fb4-477d-8e25-0ef8838b01ee\") " pod="openshift-ingress/e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z"
Sep 16 12:25:53.399962 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:53.399851    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e68e78d0-9fb4-477d-8e25-0ef8838b01ee-istio-token\") pod \"e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z\" (UID: \"e68e78d0-9fb4-477d-8e25-0ef8838b01ee\") " pod="openshift-ingress/e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z"
Sep 16 12:25:53.399962 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:53.399884    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e68e78d0-9fb4-477d-8e25-0ef8838b01ee-istio-podinfo\") pod \"e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z\" (UID: \"e68e78d0-9fb4-477d-8e25-0ef8838b01ee\") " pod="openshift-ingress/e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z"
Sep 16 12:25:53.400304 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:53.399977    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e68e78d0-9fb4-477d-8e25-0ef8838b01ee-credential-socket\") pod \"e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z\" (UID: \"e68e78d0-9fb4-477d-8e25-0ef8838b01ee\") " pod="openshift-ingress/e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z"
Sep 16 12:25:53.400304 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:53.400020    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e68e78d0-9fb4-477d-8e25-0ef8838b01ee-workload-socket\") pod \"e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z\" (UID: \"e68e78d0-9fb4-477d-8e25-0ef8838b01ee\") " pod="openshift-ingress/e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z"
Sep 16 12:25:53.400304 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:53.400066    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpgnl\" (UniqueName: \"kubernetes.io/projected/e68e78d0-9fb4-477d-8e25-0ef8838b01ee-kube-api-access-qpgnl\") pod \"e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z\" (UID: \"e68e78d0-9fb4-477d-8e25-0ef8838b01ee\") " pod="openshift-ingress/e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z"
Sep 16 12:25:53.400304 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:53.400099    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e68e78d0-9fb4-477d-8e25-0ef8838b01ee-workload-certs\") pod \"e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z\" (UID: \"e68e78d0-9fb4-477d-8e25-0ef8838b01ee\") " pod="openshift-ingress/e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z"
Sep 16 12:25:53.400304 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:53.400213    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e68e78d0-9fb4-477d-8e25-0ef8838b01ee-istiod-ca-cert\") pod \"e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z\" (UID: \"e68e78d0-9fb4-477d-8e25-0ef8838b01ee\") " pod="openshift-ingress/e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z"
Sep 16 12:25:53.400304 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:53.400273    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e68e78d0-9fb4-477d-8e25-0ef8838b01ee-istio-data\") pod \"e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z\" (UID: \"e68e78d0-9fb4-477d-8e25-0ef8838b01ee\") " pod="openshift-ingress/e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z"
Sep 16 12:25:53.501792 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:53.501758    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpgnl\" (UniqueName: \"kubernetes.io/projected/e68e78d0-9fb4-477d-8e25-0ef8838b01ee-kube-api-access-qpgnl\") pod \"e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z\" (UID: \"e68e78d0-9fb4-477d-8e25-0ef8838b01ee\") " pod="openshift-ingress/e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z"
Sep 16 12:25:53.501988 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:53.501803    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e68e78d0-9fb4-477d-8e25-0ef8838b01ee-workload-certs\") pod \"e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z\" (UID: \"e68e78d0-9fb4-477d-8e25-0ef8838b01ee\") " pod="openshift-ingress/e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z"
Sep 16 12:25:53.501988 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:53.501835    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e68e78d0-9fb4-477d-8e25-0ef8838b01ee-istiod-ca-cert\") pod \"e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z\" (UID: \"e68e78d0-9fb4-477d-8e25-0ef8838b01ee\") " pod="openshift-ingress/e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z"
Sep 16 12:25:53.501988 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:53.501874    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e68e78d0-9fb4-477d-8e25-0ef8838b01ee-istio-data\") pod \"e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z\" (UID: \"e68e78d0-9fb4-477d-8e25-0ef8838b01ee\") " pod="openshift-ingress/e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z"
Sep 16 12:25:53.501988 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:53.501946    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e68e78d0-9fb4-477d-8e25-0ef8838b01ee-istio-envoy\") pod \"e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z\" (UID: \"e68e78d0-9fb4-477d-8e25-0ef8838b01ee\") " pod="openshift-ingress/e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z"
Sep 16 12:25:53.501988 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:53.501977    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e68e78d0-9fb4-477d-8e25-0ef8838b01ee-istio-token\") pod \"e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z\" (UID: \"e68e78d0-9fb4-477d-8e25-0ef8838b01ee\") " pod="openshift-ingress/e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z"
Sep 16 12:25:53.502284 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:53.502001    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e68e78d0-9fb4-477d-8e25-0ef8838b01ee-istio-podinfo\") pod \"e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z\" (UID: \"e68e78d0-9fb4-477d-8e25-0ef8838b01ee\") " pod="openshift-ingress/e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z"
Sep 16 12:25:53.502284 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:53.502081    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e68e78d0-9fb4-477d-8e25-0ef8838b01ee-credential-socket\") pod \"e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z\" (UID: \"e68e78d0-9fb4-477d-8e25-0ef8838b01ee\") " pod="openshift-ingress/e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z"
Sep 16 12:25:53.502284 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:53.502120    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e68e78d0-9fb4-477d-8e25-0ef8838b01ee-workload-socket\") pod \"e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z\" (UID: \"e68e78d0-9fb4-477d-8e25-0ef8838b01ee\") " pod="openshift-ingress/e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z"
Sep 16 12:25:53.502284 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:53.502243    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e68e78d0-9fb4-477d-8e25-0ef8838b01ee-workload-certs\") pod \"e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z\" (UID: \"e68e78d0-9fb4-477d-8e25-0ef8838b01ee\") " pod="openshift-ingress/e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z"
Sep 16 12:25:53.502456 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:53.502431    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e68e78d0-9fb4-477d-8e25-0ef8838b01ee-istio-data\") pod \"e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z\" (UID: \"e68e78d0-9fb4-477d-8e25-0ef8838b01ee\") " pod="openshift-ingress/e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z"
Sep 16 12:25:53.502643 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:53.502617    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e68e78d0-9fb4-477d-8e25-0ef8838b01ee-credential-socket\") pod \"e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z\" (UID: \"e68e78d0-9fb4-477d-8e25-0ef8838b01ee\") " pod="openshift-ingress/e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z"
Sep 16 12:25:53.502713 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:53.502636    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e68e78d0-9fb4-477d-8e25-0ef8838b01ee-workload-socket\") pod \"e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z\" (UID: \"e68e78d0-9fb4-477d-8e25-0ef8838b01ee\") " pod="openshift-ingress/e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z"
Sep 16 12:25:53.502860 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:53.502841    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e68e78d0-9fb4-477d-8e25-0ef8838b01ee-istiod-ca-cert\") pod \"e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z\" (UID: \"e68e78d0-9fb4-477d-8e25-0ef8838b01ee\") " pod="openshift-ingress/e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z"
Sep 16 12:25:53.504966 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:53.504937    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e68e78d0-9fb4-477d-8e25-0ef8838b01ee-istio-envoy\") pod \"e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z\" (UID: \"e68e78d0-9fb4-477d-8e25-0ef8838b01ee\") " pod="openshift-ingress/e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z"
Sep 16 12:25:53.505172 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:53.505111    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e68e78d0-9fb4-477d-8e25-0ef8838b01ee-istio-podinfo\") pod \"e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z\" (UID: \"e68e78d0-9fb4-477d-8e25-0ef8838b01ee\") " pod="openshift-ingress/e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z"
Sep 16 12:25:53.512375 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:53.512351    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e68e78d0-9fb4-477d-8e25-0ef8838b01ee-istio-token\") pod \"e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z\" (UID: \"e68e78d0-9fb4-477d-8e25-0ef8838b01ee\") " pod="openshift-ingress/e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z"
Sep 16 12:25:53.512675 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:53.512657    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpgnl\" (UniqueName: \"kubernetes.io/projected/e68e78d0-9fb4-477d-8e25-0ef8838b01ee-kube-api-access-qpgnl\") pod \"e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z\" (UID: \"e68e78d0-9fb4-477d-8e25-0ef8838b01ee\") " pod="openshift-ingress/e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z"
Sep 16 12:25:53.559183 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:53.559153    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z"
Sep 16 12:25:53.844677 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:53.844654    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z"]
Sep 16 12:25:53.847157 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:25:53.847097    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode68e78d0_9fb4_477d_8e25_0ef8838b01ee.slice/crio-70ac6cf0dc96c355ac5a85b8843f079cc335d1db0995c6cbe77026ab485ca47a WatchSource:0}: Error finding container 70ac6cf0dc96c355ac5a85b8843f079cc335d1db0995c6cbe77026ab485ca47a: Status 404 returned error can't find the container with id 70ac6cf0dc96c355ac5a85b8843f079cc335d1db0995c6cbe77026ab485ca47a
Sep 16 12:25:53.849919 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:53.849883    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:25:53.850017 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:53.849966    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:25:53.850017 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:53.849997    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:25:53.908872 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:53.908843    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:54.232842 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:54.232803    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:54.578771 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:54.578693    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:54.830375 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:54.830278    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z" event={"ID":"e68e78d0-9fb4-477d-8e25-0ef8838b01ee","Type":"ContainerStarted","Data":"518934de02e1ad7347292b83427b639ecaa4e97e5e3e6100b72d21e825360ed6"}
Sep 16 12:25:54.830375 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:54.830341    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z" event={"ID":"e68e78d0-9fb4-477d-8e25-0ef8838b01ee","Type":"ContainerStarted","Data":"70ac6cf0dc96c355ac5a85b8843f079cc335d1db0995c6cbe77026ab485ca47a"}
Sep 16 12:25:54.852632 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:54.852583    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z" podStartSLOduration=1.852568851 podStartE2EDuration="1.852568851s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:25:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:25:54.850710276 +0000 UTC m=+1521.471029591" watchObservedRunningTime="2026-09-16 12:25:54.852568851 +0000 UTC m=+1521.472888166"
Sep 16 12:25:55.560239 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:55.560203    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z"
Sep 16 12:25:55.566053 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:55.566032    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z"
Sep 16 12:25:55.839075 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:55.836866    2559 generic.go:356] "Generic (PLEG): container finished" podID="b515a3be-a1c2-457b-a82e-2367f9ccbcbd" containerID="acf50a9867230ffc53c9abff4db5247edc9f5c6782c9f25d7bec5558ede9856a" exitCode=0
Sep 16 12:25:55.839075 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:55.838001    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l" event={"ID":"b515a3be-a1c2-457b-a82e-2367f9ccbcbd","Type":"ContainerDied","Data":"acf50a9867230ffc53c9abff4db5247edc9f5c6782c9f25d7bec5558ede9856a"}
Sep 16 12:25:55.839075 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:55.838057    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z"
Sep 16 12:25:55.839075 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:55.838486    2559 scope.go:117] "RemoveContainer" containerID="acf50a9867230ffc53c9abff4db5247edc9f5c6782c9f25d7bec5558ede9856a"
Sep 16 12:25:55.840511 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:55.840476    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:25:55.841945 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:55.841538    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z"
Sep 16 12:25:55.842054 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:55.841923    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:25:55.842054 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:55.842013    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:25:56.205388 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:56.205343    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:56.759282 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:56.759251    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:56.844879 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:56.844835    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l" event={"ID":"b515a3be-a1c2-457b-a82e-2367f9ccbcbd","Type":"ContainerStarted","Data":"400f52252aa45d4b8168ab22f38c5e8ba9f93794eca42866899c76d4f95a0e13"}
Sep 16 12:25:56.858829 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:56.858801    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:56.959748 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:56.959688    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:57.564663 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:57.564629    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:57.586604 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:57.586574    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l"
Sep 16 12:25:57.586847 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:57.586821    2559 patch_prober.go:28] interesting pod/e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Sep 16 12:25:57.586937 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:57.586882    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l" podUID="b515a3be-a1c2-457b-a82e-2367f9ccbcbd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Sep 16 12:25:57.613620 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:57.613577    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-9a49af-7cb84c6757-cdftt"]
Sep 16 12:25:57.613922 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:57.613893    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-9a49af-7cb84c6757-cdftt" podUID="3f3f32c2-21a0-4b0c-b9b9-afa883c14733" containerName="payload-processing" containerID="cri-o://3e2975ed14bcb16039d6d190f816ec570ad42328f001dc7e49e6f3dfe64b90f8" gracePeriod=30
Sep 16 12:25:57.620318 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:57.620286    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-9a49af-75f44ddf58-q2hkn"]
Sep 16 12:25:57.620757 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:57.620556    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-9a49af-75f44ddf58-q2hkn" podUID="06ce496b-8053-4770-8068-f09f6b1a1364" containerName="payload-pre-processing" containerID="cri-o://244af1e26180456563f589296315b6d58ecffea6a866dbc8fff73beee1f141ed" gracePeriod=30
Sep 16 12:25:57.660728 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:57.660282    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:57.767535 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:57.767480    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:25:57.771448 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:57.771421    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:57.891155 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:57.891039    2559 generic.go:356] "Generic (PLEG): container finished" podID="06ce496b-8053-4770-8068-f09f6b1a1364" containerID="244af1e26180456563f589296315b6d58ecffea6a866dbc8fff73beee1f141ed" exitCode=0
Sep 16 12:25:57.891347 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:57.891256    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-9a49af-75f44ddf58-q2hkn" event={"ID":"06ce496b-8053-4770-8068-f09f6b1a1364","Type":"ContainerDied","Data":"244af1e26180456563f589296315b6d58ecffea6a866dbc8fff73beee1f141ed"}
Sep 16 12:25:57.894156 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:57.892973    2559 generic.go:356] "Generic (PLEG): container finished" podID="3f3f32c2-21a0-4b0c-b9b9-afa883c14733" containerID="3e2975ed14bcb16039d6d190f816ec570ad42328f001dc7e49e6f3dfe64b90f8" exitCode=0
Sep 16 12:25:57.894156 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:57.893723    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-9a49af-7cb84c6757-cdftt" event={"ID":"3f3f32c2-21a0-4b0c-b9b9-afa883c14733","Type":"ContainerDied","Data":"3e2975ed14bcb16039d6d190f816ec570ad42328f001dc7e49e6f3dfe64b90f8"}
Sep 16 12:25:57.979233 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:57.979207    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-9a49af-7cb84c6757-cdftt"
Sep 16 12:25:57.996202 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:57.996176    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-9a49af-75f44ddf58-q2hkn"
Sep 16 12:25:58.071610 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:58.071528    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/06ce496b-8053-4770-8068-f09f6b1a1364-plugins-config-volume\") pod \"06ce496b-8053-4770-8068-f09f6b1a1364\" (UID: \"06ce496b-8053-4770-8068-f09f6b1a1364\") "
Sep 16 12:25:58.071610 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:58.071568    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r2kgp\" (UniqueName: \"kubernetes.io/projected/3f3f32c2-21a0-4b0c-b9b9-afa883c14733-kube-api-access-r2kgp\") pod \"3f3f32c2-21a0-4b0c-b9b9-afa883c14733\" (UID: \"3f3f32c2-21a0-4b0c-b9b9-afa883c14733\") "
Sep 16 12:25:58.071783 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:58.071668    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rqkfx\" (UniqueName: \"kubernetes.io/projected/06ce496b-8053-4770-8068-f09f6b1a1364-kube-api-access-rqkfx\") pod \"06ce496b-8053-4770-8068-f09f6b1a1364\" (UID: \"06ce496b-8053-4770-8068-f09f6b1a1364\") "
Sep 16 12:25:58.071783 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:58.071712    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3f3f32c2-21a0-4b0c-b9b9-afa883c14733-plugins-config-volume\") pod \"3f3f32c2-21a0-4b0c-b9b9-afa883c14733\" (UID: \"3f3f32c2-21a0-4b0c-b9b9-afa883c14733\") "
Sep 16 12:25:58.072101 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:58.071958    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06ce496b-8053-4770-8068-f09f6b1a1364-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "06ce496b-8053-4770-8068-f09f6b1a1364" (UID: "06ce496b-8053-4770-8068-f09f6b1a1364"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:25:58.072101 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:58.072091    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f3f32c2-21a0-4b0c-b9b9-afa883c14733-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3f3f32c2-21a0-4b0c-b9b9-afa883c14733" (UID: "3f3f32c2-21a0-4b0c-b9b9-afa883c14733"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:25:58.073637 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:58.073619    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f3f32c2-21a0-4b0c-b9b9-afa883c14733-kube-api-access-r2kgp" (OuterVolumeSpecName: "kube-api-access-r2kgp") pod "3f3f32c2-21a0-4b0c-b9b9-afa883c14733" (UID: "3f3f32c2-21a0-4b0c-b9b9-afa883c14733"). InnerVolumeSpecName "kube-api-access-r2kgp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:25:58.073698 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:58.073645    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06ce496b-8053-4770-8068-f09f6b1a1364-kube-api-access-rqkfx" (OuterVolumeSpecName: "kube-api-access-rqkfx") pod "06ce496b-8053-4770-8068-f09f6b1a1364" (UID: "06ce496b-8053-4770-8068-f09f6b1a1364"). InnerVolumeSpecName "kube-api-access-rqkfx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:25:58.119795 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:58.119759    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:58.172837 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:58.172804    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/06ce496b-8053-4770-8068-f09f6b1a1364-plugins-config-volume\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:25:58.172837 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:58.172831    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r2kgp\" (UniqueName: \"kubernetes.io/projected/3f3f32c2-21a0-4b0c-b9b9-afa883c14733-kube-api-access-r2kgp\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:25:58.172837 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:58.172840    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rqkfx\" (UniqueName: \"kubernetes.io/projected/06ce496b-8053-4770-8068-f09f6b1a1364-kube-api-access-rqkfx\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:25:58.173232 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:58.172850    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3f3f32c2-21a0-4b0c-b9b9-afa883c14733-plugins-config-volume\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:25:58.224127 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:58.224096    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:58.265230 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:58.265187    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9a49af-cthwf"]
Sep 16 12:25:58.268385 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:58.268352    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9a49af-cthwf"]
Sep 16 12:25:58.323562 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:58.323471    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:58.586515 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:58.586436    2559 patch_prober.go:28] interesting pod/e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Sep 16 12:25:58.586515 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:58.586494    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l" podUID="b515a3be-a1c2-457b-a82e-2367f9ccbcbd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Sep 16 12:25:58.613794 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:58.613765    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:58.901073 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:58.901046    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-9a49af-75f44ddf58-q2hkn"
Sep 16 12:25:58.901276 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:58.901086    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-9a49af-75f44ddf58-q2hkn" event={"ID":"06ce496b-8053-4770-8068-f09f6b1a1364","Type":"ContainerDied","Data":"e1fc055c47bf20664ea1a0e6797fae2b1ddc314b7dddbfb6f7c375be99d67e2e"}
Sep 16 12:25:58.901276 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:58.901164    2559 scope.go:117] "RemoveContainer" containerID="244af1e26180456563f589296315b6d58ecffea6a866dbc8fff73beee1f141ed"
Sep 16 12:25:58.902801 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:58.902782    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-9a49af-7cb84c6757-cdftt"
Sep 16 12:25:58.902882 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:58.902802    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-9a49af-7cb84c6757-cdftt" event={"ID":"3f3f32c2-21a0-4b0c-b9b9-afa883c14733","Type":"ContainerDied","Data":"9ae3338ea6742454756363f17df0ab35379c63f32ad8ffa8f3e281a268a22018"}
Sep 16 12:25:58.911657 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:58.911636    2559 scope.go:117] "RemoveContainer" containerID="3e2975ed14bcb16039d6d190f816ec570ad42328f001dc7e49e6f3dfe64b90f8"
Sep 16 12:25:58.926372 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:58.926352    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-9a49af-7cb84c6757-cdftt"]
Sep 16 12:25:58.931788 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:58.931768    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-9a49af-7cb84c6757-cdftt"]
Sep 16 12:25:58.947208 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:58.947179    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-9a49af-75f44ddf58-q2hkn"]
Sep 16 12:25:58.952216 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:58.952182    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:58.961362 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:58.961336    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-9a49af-75f44ddf58-q2hkn"]
Sep 16 12:25:59.587100 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:59.587063    2559 patch_prober.go:28] interesting pod/e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Sep 16 12:25:59.587524 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:59.587123    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l" podUID="b515a3be-a1c2-457b-a82e-2367f9ccbcbd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Sep 16 12:25:59.904543 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:59.904509    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:25:59.961969 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:59.961925    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06ce496b-8053-4770-8068-f09f6b1a1364" path="/var/lib/kubelet/pods/06ce496b-8053-4770-8068-f09f6b1a1364/volumes"
Sep 16 12:25:59.962361 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:59.962344    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f3f32c2-21a0-4b0c-b9b9-afa883c14733" path="/var/lib/kubelet/pods/3f3f32c2-21a0-4b0c-b9b9-afa883c14733/volumes"
Sep 16 12:25:59.962646 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:25:59.962633    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fcab6f4d-afc2-4881-a600-caaa08d8244e" path="/var/lib/kubelet/pods/fcab6f4d-afc2-4881-a600-caaa08d8244e/volumes"
Sep 16 12:26:00.007223 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:00.007190    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:00.161036 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:00.160932    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:00.377153 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:00.377105    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:00.482329 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:00.482249    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:00.515924 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:00.515894    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-f9133e-b5cf86585-gvs7f"]
Sep 16 12:26:00.516331 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:00.516317    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06ce496b-8053-4770-8068-f09f6b1a1364" containerName="payload-pre-processing"
Sep 16 12:26:00.516380 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:00.516333    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="06ce496b-8053-4770-8068-f09f6b1a1364" containerName="payload-pre-processing"
Sep 16 12:26:00.516380 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:00.516359    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f3f32c2-21a0-4b0c-b9b9-afa883c14733" containerName="payload-processing"
Sep 16 12:26:00.516380 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:00.516364    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f3f32c2-21a0-4b0c-b9b9-afa883c14733" containerName="payload-processing"
Sep 16 12:26:00.516471 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:00.516421    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f3f32c2-21a0-4b0c-b9b9-afa883c14733" containerName="payload-processing"
Sep 16 12:26:00.516471 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:00.516434    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="06ce496b-8053-4770-8068-f09f6b1a1364" containerName="payload-pre-processing"
Sep 16 12:26:00.520780 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:00.520763    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f9133e-b5cf86585-gvs7f"
Sep 16 12:26:00.523571 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:00.523545    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-f9133e\""
Sep 16 12:26:00.523701 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:00.523593    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-f9133e-dockercfg-vkb57\""
Sep 16 12:26:00.528786 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:00.528758    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-f9133e-b5cf86585-gvs7f"]
Sep 16 12:26:00.586905 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:00.586875    2559 patch_prober.go:28] interesting pod/e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Sep 16 12:26:00.587077 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:00.586946    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l" podUID="b515a3be-a1c2-457b-a82e-2367f9ccbcbd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Sep 16 12:26:00.592465 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:00.592440    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/83176f10-ef21-4402-be73-5bde2906651c-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-f9133e-b5cf86585-gvs7f\" (UID: \"83176f10-ef21-4402-be73-5bde2906651c\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f9133e-b5cf86585-gvs7f"
Sep 16 12:26:00.592795 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:00.592496    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4tld\" (UniqueName: \"kubernetes.io/projected/83176f10-ef21-4402-be73-5bde2906651c-kube-api-access-c4tld\") pod \"payload-processing-e2e-shared-b-w2-f9133e-b5cf86585-gvs7f\" (UID: \"83176f10-ef21-4402-be73-5bde2906651c\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f9133e-b5cf86585-gvs7f"
Sep 16 12:26:00.693309 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:00.693273    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/83176f10-ef21-4402-be73-5bde2906651c-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-f9133e-b5cf86585-gvs7f\" (UID: \"83176f10-ef21-4402-be73-5bde2906651c\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f9133e-b5cf86585-gvs7f"
Sep 16 12:26:00.693309 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:00.693315    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4tld\" (UniqueName: \"kubernetes.io/projected/83176f10-ef21-4402-be73-5bde2906651c-kube-api-access-c4tld\") pod \"payload-processing-e2e-shared-b-w2-f9133e-b5cf86585-gvs7f\" (UID: \"83176f10-ef21-4402-be73-5bde2906651c\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f9133e-b5cf86585-gvs7f"
Sep 16 12:26:00.694055 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:00.694036    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/83176f10-ef21-4402-be73-5bde2906651c-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-f9133e-b5cf86585-gvs7f\" (UID: \"83176f10-ef21-4402-be73-5bde2906651c\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f9133e-b5cf86585-gvs7f"
Sep 16 12:26:00.701474 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:00.701439    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4tld\" (UniqueName: \"kubernetes.io/projected/83176f10-ef21-4402-be73-5bde2906651c-kube-api-access-c4tld\") pod \"payload-processing-e2e-shared-b-w2-f9133e-b5cf86585-gvs7f\" (UID: \"83176f10-ef21-4402-be73-5bde2906651c\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f9133e-b5cf86585-gvs7f"
Sep 16 12:26:00.829936 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:00.829843    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:00.833706 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:00.833684    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f9133e-b5cf86585-gvs7f"
Sep 16 12:26:01.127088 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:01.127063    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-f9133e-b5cf86585-gvs7f"]
Sep 16 12:26:01.130438 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:26:01.130408    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83176f10_ef21_4402_be73_5bde2906651c.slice/crio-d6d99cc01574e518d38dd6d27c049af760909152444d352320ff578bfc6cb64e WatchSource:0}: Error finding container d6d99cc01574e518d38dd6d27c049af760909152444d352320ff578bfc6cb64e: Status 404 returned error can't find the container with id d6d99cc01574e518d38dd6d27c049af760909152444d352320ff578bfc6cb64e
Sep 16 12:26:01.586904 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:01.586869    2559 patch_prober.go:28] interesting pod/e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Sep 16 12:26:01.587179 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:01.586922    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l" podUID="b515a3be-a1c2-457b-a82e-2367f9ccbcbd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Sep 16 12:26:01.926839 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:01.926805    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f9133e-b5cf86585-gvs7f" event={"ID":"83176f10-ef21-4402-be73-5bde2906651c","Type":"ContainerStarted","Data":"a925424b63424bdc4d75583937da8fce76925ec2b7db384afbe849da2dccb0bd"}
Sep 16 12:26:01.927339 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:01.926865    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f9133e-b5cf86585-gvs7f"
Sep 16 12:26:01.927339 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:01.926888    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f9133e-b5cf86585-gvs7f" event={"ID":"83176f10-ef21-4402-be73-5bde2906651c","Type":"ContainerStarted","Data":"d6d99cc01574e518d38dd6d27c049af760909152444d352320ff578bfc6cb64e"}
Sep 16 12:26:01.947633 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:01.947560    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f9133e-b5cf86585-gvs7f" podStartSLOduration=1.947535813 podStartE2EDuration="1.947535813s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:26:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:26:01.944417807 +0000 UTC m=+1528.564737126" watchObservedRunningTime="2026-09-16 12:26:01.947535813 +0000 UTC m=+1528.567855127"
Sep 16 12:26:02.306162 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:02.306066    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:02.514986 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:02.514948    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:02.591402 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:02.591319    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l"
Sep 16 12:26:02.591681 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:02.591648    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l"
Sep 16 12:26:02.593053 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:02.593031    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l"
Sep 16 12:26:03.110817 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:03.110780    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:04.334155 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:04.334096    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:04.435279 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:04.435241    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:04.585869 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:04.585780    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn"]
Sep 16 12:26:04.586159 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:04.586108    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn" podUID="906351b2-188c-4513-992d-db47f5faa810" containerName="istio-proxy" containerID="cri-o://dd80817d742248ecd458e9f48d82434230decd0ec3acc35faed215820b693114" gracePeriod=30
Sep 16 12:26:04.611105 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:04.611071    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:04.921080 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:04.921048    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4bef4d-62zqh"]
Sep 16 12:26:04.924546 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:04.924521    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4bef4d-62zqh"
Sep 16 12:26:04.926917 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:04.926897    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hvtv7\""
Sep 16 12:26:04.931889 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:04.931868    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4bef4d-62zqh"]
Sep 16 12:26:05.038524 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:05.038473    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8258de11-aeb5-48e4-8742-8b19eb4445de-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-4bef4d-62zqh\" (UID: \"8258de11-aeb5-48e4-8742-8b19eb4445de\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4bef4d-62zqh"
Sep 16 12:26:05.139649 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:05.139611    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8258de11-aeb5-48e4-8742-8b19eb4445de-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-4bef4d-62zqh\" (UID: \"8258de11-aeb5-48e4-8742-8b19eb4445de\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4bef4d-62zqh"
Sep 16 12:26:05.140242 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:05.140224    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8258de11-aeb5-48e4-8742-8b19eb4445de-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-4bef4d-62zqh\" (UID: \"8258de11-aeb5-48e4-8742-8b19eb4445de\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4bef4d-62zqh"
Sep 16 12:26:05.212971 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:05.212872    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:05.238814 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:05.238781    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4bef4d-62zqh"
Sep 16 12:26:05.515561 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:05.515531    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4bef4d-62zqh"]
Sep 16 12:26:05.517886 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:26:05.517855    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8258de11_aeb5_48e4_8742_8b19eb4445de.slice/crio-4c234ae984ddfa13c54154861ba2a4d197c435e70806f7a0a09a79efa6e43607 WatchSource:0}: Error finding container 4c234ae984ddfa13c54154861ba2a4d197c435e70806f7a0a09a79efa6e43607: Status 404 returned error can't find the container with id 4c234ae984ddfa13c54154861ba2a4d197c435e70806f7a0a09a79efa6e43607
Sep 16 12:26:05.907042 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:05.906992    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:05.955354 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:05.955322    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4bef4d-62zqh" event={"ID":"8258de11-aeb5-48e4-8742-8b19eb4445de","Type":"ContainerStarted","Data":"fec151bc8e199d2b80ad1d70bf5caaed09daf513d9cb5ce4e33f6124741beaaa"}
Sep 16 12:26:05.955568 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:05.955378    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4bef4d-62zqh" event={"ID":"8258de11-aeb5-48e4-8742-8b19eb4445de","Type":"ContainerStarted","Data":"4c234ae984ddfa13c54154861ba2a4d197c435e70806f7a0a09a79efa6e43607"}
Sep 16 12:26:05.972710 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:05.972651    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4bef4d-62zqh" podStartSLOduration=1.972630968 podStartE2EDuration="1.972630968s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:26:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:26:05.970039518 +0000 UTC m=+1532.590358834" watchObservedRunningTime="2026-09-16 12:26:05.972630968 +0000 UTC m=+1532.592950286"
Sep 16 12:26:06.524372 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:06.524283    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:06.962851 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:06.962811    2559 generic.go:356] "Generic (PLEG): container finished" podID="8258de11-aeb5-48e4-8742-8b19eb4445de" containerID="fec151bc8e199d2b80ad1d70bf5caaed09daf513d9cb5ce4e33f6124741beaaa" exitCode=0
Sep 16 12:26:06.963001 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:06.962897    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4bef4d-62zqh" event={"ID":"8258de11-aeb5-48e4-8742-8b19eb4445de","Type":"ContainerDied","Data":"fec151bc8e199d2b80ad1d70bf5caaed09daf513d9cb5ce4e33f6124741beaaa"}
Sep 16 12:26:07.145685 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:07.145655    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:07.838946 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:07.838903    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:08.100767 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:08.100710    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4bef4d-62zqh"
Sep 16 12:26:08.170663 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:08.170630    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8258de11-aeb5-48e4-8742-8b19eb4445de-maas-api-service-ca\") pod \"8258de11-aeb5-48e4-8742-8b19eb4445de\" (UID: \"8258de11-aeb5-48e4-8742-8b19eb4445de\") "
Sep 16 12:26:08.170966 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:08.170945    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8258de11-aeb5-48e4-8742-8b19eb4445de-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8258de11-aeb5-48e4-8742-8b19eb4445de" (UID: "8258de11-aeb5-48e4-8742-8b19eb4445de"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:26:08.271943 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:08.271911    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8258de11-aeb5-48e4-8742-8b19eb4445de-maas-api-service-ca\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:26:08.452347 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:08.452313    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:08.975247 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:08.975206    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4bef4d-62zqh" event={"ID":"8258de11-aeb5-48e4-8742-8b19eb4445de","Type":"ContainerDied","Data":"4c234ae984ddfa13c54154861ba2a4d197c435e70806f7a0a09a79efa6e43607"}
Sep 16 12:26:08.975620 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:08.975266    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4c234ae984ddfa13c54154861ba2a4d197c435e70806f7a0a09a79efa6e43607"
Sep 16 12:26:08.975620 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:08.975267    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4bef4d-62zqh"
Sep 16 12:26:09.841844 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:09.841815    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn"
Sep 16 12:26:09.886541 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:09.886462    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/906351b2-188c-4513-992d-db47f5faa810-istio-envoy\") pod \"906351b2-188c-4513-992d-db47f5faa810\" (UID: \"906351b2-188c-4513-992d-db47f5faa810\") "
Sep 16 12:26:09.886714 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:09.886540    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/906351b2-188c-4513-992d-db47f5faa810-istio-data\") pod \"906351b2-188c-4513-992d-db47f5faa810\" (UID: \"906351b2-188c-4513-992d-db47f5faa810\") "
Sep 16 12:26:09.886714 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:09.886580    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bvx6t\" (UniqueName: \"kubernetes.io/projected/906351b2-188c-4513-992d-db47f5faa810-kube-api-access-bvx6t\") pod \"906351b2-188c-4513-992d-db47f5faa810\" (UID: \"906351b2-188c-4513-992d-db47f5faa810\") "
Sep 16 12:26:09.886714 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:09.886607    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/906351b2-188c-4513-992d-db47f5faa810-istio-token\") pod \"906351b2-188c-4513-992d-db47f5faa810\" (UID: \"906351b2-188c-4513-992d-db47f5faa810\") "
Sep 16 12:26:09.886714 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:09.886673    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/906351b2-188c-4513-992d-db47f5faa810-credential-socket\") pod \"906351b2-188c-4513-992d-db47f5faa810\" (UID: \"906351b2-188c-4513-992d-db47f5faa810\") "
Sep 16 12:26:09.886714 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:09.886709    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/906351b2-188c-4513-992d-db47f5faa810-workload-certs\") pod \"906351b2-188c-4513-992d-db47f5faa810\" (UID: \"906351b2-188c-4513-992d-db47f5faa810\") "
Sep 16 12:26:09.886982 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:09.886749    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/906351b2-188c-4513-992d-db47f5faa810-workload-socket\") pod \"906351b2-188c-4513-992d-db47f5faa810\" (UID: \"906351b2-188c-4513-992d-db47f5faa810\") "
Sep 16 12:26:09.886982 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:09.886784    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/906351b2-188c-4513-992d-db47f5faa810-istio-podinfo\") pod \"906351b2-188c-4513-992d-db47f5faa810\" (UID: \"906351b2-188c-4513-992d-db47f5faa810\") "
Sep 16 12:26:09.886982 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:09.886833    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/906351b2-188c-4513-992d-db47f5faa810-istiod-ca-cert\") pod \"906351b2-188c-4513-992d-db47f5faa810\" (UID: \"906351b2-188c-4513-992d-db47f5faa810\") "
Sep 16 12:26:09.887148 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:09.887100    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/906351b2-188c-4513-992d-db47f5faa810-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "906351b2-188c-4513-992d-db47f5faa810" (UID: "906351b2-188c-4513-992d-db47f5faa810"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:26:09.887259 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:09.887231    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/906351b2-188c-4513-992d-db47f5faa810-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "906351b2-188c-4513-992d-db47f5faa810" (UID: "906351b2-188c-4513-992d-db47f5faa810"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:26:09.887337 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:09.887283    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/906351b2-188c-4513-992d-db47f5faa810-workload-socket\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:26:09.887337 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:09.887279    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/906351b2-188c-4513-992d-db47f5faa810-istio-data" (OuterVolumeSpecName: "istio-data") pod "906351b2-188c-4513-992d-db47f5faa810" (UID: "906351b2-188c-4513-992d-db47f5faa810"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:26:09.887337 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:09.887292    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/906351b2-188c-4513-992d-db47f5faa810-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "906351b2-188c-4513-992d-db47f5faa810" (UID: "906351b2-188c-4513-992d-db47f5faa810"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:26:09.887647 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:09.887607    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/906351b2-188c-4513-992d-db47f5faa810-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "906351b2-188c-4513-992d-db47f5faa810" (UID: "906351b2-188c-4513-992d-db47f5faa810"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:26:09.889348 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:09.889298    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/906351b2-188c-4513-992d-db47f5faa810-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "906351b2-188c-4513-992d-db47f5faa810" (UID: "906351b2-188c-4513-992d-db47f5faa810"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 12:26:09.889495 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:09.889468    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/906351b2-188c-4513-992d-db47f5faa810-istio-token" (OuterVolumeSpecName: "istio-token") pod "906351b2-188c-4513-992d-db47f5faa810" (UID: "906351b2-188c-4513-992d-db47f5faa810"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:26:09.889568 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:09.889513    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/906351b2-188c-4513-992d-db47f5faa810-kube-api-access-bvx6t" (OuterVolumeSpecName: "kube-api-access-bvx6t") pod "906351b2-188c-4513-992d-db47f5faa810" (UID: "906351b2-188c-4513-992d-db47f5faa810"). InnerVolumeSpecName "kube-api-access-bvx6t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:26:09.889629 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:09.889595    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/906351b2-188c-4513-992d-db47f5faa810-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "906351b2-188c-4513-992d-db47f5faa810" (UID: "906351b2-188c-4513-992d-db47f5faa810"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:26:09.982297 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:09.982263    2559 generic.go:356] "Generic (PLEG): container finished" podID="906351b2-188c-4513-992d-db47f5faa810" containerID="dd80817d742248ecd458e9f48d82434230decd0ec3acc35faed215820b693114" exitCode=0
Sep 16 12:26:09.982676 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:09.982302    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn"
Sep 16 12:26:09.982676 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:09.982340    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn" event={"ID":"906351b2-188c-4513-992d-db47f5faa810","Type":"ContainerDied","Data":"dd80817d742248ecd458e9f48d82434230decd0ec3acc35faed215820b693114"}
Sep 16 12:26:09.982676 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:09.982395    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn" event={"ID":"906351b2-188c-4513-992d-db47f5faa810","Type":"ContainerDied","Data":"cbc8c1459d59f117c3f7cb656066e702031676e70b799cb3546f18f178fb013d"}
Sep 16 12:26:09.982676 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:09.982421    2559 scope.go:117] "RemoveContainer" containerID="dd80817d742248ecd458e9f48d82434230decd0ec3acc35faed215820b693114"
Sep 16 12:26:09.988011 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:09.987986    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/906351b2-188c-4513-992d-db47f5faa810-istio-envoy\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:26:09.988011 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:09.988007    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/906351b2-188c-4513-992d-db47f5faa810-istio-data\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:26:09.988154 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:09.988015    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bvx6t\" (UniqueName: \"kubernetes.io/projected/906351b2-188c-4513-992d-db47f5faa810-kube-api-access-bvx6t\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:26:09.988154 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:09.988033    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/906351b2-188c-4513-992d-db47f5faa810-istio-token\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:26:09.988154 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:09.988046    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/906351b2-188c-4513-992d-db47f5faa810-credential-socket\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:26:09.988154 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:09.988054    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/906351b2-188c-4513-992d-db47f5faa810-workload-certs\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:26:09.988154 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:09.988062    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/906351b2-188c-4513-992d-db47f5faa810-istio-podinfo\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:26:09.988154 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:09.988069    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/906351b2-188c-4513-992d-db47f5faa810-istiod-ca-cert\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:26:09.992066 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:09.992049    2559 scope.go:117] "RemoveContainer" containerID="c8b92a046ceab4e03fbb3dc7248e82c995bec501e762f9e41732c7dfb629ea2f"
Sep 16 12:26:10.000194 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:10.000169    2559 scope.go:117] "RemoveContainer" containerID="dd80817d742248ecd458e9f48d82434230decd0ec3acc35faed215820b693114"
Sep 16 12:26:10.000468 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:26:10.000450    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd80817d742248ecd458e9f48d82434230decd0ec3acc35faed215820b693114\": container with ID starting with dd80817d742248ecd458e9f48d82434230decd0ec3acc35faed215820b693114 not found: ID does not exist" containerID="dd80817d742248ecd458e9f48d82434230decd0ec3acc35faed215820b693114"
Sep 16 12:26:10.000547 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:10.000474    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd80817d742248ecd458e9f48d82434230decd0ec3acc35faed215820b693114"} err="failed to get container status \"dd80817d742248ecd458e9f48d82434230decd0ec3acc35faed215820b693114\": rpc error: code = NotFound desc = could not find container \"dd80817d742248ecd458e9f48d82434230decd0ec3acc35faed215820b693114\": container with ID starting with dd80817d742248ecd458e9f48d82434230decd0ec3acc35faed215820b693114 not found: ID does not exist"
Sep 16 12:26:10.000547 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:10.000491    2559 scope.go:117] "RemoveContainer" containerID="c8b92a046ceab4e03fbb3dc7248e82c995bec501e762f9e41732c7dfb629ea2f"
Sep 16 12:26:10.000734 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:26:10.000713    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8b92a046ceab4e03fbb3dc7248e82c995bec501e762f9e41732c7dfb629ea2f\": container with ID starting with c8b92a046ceab4e03fbb3dc7248e82c995bec501e762f9e41732c7dfb629ea2f not found: ID does not exist" containerID="c8b92a046ceab4e03fbb3dc7248e82c995bec501e762f9e41732c7dfb629ea2f"
Sep 16 12:26:10.000793 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:10.000742    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8b92a046ceab4e03fbb3dc7248e82c995bec501e762f9e41732c7dfb629ea2f"} err="failed to get container status \"c8b92a046ceab4e03fbb3dc7248e82c995bec501e762f9e41732c7dfb629ea2f\": rpc error: code = NotFound desc = could not find container \"c8b92a046ceab4e03fbb3dc7248e82c995bec501e762f9e41732c7dfb629ea2f\": container with ID starting with c8b92a046ceab4e03fbb3dc7248e82c995bec501e762f9e41732c7dfb629ea2f not found: ID does not exist"
Sep 16 12:26:10.000990 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:10.000970    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn"]
Sep 16 12:26:10.006621 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:10.006602    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-9a49af-openshift-default-76d456f4cd-h2cjn"]
Sep 16 12:26:11.940301 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:11.940259    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="906351b2-188c-4513-992d-db47f5faa810" path="/var/lib/kubelet/pods/906351b2-188c-4513-992d-db47f5faa810/volumes"
Sep 16 12:26:12.939331 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:12.939293    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f9133e-b5cf86585-gvs7f"
Sep 16 12:26:15.111273 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:15.111235    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:15.871758 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:15.871705    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:16.075525 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:16.075492    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4bef4d-62zqh"]
Sep 16 12:26:16.077607 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:16.077584    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4bef4d-62zqh"]
Sep 16 12:26:16.289278 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:16.289242    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:16.353820 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:16.353790    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:16.483531 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:16.483496    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:17.005690 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:17.005649    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:17.314196 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:17.314098    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:26:17.832303 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:17.832276    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:17.937764 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:17.937735    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8258de11-aeb5-48e4-8742-8b19eb4445de" path="/var/lib/kubelet/pods/8258de11-aeb5-48e4-8742-8b19eb4445de/volumes"
Sep 16 12:26:18.442188 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:18.442148    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:19.715545 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:19.715512    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:20.043169 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:20.043075    2559 generic.go:356] "Generic (PLEG): container finished" podID="e68e78d0-9fb4-477d-8e25-0ef8838b01ee" containerID="518934de02e1ad7347292b83427b639ecaa4e97e5e3e6100b72d21e825360ed6" exitCode=0
Sep 16 12:26:20.043315 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:20.043167    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z" event={"ID":"e68e78d0-9fb4-477d-8e25-0ef8838b01ee","Type":"ContainerDied","Data":"518934de02e1ad7347292b83427b639ecaa4e97e5e3e6100b72d21e825360ed6"}
Sep 16 12:26:20.043631 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:20.043617    2559 scope.go:117] "RemoveContainer" containerID="518934de02e1ad7347292b83427b639ecaa4e97e5e3e6100b72d21e825360ed6"
Sep 16 12:26:20.044756 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:20.044730    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:26:20.044827 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:20.044794    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:26:20.044864 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:20.044837    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:26:20.518739 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:20.518697    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:21.061752 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:21.061700    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z" event={"ID":"e68e78d0-9fb4-477d-8e25-0ef8838b01ee","Type":"ContainerStarted","Data":"7f635ef8d379f5f8a1360f979563ec561dc1cb2eb5bae9711ae4eaeb06c27a48"}
Sep 16 12:26:21.232730 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:21.232693    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:21.560259 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:21.560214    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z"
Sep 16 12:26:21.561056 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:21.561030    2559 patch_prober.go:28] interesting pod/e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 16 12:26:21.561124 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:21.561091    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z" podUID="e68e78d0-9fb4-477d-8e25-0ef8838b01ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 16 12:26:21.724851 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:21.724818    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:22.027246 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:22.027210    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:22.559826 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:22.559785    2559 patch_prober.go:28] interesting pod/e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 16 12:26:22.560369 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:22.560246    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z" podUID="e68e78d0-9fb4-477d-8e25-0ef8838b01ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 16 12:26:22.859963 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:22.859854    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:22.960589 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:22.960553    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:23.126272 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:23.126190    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:23.560180 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:23.559968    2559 patch_prober.go:28] interesting pod/e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 16 12:26:23.560180 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:23.560035    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z" podUID="e68e78d0-9fb4-477d-8e25-0ef8838b01ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 16 12:26:23.975248 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:23.975220    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw"]
Sep 16 12:26:23.975714 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:23.975695    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8258de11-aeb5-48e4-8742-8b19eb4445de" containerName="revoke-keys"
Sep 16 12:26:23.975813 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:23.975718    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8258de11-aeb5-48e4-8742-8b19eb4445de" containerName="revoke-keys"
Sep 16 12:26:23.975813 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:23.975743    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="906351b2-188c-4513-992d-db47f5faa810" containerName="istio-proxy"
Sep 16 12:26:23.975813 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:23.975752    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="906351b2-188c-4513-992d-db47f5faa810" containerName="istio-proxy"
Sep 16 12:26:23.975813 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:23.975776    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="906351b2-188c-4513-992d-db47f5faa810" containerName="istio-proxy"
Sep 16 12:26:23.975813 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:23.975785    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="906351b2-188c-4513-992d-db47f5faa810" containerName="istio-proxy"
Sep 16 12:26:23.976043 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:23.975877    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="906351b2-188c-4513-992d-db47f5faa810" containerName="istio-proxy"
Sep 16 12:26:23.976043 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:23.975891    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="906351b2-188c-4513-992d-db47f5faa810" containerName="istio-proxy"
Sep 16 12:26:23.976043 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:23.975906    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="8258de11-aeb5-48e4-8742-8b19eb4445de" containerName="revoke-keys"
Sep 16 12:26:23.978197 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:23.978178    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw"
Sep 16 12:26:23.981244 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:23.981223    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-72eee5-openshift-default-dockercfg-crwhc\""
Sep 16 12:26:23.991444 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:23.991383    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw"]
Sep 16 12:26:24.060155 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:24.059642    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:24.152684 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:24.152650    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:24.159493 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:24.159466    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4sgd\" (UniqueName: \"kubernetes.io/projected/6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea-kube-api-access-z4sgd\") pod \"e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw\" (UID: \"6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea\") " pod="openshift-ingress/e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw"
Sep 16 12:26:24.159801 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:24.159781    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea-credential-socket\") pod \"e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw\" (UID: \"6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea\") " pod="openshift-ingress/e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw"
Sep 16 12:26:24.160006 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:24.159990    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea-istio-podinfo\") pod \"e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw\" (UID: \"6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea\") " pod="openshift-ingress/e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw"
Sep 16 12:26:24.160249 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:24.160201    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea-istio-envoy\") pod \"e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw\" (UID: \"6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea\") " pod="openshift-ingress/e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw"
Sep 16 12:26:24.160402 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:24.160386    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea-istio-data\") pod \"e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw\" (UID: \"6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea\") " pod="openshift-ingress/e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw"
Sep 16 12:26:24.160564 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:24.160540    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea-istiod-ca-cert\") pod \"e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw\" (UID: \"6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea\") " pod="openshift-ingress/e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw"
Sep 16 12:26:24.160744 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:24.160709    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea-workload-socket\") pod \"e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw\" (UID: \"6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea\") " pod="openshift-ingress/e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw"
Sep 16 12:26:24.160937 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:24.160900    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea-istio-token\") pod \"e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw\" (UID: \"6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea\") " pod="openshift-ingress/e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw"
Sep 16 12:26:24.161143 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:24.161115    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea-workload-certs\") pod \"e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw\" (UID: \"6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea\") " pod="openshift-ingress/e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw"
Sep 16 12:26:24.263209 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:24.261911    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4sgd\" (UniqueName: \"kubernetes.io/projected/6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea-kube-api-access-z4sgd\") pod \"e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw\" (UID: \"6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea\") " pod="openshift-ingress/e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw"
Sep 16 12:26:24.263209 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:24.261979    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea-credential-socket\") pod \"e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw\" (UID: \"6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea\") " pod="openshift-ingress/e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw"
Sep 16 12:26:24.263209 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:24.262033    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea-istio-podinfo\") pod \"e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw\" (UID: \"6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea\") " pod="openshift-ingress/e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw"
Sep 16 12:26:24.263209 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:24.262077    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea-istio-envoy\") pod \"e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw\" (UID: \"6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea\") " pod="openshift-ingress/e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw"
Sep 16 12:26:24.263209 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:24.262102    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea-istio-data\") pod \"e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw\" (UID: \"6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea\") " pod="openshift-ingress/e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw"
Sep 16 12:26:24.263209 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:24.262126    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea-istiod-ca-cert\") pod \"e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw\" (UID: \"6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea\") " pod="openshift-ingress/e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw"
Sep 16 12:26:24.263209 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:24.262174    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea-workload-socket\") pod \"e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw\" (UID: \"6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea\") " pod="openshift-ingress/e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw"
Sep 16 12:26:24.263209 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:24.262216    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea-istio-token\") pod \"e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw\" (UID: \"6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea\") " pod="openshift-ingress/e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw"
Sep 16 12:26:24.263209 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:24.262273    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea-workload-certs\") pod \"e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw\" (UID: \"6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea\") " pod="openshift-ingress/e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw"
Sep 16 12:26:24.263209 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:24.262767    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea-istio-data\") pod \"e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw\" (UID: \"6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea\") " pod="openshift-ingress/e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw"
Sep 16 12:26:24.263209 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:24.262803    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea-credential-socket\") pod \"e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw\" (UID: \"6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea\") " pod="openshift-ingress/e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw"
Sep 16 12:26:24.263209 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:24.263048    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea-workload-socket\") pod \"e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw\" (UID: \"6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea\") " pod="openshift-ingress/e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw"
Sep 16 12:26:24.263209 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:24.263174    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea-workload-certs\") pod \"e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw\" (UID: \"6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea\") " pod="openshift-ingress/e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw"
Sep 16 12:26:24.264050 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:24.263999    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea-istiod-ca-cert\") pod \"e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw\" (UID: \"6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea\") " pod="openshift-ingress/e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw"
Sep 16 12:26:24.265501 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:24.265446    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea-istio-envoy\") pod \"e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw\" (UID: \"6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea\") " pod="openshift-ingress/e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw"
Sep 16 12:26:24.266507 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:24.266468    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea-istio-podinfo\") pod \"e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw\" (UID: \"6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea\") " pod="openshift-ingress/e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw"
Sep 16 12:26:24.274799 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:24.274774    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea-istio-token\") pod \"e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw\" (UID: \"6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea\") " pod="openshift-ingress/e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw"
Sep 16 12:26:24.275172 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:24.275151    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4sgd\" (UniqueName: \"kubernetes.io/projected/6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea-kube-api-access-z4sgd\") pod \"e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw\" (UID: \"6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea\") " pod="openshift-ingress/e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw"
Sep 16 12:26:24.289673 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:24.289653    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw"
Sep 16 12:26:24.560388 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:24.560290    2559 patch_prober.go:28] interesting pod/e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 16 12:26:24.560388 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:24.560365    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z" podUID="e68e78d0-9fb4-477d-8e25-0ef8838b01ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 16 12:26:24.593547 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:24.588473    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw"]
Sep 16 12:26:24.595225 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:26:24.595197    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a3cbeea_f54c_4b2c_bbff_3e92a4fda2ea.slice/crio-b8b6ecd13e21fb1d6318a9dd2774615ed9b53f77b007ee90ff4a461d7a5a10ef WatchSource:0}: Error finding container b8b6ecd13e21fb1d6318a9dd2774615ed9b53f77b007ee90ff4a461d7a5a10ef: Status 404 returned error can't find the container with id b8b6ecd13e21fb1d6318a9dd2774615ed9b53f77b007ee90ff4a461d7a5a10ef
Sep 16 12:26:24.597725 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:24.597675    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:26:24.597834 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:24.597765    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:26:24.597834 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:24.597805    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:26:25.087893 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:25.087855    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw" event={"ID":"6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea","Type":"ContainerStarted","Data":"3b7665a9fbdb46a1592e068611f7a1f2cdd2ae07e2c06002d8ad2b75c1e2d694"}
Sep 16 12:26:25.088110 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:25.087918    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw" event={"ID":"6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea","Type":"ContainerStarted","Data":"b8b6ecd13e21fb1d6318a9dd2774615ed9b53f77b007ee90ff4a461d7a5a10ef"}
Sep 16 12:26:25.108971 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:25.108917    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw" podStartSLOduration=2.108895382 podStartE2EDuration="2.108895382s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:26:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:26:25.107595431 +0000 UTC m=+1551.727914748" watchObservedRunningTime="2026-09-16 12:26:25.108895382 +0000 UTC m=+1551.729214700"
Sep 16 12:26:25.290277 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:25.290242    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw"
Sep 16 12:26:25.291832 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:25.291806    2559 patch_prober.go:28] interesting pod/e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 16 12:26:25.291958 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:25.291857    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw" podUID="6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 16 12:26:25.560381 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:25.560346    2559 patch_prober.go:28] interesting pod/e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 16 12:26:25.560757 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:25.560401    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z" podUID="e68e78d0-9fb4-477d-8e25-0ef8838b01ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 16 12:26:25.838469 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:25.838366    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z"
Sep 16 12:26:26.295193 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:26.295162    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw"
Sep 16 12:26:26.325778 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:26.325745    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:26.563954 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:26.563878    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z"
Sep 16 12:26:26.564793 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:26.564777    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z"
Sep 16 12:26:27.099983 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:27.099945    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw"
Sep 16 12:26:27.100898 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:27.100878    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw"
Sep 16 12:26:27.134556 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:27.134525    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:27.522810 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:27.522779    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:28.409415 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:28.409380    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:29.086152 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:29.086104    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:29.764157 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:29.764105    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:29.830793 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:29.830759    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:29.930743 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:29.930701    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:30.209532 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:30.209497    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:30.300801 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:30.300768    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:30.828856 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:30.828812    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:31.122285 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:31.122194    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl"]
Sep 16 12:26:31.125437 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:31.125415    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl"
Sep 16 12:26:31.128735 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:31.128717    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-b1650816-openshift-default-dockercfg-x87k4\""
Sep 16 12:26:31.139240 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:31.139215    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl"]
Sep 16 12:26:31.163963 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:31.163929    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:31.231261 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:31.231224    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e657fe6-4a44-4848-97e1-9c60c05cc767-istio-data\") pod \"e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl\" (UID: \"1e657fe6-4a44-4848-97e1-9c60c05cc767\") " pod="openshift-ingress/e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl"
Sep 16 12:26:31.231481 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:31.231276    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgq67\" (UniqueName: \"kubernetes.io/projected/1e657fe6-4a44-4848-97e1-9c60c05cc767-kube-api-access-dgq67\") pod \"e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl\" (UID: \"1e657fe6-4a44-4848-97e1-9c60c05cc767\") " pod="openshift-ingress/e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl"
Sep 16 12:26:31.231481 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:31.231318    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e657fe6-4a44-4848-97e1-9c60c05cc767-workload-socket\") pod \"e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl\" (UID: \"1e657fe6-4a44-4848-97e1-9c60c05cc767\") " pod="openshift-ingress/e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl"
Sep 16 12:26:31.231481 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:31.231436    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e657fe6-4a44-4848-97e1-9c60c05cc767-workload-certs\") pod \"e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl\" (UID: \"1e657fe6-4a44-4848-97e1-9c60c05cc767\") " pod="openshift-ingress/e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl"
Sep 16 12:26:31.231481 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:31.231473    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e657fe6-4a44-4848-97e1-9c60c05cc767-istio-envoy\") pod \"e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl\" (UID: \"1e657fe6-4a44-4848-97e1-9c60c05cc767\") " pod="openshift-ingress/e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl"
Sep 16 12:26:31.231797 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:31.231536    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e657fe6-4a44-4848-97e1-9c60c05cc767-istio-token\") pod \"e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl\" (UID: \"1e657fe6-4a44-4848-97e1-9c60c05cc767\") " pod="openshift-ingress/e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl"
Sep 16 12:26:31.231797 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:31.231565    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e657fe6-4a44-4848-97e1-9c60c05cc767-credential-socket\") pod \"e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl\" (UID: \"1e657fe6-4a44-4848-97e1-9c60c05cc767\") " pod="openshift-ingress/e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl"
Sep 16 12:26:31.231797 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:31.231617    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e657fe6-4a44-4848-97e1-9c60c05cc767-istiod-ca-cert\") pod \"e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl\" (UID: \"1e657fe6-4a44-4848-97e1-9c60c05cc767\") " pod="openshift-ingress/e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl"
Sep 16 12:26:31.231797 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:31.231677    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e657fe6-4a44-4848-97e1-9c60c05cc767-istio-podinfo\") pod \"e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl\" (UID: \"1e657fe6-4a44-4848-97e1-9c60c05cc767\") " pod="openshift-ingress/e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl"
Sep 16 12:26:31.332425 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:31.332393    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e657fe6-4a44-4848-97e1-9c60c05cc767-workload-socket\") pod \"e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl\" (UID: \"1e657fe6-4a44-4848-97e1-9c60c05cc767\") " pod="openshift-ingress/e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl"
Sep 16 12:26:31.332605 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:31.332449    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e657fe6-4a44-4848-97e1-9c60c05cc767-workload-certs\") pod \"e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl\" (UID: \"1e657fe6-4a44-4848-97e1-9c60c05cc767\") " pod="openshift-ingress/e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl"
Sep 16 12:26:31.332605 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:31.332557    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e657fe6-4a44-4848-97e1-9c60c05cc767-istio-envoy\") pod \"e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl\" (UID: \"1e657fe6-4a44-4848-97e1-9c60c05cc767\") " pod="openshift-ingress/e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl"
Sep 16 12:26:31.332729 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:31.332617    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e657fe6-4a44-4848-97e1-9c60c05cc767-istio-token\") pod \"e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl\" (UID: \"1e657fe6-4a44-4848-97e1-9c60c05cc767\") " pod="openshift-ingress/e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl"
Sep 16 12:26:31.332729 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:31.332644    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e657fe6-4a44-4848-97e1-9c60c05cc767-credential-socket\") pod \"e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl\" (UID: \"1e657fe6-4a44-4848-97e1-9c60c05cc767\") " pod="openshift-ingress/e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl"
Sep 16 12:26:31.332729 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:31.332674    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e657fe6-4a44-4848-97e1-9c60c05cc767-istiod-ca-cert\") pod \"e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl\" (UID: \"1e657fe6-4a44-4848-97e1-9c60c05cc767\") " pod="openshift-ingress/e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl"
Sep 16 12:26:31.332729 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:31.332700    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e657fe6-4a44-4848-97e1-9c60c05cc767-istio-podinfo\") pod \"e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl\" (UID: \"1e657fe6-4a44-4848-97e1-9c60c05cc767\") " pod="openshift-ingress/e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl"
Sep 16 12:26:31.332942 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:31.332800    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e657fe6-4a44-4848-97e1-9c60c05cc767-istio-data\") pod \"e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl\" (UID: \"1e657fe6-4a44-4848-97e1-9c60c05cc767\") " pod="openshift-ingress/e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl"
Sep 16 12:26:31.332942 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:31.332836    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgq67\" (UniqueName: \"kubernetes.io/projected/1e657fe6-4a44-4848-97e1-9c60c05cc767-kube-api-access-dgq67\") pod \"e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl\" (UID: \"1e657fe6-4a44-4848-97e1-9c60c05cc767\") " pod="openshift-ingress/e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl"
Sep 16 12:26:31.332942 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:31.332854    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e657fe6-4a44-4848-97e1-9c60c05cc767-workload-socket\") pod \"e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl\" (UID: \"1e657fe6-4a44-4848-97e1-9c60c05cc767\") " pod="openshift-ingress/e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl"
Sep 16 12:26:31.333059 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:31.332982    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e657fe6-4a44-4848-97e1-9c60c05cc767-credential-socket\") pod \"e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl\" (UID: \"1e657fe6-4a44-4848-97e1-9c60c05cc767\") " pod="openshift-ingress/e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl"
Sep 16 12:26:31.333059 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:31.333032    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e657fe6-4a44-4848-97e1-9c60c05cc767-workload-certs\") pod \"e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl\" (UID: \"1e657fe6-4a44-4848-97e1-9c60c05cc767\") " pod="openshift-ingress/e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl"
Sep 16 12:26:31.333215 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:31.333188    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e657fe6-4a44-4848-97e1-9c60c05cc767-istio-data\") pod \"e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl\" (UID: \"1e657fe6-4a44-4848-97e1-9c60c05cc767\") " pod="openshift-ingress/e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl"
Sep 16 12:26:31.333455 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:31.333428    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e657fe6-4a44-4848-97e1-9c60c05cc767-istiod-ca-cert\") pod \"e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl\" (UID: \"1e657fe6-4a44-4848-97e1-9c60c05cc767\") " pod="openshift-ingress/e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl"
Sep 16 12:26:31.335009 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:31.334990    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e657fe6-4a44-4848-97e1-9c60c05cc767-istio-envoy\") pod \"e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl\" (UID: \"1e657fe6-4a44-4848-97e1-9c60c05cc767\") " pod="openshift-ingress/e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl"
Sep 16 12:26:31.335256 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:31.335234    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e657fe6-4a44-4848-97e1-9c60c05cc767-istio-podinfo\") pod \"e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl\" (UID: \"1e657fe6-4a44-4848-97e1-9c60c05cc767\") " pod="openshift-ingress/e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl"
Sep 16 12:26:31.341227 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:31.341201    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e657fe6-4a44-4848-97e1-9c60c05cc767-istio-token\") pod \"e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl\" (UID: \"1e657fe6-4a44-4848-97e1-9c60c05cc767\") " pod="openshift-ingress/e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl"
Sep 16 12:26:31.341378 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:31.341363    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgq67\" (UniqueName: \"kubernetes.io/projected/1e657fe6-4a44-4848-97e1-9c60c05cc767-kube-api-access-dgq67\") pod \"e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl\" (UID: \"1e657fe6-4a44-4848-97e1-9c60c05cc767\") " pod="openshift-ingress/e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl"
Sep 16 12:26:31.403073 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:31.403044    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:26:31.436755 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:31.436731    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl"
Sep 16 12:26:31.480958 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:31.480927    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:31.714299 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:31.714273    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl"]
Sep 16 12:26:31.716537 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:26:31.716500    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e657fe6_4a44_4848_97e1_9c60c05cc767.slice/crio-4569807fcd41e7cade3b5f909846fe470cd9f71076a1148a1127b569fe3eff3d WatchSource:0}: Error finding container 4569807fcd41e7cade3b5f909846fe470cd9f71076a1148a1127b569fe3eff3d: Status 404 returned error can't find the container with id 4569807fcd41e7cade3b5f909846fe470cd9f71076a1148a1127b569fe3eff3d
Sep 16 12:26:31.719482 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:31.719443    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:26:31.719578 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:31.719528    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:26:31.719578 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:31.719568    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:26:32.135090 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:32.134995    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl" event={"ID":"1e657fe6-4a44-4848-97e1-9c60c05cc767","Type":"ContainerStarted","Data":"7157f6f183fc956d4ee9cc5c88809a735914f17c7990d62c9937722b4c609443"}
Sep 16 12:26:32.135090 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:32.135047    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl" event={"ID":"1e657fe6-4a44-4848-97e1-9c60c05cc767","Type":"ContainerStarted","Data":"4569807fcd41e7cade3b5f909846fe470cd9f71076a1148a1127b569fe3eff3d"}
Sep 16 12:26:32.158469 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:32.158426    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl" podStartSLOduration=1.158407935 podStartE2EDuration="1.158407935s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:26:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:26:32.155761379 +0000 UTC m=+1558.776080696" watchObservedRunningTime="2026-09-16 12:26:32.158407935 +0000 UTC m=+1558.778727256"
Sep 16 12:26:32.437386 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:32.437347    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl"
Sep 16 12:26:32.443223 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:32.443199    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl"
Sep 16 12:26:33.141201 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:33.141172    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl"
Sep 16 12:26:33.142191 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:33.142167    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl"
Sep 16 12:26:33.383865 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:33.383832    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:34.010887 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:34.010855    2559 scope.go:117] "RemoveContainer" containerID="01b14386f84aa992d457bd6c4ea9a0e42f28ff7dd9dccedcdcd4966f50d9eb56"
Sep 16 12:26:34.020202 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:34.020178    2559 scope.go:117] "RemoveContainer" containerID="4e13b98a15cf7a4eb3633272038bae8eb014cab00b639ae2a85fe4a61aaf8a8d"
Sep 16 12:26:34.031348 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:34.031325    2559 scope.go:117] "RemoveContainer" containerID="e53a2982339fa78974f6a31f89a0ab0e55fd610a36f99939354b677eecd2f50f"
Sep 16 12:26:34.131976 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:34.131942    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:34.234005 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:34.233939    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:34.966883 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:34.966849    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:35.697048 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:35.697016    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:36.390789 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:36.390759    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:37.027037 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:37.026990    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:37.083162 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:37.083121    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:37.398476 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:37.398444    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:37.500744 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:37.500713    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:37.571857 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:37.571826    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:38.017919 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:38.017883    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:38.638295 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:38.638261    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:39.325848 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:39.325813    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:46.812316 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:46.812275    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:26:49.233676 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:49.233602    2559 generic.go:356] "Generic (PLEG): container finished" podID="6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea" containerID="3b7665a9fbdb46a1592e068611f7a1f2cdd2ae07e2c06002d8ad2b75c1e2d694" exitCode=0
Sep 16 12:26:49.234080 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:49.233673    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw" event={"ID":"6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea","Type":"ContainerDied","Data":"3b7665a9fbdb46a1592e068611f7a1f2cdd2ae07e2c06002d8ad2b75c1e2d694"}
Sep 16 12:26:49.234165 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:49.234099    2559 scope.go:117] "RemoveContainer" containerID="3b7665a9fbdb46a1592e068611f7a1f2cdd2ae07e2c06002d8ad2b75c1e2d694"
Sep 16 12:26:49.235722 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:49.235404    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:26:49.235722 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:49.235491    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:26:49.235722 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:49.235535    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:26:50.246335 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:50.246283    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw" event={"ID":"6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea","Type":"ContainerStarted","Data":"01d1b893d44c6a77c95ad83573f9d112b87cc8c7f831400e0a682447b819ad93"}
Sep 16 12:26:50.290287 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:50.290252    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw"
Sep 16 12:26:50.290459 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:50.290358    2559 patch_prober.go:28] interesting pod/e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 16 12:26:50.290459 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:50.290394    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw" podUID="6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 16 12:26:50.851298 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:50.851227    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:51.290936 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:51.290897    2559 patch_prober.go:28] interesting pod/e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 16 12:26:51.291355 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:51.290974    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw" podUID="6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 16 12:26:51.892120 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:51.892066    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:52.093560 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:52.093523    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:52.168274 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:52.168231    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:52.290406 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:52.290356    2559 patch_prober.go:28] interesting pod/e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 16 12:26:52.290622 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:52.290422    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw" podUID="6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 16 12:26:52.362277 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:52.362195    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:52.468219 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:52.467687    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:52.563170 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:52.563098    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:52.680222 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:52.680186    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j"]
Sep 16 12:26:52.684342 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:52.684315    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:52.686036 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:52.686019    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j"
Sep 16 12:26:52.692191 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:52.688049    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j"]
Sep 16 12:26:52.692625 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:52.692604    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-3be0c5-openshift-default-dockercfg-b7s5f\""
Sep 16 12:26:52.776215 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:52.775738    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa03a336-756b-4ebc-97b3-20873ffac1cd-istio-token\") pod \"e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j\" (UID: \"aa03a336-756b-4ebc-97b3-20873ffac1cd\") " pod="openshift-ingress/e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j"
Sep 16 12:26:52.776215 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:52.775805    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa03a336-756b-4ebc-97b3-20873ffac1cd-credential-socket\") pod \"e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j\" (UID: \"aa03a336-756b-4ebc-97b3-20873ffac1cd\") " pod="openshift-ingress/e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j"
Sep 16 12:26:52.776215 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:52.775874    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa03a336-756b-4ebc-97b3-20873ffac1cd-istio-envoy\") pod \"e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j\" (UID: \"aa03a336-756b-4ebc-97b3-20873ffac1cd\") " pod="openshift-ingress/e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j"
Sep 16 12:26:52.776215 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:52.775911    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa03a336-756b-4ebc-97b3-20873ffac1cd-workload-certs\") pod \"e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j\" (UID: \"aa03a336-756b-4ebc-97b3-20873ffac1cd\") " pod="openshift-ingress/e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j"
Sep 16 12:26:52.776215 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:52.775988    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa03a336-756b-4ebc-97b3-20873ffac1cd-workload-socket\") pod \"e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j\" (UID: \"aa03a336-756b-4ebc-97b3-20873ffac1cd\") " pod="openshift-ingress/e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j"
Sep 16 12:26:52.776215 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:52.776020    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa03a336-756b-4ebc-97b3-20873ffac1cd-istiod-ca-cert\") pod \"e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j\" (UID: \"aa03a336-756b-4ebc-97b3-20873ffac1cd\") " pod="openshift-ingress/e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j"
Sep 16 12:26:52.776215 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:52.776057    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa03a336-756b-4ebc-97b3-20873ffac1cd-istio-data\") pod \"e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j\" (UID: \"aa03a336-756b-4ebc-97b3-20873ffac1cd\") " pod="openshift-ingress/e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j"
Sep 16 12:26:52.776215 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:52.776107    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84fpx\" (UniqueName: \"kubernetes.io/projected/aa03a336-756b-4ebc-97b3-20873ffac1cd-kube-api-access-84fpx\") pod \"e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j\" (UID: \"aa03a336-756b-4ebc-97b3-20873ffac1cd\") " pod="openshift-ingress/e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j"
Sep 16 12:26:52.776215 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:52.776158    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa03a336-756b-4ebc-97b3-20873ffac1cd-istio-podinfo\") pod \"e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j\" (UID: \"aa03a336-756b-4ebc-97b3-20873ffac1cd\") " pod="openshift-ingress/e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j"
Sep 16 12:26:52.877555 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:52.877503    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa03a336-756b-4ebc-97b3-20873ffac1cd-istio-envoy\") pod \"e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j\" (UID: \"aa03a336-756b-4ebc-97b3-20873ffac1cd\") " pod="openshift-ingress/e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j"
Sep 16 12:26:52.877783 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:52.877572    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa03a336-756b-4ebc-97b3-20873ffac1cd-workload-certs\") pod \"e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j\" (UID: \"aa03a336-756b-4ebc-97b3-20873ffac1cd\") " pod="openshift-ingress/e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j"
Sep 16 12:26:52.877783 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:52.877655    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa03a336-756b-4ebc-97b3-20873ffac1cd-workload-socket\") pod \"e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j\" (UID: \"aa03a336-756b-4ebc-97b3-20873ffac1cd\") " pod="openshift-ingress/e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j"
Sep 16 12:26:52.877783 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:52.877687    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa03a336-756b-4ebc-97b3-20873ffac1cd-istiod-ca-cert\") pod \"e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j\" (UID: \"aa03a336-756b-4ebc-97b3-20873ffac1cd\") " pod="openshift-ingress/e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j"
Sep 16 12:26:52.877783 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:52.877732    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa03a336-756b-4ebc-97b3-20873ffac1cd-istio-data\") pod \"e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j\" (UID: \"aa03a336-756b-4ebc-97b3-20873ffac1cd\") " pod="openshift-ingress/e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j"
Sep 16 12:26:52.878023 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:52.877785    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84fpx\" (UniqueName: \"kubernetes.io/projected/aa03a336-756b-4ebc-97b3-20873ffac1cd-kube-api-access-84fpx\") pod \"e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j\" (UID: \"aa03a336-756b-4ebc-97b3-20873ffac1cd\") " pod="openshift-ingress/e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j"
Sep 16 12:26:52.878023 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:52.877817    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa03a336-756b-4ebc-97b3-20873ffac1cd-istio-podinfo\") pod \"e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j\" (UID: \"aa03a336-756b-4ebc-97b3-20873ffac1cd\") " pod="openshift-ingress/e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j"
Sep 16 12:26:52.878023 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:52.877878    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa03a336-756b-4ebc-97b3-20873ffac1cd-istio-token\") pod \"e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j\" (UID: \"aa03a336-756b-4ebc-97b3-20873ffac1cd\") " pod="openshift-ingress/e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j"
Sep 16 12:26:52.878023 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:52.877924    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa03a336-756b-4ebc-97b3-20873ffac1cd-credential-socket\") pod \"e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j\" (UID: \"aa03a336-756b-4ebc-97b3-20873ffac1cd\") " pod="openshift-ingress/e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j"
Sep 16 12:26:52.879157 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:52.878416    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa03a336-756b-4ebc-97b3-20873ffac1cd-credential-socket\") pod \"e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j\" (UID: \"aa03a336-756b-4ebc-97b3-20873ffac1cd\") " pod="openshift-ingress/e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j"
Sep 16 12:26:52.879157 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:52.879029    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa03a336-756b-4ebc-97b3-20873ffac1cd-istio-data\") pod \"e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j\" (UID: \"aa03a336-756b-4ebc-97b3-20873ffac1cd\") " pod="openshift-ingress/e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j"
Sep 16 12:26:52.879346 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:52.879299    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa03a336-756b-4ebc-97b3-20873ffac1cd-workload-certs\") pod \"e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j\" (UID: \"aa03a336-756b-4ebc-97b3-20873ffac1cd\") " pod="openshift-ingress/e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j"
Sep 16 12:26:52.882867 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:52.879537    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa03a336-756b-4ebc-97b3-20873ffac1cd-workload-socket\") pod \"e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j\" (UID: \"aa03a336-756b-4ebc-97b3-20873ffac1cd\") " pod="openshift-ingress/e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j"
Sep 16 12:26:52.882867 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:52.880167    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa03a336-756b-4ebc-97b3-20873ffac1cd-istiod-ca-cert\") pod \"e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j\" (UID: \"aa03a336-756b-4ebc-97b3-20873ffac1cd\") " pod="openshift-ingress/e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j"
Sep 16 12:26:52.885694 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:52.885668    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa03a336-756b-4ebc-97b3-20873ffac1cd-istio-podinfo\") pod \"e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j\" (UID: \"aa03a336-756b-4ebc-97b3-20873ffac1cd\") " pod="openshift-ingress/e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j"
Sep 16 12:26:52.886087 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:52.886068    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa03a336-756b-4ebc-97b3-20873ffac1cd-istio-envoy\") pod \"e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j\" (UID: \"aa03a336-756b-4ebc-97b3-20873ffac1cd\") " pod="openshift-ingress/e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j"
Sep 16 12:26:52.893702 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:52.893682    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84fpx\" (UniqueName: \"kubernetes.io/projected/aa03a336-756b-4ebc-97b3-20873ffac1cd-kube-api-access-84fpx\") pod \"e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j\" (UID: \"aa03a336-756b-4ebc-97b3-20873ffac1cd\") " pod="openshift-ingress/e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j"
Sep 16 12:26:52.893989 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:52.893969    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa03a336-756b-4ebc-97b3-20873ffac1cd-istio-token\") pod \"e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j\" (UID: \"aa03a336-756b-4ebc-97b3-20873ffac1cd\") " pod="openshift-ingress/e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j"
Sep 16 12:26:53.008349 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:53.008313    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j"
Sep 16 12:26:53.281719 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:53.281673    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:53.294157 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:53.291506    2559 patch_prober.go:28] interesting pod/e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 16 12:26:53.294157 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:53.291574    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw" podUID="6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 16 12:26:53.347518 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:53.347004    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j"]
Sep 16 12:26:53.382668 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:53.382628    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:26:53.383605 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:53.383576    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:26:53.383776 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:53.383759    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:26:53.570156 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:53.569971    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:54.290896 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:54.290792    2559 patch_prober.go:28] interesting pod/e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 16 12:26:54.291212 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:54.291177    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw" podUID="6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 16 12:26:54.305356 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:54.305318    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j" event={"ID":"aa03a336-756b-4ebc-97b3-20873ffac1cd","Type":"ContainerStarted","Data":"1c63581c92a925e00ced5616dadab5f0c56de5e372103efbdb1a788a5303d897"}
Sep 16 12:26:54.305543 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:54.305414    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j" event={"ID":"aa03a336-756b-4ebc-97b3-20873ffac1cd","Type":"ContainerStarted","Data":"c8d295733982267752550a5704bb280359a42a51bbe80ba0a1175631df3ea401"}
Sep 16 12:26:54.328395 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:54.328351    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j" podStartSLOduration=2.328336042 podStartE2EDuration="2.328336042s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:26:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:26:54.325874484 +0000 UTC m=+1580.946193800" watchObservedRunningTime="2026-09-16 12:26:54.328336042 +0000 UTC m=+1580.948655355"
Sep 16 12:26:54.667676 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:54.667643    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:55.009226 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:55.009064    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j"
Sep 16 12:26:55.014668 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:55.014638    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j"
Sep 16 12:26:55.291075 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:55.290984    2559 patch_prober.go:28] interesting pod/e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 16 12:26:55.291075 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:55.291045    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw" podUID="6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 16 12:26:55.311509 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:55.311480    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j"
Sep 16 12:26:55.312617 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:55.312598    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j"
Sep 16 12:26:55.695390 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:55.695350    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:56.245206 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:56.245168    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:56.295041 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:56.295013    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw"
Sep 16 12:26:56.295481 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:56.295452    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw"
Sep 16 12:26:56.296042 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:56.296019    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw"
Sep 16 12:26:56.327441 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:56.327416    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:56.636228 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:56.636138    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:56.978908 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:56.978873    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:57.431810 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:57.431778    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:57.558205 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:57.558101    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:58.330886 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:58.330855    2559 generic.go:356] "Generic (PLEG): container finished" podID="1e657fe6-4a44-4848-97e1-9c60c05cc767" containerID="7157f6f183fc956d4ee9cc5c88809a735914f17c7990d62c9937722b4c609443" exitCode=0
Sep 16 12:26:58.331288 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:58.330931    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl" event={"ID":"1e657fe6-4a44-4848-97e1-9c60c05cc767","Type":"ContainerDied","Data":"7157f6f183fc956d4ee9cc5c88809a735914f17c7990d62c9937722b4c609443"}
Sep 16 12:26:58.331443 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:58.331427    2559 scope.go:117] "RemoveContainer" containerID="7157f6f183fc956d4ee9cc5c88809a735914f17c7990d62c9937722b4c609443"
Sep 16 12:26:58.332663 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:58.332638    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:26:58.332715 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:58.332703    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:26:58.332751 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:58.332735    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:26:58.367346 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:58.367298    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:58.748884 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:58.748855    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:58.814231 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:58.814176    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-37953c-openshift-default-f575b9d4-k7tw9"]
Sep 16 12:26:58.814923 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:58.814889    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-37953c-openshift-default-f575b9d4-k7tw9" podUID="a4fded1b-9bf5-4b8d-ab3d-b050f69370de" containerName="istio-proxy" containerID="cri-o://95dc5f665fd4c53c11e34d91c0962aa28f02d5aa495485add60e43afdb46f0bd" gracePeriod=30
Sep 16 12:26:58.866046 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:58.855323    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:59.044791 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:59.044655    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:59.144526 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:59.144487    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:59.246290 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:59.246238    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:26:59.341179 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:59.341060    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl" event={"ID":"1e657fe6-4a44-4848-97e1-9c60c05cc767","Type":"ContainerStarted","Data":"a63c67bc032dbb9f6fd3d67f2e2fb14e847af766edff5453c220bcb24940a549"}
Sep 16 12:26:59.437519 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:59.437486    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl"
Sep 16 12:26:59.439197 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:59.439161    2559 patch_prober.go:28] interesting pod/e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Sep 16 12:26:59.439356 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:59.439243    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl" podUID="1e657fe6-4a44-4848-97e1-9c60c05cc767" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Sep 16 12:26:59.624071 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:26:59.623980    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:27:00.034343 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:00.034297    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:27:00.140993 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:00.140920    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:27:00.307124 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:00.307017    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:27:00.438233 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:00.438192    2559 patch_prober.go:28] interesting pod/e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Sep 16 12:27:00.438716 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:00.438267    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl" podUID="1e657fe6-4a44-4848-97e1-9c60c05cc767" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Sep 16 12:27:00.565595 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:00.565507    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:27:00.663745 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:00.663711    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:27:00.761092 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:00.761054    2559 patch_prober.go:28] interesting pod/e2e-noten-37953c-openshift-default-f575b9d4-k7tw9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 16 12:27:00.761427 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:00.761383    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-noten-37953c-openshift-default-f575b9d4-k7tw9" podUID="a4fded1b-9bf5-4b8d-ab3d-b050f69370de" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 12:27:01.145053 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:01.144990    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:27:01.438169 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:01.438113    2559 patch_prober.go:28] interesting pod/e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Sep 16 12:27:01.438483 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:01.438453    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl" podUID="1e657fe6-4a44-4848-97e1-9c60c05cc767" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Sep 16 12:27:02.241896 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:02.241864    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:27:02.437569 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:02.437533    2559 patch_prober.go:28] interesting pod/e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Sep 16 12:27:02.437871 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:02.437832    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl" podUID="1e657fe6-4a44-4848-97e1-9c60c05cc767" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Sep 16 12:27:03.019500 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:03.019454    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:27:03.141941 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:03.141907    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl"
Sep 16 12:27:03.438204 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:03.438166    2559 patch_prober.go:28] interesting pod/e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Sep 16 12:27:03.438407 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:03.438239    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl" podUID="1e657fe6-4a44-4848-97e1-9c60c05cc767" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Sep 16 12:27:04.022661 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:04.022636    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-37953c-openshift-default-f575b9d4-k7tw9"
Sep 16 12:27:04.104198 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:04.104089    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a4fded1b-9bf5-4b8d-ab3d-b050f69370de-istiod-ca-cert\") pod \"a4fded1b-9bf5-4b8d-ab3d-b050f69370de\" (UID: \"a4fded1b-9bf5-4b8d-ab3d-b050f69370de\") "
Sep 16 12:27:04.104198 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:04.104154    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a4fded1b-9bf5-4b8d-ab3d-b050f69370de-istio-podinfo\") pod \"a4fded1b-9bf5-4b8d-ab3d-b050f69370de\" (UID: \"a4fded1b-9bf5-4b8d-ab3d-b050f69370de\") "
Sep 16 12:27:04.104198 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:04.104195    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a4fded1b-9bf5-4b8d-ab3d-b050f69370de-istio-token\") pod \"a4fded1b-9bf5-4b8d-ab3d-b050f69370de\" (UID: \"a4fded1b-9bf5-4b8d-ab3d-b050f69370de\") "
Sep 16 12:27:04.104485 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:04.104237    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a4fded1b-9bf5-4b8d-ab3d-b050f69370de-istio-data\") pod \"a4fded1b-9bf5-4b8d-ab3d-b050f69370de\" (UID: \"a4fded1b-9bf5-4b8d-ab3d-b050f69370de\") "
Sep 16 12:27:04.104485 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:04.104351    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h4jkv\" (UniqueName: \"kubernetes.io/projected/a4fded1b-9bf5-4b8d-ab3d-b050f69370de-kube-api-access-h4jkv\") pod \"a4fded1b-9bf5-4b8d-ab3d-b050f69370de\" (UID: \"a4fded1b-9bf5-4b8d-ab3d-b050f69370de\") "
Sep 16 12:27:04.104485 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:04.104443    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a4fded1b-9bf5-4b8d-ab3d-b050f69370de-workload-certs\") pod \"a4fded1b-9bf5-4b8d-ab3d-b050f69370de\" (UID: \"a4fded1b-9bf5-4b8d-ab3d-b050f69370de\") "
Sep 16 12:27:04.104485 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:04.104466    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4fded1b-9bf5-4b8d-ab3d-b050f69370de-credential-socket\") pod \"a4fded1b-9bf5-4b8d-ab3d-b050f69370de\" (UID: \"a4fded1b-9bf5-4b8d-ab3d-b050f69370de\") "
Sep 16 12:27:04.104681 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:04.104510    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4fded1b-9bf5-4b8d-ab3d-b050f69370de-workload-socket\") pod \"a4fded1b-9bf5-4b8d-ab3d-b050f69370de\" (UID: \"a4fded1b-9bf5-4b8d-ab3d-b050f69370de\") "
Sep 16 12:27:04.104681 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:04.104547    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4fded1b-9bf5-4b8d-ab3d-b050f69370de-istio-data" (OuterVolumeSpecName: "istio-data") pod "a4fded1b-9bf5-4b8d-ab3d-b050f69370de" (UID: "a4fded1b-9bf5-4b8d-ab3d-b050f69370de"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:27:04.104681 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:04.104552    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4fded1b-9bf5-4b8d-ab3d-b050f69370de-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a4fded1b-9bf5-4b8d-ab3d-b050f69370de" (UID: "a4fded1b-9bf5-4b8d-ab3d-b050f69370de"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:27:04.104681 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:04.104604    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a4fded1b-9bf5-4b8d-ab3d-b050f69370de-istio-envoy\") pod \"a4fded1b-9bf5-4b8d-ab3d-b050f69370de\" (UID: \"a4fded1b-9bf5-4b8d-ab3d-b050f69370de\") "
Sep 16 12:27:04.104892 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:04.104728    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4fded1b-9bf5-4b8d-ab3d-b050f69370de-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a4fded1b-9bf5-4b8d-ab3d-b050f69370de" (UID: "a4fded1b-9bf5-4b8d-ab3d-b050f69370de"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:27:04.104892 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:04.104788    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4fded1b-9bf5-4b8d-ab3d-b050f69370de-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a4fded1b-9bf5-4b8d-ab3d-b050f69370de" (UID: "a4fded1b-9bf5-4b8d-ab3d-b050f69370de"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:27:04.104892 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:04.104823    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4fded1b-9bf5-4b8d-ab3d-b050f69370de-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a4fded1b-9bf5-4b8d-ab3d-b050f69370de" (UID: "a4fded1b-9bf5-4b8d-ab3d-b050f69370de"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:27:04.105054 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:04.105015    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a4fded1b-9bf5-4b8d-ab3d-b050f69370de-istio-data\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:27:04.105054 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:04.105029    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a4fded1b-9bf5-4b8d-ab3d-b050f69370de-workload-certs\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:27:04.105054 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:04.105043    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4fded1b-9bf5-4b8d-ab3d-b050f69370de-credential-socket\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:27:04.105054 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:04.105054    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4fded1b-9bf5-4b8d-ab3d-b050f69370de-workload-socket\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:27:04.105282 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:04.105063    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a4fded1b-9bf5-4b8d-ab3d-b050f69370de-istiod-ca-cert\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:27:04.106628 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:04.106587    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4fded1b-9bf5-4b8d-ab3d-b050f69370de-kube-api-access-h4jkv" (OuterVolumeSpecName: "kube-api-access-h4jkv") pod "a4fded1b-9bf5-4b8d-ab3d-b050f69370de" (UID: "a4fded1b-9bf5-4b8d-ab3d-b050f69370de"). InnerVolumeSpecName "kube-api-access-h4jkv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:27:04.106746 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:04.106633    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a4fded1b-9bf5-4b8d-ab3d-b050f69370de-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a4fded1b-9bf5-4b8d-ab3d-b050f69370de" (UID: "a4fded1b-9bf5-4b8d-ab3d-b050f69370de"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 12:27:04.106789 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:04.106771    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4fded1b-9bf5-4b8d-ab3d-b050f69370de-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a4fded1b-9bf5-4b8d-ab3d-b050f69370de" (UID: "a4fded1b-9bf5-4b8d-ab3d-b050f69370de"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:27:04.106789 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:04.106780    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4fded1b-9bf5-4b8d-ab3d-b050f69370de-istio-token" (OuterVolumeSpecName: "istio-token") pod "a4fded1b-9bf5-4b8d-ab3d-b050f69370de" (UID: "a4fded1b-9bf5-4b8d-ab3d-b050f69370de"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:27:04.195041 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:04.195003    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:27:04.206331 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:04.206308    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h4jkv\" (UniqueName: \"kubernetes.io/projected/a4fded1b-9bf5-4b8d-ab3d-b050f69370de-kube-api-access-h4jkv\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:27:04.206331 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:04.206331    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a4fded1b-9bf5-4b8d-ab3d-b050f69370de-istio-envoy\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:27:04.206448 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:04.206340    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a4fded1b-9bf5-4b8d-ab3d-b050f69370de-istio-podinfo\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:27:04.206448 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:04.206348    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a4fded1b-9bf5-4b8d-ab3d-b050f69370de-istio-token\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:27:04.381253 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:04.381113    2559 generic.go:356] "Generic (PLEG): container finished" podID="a4fded1b-9bf5-4b8d-ab3d-b050f69370de" containerID="95dc5f665fd4c53c11e34d91c0962aa28f02d5aa495485add60e43afdb46f0bd" exitCode=0
Sep 16 12:27:04.381253 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:04.381198    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-37953c-openshift-default-f575b9d4-k7tw9"
Sep 16 12:27:04.381253 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:04.381198    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-37953c-openshift-default-f575b9d4-k7tw9" event={"ID":"a4fded1b-9bf5-4b8d-ab3d-b050f69370de","Type":"ContainerDied","Data":"95dc5f665fd4c53c11e34d91c0962aa28f02d5aa495485add60e43afdb46f0bd"}
Sep 16 12:27:04.381585 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:04.381294    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-37953c-openshift-default-f575b9d4-k7tw9" event={"ID":"a4fded1b-9bf5-4b8d-ab3d-b050f69370de","Type":"ContainerDied","Data":"22aecb05bb5dd0b659b4dc048f1878b2122e5c8e6dde8a45f6c4867b38b8aaf8"}
Sep 16 12:27:04.381585 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:04.381325    2559 scope.go:117] "RemoveContainer" containerID="95dc5f665fd4c53c11e34d91c0962aa28f02d5aa495485add60e43afdb46f0bd"
Sep 16 12:27:04.392018 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:04.391996    2559 scope.go:117] "RemoveContainer" containerID="95dc5f665fd4c53c11e34d91c0962aa28f02d5aa495485add60e43afdb46f0bd"
Sep 16 12:27:04.392359 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:27:04.392338    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95dc5f665fd4c53c11e34d91c0962aa28f02d5aa495485add60e43afdb46f0bd\": container with ID starting with 95dc5f665fd4c53c11e34d91c0962aa28f02d5aa495485add60e43afdb46f0bd not found: ID does not exist" containerID="95dc5f665fd4c53c11e34d91c0962aa28f02d5aa495485add60e43afdb46f0bd"
Sep 16 12:27:04.392464 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:04.392366    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95dc5f665fd4c53c11e34d91c0962aa28f02d5aa495485add60e43afdb46f0bd"} err="failed to get container status \"95dc5f665fd4c53c11e34d91c0962aa28f02d5aa495485add60e43afdb46f0bd\": rpc error: code = NotFound desc = could not find container \"95dc5f665fd4c53c11e34d91c0962aa28f02d5aa495485add60e43afdb46f0bd\": container with ID starting with 95dc5f665fd4c53c11e34d91c0962aa28f02d5aa495485add60e43afdb46f0bd not found: ID does not exist"
Sep 16 12:27:04.406179 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:04.406150    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-37953c-openshift-default-f575b9d4-k7tw9"]
Sep 16 12:27:04.411793 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:04.411769    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-37953c-openshift-default-f575b9d4-k7tw9"]
Sep 16 12:27:04.472077 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:04.472044    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl"
Sep 16 12:27:04.473680 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:04.473655    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl"
Sep 16 12:27:04.506842 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:04.506811    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:27:05.938401 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:05.938363    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4fded1b-9bf5-4b8d-ab3d-b050f69370de" path="/var/lib/kubelet/pods/a4fded1b-9bf5-4b8d-ab3d-b050f69370de/volumes"
Sep 16 12:27:08.843363 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:08.843330    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:27:19.507192 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:19.507116    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:27:22.166868 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:22.166828    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:27:22.899361 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:22.899319    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:27:23.710879 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:23.710836    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:27:24.423270 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:24.423235    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:27:24.806785 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:24.806697    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:27:25.062943 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:25.062854    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:27:25.846845 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:25.846802    2559 patch_prober.go:28] interesting pod/e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": read tcp 10.132.0.2:43636->10.132.0.69:15021: read: connection reset by peer" start-of-body=
Sep 16 12:27:25.847319 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:25.846868    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j" podUID="aa03a336-756b-4ebc-97b3-20873ffac1cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": read tcp 10.132.0.2:43636->10.132.0.69:15021: read: connection reset by peer"
Sep 16 12:27:25.940838 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:25.940810    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:27:26.408816 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:26.408777    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:27:26.530156 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:26.530101    2559 generic.go:356] "Generic (PLEG): container finished" podID="aa03a336-756b-4ebc-97b3-20873ffac1cd" containerID="1c63581c92a925e00ced5616dadab5f0c56de5e372103efbdb1a788a5303d897" exitCode=0
Sep 16 12:27:26.530321 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:26.530171    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j" event={"ID":"aa03a336-756b-4ebc-97b3-20873ffac1cd","Type":"ContainerDied","Data":"1c63581c92a925e00ced5616dadab5f0c56de5e372103efbdb1a788a5303d897"}
Sep 16 12:27:26.530594 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:26.530580    2559 scope.go:117] "RemoveContainer" containerID="1c63581c92a925e00ced5616dadab5f0c56de5e372103efbdb1a788a5303d897"
Sep 16 12:27:26.531836 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:26.531809    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:27:26.531892 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:26.531875    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:27:26.531927 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:26.531905    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:27:26.762363 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:26.762268    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:27:27.538356 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:27.538321    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j" event={"ID":"aa03a336-756b-4ebc-97b3-20873ffac1cd","Type":"ContainerStarted","Data":"3b5580cef30ac0f88cb6f204f70ecf8ec8680a1dbff04dfb11c65fff12910b69"}
Sep 16 12:27:28.009072 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:28.009034    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j"
Sep 16 12:27:28.009361 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:28.009267    2559 patch_prober.go:28] interesting pod/e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 16 12:27:28.009361 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:28.009317    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j" podUID="aa03a336-756b-4ebc-97b3-20873ffac1cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 16 12:27:29.009434 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:29.009393    2559 patch_prober.go:28] interesting pod/e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 16 12:27:29.009923 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:29.009454    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j" podUID="aa03a336-756b-4ebc-97b3-20873ffac1cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 16 12:27:30.009698 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:30.009658    2559 patch_prober.go:28] interesting pod/e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 16 12:27:30.010220 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:30.009718    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j" podUID="aa03a336-756b-4ebc-97b3-20873ffac1cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 16 12:27:31.008857 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:31.008826    2559 patch_prober.go:28] interesting pod/e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 16 12:27:31.009058 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:31.008884    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j" podUID="aa03a336-756b-4ebc-97b3-20873ffac1cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 16 12:27:32.008843 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:32.008808    2559 patch_prober.go:28] interesting pod/e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 16 12:27:32.009226 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:32.008888    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j" podUID="aa03a336-756b-4ebc-97b3-20873ffac1cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 16 12:27:33.009302 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:33.009269    2559 patch_prober.go:28] interesting pod/e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 16 12:27:33.009694 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:33.009323    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j" podUID="aa03a336-756b-4ebc-97b3-20873ffac1cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 16 12:27:34.013411 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:34.013380    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j"
Sep 16 12:27:34.013764 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:34.013670    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j"
Sep 16 12:27:34.014493 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:34.014472    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j"
Sep 16 12:27:34.081365 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:34.081329    2559 scope.go:117] "RemoveContainer" containerID="4d8734aa82e13742973c0f9af75f074efb120ff551a6f130c5e9e28fb05b05cd"
Sep 16 12:27:34.092179 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:34.092157    2559 scope.go:117] "RemoveContainer" containerID="4cc850a87ad9051cd324bb6060d71476bec5989a1129b0a08f4eee44c0cc590f"
Sep 16 12:27:36.127464 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:36.127431    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:27:41.100337 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:41.100308    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:27:44.212529 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:44.212492    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:27:51.155045 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:27:51.155014    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:28:00.136215 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:28:00.136169    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b1650816-z7k5g"]
Sep 16 12:28:00.136858 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:28:00.136838    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4fded1b-9bf5-4b8d-ab3d-b050f69370de" containerName="istio-proxy"
Sep 16 12:28:00.136937 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:28:00.136860    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4fded1b-9bf5-4b8d-ab3d-b050f69370de" containerName="istio-proxy"
Sep 16 12:28:00.136997 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:28:00.136967    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4fded1b-9bf5-4b8d-ab3d-b050f69370de" containerName="istio-proxy"
Sep 16 12:28:00.140681 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:28:00.140654    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b1650816-z7k5g"
Sep 16 12:28:00.144915 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:28:00.144891    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hvtv7\""
Sep 16 12:28:00.146441 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:28:00.146420    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b1650816-z7k5g"]
Sep 16 12:28:00.278952 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:28:00.278920    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/638f2ccf-8b02-4482-a4e4-79177f801942-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-b1650816-z7k5g\" (UID: \"638f2ccf-8b02-4482-a4e4-79177f801942\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b1650816-z7k5g"
Sep 16 12:28:00.379714 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:28:00.379685    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/638f2ccf-8b02-4482-a4e4-79177f801942-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-b1650816-z7k5g\" (UID: \"638f2ccf-8b02-4482-a4e4-79177f801942\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b1650816-z7k5g"
Sep 16 12:28:00.380393 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:28:00.380372    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/638f2ccf-8b02-4482-a4e4-79177f801942-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-b1650816-z7k5g\" (UID: \"638f2ccf-8b02-4482-a4e4-79177f801942\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b1650816-z7k5g"
Sep 16 12:28:00.424616 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:28:00.424584    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:28:00.456183 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:28:00.456159    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b1650816-z7k5g"
Sep 16 12:28:00.730210 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:28:00.730184    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b1650816-z7k5g"]
Sep 16 12:28:00.731959 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:28:00.731932    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod638f2ccf_8b02_4482_a4e4_79177f801942.slice/crio-3f3b7688d14a3c2fc44f3d03cc4d4dd345bec53199a9d46d16f43a433a7bef4c WatchSource:0}: Error finding container 3f3b7688d14a3c2fc44f3d03cc4d4dd345bec53199a9d46d16f43a433a7bef4c: Status 404 returned error can't find the container with id 3f3b7688d14a3c2fc44f3d03cc4d4dd345bec53199a9d46d16f43a433a7bef4c
Sep 16 12:28:01.223481 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:28:01.223445    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:28:01.742962 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:28:01.742921    2559 generic.go:356] "Generic (PLEG): container finished" podID="638f2ccf-8b02-4482-a4e4-79177f801942" containerID="b45bfe38feec49588a8267ec54c786bafdf7b0ddf4e2cb0fe065e890717ae177" exitCode=0
Sep 16 12:28:01.743154 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:28:01.743013    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b1650816-z7k5g" event={"ID":"638f2ccf-8b02-4482-a4e4-79177f801942","Type":"ContainerDied","Data":"b45bfe38feec49588a8267ec54c786bafdf7b0ddf4e2cb0fe065e890717ae177"}
Sep 16 12:28:01.743154 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:28:01.743089    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b1650816-z7k5g" event={"ID":"638f2ccf-8b02-4482-a4e4-79177f801942","Type":"ContainerStarted","Data":"3f3b7688d14a3c2fc44f3d03cc4d4dd345bec53199a9d46d16f43a433a7bef4c"}
Sep 16 12:28:01.836301 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:28:01.836258    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:28:02.827507 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:28:02.827472    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:28:02.885650 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:28:02.885625    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b1650816-z7k5g"
Sep 16 12:28:03.010381 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:28:03.010292    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/638f2ccf-8b02-4482-a4e4-79177f801942-maas-api-service-ca\") pod \"638f2ccf-8b02-4482-a4e4-79177f801942\" (UID: \"638f2ccf-8b02-4482-a4e4-79177f801942\") "
Sep 16 12:28:03.010715 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:28:03.010694    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/638f2ccf-8b02-4482-a4e4-79177f801942-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "638f2ccf-8b02-4482-a4e4-79177f801942" (UID: "638f2ccf-8b02-4482-a4e4-79177f801942"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:28:03.112337 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:28:03.112306    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/638f2ccf-8b02-4482-a4e4-79177f801942-maas-api-service-ca\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:28:03.529352 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:28:03.529323    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:28:03.756944 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:28:03.756910    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b1650816-z7k5g" event={"ID":"638f2ccf-8b02-4482-a4e4-79177f801942","Type":"ContainerDied","Data":"3f3b7688d14a3c2fc44f3d03cc4d4dd345bec53199a9d46d16f43a433a7bef4c"}
Sep 16 12:28:03.756944 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:28:03.756943    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b1650816-z7k5g"
Sep 16 12:28:03.757206 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:28:03.756963    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3f3b7688d14a3c2fc44f3d03cc4d4dd345bec53199a9d46d16f43a433a7bef4c"
Sep 16 12:28:04.149219 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:28:04.149189    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:28:04.803826 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:28:04.803797    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:28:05.005575 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:28:05.005542    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:28:05.662754 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:28:05.662724    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:28:15.630371 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:28:15.630334    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:28:15.696466 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:28:15.696433    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:28:15.760013 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:28:15.759980    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:28:15.797251 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:28:15.797222    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b1650816-z7k5g"]
Sep 16 12:28:15.799192 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:28:15.799170    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b1650816-z7k5g"]
Sep 16 12:28:15.860434 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:28:15.860402    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:28:15.939333 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:28:15.939293    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="638f2ccf-8b02-4482-a4e4-79177f801942" path="/var/lib/kubelet/pods/638f2ccf-8b02-4482-a4e4-79177f801942/volumes"
Sep 16 12:28:16.216656 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:28:16.216558    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:28:16.947018 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:28:16.946975    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:28:17.659026 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:28:17.658983    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:28:18.316739 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:28:18.316707    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:28:19.029045 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:28:19.029013    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:28:19.458192 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:28:19.458155    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:28:19.693497 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:28:19.693460    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:28:24.536438 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:28:24.536405    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:28:28.601606 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:28:28.601562    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:28:29.191483 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:28:29.191449    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:28:34.126483 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:28:34.126444    2559 scope.go:117] "RemoveContainer" containerID="7815dd7948827dfadfe75730baca720b5067d8f21088e867843fb47bc30d4704"
Sep 16 12:28:35.045596 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:28:35.045536    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:28:41.397259 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:28:41.397223    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:28:45.044235 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:28:45.044197    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:29:00.711064 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:29:00.710975    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:29:01.794886 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:29:01.794852    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:29:06.236354 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:29:06.236312    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:29:07.613467 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:29:07.613427    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:29:17.305943 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:29:17.305910    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:29:18.441692 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:29:18.441650    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:29:21.773952 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:29:21.773916    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:29:21.834986 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:29:21.834950    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:29:22.083788 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:29:22.083694    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl"]
Sep 16 12:29:22.084150 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:29:22.083949    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl" podUID="1e657fe6-4a44-4848-97e1-9c60c05cc767" containerName="istio-proxy" containerID="cri-o://a63c67bc032dbb9f6fd3d67f2e2fb14e847af766edff5453c220bcb24940a549" gracePeriod=30
Sep 16 12:29:22.109255 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:29:22.109216    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:29:23.668187 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:29:23.668155    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:29:23.766105 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:29:23.766066    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:29:23.866008 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:29:23.865969    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:29:24.735963 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:29:24.735927    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:29:24.829386 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:29:24.829357    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:29:24.938308 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:29:24.938280    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:29:26.553747 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:29:26.553704    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:29:27.217599 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:29:27.217571    2559 generic.go:356] "Generic (PLEG): container finished" podID="1e657fe6-4a44-4848-97e1-9c60c05cc767" containerID="a63c67bc032dbb9f6fd3d67f2e2fb14e847af766edff5453c220bcb24940a549" exitCode=0
Sep 16 12:29:27.217776 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:29:27.217646    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl" event={"ID":"1e657fe6-4a44-4848-97e1-9c60c05cc767","Type":"ContainerDied","Data":"a63c67bc032dbb9f6fd3d67f2e2fb14e847af766edff5453c220bcb24940a549"}
Sep 16 12:29:27.217776 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:29:27.217729    2559 scope.go:117] "RemoveContainer" containerID="7157f6f183fc956d4ee9cc5c88809a735914f17c7990d62c9937722b4c609443"
Sep 16 12:29:27.350170 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:29:27.350095    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl"
Sep 16 12:29:27.464631 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:29:27.464592    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e657fe6-4a44-4848-97e1-9c60c05cc767-credential-socket\") pod \"1e657fe6-4a44-4848-97e1-9c60c05cc767\" (UID: \"1e657fe6-4a44-4848-97e1-9c60c05cc767\") "
Sep 16 12:29:27.464631 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:29:27.464631    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e657fe6-4a44-4848-97e1-9c60c05cc767-istio-token\") pod \"1e657fe6-4a44-4848-97e1-9c60c05cc767\" (UID: \"1e657fe6-4a44-4848-97e1-9c60c05cc767\") "
Sep 16 12:29:27.464902 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:29:27.464658    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e657fe6-4a44-4848-97e1-9c60c05cc767-istiod-ca-cert\") pod \"1e657fe6-4a44-4848-97e1-9c60c05cc767\" (UID: \"1e657fe6-4a44-4848-97e1-9c60c05cc767\") "
Sep 16 12:29:27.464902 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:29:27.464699    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dgq67\" (UniqueName: \"kubernetes.io/projected/1e657fe6-4a44-4848-97e1-9c60c05cc767-kube-api-access-dgq67\") pod \"1e657fe6-4a44-4848-97e1-9c60c05cc767\" (UID: \"1e657fe6-4a44-4848-97e1-9c60c05cc767\") "
Sep 16 12:29:27.464902 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:29:27.464797    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e657fe6-4a44-4848-97e1-9c60c05cc767-istio-data\") pod \"1e657fe6-4a44-4848-97e1-9c60c05cc767\" (UID: \"1e657fe6-4a44-4848-97e1-9c60c05cc767\") "
Sep 16 12:29:27.464902 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:29:27.464860    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e657fe6-4a44-4848-97e1-9c60c05cc767-istio-podinfo\") pod \"1e657fe6-4a44-4848-97e1-9c60c05cc767\" (UID: \"1e657fe6-4a44-4848-97e1-9c60c05cc767\") "
Sep 16 12:29:27.464902 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:29:27.464889    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e657fe6-4a44-4848-97e1-9c60c05cc767-workload-certs\") pod \"1e657fe6-4a44-4848-97e1-9c60c05cc767\" (UID: \"1e657fe6-4a44-4848-97e1-9c60c05cc767\") "
Sep 16 12:29:27.465226 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:29:27.464905    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e657fe6-4a44-4848-97e1-9c60c05cc767-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1e657fe6-4a44-4848-97e1-9c60c05cc767" (UID: "1e657fe6-4a44-4848-97e1-9c60c05cc767"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:29:27.465226 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:29:27.464983    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e657fe6-4a44-4848-97e1-9c60c05cc767-workload-socket\") pod \"1e657fe6-4a44-4848-97e1-9c60c05cc767\" (UID: \"1e657fe6-4a44-4848-97e1-9c60c05cc767\") "
Sep 16 12:29:27.465226 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:29:27.465010    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e657fe6-4a44-4848-97e1-9c60c05cc767-istio-envoy\") pod \"1e657fe6-4a44-4848-97e1-9c60c05cc767\" (UID: \"1e657fe6-4a44-4848-97e1-9c60c05cc767\") "
Sep 16 12:29:27.465226 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:29:27.465089    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e657fe6-4a44-4848-97e1-9c60c05cc767-istio-data" (OuterVolumeSpecName: "istio-data") pod "1e657fe6-4a44-4848-97e1-9c60c05cc767" (UID: "1e657fe6-4a44-4848-97e1-9c60c05cc767"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:29:27.465438 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:29:27.465226    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e657fe6-4a44-4848-97e1-9c60c05cc767-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1e657fe6-4a44-4848-97e1-9c60c05cc767" (UID: "1e657fe6-4a44-4848-97e1-9c60c05cc767"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:29:27.465438 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:29:27.465268    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e657fe6-4a44-4848-97e1-9c60c05cc767-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1e657fe6-4a44-4848-97e1-9c60c05cc767" (UID: "1e657fe6-4a44-4848-97e1-9c60c05cc767"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:29:27.465438 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:29:27.465401    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e657fe6-4a44-4848-97e1-9c60c05cc767-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1e657fe6-4a44-4848-97e1-9c60c05cc767" (UID: "1e657fe6-4a44-4848-97e1-9c60c05cc767"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:29:27.465601 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:29:27.465512    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e657fe6-4a44-4848-97e1-9c60c05cc767-istio-data\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:29:27.465601 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:29:27.465532    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e657fe6-4a44-4848-97e1-9c60c05cc767-workload-certs\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:29:27.465601 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:29:27.465546    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e657fe6-4a44-4848-97e1-9c60c05cc767-workload-socket\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:29:27.465601 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:29:27.465559    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e657fe6-4a44-4848-97e1-9c60c05cc767-credential-socket\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:29:27.465601 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:29:27.465572    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e657fe6-4a44-4848-97e1-9c60c05cc767-istiod-ca-cert\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:29:27.467069 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:29:27.467033    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1e657fe6-4a44-4848-97e1-9c60c05cc767-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1e657fe6-4a44-4848-97e1-9c60c05cc767" (UID: "1e657fe6-4a44-4848-97e1-9c60c05cc767"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 12:29:27.467222 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:29:27.467109    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e657fe6-4a44-4848-97e1-9c60c05cc767-kube-api-access-dgq67" (OuterVolumeSpecName: "kube-api-access-dgq67") pod "1e657fe6-4a44-4848-97e1-9c60c05cc767" (UID: "1e657fe6-4a44-4848-97e1-9c60c05cc767"). InnerVolumeSpecName "kube-api-access-dgq67". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:29:27.467222 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:29:27.467122    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e657fe6-4a44-4848-97e1-9c60c05cc767-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1e657fe6-4a44-4848-97e1-9c60c05cc767" (UID: "1e657fe6-4a44-4848-97e1-9c60c05cc767"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:29:27.467222 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:29:27.467153    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e657fe6-4a44-4848-97e1-9c60c05cc767-istio-token" (OuterVolumeSpecName: "istio-token") pod "1e657fe6-4a44-4848-97e1-9c60c05cc767" (UID: "1e657fe6-4a44-4848-97e1-9c60c05cc767"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:29:27.566067 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:29:27.566037    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e657fe6-4a44-4848-97e1-9c60c05cc767-istio-envoy\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:29:27.566067 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:29:27.566062    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e657fe6-4a44-4848-97e1-9c60c05cc767-istio-token\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:29:27.566067 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:29:27.566071    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dgq67\" (UniqueName: \"kubernetes.io/projected/1e657fe6-4a44-4848-97e1-9c60c05cc767-kube-api-access-dgq67\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:29:27.566540 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:29:27.566081    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e657fe6-4a44-4848-97e1-9c60c05cc767-istio-podinfo\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:29:28.231501 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:29:28.231416    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl"
Sep 16 12:29:28.231501 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:29:28.231440    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl" event={"ID":"1e657fe6-4a44-4848-97e1-9c60c05cc767","Type":"ContainerDied","Data":"4569807fcd41e7cade3b5f909846fe470cd9f71076a1148a1127b569fe3eff3d"}
Sep 16 12:29:28.231710 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:29:28.231529    2559 scope.go:117] "RemoveContainer" containerID="a63c67bc032dbb9f6fd3d67f2e2fb14e847af766edff5453c220bcb24940a549"
Sep 16 12:29:28.250374 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:29:28.250350    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl"]
Sep 16 12:29:28.253532 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:29:28.253510    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-b1650816-openshift-default-6c7d5f96fb-4h8tl"]
Sep 16 12:29:29.938150 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:29:29.938110    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e657fe6-4a44-4848-97e1-9c60c05cc767" path="/var/lib/kubelet/pods/1e657fe6-4a44-4848-97e1-9c60c05cc767/volumes"
Sep 16 12:29:32.280986 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:29:32.280949    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:29:32.381978 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:29:32.381947    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:29:33.096638 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:29:33.096607    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:29:34.147732 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:29:34.147701    2559 scope.go:117] "RemoveContainer" containerID="9a8613e376ca5712c9b77f025d2ecaebcc8425d58b6d0e481fb4666a4b6765bc"
Sep 16 12:29:34.156619 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:29:34.156595    2559 scope.go:117] "RemoveContainer" containerID="6404e64b357277cdad5e5baa00d312138d876c326b09b17949e0ea03d3a37508"
Sep 16 12:29:38.918270 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:29:38.918236    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:29:38.988993 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:29:38.988963    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:29:39.098530 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:29:39.098494    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:29:39.196550 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:29:39.196458    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:29:41.701142 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:29:41.701109    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:29:49.757079 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:29:49.757045    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:29:50.030013 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:29:50.029924    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:30:00.153510 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:00.153476    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-7a4d5c-29826030-dx5ss"]
Sep 16 12:30:00.153955 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:00.153941    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e657fe6-4a44-4848-97e1-9c60c05cc767" containerName="istio-proxy"
Sep 16 12:30:00.153955 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:00.153957    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e657fe6-4a44-4848-97e1-9c60c05cc767" containerName="istio-proxy"
Sep 16 12:30:00.154045 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:00.153965    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="638f2ccf-8b02-4482-a4e4-79177f801942" containerName="revoke-keys"
Sep 16 12:30:00.154045 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:00.153970    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="638f2ccf-8b02-4482-a4e4-79177f801942" containerName="revoke-keys"
Sep 16 12:30:00.154045 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:00.153994    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e657fe6-4a44-4848-97e1-9c60c05cc767" containerName="istio-proxy"
Sep 16 12:30:00.154045 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:00.153999    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e657fe6-4a44-4848-97e1-9c60c05cc767" containerName="istio-proxy"
Sep 16 12:30:00.154204 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:00.154081    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e657fe6-4a44-4848-97e1-9c60c05cc767" containerName="istio-proxy"
Sep 16 12:30:00.154204 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:00.154089    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="638f2ccf-8b02-4482-a4e4-79177f801942" containerName="revoke-keys"
Sep 16 12:30:00.154204 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:00.154098    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e657fe6-4a44-4848-97e1-9c60c05cc767" containerName="istio-proxy"
Sep 16 12:30:00.157372 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:00.157355    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-72eee5-29826030-5shzd"]
Sep 16 12:30:00.157487 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:00.157468    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-7a4d5c-29826030-dx5ss"
Sep 16 12:30:00.160366 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:00.160341    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hvtv7\""
Sep 16 12:30:00.160516 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:00.160481    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29826030-kpl2h"]
Sep 16 12:30:00.160587 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:00.160536    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-72eee5-29826030-5shzd"
Sep 16 12:30:00.163808 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:00.163788    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29826030-kpl2h"
Sep 16 12:30:00.168960 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:00.168939    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-7a4d5c-29826030-dx5ss"]
Sep 16 12:30:00.170372 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:00.170351    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-7a4d5c-29826030-dx5ss"
Sep 16 12:30:00.181416 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:00.181387    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-72eee5-29826030-5shzd"]
Sep 16 12:30:00.181905 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:00.181882    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29826030-kpl2h"]
Sep 16 12:30:00.182192 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:00.182174    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-72eee5-29826030-5shzd"
Sep 16 12:30:00.227443 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:00.227293    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29826030-kpl2h"
Sep 16 12:30:00.457901 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:00.457876    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-7a4d5c-29826030-dx5ss"]
Sep 16 12:30:00.460588 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:30:00.460563    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod941df1db_49d1_49d7_8c04_4feb58e9782a.slice/crio-57b770abcdbce08b420e67b26260785dbebd7d82e7a9334cea0dd5b1b284ad0d WatchSource:0}: Error finding container 57b770abcdbce08b420e67b26260785dbebd7d82e7a9334cea0dd5b1b284ad0d: Status 404 returned error can't find the container with id 57b770abcdbce08b420e67b26260785dbebd7d82e7a9334cea0dd5b1b284ad0d
Sep 16 12:30:00.481518 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:00.481493    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-72eee5-29826030-5shzd"]
Sep 16 12:30:00.482472 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:30:00.482450    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0d3aeed_ce39_45c7_9e99_7af15b6877ae.slice/crio-798a95433632b2a9c39a8b28ad524c65d4aa210c27f3057ca28b04230b93f196 WatchSource:0}: Error finding container 798a95433632b2a9c39a8b28ad524c65d4aa210c27f3057ca28b04230b93f196: Status 404 returned error can't find the container with id 798a95433632b2a9c39a8b28ad524c65d4aa210c27f3057ca28b04230b93f196
Sep 16 12:30:00.521973 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:00.521952    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29826030-kpl2h"]
Sep 16 12:30:00.523774 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:30:00.523748    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53a5d543_93ef_473d_80ff_b9c81bcb8d80.slice/crio-4720fa6b5f5e1f46e5a81f81c56e142824e8be521ac4ff1961444708b4fcd93e WatchSource:0}: Error finding container 4720fa6b5f5e1f46e5a81f81c56e142824e8be521ac4ff1961444708b4fcd93e: Status 404 returned error can't find the container with id 4720fa6b5f5e1f46e5a81f81c56e142824e8be521ac4ff1961444708b4fcd93e
Sep 16 12:30:01.417577 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:01.417541    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29826030-kpl2h" event={"ID":"53a5d543-93ef-473d-80ff-b9c81bcb8d80","Type":"ContainerStarted","Data":"1b8aa5951fd0239d5f8f158417cc647f4bacb0ed76c8f2e28ad4d63db87a3c53"}
Sep 16 12:30:01.418013 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:01.417601    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29826030-kpl2h" event={"ID":"53a5d543-93ef-473d-80ff-b9c81bcb8d80","Type":"ContainerStarted","Data":"4720fa6b5f5e1f46e5a81f81c56e142824e8be521ac4ff1961444708b4fcd93e"}
Sep 16 12:30:01.419116 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:01.419091    2559 generic.go:356] "Generic (PLEG): container finished" podID="941df1db-49d1-49d7-8c04-4feb58e9782a" containerID="56ed3db761b157f80041c290f5f70f16b9a04ee0f46b378c3b59d45bbab6d05d" exitCode=0
Sep 16 12:30:01.419259 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:01.419164    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-7a4d5c-29826030-dx5ss" event={"ID":"941df1db-49d1-49d7-8c04-4feb58e9782a","Type":"ContainerDied","Data":"56ed3db761b157f80041c290f5f70f16b9a04ee0f46b378c3b59d45bbab6d05d"}
Sep 16 12:30:01.419259 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:01.419207    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-7a4d5c-29826030-dx5ss" event={"ID":"941df1db-49d1-49d7-8c04-4feb58e9782a","Type":"ContainerStarted","Data":"57b770abcdbce08b420e67b26260785dbebd7d82e7a9334cea0dd5b1b284ad0d"}
Sep 16 12:30:01.420718 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:01.420694    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-72eee5-29826030-5shzd" event={"ID":"e0d3aeed-ce39-45c7-9e99-7af15b6877ae","Type":"ContainerStarted","Data":"57f227d83e28c31047818a087161cd3186fc33cc221057990f950a206df973ce"}
Sep 16 12:30:01.420826 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:01.420738    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-72eee5-29826030-5shzd" event={"ID":"e0d3aeed-ce39-45c7-9e99-7af15b6877ae","Type":"ContainerStarted","Data":"798a95433632b2a9c39a8b28ad524c65d4aa210c27f3057ca28b04230b93f196"}
Sep 16 12:30:01.432467 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:01.432430    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29826030-kpl2h" podStartSLOduration=1.432416586 podStartE2EDuration="1.432416586s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:30:01.431742265 +0000 UTC m=+1768.052061584" watchObservedRunningTime="2026-09-16 12:30:01.432416586 +0000 UTC m=+1768.052735901"
Sep 16 12:30:01.459084 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:01.459035    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-72eee5-29826030-5shzd" podStartSLOduration=1.459021276 podStartE2EDuration="1.459021276s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:30:01.457759563 +0000 UTC m=+1768.078078879" watchObservedRunningTime="2026-09-16 12:30:01.459021276 +0000 UTC m=+1768.079340589"
Sep 16 12:30:02.427280 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:02.427241    2559 generic.go:356] "Generic (PLEG): container finished" podID="53a5d543-93ef-473d-80ff-b9c81bcb8d80" containerID="1b8aa5951fd0239d5f8f158417cc647f4bacb0ed76c8f2e28ad4d63db87a3c53" exitCode=0
Sep 16 12:30:02.427749 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:02.427331    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29826030-kpl2h" event={"ID":"53a5d543-93ef-473d-80ff-b9c81bcb8d80","Type":"ContainerDied","Data":"1b8aa5951fd0239d5f8f158417cc647f4bacb0ed76c8f2e28ad4d63db87a3c53"}
Sep 16 12:30:02.428942 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:02.428922    2559 generic.go:356] "Generic (PLEG): container finished" podID="e0d3aeed-ce39-45c7-9e99-7af15b6877ae" containerID="57f227d83e28c31047818a087161cd3186fc33cc221057990f950a206df973ce" exitCode=0
Sep 16 12:30:02.429052 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:02.428998    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-72eee5-29826030-5shzd" event={"ID":"e0d3aeed-ce39-45c7-9e99-7af15b6877ae","Type":"ContainerDied","Data":"57f227d83e28c31047818a087161cd3186fc33cc221057990f950a206df973ce"}
Sep 16 12:30:02.573732 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:02.573699    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-7a4d5c-29826030-dx5ss"
Sep 16 12:30:03.435383 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:03.435357    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-7a4d5c-29826030-dx5ss"
Sep 16 12:30:03.435383 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:03.435368    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-7a4d5c-29826030-dx5ss" event={"ID":"941df1db-49d1-49d7-8c04-4feb58e9782a","Type":"ContainerDied","Data":"57b770abcdbce08b420e67b26260785dbebd7d82e7a9334cea0dd5b1b284ad0d"}
Sep 16 12:30:03.435816 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:03.435417    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="57b770abcdbce08b420e67b26260785dbebd7d82e7a9334cea0dd5b1b284ad0d"
Sep 16 12:30:03.570653 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:03.570625    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29826030-kpl2h"
Sep 16 12:30:03.611082 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:03.611021    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-72eee5-29826030-5shzd"
Sep 16 12:30:04.442457 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:04.442428    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29826030-kpl2h"
Sep 16 12:30:04.442868 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:04.442426    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29826030-kpl2h" event={"ID":"53a5d543-93ef-473d-80ff-b9c81bcb8d80","Type":"ContainerDied","Data":"4720fa6b5f5e1f46e5a81f81c56e142824e8be521ac4ff1961444708b4fcd93e"}
Sep 16 12:30:04.442868 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:04.442584    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4720fa6b5f5e1f46e5a81f81c56e142824e8be521ac4ff1961444708b4fcd93e"
Sep 16 12:30:04.443891 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:04.443874    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-72eee5-29826030-5shzd"
Sep 16 12:30:04.444003 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:04.443875    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-72eee5-29826030-5shzd" event={"ID":"e0d3aeed-ce39-45c7-9e99-7af15b6877ae","Type":"ContainerDied","Data":"798a95433632b2a9c39a8b28ad524c65d4aa210c27f3057ca28b04230b93f196"}
Sep 16 12:30:04.444065 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:04.444005    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="798a95433632b2a9c39a8b28ad524c65d4aa210c27f3057ca28b04230b93f196"
Sep 16 12:30:07.306550 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:07.306517    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:30:11.021343 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:11.021311    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:30:12.311042 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:12.310992    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:30:16.966699 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:16.966664    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:30:17.043352 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:17.043323    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:30:17.342342 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:17.342249    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:30:17.671931 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:17.671895    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-835ec8-openshift-default-6d9c668588-xht45"]
Sep 16 12:30:17.672551 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:17.672518    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="941df1db-49d1-49d7-8c04-4feb58e9782a" containerName="cleanup"
Sep 16 12:30:17.672551 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:17.672545    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="941df1db-49d1-49d7-8c04-4feb58e9782a" containerName="cleanup"
Sep 16 12:30:17.672551 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:17.672555    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53a5d543-93ef-473d-80ff-b9c81bcb8d80" containerName="cleanup"
Sep 16 12:30:17.672804 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:17.672565    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="53a5d543-93ef-473d-80ff-b9c81bcb8d80" containerName="cleanup"
Sep 16 12:30:17.672804 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:17.672585    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0d3aeed-ce39-45c7-9e99-7af15b6877ae" containerName="cleanup"
Sep 16 12:30:17.672804 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:17.672593    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0d3aeed-ce39-45c7-9e99-7af15b6877ae" containerName="cleanup"
Sep 16 12:30:17.672804 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:17.672694    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0d3aeed-ce39-45c7-9e99-7af15b6877ae" containerName="cleanup"
Sep 16 12:30:17.672804 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:17.672704    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="941df1db-49d1-49d7-8c04-4feb58e9782a" containerName="cleanup"
Sep 16 12:30:17.672804 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:17.672713    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="53a5d543-93ef-473d-80ff-b9c81bcb8d80" containerName="cleanup"
Sep 16 12:30:17.676266 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:17.676241    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-835ec8-openshift-default-6d9c668588-xht45"
Sep 16 12:30:17.679109 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:17.679090    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-835ec8-openshift-default-dockercfg-r9hrj\""
Sep 16 12:30:17.688721 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:17.688697    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-835ec8-openshift-default-6d9c668588-xht45"]
Sep 16 12:30:17.696804 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:17.696779    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:30:17.754424 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:17.754389    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0396f9d0-6466-4e68-997e-f9df4f5ede4b-workload-socket\") pod \"e2e-api-a-835ec8-openshift-default-6d9c668588-xht45\" (UID: \"0396f9d0-6466-4e68-997e-f9df4f5ede4b\") " pod="openshift-ingress/e2e-api-a-835ec8-openshift-default-6d9c668588-xht45"
Sep 16 12:30:17.754424 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:17.754424    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0396f9d0-6466-4e68-997e-f9df4f5ede4b-istiod-ca-cert\") pod \"e2e-api-a-835ec8-openshift-default-6d9c668588-xht45\" (UID: \"0396f9d0-6466-4e68-997e-f9df4f5ede4b\") " pod="openshift-ingress/e2e-api-a-835ec8-openshift-default-6d9c668588-xht45"
Sep 16 12:30:17.754647 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:17.754459    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0396f9d0-6466-4e68-997e-f9df4f5ede4b-workload-certs\") pod \"e2e-api-a-835ec8-openshift-default-6d9c668588-xht45\" (UID: \"0396f9d0-6466-4e68-997e-f9df4f5ede4b\") " pod="openshift-ingress/e2e-api-a-835ec8-openshift-default-6d9c668588-xht45"
Sep 16 12:30:17.754647 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:17.754535    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0396f9d0-6466-4e68-997e-f9df4f5ede4b-istio-podinfo\") pod \"e2e-api-a-835ec8-openshift-default-6d9c668588-xht45\" (UID: \"0396f9d0-6466-4e68-997e-f9df4f5ede4b\") " pod="openshift-ingress/e2e-api-a-835ec8-openshift-default-6d9c668588-xht45"
Sep 16 12:30:17.754647 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:17.754598    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0396f9d0-6466-4e68-997e-f9df4f5ede4b-istio-token\") pod \"e2e-api-a-835ec8-openshift-default-6d9c668588-xht45\" (UID: \"0396f9d0-6466-4e68-997e-f9df4f5ede4b\") " pod="openshift-ingress/e2e-api-a-835ec8-openshift-default-6d9c668588-xht45"
Sep 16 12:30:17.754647 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:17.754619    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0396f9d0-6466-4e68-997e-f9df4f5ede4b-credential-socket\") pod \"e2e-api-a-835ec8-openshift-default-6d9c668588-xht45\" (UID: \"0396f9d0-6466-4e68-997e-f9df4f5ede4b\") " pod="openshift-ingress/e2e-api-a-835ec8-openshift-default-6d9c668588-xht45"
Sep 16 12:30:17.754647 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:17.754639    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6rtt\" (UniqueName: \"kubernetes.io/projected/0396f9d0-6466-4e68-997e-f9df4f5ede4b-kube-api-access-g6rtt\") pod \"e2e-api-a-835ec8-openshift-default-6d9c668588-xht45\" (UID: \"0396f9d0-6466-4e68-997e-f9df4f5ede4b\") " pod="openshift-ingress/e2e-api-a-835ec8-openshift-default-6d9c668588-xht45"
Sep 16 12:30:17.754898 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:17.754657    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0396f9d0-6466-4e68-997e-f9df4f5ede4b-istio-envoy\") pod \"e2e-api-a-835ec8-openshift-default-6d9c668588-xht45\" (UID: \"0396f9d0-6466-4e68-997e-f9df4f5ede4b\") " pod="openshift-ingress/e2e-api-a-835ec8-openshift-default-6d9c668588-xht45"
Sep 16 12:30:17.754898 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:17.754765    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0396f9d0-6466-4e68-997e-f9df4f5ede4b-istio-data\") pod \"e2e-api-a-835ec8-openshift-default-6d9c668588-xht45\" (UID: \"0396f9d0-6466-4e68-997e-f9df4f5ede4b\") " pod="openshift-ingress/e2e-api-a-835ec8-openshift-default-6d9c668588-xht45"
Sep 16 12:30:17.825592 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:17.825558    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:30:17.855553 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:17.855523    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0396f9d0-6466-4e68-997e-f9df4f5ede4b-workload-socket\") pod \"e2e-api-a-835ec8-openshift-default-6d9c668588-xht45\" (UID: \"0396f9d0-6466-4e68-997e-f9df4f5ede4b\") " pod="openshift-ingress/e2e-api-a-835ec8-openshift-default-6d9c668588-xht45"
Sep 16 12:30:17.855553 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:17.855553    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0396f9d0-6466-4e68-997e-f9df4f5ede4b-istiod-ca-cert\") pod \"e2e-api-a-835ec8-openshift-default-6d9c668588-xht45\" (UID: \"0396f9d0-6466-4e68-997e-f9df4f5ede4b\") " pod="openshift-ingress/e2e-api-a-835ec8-openshift-default-6d9c668588-xht45"
Sep 16 12:30:17.855758 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:17.855598    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0396f9d0-6466-4e68-997e-f9df4f5ede4b-workload-certs\") pod \"e2e-api-a-835ec8-openshift-default-6d9c668588-xht45\" (UID: \"0396f9d0-6466-4e68-997e-f9df4f5ede4b\") " pod="openshift-ingress/e2e-api-a-835ec8-openshift-default-6d9c668588-xht45"
Sep 16 12:30:17.855758 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:17.855638    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0396f9d0-6466-4e68-997e-f9df4f5ede4b-istio-podinfo\") pod \"e2e-api-a-835ec8-openshift-default-6d9c668588-xht45\" (UID: \"0396f9d0-6466-4e68-997e-f9df4f5ede4b\") " pod="openshift-ingress/e2e-api-a-835ec8-openshift-default-6d9c668588-xht45"
Sep 16 12:30:17.855758 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:17.855671    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0396f9d0-6466-4e68-997e-f9df4f5ede4b-istio-token\") pod \"e2e-api-a-835ec8-openshift-default-6d9c668588-xht45\" (UID: \"0396f9d0-6466-4e68-997e-f9df4f5ede4b\") " pod="openshift-ingress/e2e-api-a-835ec8-openshift-default-6d9c668588-xht45"
Sep 16 12:30:17.855758 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:17.855691    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0396f9d0-6466-4e68-997e-f9df4f5ede4b-credential-socket\") pod \"e2e-api-a-835ec8-openshift-default-6d9c668588-xht45\" (UID: \"0396f9d0-6466-4e68-997e-f9df4f5ede4b\") " pod="openshift-ingress/e2e-api-a-835ec8-openshift-default-6d9c668588-xht45"
Sep 16 12:30:17.855758 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:17.855710    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6rtt\" (UniqueName: \"kubernetes.io/projected/0396f9d0-6466-4e68-997e-f9df4f5ede4b-kube-api-access-g6rtt\") pod \"e2e-api-a-835ec8-openshift-default-6d9c668588-xht45\" (UID: \"0396f9d0-6466-4e68-997e-f9df4f5ede4b\") " pod="openshift-ingress/e2e-api-a-835ec8-openshift-default-6d9c668588-xht45"
Sep 16 12:30:17.855758 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:17.855740    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0396f9d0-6466-4e68-997e-f9df4f5ede4b-istio-envoy\") pod \"e2e-api-a-835ec8-openshift-default-6d9c668588-xht45\" (UID: \"0396f9d0-6466-4e68-997e-f9df4f5ede4b\") " pod="openshift-ingress/e2e-api-a-835ec8-openshift-default-6d9c668588-xht45"
Sep 16 12:30:17.856062 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:17.855804    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0396f9d0-6466-4e68-997e-f9df4f5ede4b-istio-data\") pod \"e2e-api-a-835ec8-openshift-default-6d9c668588-xht45\" (UID: \"0396f9d0-6466-4e68-997e-f9df4f5ede4b\") " pod="openshift-ingress/e2e-api-a-835ec8-openshift-default-6d9c668588-xht45"
Sep 16 12:30:17.856126 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:17.856067    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0396f9d0-6466-4e68-997e-f9df4f5ede4b-workload-certs\") pod \"e2e-api-a-835ec8-openshift-default-6d9c668588-xht45\" (UID: \"0396f9d0-6466-4e68-997e-f9df4f5ede4b\") " pod="openshift-ingress/e2e-api-a-835ec8-openshift-default-6d9c668588-xht45"
Sep 16 12:30:17.856126 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:17.856085    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0396f9d0-6466-4e68-997e-f9df4f5ede4b-workload-socket\") pod \"e2e-api-a-835ec8-openshift-default-6d9c668588-xht45\" (UID: \"0396f9d0-6466-4e68-997e-f9df4f5ede4b\") " pod="openshift-ingress/e2e-api-a-835ec8-openshift-default-6d9c668588-xht45"
Sep 16 12:30:17.856248 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:17.856159    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0396f9d0-6466-4e68-997e-f9df4f5ede4b-credential-socket\") pod \"e2e-api-a-835ec8-openshift-default-6d9c668588-xht45\" (UID: \"0396f9d0-6466-4e68-997e-f9df4f5ede4b\") " pod="openshift-ingress/e2e-api-a-835ec8-openshift-default-6d9c668588-xht45"
Sep 16 12:30:17.856248 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:17.856233    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0396f9d0-6466-4e68-997e-f9df4f5ede4b-istio-data\") pod \"e2e-api-a-835ec8-openshift-default-6d9c668588-xht45\" (UID: \"0396f9d0-6466-4e68-997e-f9df4f5ede4b\") " pod="openshift-ingress/e2e-api-a-835ec8-openshift-default-6d9c668588-xht45"
Sep 16 12:30:17.856335 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:17.856317    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0396f9d0-6466-4e68-997e-f9df4f5ede4b-istiod-ca-cert\") pod \"e2e-api-a-835ec8-openshift-default-6d9c668588-xht45\" (UID: \"0396f9d0-6466-4e68-997e-f9df4f5ede4b\") " pod="openshift-ingress/e2e-api-a-835ec8-openshift-default-6d9c668588-xht45"
Sep 16 12:30:17.858151 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:17.858114    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0396f9d0-6466-4e68-997e-f9df4f5ede4b-istio-envoy\") pod \"e2e-api-a-835ec8-openshift-default-6d9c668588-xht45\" (UID: \"0396f9d0-6466-4e68-997e-f9df4f5ede4b\") " pod="openshift-ingress/e2e-api-a-835ec8-openshift-default-6d9c668588-xht45"
Sep 16 12:30:17.858287 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:17.858272    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0396f9d0-6466-4e68-997e-f9df4f5ede4b-istio-podinfo\") pod \"e2e-api-a-835ec8-openshift-default-6d9c668588-xht45\" (UID: \"0396f9d0-6466-4e68-997e-f9df4f5ede4b\") " pod="openshift-ingress/e2e-api-a-835ec8-openshift-default-6d9c668588-xht45"
Sep 16 12:30:17.863539 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:17.863520    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0396f9d0-6466-4e68-997e-f9df4f5ede4b-istio-token\") pod \"e2e-api-a-835ec8-openshift-default-6d9c668588-xht45\" (UID: \"0396f9d0-6466-4e68-997e-f9df4f5ede4b\") " pod="openshift-ingress/e2e-api-a-835ec8-openshift-default-6d9c668588-xht45"
Sep 16 12:30:17.863695 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:17.863677    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6rtt\" (UniqueName: \"kubernetes.io/projected/0396f9d0-6466-4e68-997e-f9df4f5ede4b-kube-api-access-g6rtt\") pod \"e2e-api-a-835ec8-openshift-default-6d9c668588-xht45\" (UID: \"0396f9d0-6466-4e68-997e-f9df4f5ede4b\") " pod="openshift-ingress/e2e-api-a-835ec8-openshift-default-6d9c668588-xht45"
Sep 16 12:30:17.987337 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:17.987247    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-835ec8-openshift-default-6d9c668588-xht45"
Sep 16 12:30:18.267561 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:18.267538    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-835ec8-openshift-default-6d9c668588-xht45"]
Sep 16 12:30:18.268546 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:30:18.268518    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0396f9d0_6466_4e68_997e_f9df4f5ede4b.slice/crio-fa73beb94593f76dc7594812bfd6414fa6d8b42e5b8bbd779e539f0d7ae8c435 WatchSource:0}: Error finding container fa73beb94593f76dc7594812bfd6414fa6d8b42e5b8bbd779e539f0d7ae8c435: Status 404 returned error can't find the container with id fa73beb94593f76dc7594812bfd6414fa6d8b42e5b8bbd779e539f0d7ae8c435
Sep 16 12:30:18.270757 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:18.270728    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:30:18.270846 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:18.270791    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:30:18.270846 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:18.270817    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:30:18.526318 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:18.526229    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-835ec8-openshift-default-6d9c668588-xht45" event={"ID":"0396f9d0-6466-4e68-997e-f9df4f5ede4b","Type":"ContainerStarted","Data":"c7ea972003ca21a1707553e1c8a31e957eddeee69203ff26bd8ee2553d029c5c"}
Sep 16 12:30:18.526318 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:18.526293    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-835ec8-openshift-default-6d9c668588-xht45" event={"ID":"0396f9d0-6466-4e68-997e-f9df4f5ede4b","Type":"ContainerStarted","Data":"fa73beb94593f76dc7594812bfd6414fa6d8b42e5b8bbd779e539f0d7ae8c435"}
Sep 16 12:30:18.547169 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:18.547110    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-835ec8-openshift-default-6d9c668588-xht45" podStartSLOduration=1.54709605 podStartE2EDuration="1.54709605s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:30:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:30:18.543931693 +0000 UTC m=+1785.164251011" watchObservedRunningTime="2026-09-16 12:30:18.54709605 +0000 UTC m=+1785.167415366"
Sep 16 12:30:18.988037 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:18.987998    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-835ec8-openshift-default-6d9c668588-xht45"
Sep 16 12:30:19.736147 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:19.736103    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:30:19.993446 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:19.993369    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-835ec8-openshift-default-6d9c668588-xht45"
Sep 16 12:30:20.448269 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:20.448229    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:30:20.537272 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:20.537244    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-835ec8-openshift-default-6d9c668588-xht45"
Sep 16 12:30:20.538178 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:20.538122    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-835ec8-openshift-default-6d9c668588-xht45"
Sep 16 12:30:20.610466 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:20.610428    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:30:20.716001 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:20.715911    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:30:21.407810 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:21.407780    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:30:22.127394 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:22.127355    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:30:22.916249 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:22.916207    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:30:23.520812 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:23.520779    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:30:24.175693 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:24.175662    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:30:24.275654 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:24.275618    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:30:24.375924 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:24.375895    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:30:24.674004 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:24.673970    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:30:24.778690 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:24.778661    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:30:32.803099 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:32.803054    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:30:33.992235 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:33.992207    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-hrvzp_63ee784a-3b40-4259-9923-74a24d0203a0/console-operator/5.log"
Sep 16 12:30:33.996787 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:33.996760    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-hrvzp_63ee784a-3b40-4259-9923-74a24d0203a0/console-operator/5.log"
Sep 16 12:30:44.683775 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:44.683735    2559 generic.go:356] "Generic (PLEG): container finished" podID="0396f9d0-6466-4e68-997e-f9df4f5ede4b" containerID="c7ea972003ca21a1707553e1c8a31e957eddeee69203ff26bd8ee2553d029c5c" exitCode=0
Sep 16 12:30:44.684233 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:44.683806    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-835ec8-openshift-default-6d9c668588-xht45" event={"ID":"0396f9d0-6466-4e68-997e-f9df4f5ede4b","Type":"ContainerDied","Data":"c7ea972003ca21a1707553e1c8a31e957eddeee69203ff26bd8ee2553d029c5c"}
Sep 16 12:30:44.684299 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:44.684284    2559 scope.go:117] "RemoveContainer" containerID="c7ea972003ca21a1707553e1c8a31e957eddeee69203ff26bd8ee2553d029c5c"
Sep 16 12:30:44.685360 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:44.685335    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:30:44.685420 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:44.685400    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:30:44.685456 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:44.685429    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:30:45.692489 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:45.692454    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-835ec8-openshift-default-6d9c668588-xht45" event={"ID":"0396f9d0-6466-4e68-997e-f9df4f5ede4b","Type":"ContainerStarted","Data":"6ec13decdf8b926c3b49330a741735e9138d40a25c46036e44f51bdc250ba259"}
Sep 16 12:30:45.987714 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:45.987623    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-835ec8-openshift-default-6d9c668588-xht45"
Sep 16 12:30:45.989101 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:45.989075    2559 patch_prober.go:28] interesting pod/e2e-api-a-835ec8-openshift-default-6d9c668588-xht45 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Sep 16 12:30:45.989245 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:45.989155    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-835ec8-openshift-default-6d9c668588-xht45" podUID="0396f9d0-6466-4e68-997e-f9df4f5ede4b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Sep 16 12:30:46.115355 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:46.115318    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:30:46.820336 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:46.820302    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:30:46.988110 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:46.988073    2559 patch_prober.go:28] interesting pod/e2e-api-a-835ec8-openshift-default-6d9c668588-xht45 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Sep 16 12:30:46.988285 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:46.988127    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-835ec8-openshift-default-6d9c668588-xht45" podUID="0396f9d0-6466-4e68-997e-f9df4f5ede4b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Sep 16 12:30:47.564349 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:47.564316    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:30:47.987817 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:47.987786    2559 patch_prober.go:28] interesting pod/e2e-api-a-835ec8-openshift-default-6d9c668588-xht45 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Sep 16 12:30:47.988205 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:47.987859    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-835ec8-openshift-default-6d9c668588-xht45" podUID="0396f9d0-6466-4e68-997e-f9df4f5ede4b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Sep 16 12:30:48.345323 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:48.345223    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:30:48.988272 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:48.988232    2559 patch_prober.go:28] interesting pod/e2e-api-a-835ec8-openshift-default-6d9c668588-xht45 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Sep 16 12:30:48.988689 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:48.988301    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-835ec8-openshift-default-6d9c668588-xht45" podUID="0396f9d0-6466-4e68-997e-f9df4f5ede4b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Sep 16 12:30:49.240642 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:49.240521    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:30:49.928629 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:49.928593    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:30:49.988323 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:49.988285    2559 patch_prober.go:28] interesting pod/e2e-api-a-835ec8-openshift-default-6d9c668588-xht45 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Sep 16 12:30:49.988766 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:49.988343    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-835ec8-openshift-default-6d9c668588-xht45" podUID="0396f9d0-6466-4e68-997e-f9df4f5ede4b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Sep 16 12:30:50.538077 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:50.537169    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-835ec8-openshift-default-6d9c668588-xht45"
Sep 16 12:30:50.744030 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:50.743936    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:30:50.907105 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:50.907077    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:30:50.988334 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:50.988299    2559 patch_prober.go:28] interesting pod/e2e-api-a-835ec8-openshift-default-6d9c668588-xht45 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Sep 16 12:30:50.988707 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:50.988354    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-835ec8-openshift-default-6d9c668588-xht45" podUID="0396f9d0-6466-4e68-997e-f9df4f5ede4b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Sep 16 12:30:51.396856 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:51.396751    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:30:51.718396 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:51.718366    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h"]
Sep 16 12:30:51.721356 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:51.721333    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h"
Sep 16 12:30:51.723968 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:51.723944    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-5c41db-openshift-default-dockercfg-x2psg\""
Sep 16 12:30:51.732693 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:51.732666    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h"]
Sep 16 12:30:51.745384 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:51.745353    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:30:51.820620 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:51.820570    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bccc53b8-67ae-4dc6-8cde-76374d131e14-workload-certs\") pod \"e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h\" (UID: \"bccc53b8-67ae-4dc6-8cde-76374d131e14\") " pod="openshift-ingress/e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h"
Sep 16 12:30:51.820620 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:51.820623    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bccc53b8-67ae-4dc6-8cde-76374d131e14-istio-data\") pod \"e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h\" (UID: \"bccc53b8-67ae-4dc6-8cde-76374d131e14\") " pod="openshift-ingress/e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h"
Sep 16 12:30:51.820891 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:51.820701    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bccc53b8-67ae-4dc6-8cde-76374d131e14-istio-token\") pod \"e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h\" (UID: \"bccc53b8-67ae-4dc6-8cde-76374d131e14\") " pod="openshift-ingress/e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h"
Sep 16 12:30:51.820891 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:51.820771    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bccc53b8-67ae-4dc6-8cde-76374d131e14-workload-socket\") pod \"e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h\" (UID: \"bccc53b8-67ae-4dc6-8cde-76374d131e14\") " pod="openshift-ingress/e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h"
Sep 16 12:30:51.820891 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:51.820811    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bccc53b8-67ae-4dc6-8cde-76374d131e14-istiod-ca-cert\") pod \"e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h\" (UID: \"bccc53b8-67ae-4dc6-8cde-76374d131e14\") " pod="openshift-ingress/e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h"
Sep 16 12:30:51.821050 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:51.820942    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bccc53b8-67ae-4dc6-8cde-76374d131e14-credential-socket\") pod \"e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h\" (UID: \"bccc53b8-67ae-4dc6-8cde-76374d131e14\") " pod="openshift-ingress/e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h"
Sep 16 12:30:51.821050 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:51.820996    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4qjr\" (UniqueName: \"kubernetes.io/projected/bccc53b8-67ae-4dc6-8cde-76374d131e14-kube-api-access-k4qjr\") pod \"e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h\" (UID: \"bccc53b8-67ae-4dc6-8cde-76374d131e14\") " pod="openshift-ingress/e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h"
Sep 16 12:30:51.821050 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:51.821039    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bccc53b8-67ae-4dc6-8cde-76374d131e14-istio-podinfo\") pod \"e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h\" (UID: \"bccc53b8-67ae-4dc6-8cde-76374d131e14\") " pod="openshift-ingress/e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h"
Sep 16 12:30:51.821182 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:51.821091    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bccc53b8-67ae-4dc6-8cde-76374d131e14-istio-envoy\") pod \"e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h\" (UID: \"bccc53b8-67ae-4dc6-8cde-76374d131e14\") " pod="openshift-ingress/e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h"
Sep 16 12:30:51.921953 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:51.921917    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bccc53b8-67ae-4dc6-8cde-76374d131e14-workload-certs\") pod \"e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h\" (UID: \"bccc53b8-67ae-4dc6-8cde-76374d131e14\") " pod="openshift-ingress/e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h"
Sep 16 12:30:51.921953 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:51.921958    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bccc53b8-67ae-4dc6-8cde-76374d131e14-istio-data\") pod \"e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h\" (UID: \"bccc53b8-67ae-4dc6-8cde-76374d131e14\") " pod="openshift-ingress/e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h"
Sep 16 12:30:51.922275 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:51.921987    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bccc53b8-67ae-4dc6-8cde-76374d131e14-istio-token\") pod \"e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h\" (UID: \"bccc53b8-67ae-4dc6-8cde-76374d131e14\") " pod="openshift-ingress/e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h"
Sep 16 12:30:51.922275 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:51.922022    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bccc53b8-67ae-4dc6-8cde-76374d131e14-workload-socket\") pod \"e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h\" (UID: \"bccc53b8-67ae-4dc6-8cde-76374d131e14\") " pod="openshift-ingress/e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h"
Sep 16 12:30:51.922275 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:51.922049    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bccc53b8-67ae-4dc6-8cde-76374d131e14-istiod-ca-cert\") pod \"e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h\" (UID: \"bccc53b8-67ae-4dc6-8cde-76374d131e14\") " pod="openshift-ingress/e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h"
Sep 16 12:30:51.922275 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:51.922175    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bccc53b8-67ae-4dc6-8cde-76374d131e14-credential-socket\") pod \"e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h\" (UID: \"bccc53b8-67ae-4dc6-8cde-76374d131e14\") " pod="openshift-ingress/e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h"
Sep 16 12:30:51.922275 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:51.922227    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4qjr\" (UniqueName: \"kubernetes.io/projected/bccc53b8-67ae-4dc6-8cde-76374d131e14-kube-api-access-k4qjr\") pod \"e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h\" (UID: \"bccc53b8-67ae-4dc6-8cde-76374d131e14\") " pod="openshift-ingress/e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h"
Sep 16 12:30:51.922275 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:51.922271    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bccc53b8-67ae-4dc6-8cde-76374d131e14-istio-podinfo\") pod \"e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h\" (UID: \"bccc53b8-67ae-4dc6-8cde-76374d131e14\") " pod="openshift-ingress/e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h"
Sep 16 12:30:51.922597 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:51.922324    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bccc53b8-67ae-4dc6-8cde-76374d131e14-istio-envoy\") pod \"e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h\" (UID: \"bccc53b8-67ae-4dc6-8cde-76374d131e14\") " pod="openshift-ingress/e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h"
Sep 16 12:30:51.922597 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:51.922438    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bccc53b8-67ae-4dc6-8cde-76374d131e14-workload-certs\") pod \"e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h\" (UID: \"bccc53b8-67ae-4dc6-8cde-76374d131e14\") " pod="openshift-ingress/e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h"
Sep 16 12:30:51.922597 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:51.922522    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bccc53b8-67ae-4dc6-8cde-76374d131e14-workload-socket\") pod \"e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h\" (UID: \"bccc53b8-67ae-4dc6-8cde-76374d131e14\") " pod="openshift-ingress/e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h"
Sep 16 12:30:51.923199 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:51.923170    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bccc53b8-67ae-4dc6-8cde-76374d131e14-istiod-ca-cert\") pod \"e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h\" (UID: \"bccc53b8-67ae-4dc6-8cde-76374d131e14\") " pod="openshift-ingress/e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h"
Sep 16 12:30:51.923339 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:51.923260    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bccc53b8-67ae-4dc6-8cde-76374d131e14-credential-socket\") pod \"e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h\" (UID: \"bccc53b8-67ae-4dc6-8cde-76374d131e14\") " pod="openshift-ingress/e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h"
Sep 16 12:30:51.923448 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:51.923428    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bccc53b8-67ae-4dc6-8cde-76374d131e14-istio-data\") pod \"e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h\" (UID: \"bccc53b8-67ae-4dc6-8cde-76374d131e14\") " pod="openshift-ingress/e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h"
Sep 16 12:30:51.924700 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:51.924669    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bccc53b8-67ae-4dc6-8cde-76374d131e14-istio-envoy\") pod \"e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h\" (UID: \"bccc53b8-67ae-4dc6-8cde-76374d131e14\") " pod="openshift-ingress/e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h"
Sep 16 12:30:51.925001 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:51.924984    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bccc53b8-67ae-4dc6-8cde-76374d131e14-istio-podinfo\") pod \"e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h\" (UID: \"bccc53b8-67ae-4dc6-8cde-76374d131e14\") " pod="openshift-ingress/e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h"
Sep 16 12:30:51.929821 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:51.929800    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bccc53b8-67ae-4dc6-8cde-76374d131e14-istio-token\") pod \"e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h\" (UID: \"bccc53b8-67ae-4dc6-8cde-76374d131e14\") " pod="openshift-ingress/e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h"
Sep 16 12:30:51.930547 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:51.930518    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4qjr\" (UniqueName: \"kubernetes.io/projected/bccc53b8-67ae-4dc6-8cde-76374d131e14-kube-api-access-k4qjr\") pod \"e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h\" (UID: \"bccc53b8-67ae-4dc6-8cde-76374d131e14\") " pod="openshift-ingress/e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h"
Sep 16 12:30:51.998023 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:51.997929    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-835ec8-openshift-default-6d9c668588-xht45"
Sep 16 12:30:52.000297 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:52.000275    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-835ec8-openshift-default-6d9c668588-xht45"
Sep 16 12:30:52.034453 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:52.034416    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h"
Sep 16 12:30:52.211485 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:52.211447    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:30:52.317950 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:52.317703    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h"]
Sep 16 12:30:52.321102 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:30:52.321077    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbccc53b8_67ae_4dc6_8cde_76374d131e14.slice/crio-efb0ac4fab795776b752ab5ac4bf6b71a2ea150f69a9454e6b772a9c1da48a4d WatchSource:0}: Error finding container efb0ac4fab795776b752ab5ac4bf6b71a2ea150f69a9454e6b772a9c1da48a4d: Status 404 returned error can't find the container with id efb0ac4fab795776b752ab5ac4bf6b71a2ea150f69a9454e6b772a9c1da48a4d
Sep 16 12:30:52.323957 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:52.323923    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:30:52.324063 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:52.324028    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:30:52.324148 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:52.324076    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:30:52.736937 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:52.736893    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h" event={"ID":"bccc53b8-67ae-4dc6-8cde-76374d131e14","Type":"ContainerStarted","Data":"ea5db9dfe765a4c92e9f7ddce4ca4945e6ad429f9eb250d36555fbebf53d4f63"}
Sep 16 12:30:52.737157 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:52.736959    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h" event={"ID":"bccc53b8-67ae-4dc6-8cde-76374d131e14","Type":"ContainerStarted","Data":"efb0ac4fab795776b752ab5ac4bf6b71a2ea150f69a9454e6b772a9c1da48a4d"}
Sep 16 12:30:52.756828 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:52.756776    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h" podStartSLOduration=1.756758875 podStartE2EDuration="1.756758875s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:30:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:30:52.754412858 +0000 UTC m=+1819.374732175" watchObservedRunningTime="2026-09-16 12:30:52.756758875 +0000 UTC m=+1819.377078232"
Sep 16 12:30:53.034620 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:53.034536    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h"
Sep 16 12:30:53.041480 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:53.041450    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h"
Sep 16 12:30:53.743740 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:53.743707    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h"
Sep 16 12:30:53.744907 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:53.744886    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h"
Sep 16 12:30:54.085949 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:54.085851    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:30:54.744030 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:54.744000    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:30:54.839447 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:54.839409    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:30:55.531878 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:55.531842    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:30:56.283264 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:56.283231    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:30:56.940048 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:56.940008    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:30:57.796037 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:57.796002    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:30:58.417924 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:58.417890    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:30:59.042862 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:59.042826    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:30:59.112322 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:59.112277    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:30:59.420193 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:59.420123    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:30:59.521944 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:59.521906    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:30:59.582225 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:30:59.582190    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:31:00.305153 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:00.301843    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:31:02.416641 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:02.416598    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:31:15.940448 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:15.940401    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:31:19.844286 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:19.844187    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:31:21.508426 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:21.508392    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:31:22.038657 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:22.038553    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:31:22.193729 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:22.193676    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-7a4d5c-hhm8d"]
Sep 16 12:31:22.197513 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:22.197497    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-7a4d5c-hhm8d"
Sep 16 12:31:22.199944 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:22.199920    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hvtv7\""
Sep 16 12:31:22.203735 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:22.203713    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-7a4d5c-hhm8d"]
Sep 16 12:31:22.327472 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:22.327383    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:31:22.332589 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:22.332554    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea1b1001-d496-48f3-96fd-acedc73df7dc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-7a4d5c-hhm8d\" (UID: \"ea1b1001-d496-48f3-96fd-acedc73df7dc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-7a4d5c-hhm8d"
Sep 16 12:31:22.433947 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:22.433915    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea1b1001-d496-48f3-96fd-acedc73df7dc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-7a4d5c-hhm8d\" (UID: \"ea1b1001-d496-48f3-96fd-acedc73df7dc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-7a4d5c-hhm8d"
Sep 16 12:31:22.434702 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:22.434667    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea1b1001-d496-48f3-96fd-acedc73df7dc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-7a4d5c-hhm8d\" (UID: \"ea1b1001-d496-48f3-96fd-acedc73df7dc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-7a4d5c-hhm8d"
Sep 16 12:31:22.510757 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:22.510714    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-7a4d5c-hhm8d"
Sep 16 12:31:22.802517 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:22.802488    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-7a4d5c-hhm8d"]
Sep 16 12:31:22.803598 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:31:22.803571    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea1b1001_d496_48f3_96fd_acedc73df7dc.slice/crio-a3d7ccedfa3bd84c6b489ce82bd869405098e6b11d65943f43d7da693efbc402 WatchSource:0}: Error finding container a3d7ccedfa3bd84c6b489ce82bd869405098e6b11d65943f43d7da693efbc402: Status 404 returned error can't find the container with id a3d7ccedfa3bd84c6b489ce82bd869405098e6b11d65943f43d7da693efbc402
Sep 16 12:31:22.915444 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:22.915402    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-7a4d5c-hhm8d" event={"ID":"ea1b1001-d496-48f3-96fd-acedc73df7dc","Type":"ContainerStarted","Data":"a3d7ccedfa3bd84c6b489ce82bd869405098e6b11d65943f43d7da693efbc402"}
Sep 16 12:31:23.144639 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:23.144511    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:31:23.631250 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:23.631208    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:31:23.680383 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:23.680351    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:31:23.922799 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:23.922766    2559 generic.go:356] "Generic (PLEG): container finished" podID="ea1b1001-d496-48f3-96fd-acedc73df7dc" containerID="e56cd325a7bb1bf175c343a8107c5ca0aa71c2f978724218691aef5a51d4ba1d" exitCode=0
Sep 16 12:31:23.922981 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:23.922866    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-7a4d5c-hhm8d" event={"ID":"ea1b1001-d496-48f3-96fd-acedc73df7dc","Type":"ContainerDied","Data":"e56cd325a7bb1bf175c343a8107c5ca0aa71c2f978724218691aef5a51d4ba1d"}
Sep 16 12:31:23.928361 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:23.928340    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:31:24.546843 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:24.546795    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:31:24.785298 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:24.785257    2559 patch_prober.go:28] interesting pod/e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 16 12:31:24.785678 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:24.785325    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h" podUID="bccc53b8-67ae-4dc6-8cde-76374d131e14" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 16 12:31:24.979781 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:24.979751    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:31:25.084289 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:25.084260    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-7a4d5c-hhm8d"
Sep 16 12:31:25.166148 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:25.166102    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea1b1001-d496-48f3-96fd-acedc73df7dc-maas-api-service-ca\") pod \"ea1b1001-d496-48f3-96fd-acedc73df7dc\" (UID: \"ea1b1001-d496-48f3-96fd-acedc73df7dc\") "
Sep 16 12:31:25.166523 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:25.166502    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea1b1001-d496-48f3-96fd-acedc73df7dc-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ea1b1001-d496-48f3-96fd-acedc73df7dc" (UID: "ea1b1001-d496-48f3-96fd-acedc73df7dc"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:31:25.267235 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:25.267157    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea1b1001-d496-48f3-96fd-acedc73df7dc-maas-api-service-ca\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:31:25.279206 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:25.279154    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:31:25.908765 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:25.908725    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:31:25.936850 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:25.936820    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-7a4d5c-hhm8d"
Sep 16 12:31:25.938943 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:25.938916    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-7a4d5c-hhm8d" event={"ID":"ea1b1001-d496-48f3-96fd-acedc73df7dc","Type":"ContainerDied","Data":"a3d7ccedfa3bd84c6b489ce82bd869405098e6b11d65943f43d7da693efbc402"}
Sep 16 12:31:25.939051 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:25.938957    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a3d7ccedfa3bd84c6b489ce82bd869405098e6b11d65943f43d7da693efbc402"
Sep 16 12:31:26.546896 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:26.546863    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:31:26.944540 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:26.944509    2559 generic.go:356] "Generic (PLEG): container finished" podID="bccc53b8-67ae-4dc6-8cde-76374d131e14" containerID="ea5db9dfe765a4c92e9f7ddce4ca4945e6ad429f9eb250d36555fbebf53d4f63" exitCode=0
Sep 16 12:31:26.944923 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:26.944586    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h" event={"ID":"bccc53b8-67ae-4dc6-8cde-76374d131e14","Type":"ContainerDied","Data":"ea5db9dfe765a4c92e9f7ddce4ca4945e6ad429f9eb250d36555fbebf53d4f63"}
Sep 16 12:31:26.945007 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:26.944993    2559 scope.go:117] "RemoveContainer" containerID="ea5db9dfe765a4c92e9f7ddce4ca4945e6ad429f9eb250d36555fbebf53d4f63"
Sep 16 12:31:26.946245 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:26.946215    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:31:26.946308 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:26.946291    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:31:26.946344 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:26.946322    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:31:27.105564 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:27.105533    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:31:27.313949 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:27.313863    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:31:27.959276 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:27.958229    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h" event={"ID":"bccc53b8-67ae-4dc6-8cde-76374d131e14","Type":"ContainerStarted","Data":"86f9751ec7644ae1ec6247357449ba8af97e23f497c3fefb1c0f1e176ca4f8bd"}
Sep 16 12:31:28.035087 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:28.035056    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h"
Sep 16 12:31:28.035347 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:28.035319    2559 patch_prober.go:28] interesting pod/e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Sep 16 12:31:28.035580 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:28.035555    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h" podUID="bccc53b8-67ae-4dc6-8cde-76374d131e14" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Sep 16 12:31:28.048162 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:28.048109    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:31:28.105947 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:28.105913    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:31:28.273823 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:28.273714    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-835ec8-l4lfh"]
Sep 16 12:31:28.274288 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:28.274268    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea1b1001-d496-48f3-96fd-acedc73df7dc" containerName="revoke-keys"
Sep 16 12:31:28.274395 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:28.274290    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea1b1001-d496-48f3-96fd-acedc73df7dc" containerName="revoke-keys"
Sep 16 12:31:28.274453 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:28.274415    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea1b1001-d496-48f3-96fd-acedc73df7dc" containerName="revoke-keys"
Sep 16 12:31:28.276595 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:28.276574    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-835ec8-l4lfh"
Sep 16 12:31:28.282089 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:28.282067    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hvtv7\""
Sep 16 12:31:28.294236 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:28.294213    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-835ec8-l4lfh"]
Sep 16 12:31:28.404745 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:28.404712    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad42a899-afdb-4fe8-9c0a-e402b0c60c94-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-835ec8-l4lfh\" (UID: \"ad42a899-afdb-4fe8-9c0a-e402b0c60c94\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-835ec8-l4lfh"
Sep 16 12:31:28.505873 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:28.505834    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad42a899-afdb-4fe8-9c0a-e402b0c60c94-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-835ec8-l4lfh\" (UID: \"ad42a899-afdb-4fe8-9c0a-e402b0c60c94\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-835ec8-l4lfh"
Sep 16 12:31:28.506522 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:28.506499    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad42a899-afdb-4fe8-9c0a-e402b0c60c94-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-835ec8-l4lfh\" (UID: \"ad42a899-afdb-4fe8-9c0a-e402b0c60c94\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-835ec8-l4lfh"
Sep 16 12:31:28.588355 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:28.588275    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-835ec8-l4lfh"
Sep 16 12:31:28.883672 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:28.883647    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-835ec8-l4lfh"]
Sep 16 12:31:28.885262 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:31:28.885234    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad42a899_afdb_4fe8_9c0a_e402b0c60c94.slice/crio-2665f6c4ac4fbe473c15218c0a57df239431f83ee6a7b5622bf0773cf089ec75 WatchSource:0}: Error finding container 2665f6c4ac4fbe473c15218c0a57df239431f83ee6a7b5622bf0773cf089ec75: Status 404 returned error can't find the container with id 2665f6c4ac4fbe473c15218c0a57df239431f83ee6a7b5622bf0773cf089ec75
Sep 16 12:31:28.969952 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:28.969875    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-835ec8-l4lfh" event={"ID":"ad42a899-afdb-4fe8-9c0a-e402b0c60c94","Type":"ContainerStarted","Data":"2665f6c4ac4fbe473c15218c0a57df239431f83ee6a7b5622bf0773cf089ec75"}
Sep 16 12:31:29.035255 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:29.035215    2559 patch_prober.go:28] interesting pod/e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Sep 16 12:31:29.035428 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:29.035280    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h" podUID="bccc53b8-67ae-4dc6-8cde-76374d131e14" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Sep 16 12:31:29.063867 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:29.063823    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:31:29.841280 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:29.841237    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:31:29.977328 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:29.977297    2559 generic.go:356] "Generic (PLEG): container finished" podID="ad42a899-afdb-4fe8-9c0a-e402b0c60c94" containerID="2400af9caf541e6fee3150943d38743efc375b9f16cf92250a9c078773dd721b" exitCode=0
Sep 16 12:31:29.977790 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:29.977380    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-835ec8-l4lfh" event={"ID":"ad42a899-afdb-4fe8-9c0a-e402b0c60c94","Type":"ContainerDied","Data":"2400af9caf541e6fee3150943d38743efc375b9f16cf92250a9c078773dd721b"}
Sep 16 12:31:30.045668 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:30.045624    2559 patch_prober.go:28] interesting pod/e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Sep 16 12:31:30.045906 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:30.045697    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h" podUID="bccc53b8-67ae-4dc6-8cde-76374d131e14" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Sep 16 12:31:30.737019 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:30.736977    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:31:31.068990 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:31.068739    2559 patch_prober.go:28] interesting pod/e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Sep 16 12:31:31.068990 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:31.068907    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h" podUID="bccc53b8-67ae-4dc6-8cde-76374d131e14" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Sep 16 12:31:31.151157 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:31.149824    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-835ec8-l4lfh"
Sep 16 12:31:31.271504 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:31.271476    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad42a899-afdb-4fe8-9c0a-e402b0c60c94-maas-api-service-ca\") pod \"ad42a899-afdb-4fe8-9c0a-e402b0c60c94\" (UID: \"ad42a899-afdb-4fe8-9c0a-e402b0c60c94\") "
Sep 16 12:31:31.271815 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:31.271790    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad42a899-afdb-4fe8-9c0a-e402b0c60c94-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ad42a899-afdb-4fe8-9c0a-e402b0c60c94" (UID: "ad42a899-afdb-4fe8-9c0a-e402b0c60c94"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:31:31.372533 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:31.372446    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad42a899-afdb-4fe8-9c0a-e402b0c60c94-maas-api-service-ca\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:31:31.579858 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:31.579828    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:31:31.990320 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:31.990296    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-835ec8-l4lfh"
Sep 16 12:31:31.990511 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:31.990292    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-835ec8-l4lfh" event={"ID":"ad42a899-afdb-4fe8-9c0a-e402b0c60c94","Type":"ContainerDied","Data":"2665f6c4ac4fbe473c15218c0a57df239431f83ee6a7b5622bf0773cf089ec75"}
Sep 16 12:31:31.990511 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:31.990413    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2665f6c4ac4fbe473c15218c0a57df239431f83ee6a7b5622bf0773cf089ec75"
Sep 16 12:31:32.035482 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:32.035445    2559 patch_prober.go:28] interesting pod/e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Sep 16 12:31:32.035661 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:32.035506    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h" podUID="bccc53b8-67ae-4dc6-8cde-76374d131e14" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Sep 16 12:31:32.499738 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:32.499695    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:31:33.035257 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:33.035222    2559 patch_prober.go:28] interesting pod/e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Sep 16 12:31:33.035545 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:33.035513    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h" podUID="bccc53b8-67ae-4dc6-8cde-76374d131e14" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Sep 16 12:31:33.248163 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:33.248099    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:31:33.895867 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:33.895834    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:31:34.038807 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:34.038777    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h"
Sep 16 12:31:34.039195 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:34.039174    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h"
Sep 16 12:31:34.039876 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:34.039855    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h"
Sep 16 12:31:34.200153 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:34.195655    2559 scope.go:117] "RemoveContainer" containerID="2708953f9c10520425ee5d7a047c9bbe05dc91d45a22e477ce3197c22059d0c1"
Sep 16 12:31:34.209798 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:34.209780    2559 scope.go:117] "RemoveContainer" containerID="9058f81647311c07f0ee85a935fe808d504e9b1e0af51760426015e01c84a2d7"
Sep 16 12:31:38.422307 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:38.422273    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:31:39.453256 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:39.453212    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-7a4d5c-29826030-dx5ss"]
Sep 16 12:31:39.455605 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:39.455578    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-7a4d5c-29826030-dx5ss"]
Sep 16 12:31:39.458046 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:39.458021    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:31:39.474401 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:39.474375    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-7a4d5c-5dd74ddd9f-tnrs8"]
Sep 16 12:31:39.474653 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:39.474625    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w4-7a4d5c-5dd74ddd9f-tnrs8" podUID="833e2257-98b1-4f6b-a5ab-41e7fd8efbb8" containerName="payload-processing" containerID="cri-o://14740b7e1fa513994b8d680829fd983bcf2875a3af20a21c1bf85cb7bc14bbf1" gracePeriod=30
Sep 16 12:31:39.479317 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:39.479292    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-7a4d5c-7b54999db-828tz"]
Sep 16 12:31:39.479721 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:39.479663    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-7a4d5c-7b54999db-828tz" podUID="97eab9bf-a543-42c3-9f9c-abae5e34a2e3" containerName="payload-pre-processing" containerID="cri-o://5861a8308b619487c9c79cae4ad26a8795512603a9aa5a899afdfc73453665e6" gracePeriod=30
Sep 16 12:31:39.525927 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:39.525879    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:31:39.630074 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:39.630003    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:31:39.636306 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:39.636120    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-7a4d5c-hhm8d"]
Sep 16 12:31:39.640928 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:39.640900    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-7a4d5c-hhm8d"]
Sep 16 12:31:39.698947 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:39.698916    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:31:39.771784 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:39.771762    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-7a4d5c-5dd74ddd9f-tnrs8"
Sep 16 12:31:39.774786 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:39.774763    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-7a4d5c-7b54999db-828tz"
Sep 16 12:31:39.859183 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:39.859117    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/97eab9bf-a543-42c3-9f9c-abae5e34a2e3-plugins-config-volume\") pod \"97eab9bf-a543-42c3-9f9c-abae5e34a2e3\" (UID: \"97eab9bf-a543-42c3-9f9c-abae5e34a2e3\") "
Sep 16 12:31:39.859385 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:39.859238    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/833e2257-98b1-4f6b-a5ab-41e7fd8efbb8-plugins-config-volume\") pod \"833e2257-98b1-4f6b-a5ab-41e7fd8efbb8\" (UID: \"833e2257-98b1-4f6b-a5ab-41e7fd8efbb8\") "
Sep 16 12:31:39.859385 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:39.859271    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k79b5\" (UniqueName: \"kubernetes.io/projected/833e2257-98b1-4f6b-a5ab-41e7fd8efbb8-kube-api-access-k79b5\") pod \"833e2257-98b1-4f6b-a5ab-41e7fd8efbb8\" (UID: \"833e2257-98b1-4f6b-a5ab-41e7fd8efbb8\") "
Sep 16 12:31:39.859385 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:39.859300    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6tngh\" (UniqueName: \"kubernetes.io/projected/97eab9bf-a543-42c3-9f9c-abae5e34a2e3-kube-api-access-6tngh\") pod \"97eab9bf-a543-42c3-9f9c-abae5e34a2e3\" (UID: \"97eab9bf-a543-42c3-9f9c-abae5e34a2e3\") "
Sep 16 12:31:39.859603 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:39.859571    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97eab9bf-a543-42c3-9f9c-abae5e34a2e3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "97eab9bf-a543-42c3-9f9c-abae5e34a2e3" (UID: "97eab9bf-a543-42c3-9f9c-abae5e34a2e3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:31:39.859671 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:39.859602    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/833e2257-98b1-4f6b-a5ab-41e7fd8efbb8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "833e2257-98b1-4f6b-a5ab-41e7fd8efbb8" (UID: "833e2257-98b1-4f6b-a5ab-41e7fd8efbb8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:31:39.859732 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:39.859684    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/833e2257-98b1-4f6b-a5ab-41e7fd8efbb8-plugins-config-volume\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:31:39.859732 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:39.859703    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/97eab9bf-a543-42c3-9f9c-abae5e34a2e3-plugins-config-volume\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:31:39.861816 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:39.861786    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97eab9bf-a543-42c3-9f9c-abae5e34a2e3-kube-api-access-6tngh" (OuterVolumeSpecName: "kube-api-access-6tngh") pod "97eab9bf-a543-42c3-9f9c-abae5e34a2e3" (UID: "97eab9bf-a543-42c3-9f9c-abae5e34a2e3"). InnerVolumeSpecName "kube-api-access-6tngh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:31:39.862305 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:39.862279    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/833e2257-98b1-4f6b-a5ab-41e7fd8efbb8-kube-api-access-k79b5" (OuterVolumeSpecName: "kube-api-access-k79b5") pod "833e2257-98b1-4f6b-a5ab-41e7fd8efbb8" (UID: "833e2257-98b1-4f6b-a5ab-41e7fd8efbb8"). InnerVolumeSpecName "kube-api-access-k79b5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:31:39.938450 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:39.938422    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="941df1db-49d1-49d7-8c04-4feb58e9782a" path="/var/lib/kubelet/pods/941df1db-49d1-49d7-8c04-4feb58e9782a/volumes"
Sep 16 12:31:39.938770 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:39.938757    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea1b1001-d496-48f3-96fd-acedc73df7dc" path="/var/lib/kubelet/pods/ea1b1001-d496-48f3-96fd-acedc73df7dc/volumes"
Sep 16 12:31:39.967590 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:39.962069    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k79b5\" (UniqueName: \"kubernetes.io/projected/833e2257-98b1-4f6b-a5ab-41e7fd8efbb8-kube-api-access-k79b5\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:31:39.967590 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:39.962104    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6tngh\" (UniqueName: \"kubernetes.io/projected/97eab9bf-a543-42c3-9f9c-abae5e34a2e3-kube-api-access-6tngh\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:31:40.033918 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:40.033815    2559 generic.go:356] "Generic (PLEG): container finished" podID="833e2257-98b1-4f6b-a5ab-41e7fd8efbb8" containerID="14740b7e1fa513994b8d680829fd983bcf2875a3af20a21c1bf85cb7bc14bbf1" exitCode=0
Sep 16 12:31:40.033918 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:40.033868    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-7a4d5c-5dd74ddd9f-tnrs8"
Sep 16 12:31:40.033918 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:40.033882    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-7a4d5c-5dd74ddd9f-tnrs8" event={"ID":"833e2257-98b1-4f6b-a5ab-41e7fd8efbb8","Type":"ContainerDied","Data":"14740b7e1fa513994b8d680829fd983bcf2875a3af20a21c1bf85cb7bc14bbf1"}
Sep 16 12:31:40.034410 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:40.033979    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-7a4d5c-5dd74ddd9f-tnrs8" event={"ID":"833e2257-98b1-4f6b-a5ab-41e7fd8efbb8","Type":"ContainerDied","Data":"f0b0868920d55dff9fbaf0c1efba17dbcf8a59b2c197cc90961ec033d93940b1"}
Sep 16 12:31:40.034709 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:40.034003    2559 scope.go:117] "RemoveContainer" containerID="14740b7e1fa513994b8d680829fd983bcf2875a3af20a21c1bf85cb7bc14bbf1"
Sep 16 12:31:40.035622 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:40.035596    2559 generic.go:356] "Generic (PLEG): container finished" podID="97eab9bf-a543-42c3-9f9c-abae5e34a2e3" containerID="5861a8308b619487c9c79cae4ad26a8795512603a9aa5a899afdfc73453665e6" exitCode=0
Sep 16 12:31:40.035748 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:40.035660    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-7a4d5c-7b54999db-828tz"
Sep 16 12:31:40.035748 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:40.035664    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-7a4d5c-7b54999db-828tz" event={"ID":"97eab9bf-a543-42c3-9f9c-abae5e34a2e3","Type":"ContainerDied","Data":"5861a8308b619487c9c79cae4ad26a8795512603a9aa5a899afdfc73453665e6"}
Sep 16 12:31:40.035748 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:40.035708    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-7a4d5c-7b54999db-828tz" event={"ID":"97eab9bf-a543-42c3-9f9c-abae5e34a2e3","Type":"ContainerDied","Data":"178a4b80921defeeaa5a8b1f03651825cda30bc7b5036afbc8be5703d2c9bf93"}
Sep 16 12:31:40.044412 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:40.044394    2559 scope.go:117] "RemoveContainer" containerID="14740b7e1fa513994b8d680829fd983bcf2875a3af20a21c1bf85cb7bc14bbf1"
Sep 16 12:31:40.044856 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:31:40.044678    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14740b7e1fa513994b8d680829fd983bcf2875a3af20a21c1bf85cb7bc14bbf1\": container with ID starting with 14740b7e1fa513994b8d680829fd983bcf2875a3af20a21c1bf85cb7bc14bbf1 not found: ID does not exist" containerID="14740b7e1fa513994b8d680829fd983bcf2875a3af20a21c1bf85cb7bc14bbf1"
Sep 16 12:31:40.044856 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:40.044718    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14740b7e1fa513994b8d680829fd983bcf2875a3af20a21c1bf85cb7bc14bbf1"} err="failed to get container status \"14740b7e1fa513994b8d680829fd983bcf2875a3af20a21c1bf85cb7bc14bbf1\": rpc error: code = NotFound desc = could not find container \"14740b7e1fa513994b8d680829fd983bcf2875a3af20a21c1bf85cb7bc14bbf1\": container with ID starting with 14740b7e1fa513994b8d680829fd983bcf2875a3af20a21c1bf85cb7bc14bbf1 not found: ID does not exist"
Sep 16 12:31:40.044856 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:40.044741    2559 scope.go:117] "RemoveContainer" containerID="5861a8308b619487c9c79cae4ad26a8795512603a9aa5a899afdfc73453665e6"
Sep 16 12:31:40.053225 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:40.053204    2559 scope.go:117] "RemoveContainer" containerID="5861a8308b619487c9c79cae4ad26a8795512603a9aa5a899afdfc73453665e6"
Sep 16 12:31:40.053502 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:31:40.053483    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5861a8308b619487c9c79cae4ad26a8795512603a9aa5a899afdfc73453665e6\": container with ID starting with 5861a8308b619487c9c79cae4ad26a8795512603a9aa5a899afdfc73453665e6 not found: ID does not exist" containerID="5861a8308b619487c9c79cae4ad26a8795512603a9aa5a899afdfc73453665e6"
Sep 16 12:31:40.053555 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:40.053509    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5861a8308b619487c9c79cae4ad26a8795512603a9aa5a899afdfc73453665e6"} err="failed to get container status \"5861a8308b619487c9c79cae4ad26a8795512603a9aa5a899afdfc73453665e6\": rpc error: code = NotFound desc = could not find container \"5861a8308b619487c9c79cae4ad26a8795512603a9aa5a899afdfc73453665e6\": container with ID starting with 5861a8308b619487c9c79cae4ad26a8795512603a9aa5a899afdfc73453665e6 not found: ID does not exist"
Sep 16 12:31:40.057464 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:40.057442    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-7a4d5c-5dd74ddd9f-tnrs8"]
Sep 16 12:31:40.062328 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:40.062304    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-7a4d5c-5dd74ddd9f-tnrs8"]
Sep 16 12:31:40.072267 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:40.072248    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-7a4d5c-7b54999db-828tz"]
Sep 16 12:31:40.078039 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:40.078019    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-7a4d5c-7b54999db-828tz"]
Sep 16 12:31:40.095843 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:40.095818    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:31:40.196668 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:40.196635    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:31:40.833403 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:40.833372    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:31:41.552578 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:41.552541    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:31:41.938470 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:41.938438    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="833e2257-98b1-4f6b-a5ab-41e7fd8efbb8" path="/var/lib/kubelet/pods/833e2257-98b1-4f6b-a5ab-41e7fd8efbb8/volumes"
Sep 16 12:31:41.938942 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:41.938925    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97eab9bf-a543-42c3-9f9c-abae5e34a2e3" path="/var/lib/kubelet/pods/97eab9bf-a543-42c3-9f9c-abae5e34a2e3/volumes"
Sep 16 12:31:42.148043 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:42.148006    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:31:42.245476 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:42.245379    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:31:42.286127 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:42.286094    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-835ec8-l4lfh"]
Sep 16 12:31:42.291721 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:42.291695    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-835ec8-l4lfh"]
Sep 16 12:31:42.330066 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:42.330039    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:31:42.394095 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:42.394056    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:31:43.206405 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:43.206370    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:31:43.306178 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:43.306124    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:31:43.938088 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:43.938056    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad42a899-afdb-4fe8-9c0a-e402b0c60c94" path="/var/lib/kubelet/pods/ad42a899-afdb-4fe8-9c0a-e402b0c60c94/volumes"
Sep 16 12:31:44.086091 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:44.086059    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:31:45.013940 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:45.013902    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:31:45.519670 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:45.519635    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:31:46.425410 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:46.425378    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:31:46.992898 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:46.992868    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:31:47.079019 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:47.078986    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:31:47.178492 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:47.178457    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:31:47.432726 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:47.432696    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:31:48.975708 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:48.975677    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:31:49.049714 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:49.049681    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:31:49.364572 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:49.364478    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-835ec8-openshift-default-6d9c668588-xht45"]
Sep 16 12:31:49.364751 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:49.364719    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-835ec8-openshift-default-6d9c668588-xht45" podUID="0396f9d0-6466-4e68-997e-f9df4f5ede4b" containerName="istio-proxy" containerID="cri-o://6ec13decdf8b926c3b49330a741735e9138d40a25c46036e44f51bdc250ba259" gracePeriod=30
Sep 16 12:31:49.376849 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:49.376802    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:31:49.870223 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:49.870194    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5c41db-72rt7"]
Sep 16 12:31:49.870624 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:49.870611    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad42a899-afdb-4fe8-9c0a-e402b0c60c94" containerName="revoke-keys"
Sep 16 12:31:49.870624 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:49.870625    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad42a899-afdb-4fe8-9c0a-e402b0c60c94" containerName="revoke-keys"
Sep 16 12:31:49.870730 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:49.870654    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="833e2257-98b1-4f6b-a5ab-41e7fd8efbb8" containerName="payload-processing"
Sep 16 12:31:49.870730 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:49.870660    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="833e2257-98b1-4f6b-a5ab-41e7fd8efbb8" containerName="payload-processing"
Sep 16 12:31:49.870730 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:49.870669    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97eab9bf-a543-42c3-9f9c-abae5e34a2e3" containerName="payload-pre-processing"
Sep 16 12:31:49.870730 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:49.870674    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="97eab9bf-a543-42c3-9f9c-abae5e34a2e3" containerName="payload-pre-processing"
Sep 16 12:31:49.870730 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:49.870729    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="97eab9bf-a543-42c3-9f9c-abae5e34a2e3" containerName="payload-pre-processing"
Sep 16 12:31:49.870908 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:49.870739    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad42a899-afdb-4fe8-9c0a-e402b0c60c94" containerName="revoke-keys"
Sep 16 12:31:49.870908 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:49.870747    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="833e2257-98b1-4f6b-a5ab-41e7fd8efbb8" containerName="payload-processing"
Sep 16 12:31:49.875186 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:49.875170    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5c41db-72rt7"
Sep 16 12:31:49.877664 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:49.877644    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hvtv7\""
Sep 16 12:31:49.881655 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:49.881631    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5c41db-72rt7"]
Sep 16 12:31:49.969603 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:49.969573    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5de3fdb9-bed0-4c08-b68e-a68b2496a269-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-5c41db-72rt7\" (UID: \"5de3fdb9-bed0-4c08-b68e-a68b2496a269\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5c41db-72rt7"
Sep 16 12:31:50.070222 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:50.070190    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5de3fdb9-bed0-4c08-b68e-a68b2496a269-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-5c41db-72rt7\" (UID: \"5de3fdb9-bed0-4c08-b68e-a68b2496a269\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5c41db-72rt7"
Sep 16 12:31:50.071055 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:50.071031    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5de3fdb9-bed0-4c08-b68e-a68b2496a269-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-5c41db-72rt7\" (UID: \"5de3fdb9-bed0-4c08-b68e-a68b2496a269\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5c41db-72rt7"
Sep 16 12:31:50.186800 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:50.186769    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5c41db-72rt7"
Sep 16 12:31:50.222213 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:50.222182    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:31:50.468191 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:50.468163    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5c41db-72rt7"]
Sep 16 12:31:51.023613 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:51.023523    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:31:51.102327 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:51.102290    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5c41db-72rt7" event={"ID":"5de3fdb9-bed0-4c08-b68e-a68b2496a269","Type":"ContainerStarted","Data":"60295a1be70257dccebbaaa7b756df4d762c26fa7eb7ed196e5738a96477697b"}
Sep 16 12:31:51.102807 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:51.102344    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5c41db-72rt7" event={"ID":"5de3fdb9-bed0-4c08-b68e-a68b2496a269","Type":"ContainerStarted","Data":"7192d54ecb8dbeb7550fcc28132fe75df79e2c6ab95dec59d0951d277ff6b72e"}
Sep 16 12:31:51.119191 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:51.119126    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5c41db-72rt7" podStartSLOduration=2.119107547 podStartE2EDuration="2.119107547s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:31:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:31:51.118577341 +0000 UTC m=+1877.738896658" watchObservedRunningTime="2026-09-16 12:31:51.119107547 +0000 UTC m=+1877.739426867"
Sep 16 12:31:51.809610 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:51.809573    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:31:52.001014 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:52.000977    2559 patch_prober.go:28] interesting pod/e2e-api-a-835ec8-openshift-default-6d9c668588-xht45 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 16 12:31:52.001183 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:52.001039    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-835ec8-openshift-default-6d9c668588-xht45" podUID="0396f9d0-6466-4e68-997e-f9df4f5ede4b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 12:31:52.110328 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:52.110237    2559 generic.go:356] "Generic (PLEG): container finished" podID="5de3fdb9-bed0-4c08-b68e-a68b2496a269" containerID="60295a1be70257dccebbaaa7b756df4d762c26fa7eb7ed196e5738a96477697b" exitCode=0
Sep 16 12:31:52.110328 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:52.110319    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5c41db-72rt7" event={"ID":"5de3fdb9-bed0-4c08-b68e-a68b2496a269","Type":"ContainerDied","Data":"60295a1be70257dccebbaaa7b756df4d762c26fa7eb7ed196e5738a96477697b"}
Sep 16 12:31:52.609815 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:52.609776    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:31:53.264362 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:53.264308    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:31:53.276367 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:53.276342    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5c41db-72rt7"
Sep 16 12:31:53.404661 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:53.404626    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5de3fdb9-bed0-4c08-b68e-a68b2496a269-maas-api-service-ca\") pod \"5de3fdb9-bed0-4c08-b68e-a68b2496a269\" (UID: \"5de3fdb9-bed0-4c08-b68e-a68b2496a269\") "
Sep 16 12:31:53.405062 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:53.405039    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5de3fdb9-bed0-4c08-b68e-a68b2496a269-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5de3fdb9-bed0-4c08-b68e-a68b2496a269" (UID: "5de3fdb9-bed0-4c08-b68e-a68b2496a269"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:31:53.505872 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:53.505817    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5de3fdb9-bed0-4c08-b68e-a68b2496a269-maas-api-service-ca\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:31:53.919034 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:53.918999    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:31:54.123665 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:54.123632    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5c41db-72rt7" event={"ID":"5de3fdb9-bed0-4c08-b68e-a68b2496a269","Type":"ContainerDied","Data":"7192d54ecb8dbeb7550fcc28132fe75df79e2c6ab95dec59d0951d277ff6b72e"}
Sep 16 12:31:54.123859 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:54.123688    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7192d54ecb8dbeb7550fcc28132fe75df79e2c6ab95dec59d0951d277ff6b72e"
Sep 16 12:31:54.123859 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:54.123640    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5c41db-72rt7"
Sep 16 12:31:54.628008 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:54.627940    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-835ec8-openshift-default-6d9c668588-xht45"
Sep 16 12:31:54.717570 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:54.717534    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0396f9d0-6466-4e68-997e-f9df4f5ede4b-istio-podinfo\") pod \"0396f9d0-6466-4e68-997e-f9df4f5ede4b\" (UID: \"0396f9d0-6466-4e68-997e-f9df4f5ede4b\") "
Sep 16 12:31:54.717570 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:54.717568    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0396f9d0-6466-4e68-997e-f9df4f5ede4b-istio-token\") pod \"0396f9d0-6466-4e68-997e-f9df4f5ede4b\" (UID: \"0396f9d0-6466-4e68-997e-f9df4f5ede4b\") "
Sep 16 12:31:54.717839 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:54.717591    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0396f9d0-6466-4e68-997e-f9df4f5ede4b-istio-envoy\") pod \"0396f9d0-6466-4e68-997e-f9df4f5ede4b\" (UID: \"0396f9d0-6466-4e68-997e-f9df4f5ede4b\") "
Sep 16 12:31:54.717839 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:54.717643    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0396f9d0-6466-4e68-997e-f9df4f5ede4b-workload-socket\") pod \"0396f9d0-6466-4e68-997e-f9df4f5ede4b\" (UID: \"0396f9d0-6466-4e68-997e-f9df4f5ede4b\") "
Sep 16 12:31:54.717839 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:54.717686    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0396f9d0-6466-4e68-997e-f9df4f5ede4b-credential-socket\") pod \"0396f9d0-6466-4e68-997e-f9df4f5ede4b\" (UID: \"0396f9d0-6466-4e68-997e-f9df4f5ede4b\") "
Sep 16 12:31:54.717839 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:54.717713    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0396f9d0-6466-4e68-997e-f9df4f5ede4b-istio-data\") pod \"0396f9d0-6466-4e68-997e-f9df4f5ede4b\" (UID: \"0396f9d0-6466-4e68-997e-f9df4f5ede4b\") "
Sep 16 12:31:54.717839 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:54.717747    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0396f9d0-6466-4e68-997e-f9df4f5ede4b-istiod-ca-cert\") pod \"0396f9d0-6466-4e68-997e-f9df4f5ede4b\" (UID: \"0396f9d0-6466-4e68-997e-f9df4f5ede4b\") "
Sep 16 12:31:54.717839 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:54.717806    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0396f9d0-6466-4e68-997e-f9df4f5ede4b-workload-certs\") pod \"0396f9d0-6466-4e68-997e-f9df4f5ede4b\" (UID: \"0396f9d0-6466-4e68-997e-f9df4f5ede4b\") "
Sep 16 12:31:54.718187 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:54.717878    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g6rtt\" (UniqueName: \"kubernetes.io/projected/0396f9d0-6466-4e68-997e-f9df4f5ede4b-kube-api-access-g6rtt\") pod \"0396f9d0-6466-4e68-997e-f9df4f5ede4b\" (UID: \"0396f9d0-6466-4e68-997e-f9df4f5ede4b\") "
Sep 16 12:31:54.718187 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:54.717938    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0396f9d0-6466-4e68-997e-f9df4f5ede4b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0396f9d0-6466-4e68-997e-f9df4f5ede4b" (UID: "0396f9d0-6466-4e68-997e-f9df4f5ede4b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:31:54.718187 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:54.718006    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0396f9d0-6466-4e68-997e-f9df4f5ede4b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0396f9d0-6466-4e68-997e-f9df4f5ede4b" (UID: "0396f9d0-6466-4e68-997e-f9df4f5ede4b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:31:54.718352 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:54.718243    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0396f9d0-6466-4e68-997e-f9df4f5ede4b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0396f9d0-6466-4e68-997e-f9df4f5ede4b" (UID: "0396f9d0-6466-4e68-997e-f9df4f5ede4b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:31:54.718528 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:54.718478    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0396f9d0-6466-4e68-997e-f9df4f5ede4b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0396f9d0-6466-4e68-997e-f9df4f5ede4b" (UID: "0396f9d0-6466-4e68-997e-f9df4f5ede4b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:31:54.718528 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:54.718498    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0396f9d0-6466-4e68-997e-f9df4f5ede4b-workload-socket\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:31:54.718681 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:54.718537    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0396f9d0-6466-4e68-997e-f9df4f5ede4b-credential-socket\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:31:54.718681 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:54.718555    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0396f9d0-6466-4e68-997e-f9df4f5ede4b-workload-certs\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:31:54.718681 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:54.718157    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0396f9d0-6466-4e68-997e-f9df4f5ede4b-istio-data" (OuterVolumeSpecName: "istio-data") pod "0396f9d0-6466-4e68-997e-f9df4f5ede4b" (UID: "0396f9d0-6466-4e68-997e-f9df4f5ede4b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:31:54.720011 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:54.719965    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0396f9d0-6466-4e68-997e-f9df4f5ede4b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0396f9d0-6466-4e68-997e-f9df4f5ede4b" (UID: "0396f9d0-6466-4e68-997e-f9df4f5ede4b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 12:31:54.720011 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:54.719997    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0396f9d0-6466-4e68-997e-f9df4f5ede4b-istio-token" (OuterVolumeSpecName: "istio-token") pod "0396f9d0-6466-4e68-997e-f9df4f5ede4b" (UID: "0396f9d0-6466-4e68-997e-f9df4f5ede4b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:31:54.720193 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:54.720049    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0396f9d0-6466-4e68-997e-f9df4f5ede4b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0396f9d0-6466-4e68-997e-f9df4f5ede4b" (UID: "0396f9d0-6466-4e68-997e-f9df4f5ede4b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:31:54.720193 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:54.720051    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0396f9d0-6466-4e68-997e-f9df4f5ede4b-kube-api-access-g6rtt" (OuterVolumeSpecName: "kube-api-access-g6rtt") pod "0396f9d0-6466-4e68-997e-f9df4f5ede4b" (UID: "0396f9d0-6466-4e68-997e-f9df4f5ede4b"). InnerVolumeSpecName "kube-api-access-g6rtt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:31:54.726450 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:54.726281    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:31:54.819890 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:54.819861    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0396f9d0-6466-4e68-997e-f9df4f5ede4b-istiod-ca-cert\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:31:54.819890 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:54.819886    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g6rtt\" (UniqueName: \"kubernetes.io/projected/0396f9d0-6466-4e68-997e-f9df4f5ede4b-kube-api-access-g6rtt\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:31:54.819890 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:54.819897    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0396f9d0-6466-4e68-997e-f9df4f5ede4b-istio-podinfo\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:31:54.820156 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:54.819906    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0396f9d0-6466-4e68-997e-f9df4f5ede4b-istio-token\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:31:54.820156 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:54.819915    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0396f9d0-6466-4e68-997e-f9df4f5ede4b-istio-envoy\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:31:54.820156 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:54.819926    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0396f9d0-6466-4e68-997e-f9df4f5ede4b-istio-data\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:31:55.131022 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:55.130986    2559 generic.go:356] "Generic (PLEG): container finished" podID="0396f9d0-6466-4e68-997e-f9df4f5ede4b" containerID="6ec13decdf8b926c3b49330a741735e9138d40a25c46036e44f51bdc250ba259" exitCode=0
Sep 16 12:31:55.131257 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:55.131031    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-835ec8-openshift-default-6d9c668588-xht45"
Sep 16 12:31:55.131257 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:55.131075    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-835ec8-openshift-default-6d9c668588-xht45" event={"ID":"0396f9d0-6466-4e68-997e-f9df4f5ede4b","Type":"ContainerDied","Data":"6ec13decdf8b926c3b49330a741735e9138d40a25c46036e44f51bdc250ba259"}
Sep 16 12:31:55.131257 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:55.131145    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-835ec8-openshift-default-6d9c668588-xht45" event={"ID":"0396f9d0-6466-4e68-997e-f9df4f5ede4b","Type":"ContainerDied","Data":"fa73beb94593f76dc7594812bfd6414fa6d8b42e5b8bbd779e539f0d7ae8c435"}
Sep 16 12:31:55.131257 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:55.131189    2559 scope.go:117] "RemoveContainer" containerID="6ec13decdf8b926c3b49330a741735e9138d40a25c46036e44f51bdc250ba259"
Sep 16 12:31:55.148578 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:55.148559    2559 scope.go:117] "RemoveContainer" containerID="c7ea972003ca21a1707553e1c8a31e957eddeee69203ff26bd8ee2553d029c5c"
Sep 16 12:31:55.157858 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:55.157804    2559 scope.go:117] "RemoveContainer" containerID="6ec13decdf8b926c3b49330a741735e9138d40a25c46036e44f51bdc250ba259"
Sep 16 12:31:55.158641 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:31:55.158272    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ec13decdf8b926c3b49330a741735e9138d40a25c46036e44f51bdc250ba259\": container with ID starting with 6ec13decdf8b926c3b49330a741735e9138d40a25c46036e44f51bdc250ba259 not found: ID does not exist" containerID="6ec13decdf8b926c3b49330a741735e9138d40a25c46036e44f51bdc250ba259"
Sep 16 12:31:55.158641 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:55.158316    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ec13decdf8b926c3b49330a741735e9138d40a25c46036e44f51bdc250ba259"} err="failed to get container status \"6ec13decdf8b926c3b49330a741735e9138d40a25c46036e44f51bdc250ba259\": rpc error: code = NotFound desc = could not find container \"6ec13decdf8b926c3b49330a741735e9138d40a25c46036e44f51bdc250ba259\": container with ID starting with 6ec13decdf8b926c3b49330a741735e9138d40a25c46036e44f51bdc250ba259 not found: ID does not exist"
Sep 16 12:31:55.158641 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:55.158342    2559 scope.go:117] "RemoveContainer" containerID="c7ea972003ca21a1707553e1c8a31e957eddeee69203ff26bd8ee2553d029c5c"
Sep 16 12:31:55.158938 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:31:55.158916    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7ea972003ca21a1707553e1c8a31e957eddeee69203ff26bd8ee2553d029c5c\": container with ID starting with c7ea972003ca21a1707553e1c8a31e957eddeee69203ff26bd8ee2553d029c5c not found: ID does not exist" containerID="c7ea972003ca21a1707553e1c8a31e957eddeee69203ff26bd8ee2553d029c5c"
Sep 16 12:31:55.159009 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:55.158948    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7ea972003ca21a1707553e1c8a31e957eddeee69203ff26bd8ee2553d029c5c"} err="failed to get container status \"c7ea972003ca21a1707553e1c8a31e957eddeee69203ff26bd8ee2553d029c5c\": rpc error: code = NotFound desc = could not find container \"c7ea972003ca21a1707553e1c8a31e957eddeee69203ff26bd8ee2553d029c5c\": container with ID starting with c7ea972003ca21a1707553e1c8a31e957eddeee69203ff26bd8ee2553d029c5c not found: ID does not exist"
Sep 16 12:31:55.161493 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:55.161466    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-835ec8-openshift-default-6d9c668588-xht45"]
Sep 16 12:31:55.163570 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:55.163548    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-835ec8-openshift-default-6d9c668588-xht45"]
Sep 16 12:31:55.939511 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:31:55.939469    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0396f9d0-6466-4e68-997e-f9df4f5ede4b" path="/var/lib/kubelet/pods/0396f9d0-6466-4e68-997e-f9df4f5ede4b/volumes"
Sep 16 12:32:00.306732 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:00.306697    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:32:03.638606 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:03.638574    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:32:03.696364 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:03.696329    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:32:04.548616 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:04.548578    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:32:05.410850 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:05.410819    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:32:05.510842 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:05.510810    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:32:05.583548 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:05.583514    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5c41db-72rt7"]
Sep 16 12:32:05.585650 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:05.585620    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:32:05.586665 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:05.586644    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5c41db-72rt7"]
Sep 16 12:32:05.652526 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:05.652493    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:32:05.945649 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:05.945614    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5de3fdb9-bed0-4c08-b68e-a68b2496a269" path="/var/lib/kubelet/pods/5de3fdb9-bed0-4c08-b68e-a68b2496a269/volumes"
Sep 16 12:32:06.012915 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:06.012879    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:32:06.113084 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:06.113030    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:32:06.657053 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:06.657017    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:32:07.424538 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:07.424500    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:32:08.093232 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:08.093203    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:32:08.709400 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:08.709367    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:32:09.997284 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:09.997250    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:32:11.665088 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:11.665050    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:32:11.770977 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:11.770944    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:32:11.952559 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:11.952468    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h"]
Sep 16 12:32:11.952716 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:11.952678    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h" podUID="bccc53b8-67ae-4dc6-8cde-76374d131e14" containerName="istio-proxy" containerID="cri-o://86f9751ec7644ae1ec6247357449ba8af97e23f497c3fefb1c0f1e176ca4f8bd" gracePeriod=30
Sep 16 12:32:11.969499 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:11.969473    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:32:12.538943 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:12.538907    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:32:13.283601 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:13.283563    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:32:14.048571 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:14.048535    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:32:14.671076 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:14.671043    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:32:15.519927 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:15.519889    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:32:15.725470 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:15.725440    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:32:16.114875 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:16.114841    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:32:16.725236 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:16.725203    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:32:17.210186 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:17.210154    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h"
Sep 16 12:32:17.250495 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:17.250463    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bccc53b8-67ae-4dc6-8cde-76374d131e14-istio-podinfo\") pod \"bccc53b8-67ae-4dc6-8cde-76374d131e14\" (UID: \"bccc53b8-67ae-4dc6-8cde-76374d131e14\") "
Sep 16 12:32:17.250660 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:17.250509    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bccc53b8-67ae-4dc6-8cde-76374d131e14-workload-socket\") pod \"bccc53b8-67ae-4dc6-8cde-76374d131e14\" (UID: \"bccc53b8-67ae-4dc6-8cde-76374d131e14\") "
Sep 16 12:32:17.250660 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:17.250544    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bccc53b8-67ae-4dc6-8cde-76374d131e14-workload-certs\") pod \"bccc53b8-67ae-4dc6-8cde-76374d131e14\" (UID: \"bccc53b8-67ae-4dc6-8cde-76374d131e14\") "
Sep 16 12:32:17.250660 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:17.250587    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bccc53b8-67ae-4dc6-8cde-76374d131e14-istio-envoy\") pod \"bccc53b8-67ae-4dc6-8cde-76374d131e14\" (UID: \"bccc53b8-67ae-4dc6-8cde-76374d131e14\") "
Sep 16 12:32:17.250811 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:17.250663    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bccc53b8-67ae-4dc6-8cde-76374d131e14-credential-socket\") pod \"bccc53b8-67ae-4dc6-8cde-76374d131e14\" (UID: \"bccc53b8-67ae-4dc6-8cde-76374d131e14\") "
Sep 16 12:32:17.250811 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:17.250706    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k4qjr\" (UniqueName: \"kubernetes.io/projected/bccc53b8-67ae-4dc6-8cde-76374d131e14-kube-api-access-k4qjr\") pod \"bccc53b8-67ae-4dc6-8cde-76374d131e14\" (UID: \"bccc53b8-67ae-4dc6-8cde-76374d131e14\") "
Sep 16 12:32:17.250811 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:17.250769    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bccc53b8-67ae-4dc6-8cde-76374d131e14-istio-token\") pod \"bccc53b8-67ae-4dc6-8cde-76374d131e14\" (UID: \"bccc53b8-67ae-4dc6-8cde-76374d131e14\") "
Sep 16 12:32:17.250974 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:17.250833    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bccc53b8-67ae-4dc6-8cde-76374d131e14-istio-data\") pod \"bccc53b8-67ae-4dc6-8cde-76374d131e14\" (UID: \"bccc53b8-67ae-4dc6-8cde-76374d131e14\") "
Sep 16 12:32:17.250974 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:17.250885    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bccc53b8-67ae-4dc6-8cde-76374d131e14-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bccc53b8-67ae-4dc6-8cde-76374d131e14" (UID: "bccc53b8-67ae-4dc6-8cde-76374d131e14"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:32:17.250974 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:17.250893    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bccc53b8-67ae-4dc6-8cde-76374d131e14-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bccc53b8-67ae-4dc6-8cde-76374d131e14" (UID: "bccc53b8-67ae-4dc6-8cde-76374d131e14"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:32:17.251162 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:17.251099    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bccc53b8-67ae-4dc6-8cde-76374d131e14-istio-data" (OuterVolumeSpecName: "istio-data") pod "bccc53b8-67ae-4dc6-8cde-76374d131e14" (UID: "bccc53b8-67ae-4dc6-8cde-76374d131e14"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:32:17.251162 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:17.251151    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bccc53b8-67ae-4dc6-8cde-76374d131e14-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bccc53b8-67ae-4dc6-8cde-76374d131e14" (UID: "bccc53b8-67ae-4dc6-8cde-76374d131e14"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:32:17.251289 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:17.251256    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bccc53b8-67ae-4dc6-8cde-76374d131e14-istiod-ca-cert\") pod \"bccc53b8-67ae-4dc6-8cde-76374d131e14\" (UID: \"bccc53b8-67ae-4dc6-8cde-76374d131e14\") "
Sep 16 12:32:17.251691 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:17.251664    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bccc53b8-67ae-4dc6-8cde-76374d131e14-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bccc53b8-67ae-4dc6-8cde-76374d131e14" (UID: "bccc53b8-67ae-4dc6-8cde-76374d131e14"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:32:17.251691 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:17.251659    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bccc53b8-67ae-4dc6-8cde-76374d131e14-istio-data\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:32:17.251888 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:17.251713    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bccc53b8-67ae-4dc6-8cde-76374d131e14-workload-socket\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:32:17.251888 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:17.251728    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bccc53b8-67ae-4dc6-8cde-76374d131e14-workload-certs\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:32:17.251888 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:17.251742    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bccc53b8-67ae-4dc6-8cde-76374d131e14-credential-socket\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:32:17.253123 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:17.253092    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bccc53b8-67ae-4dc6-8cde-76374d131e14-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bccc53b8-67ae-4dc6-8cde-76374d131e14" (UID: "bccc53b8-67ae-4dc6-8cde-76374d131e14"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:32:17.253123 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:17.253112    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bccc53b8-67ae-4dc6-8cde-76374d131e14-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bccc53b8-67ae-4dc6-8cde-76374d131e14" (UID: "bccc53b8-67ae-4dc6-8cde-76374d131e14"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 12:32:17.253324 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:17.253221    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bccc53b8-67ae-4dc6-8cde-76374d131e14-istio-token" (OuterVolumeSpecName: "istio-token") pod "bccc53b8-67ae-4dc6-8cde-76374d131e14" (UID: "bccc53b8-67ae-4dc6-8cde-76374d131e14"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:32:17.253757 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:17.253735    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bccc53b8-67ae-4dc6-8cde-76374d131e14-kube-api-access-k4qjr" (OuterVolumeSpecName: "kube-api-access-k4qjr") pod "bccc53b8-67ae-4dc6-8cde-76374d131e14" (UID: "bccc53b8-67ae-4dc6-8cde-76374d131e14"). InnerVolumeSpecName "kube-api-access-k4qjr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:32:17.271108 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:17.271082    2559 generic.go:356] "Generic (PLEG): container finished" podID="bccc53b8-67ae-4dc6-8cde-76374d131e14" containerID="86f9751ec7644ae1ec6247357449ba8af97e23f497c3fefb1c0f1e176ca4f8bd" exitCode=0
Sep 16 12:32:17.271222 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:17.271172    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h"
Sep 16 12:32:17.271286 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:17.271168    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h" event={"ID":"bccc53b8-67ae-4dc6-8cde-76374d131e14","Type":"ContainerDied","Data":"86f9751ec7644ae1ec6247357449ba8af97e23f497c3fefb1c0f1e176ca4f8bd"}
Sep 16 12:32:17.271334 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:17.271312    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h" event={"ID":"bccc53b8-67ae-4dc6-8cde-76374d131e14","Type":"ContainerDied","Data":"efb0ac4fab795776b752ab5ac4bf6b71a2ea150f69a9454e6b772a9c1da48a4d"}
Sep 16 12:32:17.271380 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:17.271334    2559 scope.go:117] "RemoveContainer" containerID="86f9751ec7644ae1ec6247357449ba8af97e23f497c3fefb1c0f1e176ca4f8bd"
Sep 16 12:32:17.281667 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:17.281648    2559 scope.go:117] "RemoveContainer" containerID="ea5db9dfe765a4c92e9f7ddce4ca4945e6ad429f9eb250d36555fbebf53d4f63"
Sep 16 12:32:17.289503 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:17.289488    2559 scope.go:117] "RemoveContainer" containerID="86f9751ec7644ae1ec6247357449ba8af97e23f497c3fefb1c0f1e176ca4f8bd"
Sep 16 12:32:17.289763 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:32:17.289744    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86f9751ec7644ae1ec6247357449ba8af97e23f497c3fefb1c0f1e176ca4f8bd\": container with ID starting with 86f9751ec7644ae1ec6247357449ba8af97e23f497c3fefb1c0f1e176ca4f8bd not found: ID does not exist" containerID="86f9751ec7644ae1ec6247357449ba8af97e23f497c3fefb1c0f1e176ca4f8bd"
Sep 16 12:32:17.289842 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:17.289773    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86f9751ec7644ae1ec6247357449ba8af97e23f497c3fefb1c0f1e176ca4f8bd"} err="failed to get container status \"86f9751ec7644ae1ec6247357449ba8af97e23f497c3fefb1c0f1e176ca4f8bd\": rpc error: code = NotFound desc = could not find container \"86f9751ec7644ae1ec6247357449ba8af97e23f497c3fefb1c0f1e176ca4f8bd\": container with ID starting with 86f9751ec7644ae1ec6247357449ba8af97e23f497c3fefb1c0f1e176ca4f8bd not found: ID does not exist"
Sep 16 12:32:17.289842 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:17.289799    2559 scope.go:117] "RemoveContainer" containerID="ea5db9dfe765a4c92e9f7ddce4ca4945e6ad429f9eb250d36555fbebf53d4f63"
Sep 16 12:32:17.290100 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:32:17.290066    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea5db9dfe765a4c92e9f7ddce4ca4945e6ad429f9eb250d36555fbebf53d4f63\": container with ID starting with ea5db9dfe765a4c92e9f7ddce4ca4945e6ad429f9eb250d36555fbebf53d4f63 not found: ID does not exist" containerID="ea5db9dfe765a4c92e9f7ddce4ca4945e6ad429f9eb250d36555fbebf53d4f63"
Sep 16 12:32:17.290233 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:17.290100    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea5db9dfe765a4c92e9f7ddce4ca4945e6ad429f9eb250d36555fbebf53d4f63"} err="failed to get container status \"ea5db9dfe765a4c92e9f7ddce4ca4945e6ad429f9eb250d36555fbebf53d4f63\": rpc error: code = NotFound desc = could not find container \"ea5db9dfe765a4c92e9f7ddce4ca4945e6ad429f9eb250d36555fbebf53d4f63\": container with ID starting with ea5db9dfe765a4c92e9f7ddce4ca4945e6ad429f9eb250d36555fbebf53d4f63 not found: ID does not exist"
Sep 16 12:32:17.293258 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:17.293235    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h"]
Sep 16 12:32:17.297032 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:17.297009    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-5c41db-openshift-default-6db6b75f76-r5s6h"]
Sep 16 12:32:17.353094 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:17.353028    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k4qjr\" (UniqueName: \"kubernetes.io/projected/bccc53b8-67ae-4dc6-8cde-76374d131e14-kube-api-access-k4qjr\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:32:17.353094 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:17.353051    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bccc53b8-67ae-4dc6-8cde-76374d131e14-istio-token\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:32:17.353094 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:17.353062    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bccc53b8-67ae-4dc6-8cde-76374d131e14-istiod-ca-cert\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:32:17.353094 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:17.353070    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bccc53b8-67ae-4dc6-8cde-76374d131e14-istio-podinfo\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:32:17.353094 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:17.353078    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bccc53b8-67ae-4dc6-8cde-76374d131e14-istio-envoy\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:32:17.938730 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:17.938697    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bccc53b8-67ae-4dc6-8cde-76374d131e14" path="/var/lib/kubelet/pods/bccc53b8-67ae-4dc6-8cde-76374d131e14/volumes"
Sep 16 12:32:20.401792 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:20.401761    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:32:21.657822 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:21.657789    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:32:22.526233 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:22.526198    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:32:23.111924 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:23.111881    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:32:23.211021 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:23.210993    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:32:23.310735 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:23.310690    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:32:23.376302 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:23.376199    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:32:23.707751 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:23.707700    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:32:23.777861 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:23.777823    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:32:24.530082 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:24.530048    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:32:25.432642 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:25.432600    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:32:26.105519 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:26.105484    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:32:26.818639 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:26.818605    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:32:26.888453 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:26.888417    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:32:29.579690 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:29.579656    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:32:29.680010 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:29.679972    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:32:29.864097 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:29.864018    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l"]
Sep 16 12:32:29.864314 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:29.864287    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l" podUID="b515a3be-a1c2-457b-a82e-2367f9ccbcbd" containerName="istio-proxy" containerID="cri-o://400f52252aa45d4b8168ab22f38c5e8ba9f93794eca42866899c76d4f95a0e13" gracePeriod=30
Sep 16 12:32:29.886875 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:29.886842    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:32:30.557961 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:30.557921    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:32:31.342866 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:31.342820    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:32:32.017737 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:32.017699    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:32:32.594319 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:32.594281    2559 patch_prober.go:28] interesting pod/e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 16 12:32:32.594708 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:32.594342    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l" podUID="b515a3be-a1c2-457b-a82e-2367f9ccbcbd" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 12:32:32.828223 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:32.828188    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:32:33.442110 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:33.442073    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:32:33.601435 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:33.601405    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:32:34.236376 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:34.236346    2559 scope.go:117] "RemoveContainer" containerID="5b71f77c8a867c74b971cf1e892f04b4f0bc8747625b8fe9a3b488a894de007b"
Sep 16 12:32:34.244905 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:34.244885    2559 scope.go:117] "RemoveContainer" containerID="fec151bc8e199d2b80ad1d70bf5caaed09daf513d9cb5ce4e33f6124741beaaa"
Sep 16 12:32:35.118187 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:35.118161    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l"
Sep 16 12:32:35.232796 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:35.232772    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b515a3be-a1c2-457b-a82e-2367f9ccbcbd-credential-socket\") pod \"b515a3be-a1c2-457b-a82e-2367f9ccbcbd\" (UID: \"b515a3be-a1c2-457b-a82e-2367f9ccbcbd\") "
Sep 16 12:32:35.232796 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:35.232799    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b515a3be-a1c2-457b-a82e-2367f9ccbcbd-workload-certs\") pod \"b515a3be-a1c2-457b-a82e-2367f9ccbcbd\" (UID: \"b515a3be-a1c2-457b-a82e-2367f9ccbcbd\") "
Sep 16 12:32:35.233022 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:35.232817    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b515a3be-a1c2-457b-a82e-2367f9ccbcbd-workload-socket\") pod \"b515a3be-a1c2-457b-a82e-2367f9ccbcbd\" (UID: \"b515a3be-a1c2-457b-a82e-2367f9ccbcbd\") "
Sep 16 12:32:35.233022 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:35.232853    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b515a3be-a1c2-457b-a82e-2367f9ccbcbd-istiod-ca-cert\") pod \"b515a3be-a1c2-457b-a82e-2367f9ccbcbd\" (UID: \"b515a3be-a1c2-457b-a82e-2367f9ccbcbd\") "
Sep 16 12:32:35.233022 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:35.232879    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b515a3be-a1c2-457b-a82e-2367f9ccbcbd-istio-podinfo\") pod \"b515a3be-a1c2-457b-a82e-2367f9ccbcbd\" (UID: \"b515a3be-a1c2-457b-a82e-2367f9ccbcbd\") "
Sep 16 12:32:35.233022 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:35.232905    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8ql8f\" (UniqueName: \"kubernetes.io/projected/b515a3be-a1c2-457b-a82e-2367f9ccbcbd-kube-api-access-8ql8f\") pod \"b515a3be-a1c2-457b-a82e-2367f9ccbcbd\" (UID: \"b515a3be-a1c2-457b-a82e-2367f9ccbcbd\") "
Sep 16 12:32:35.233022 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:35.232935    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b515a3be-a1c2-457b-a82e-2367f9ccbcbd-istio-envoy\") pod \"b515a3be-a1c2-457b-a82e-2367f9ccbcbd\" (UID: \"b515a3be-a1c2-457b-a82e-2367f9ccbcbd\") "
Sep 16 12:32:35.233022 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:35.233022    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b515a3be-a1c2-457b-a82e-2367f9ccbcbd-istio-token\") pod \"b515a3be-a1c2-457b-a82e-2367f9ccbcbd\" (UID: \"b515a3be-a1c2-457b-a82e-2367f9ccbcbd\") "
Sep 16 12:32:35.233387 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:35.233077    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b515a3be-a1c2-457b-a82e-2367f9ccbcbd-istio-data\") pod \"b515a3be-a1c2-457b-a82e-2367f9ccbcbd\" (UID: \"b515a3be-a1c2-457b-a82e-2367f9ccbcbd\") "
Sep 16 12:32:35.233387 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:35.233091    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b515a3be-a1c2-457b-a82e-2367f9ccbcbd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b515a3be-a1c2-457b-a82e-2367f9ccbcbd" (UID: "b515a3be-a1c2-457b-a82e-2367f9ccbcbd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:32:35.233387 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:35.233160    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b515a3be-a1c2-457b-a82e-2367f9ccbcbd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b515a3be-a1c2-457b-a82e-2367f9ccbcbd" (UID: "b515a3be-a1c2-457b-a82e-2367f9ccbcbd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:32:35.233387 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:35.233177    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b515a3be-a1c2-457b-a82e-2367f9ccbcbd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b515a3be-a1c2-457b-a82e-2367f9ccbcbd" (UID: "b515a3be-a1c2-457b-a82e-2367f9ccbcbd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:32:35.233594 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:35.233432    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b515a3be-a1c2-457b-a82e-2367f9ccbcbd-istio-data" (OuterVolumeSpecName: "istio-data") pod "b515a3be-a1c2-457b-a82e-2367f9ccbcbd" (UID: "b515a3be-a1c2-457b-a82e-2367f9ccbcbd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:32:35.233594 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:35.233458    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b515a3be-a1c2-457b-a82e-2367f9ccbcbd-credential-socket\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:32:35.233594 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:35.233475    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b515a3be-a1c2-457b-a82e-2367f9ccbcbd-workload-certs\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:32:35.233594 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:35.233484    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b515a3be-a1c2-457b-a82e-2367f9ccbcbd-workload-socket\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:32:35.233594 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:35.233538    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b515a3be-a1c2-457b-a82e-2367f9ccbcbd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b515a3be-a1c2-457b-a82e-2367f9ccbcbd" (UID: "b515a3be-a1c2-457b-a82e-2367f9ccbcbd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:32:35.235157 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:35.235120    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b515a3be-a1c2-457b-a82e-2367f9ccbcbd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b515a3be-a1c2-457b-a82e-2367f9ccbcbd" (UID: "b515a3be-a1c2-457b-a82e-2367f9ccbcbd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:32:35.235350 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:35.235330    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b515a3be-a1c2-457b-a82e-2367f9ccbcbd-istio-token" (OuterVolumeSpecName: "istio-token") pod "b515a3be-a1c2-457b-a82e-2367f9ccbcbd" (UID: "b515a3be-a1c2-457b-a82e-2367f9ccbcbd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:32:35.235567 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:35.235550    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b515a3be-a1c2-457b-a82e-2367f9ccbcbd-kube-api-access-8ql8f" (OuterVolumeSpecName: "kube-api-access-8ql8f") pod "b515a3be-a1c2-457b-a82e-2367f9ccbcbd" (UID: "b515a3be-a1c2-457b-a82e-2367f9ccbcbd"). InnerVolumeSpecName "kube-api-access-8ql8f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:32:35.235622 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:35.235556    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b515a3be-a1c2-457b-a82e-2367f9ccbcbd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b515a3be-a1c2-457b-a82e-2367f9ccbcbd" (UID: "b515a3be-a1c2-457b-a82e-2367f9ccbcbd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 12:32:35.334710 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:35.334678    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b515a3be-a1c2-457b-a82e-2367f9ccbcbd-istio-data\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:32:35.334710 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:35.334703    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b515a3be-a1c2-457b-a82e-2367f9ccbcbd-istiod-ca-cert\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:32:35.334710 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:35.334712    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b515a3be-a1c2-457b-a82e-2367f9ccbcbd-istio-podinfo\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:32:35.334929 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:35.334720    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8ql8f\" (UniqueName: \"kubernetes.io/projected/b515a3be-a1c2-457b-a82e-2367f9ccbcbd-kube-api-access-8ql8f\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:32:35.334929 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:35.334731    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b515a3be-a1c2-457b-a82e-2367f9ccbcbd-istio-envoy\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:32:35.334929 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:35.334740    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b515a3be-a1c2-457b-a82e-2367f9ccbcbd-istio-token\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:32:35.381619 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:35.381580    2559 generic.go:356] "Generic (PLEG): container finished" podID="b515a3be-a1c2-457b-a82e-2367f9ccbcbd" containerID="400f52252aa45d4b8168ab22f38c5e8ba9f93794eca42866899c76d4f95a0e13" exitCode=0
Sep 16 12:32:35.381786 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:35.381627    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l"
Sep 16 12:32:35.381786 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:35.381668    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l" event={"ID":"b515a3be-a1c2-457b-a82e-2367f9ccbcbd","Type":"ContainerDied","Data":"400f52252aa45d4b8168ab22f38c5e8ba9f93794eca42866899c76d4f95a0e13"}
Sep 16 12:32:35.381786 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:35.381725    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l" event={"ID":"b515a3be-a1c2-457b-a82e-2367f9ccbcbd","Type":"ContainerDied","Data":"0d4f6cde8f83844ed78a17eedce4b53e044e091d8b26b06b1dc444eb1c92f2dc"}
Sep 16 12:32:35.381786 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:35.381761    2559 scope.go:117] "RemoveContainer" containerID="400f52252aa45d4b8168ab22f38c5e8ba9f93794eca42866899c76d4f95a0e13"
Sep 16 12:32:35.390836 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:35.390821    2559 scope.go:117] "RemoveContainer" containerID="acf50a9867230ffc53c9abff4db5247edc9f5c6782c9f25d7bec5558ede9856a"
Sep 16 12:32:35.398619 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:35.398603    2559 scope.go:117] "RemoveContainer" containerID="400f52252aa45d4b8168ab22f38c5e8ba9f93794eca42866899c76d4f95a0e13"
Sep 16 12:32:35.398889 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:32:35.398870    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"400f52252aa45d4b8168ab22f38c5e8ba9f93794eca42866899c76d4f95a0e13\": container with ID starting with 400f52252aa45d4b8168ab22f38c5e8ba9f93794eca42866899c76d4f95a0e13 not found: ID does not exist" containerID="400f52252aa45d4b8168ab22f38c5e8ba9f93794eca42866899c76d4f95a0e13"
Sep 16 12:32:35.398935 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:35.398897    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"400f52252aa45d4b8168ab22f38c5e8ba9f93794eca42866899c76d4f95a0e13"} err="failed to get container status \"400f52252aa45d4b8168ab22f38c5e8ba9f93794eca42866899c76d4f95a0e13\": rpc error: code = NotFound desc = could not find container \"400f52252aa45d4b8168ab22f38c5e8ba9f93794eca42866899c76d4f95a0e13\": container with ID starting with 400f52252aa45d4b8168ab22f38c5e8ba9f93794eca42866899c76d4f95a0e13 not found: ID does not exist"
Sep 16 12:32:35.398935 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:35.398913    2559 scope.go:117] "RemoveContainer" containerID="acf50a9867230ffc53c9abff4db5247edc9f5c6782c9f25d7bec5558ede9856a"
Sep 16 12:32:35.399172 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:32:35.399152    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"acf50a9867230ffc53c9abff4db5247edc9f5c6782c9f25d7bec5558ede9856a\": container with ID starting with acf50a9867230ffc53c9abff4db5247edc9f5c6782c9f25d7bec5558ede9856a not found: ID does not exist" containerID="acf50a9867230ffc53c9abff4db5247edc9f5c6782c9f25d7bec5558ede9856a"
Sep 16 12:32:35.399236 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:35.399182    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acf50a9867230ffc53c9abff4db5247edc9f5c6782c9f25d7bec5558ede9856a"} err="failed to get container status \"acf50a9867230ffc53c9abff4db5247edc9f5c6782c9f25d7bec5558ede9856a\": rpc error: code = NotFound desc = could not find container \"acf50a9867230ffc53c9abff4db5247edc9f5c6782c9f25d7bec5558ede9856a\": container with ID starting with acf50a9867230ffc53c9abff4db5247edc9f5c6782c9f25d7bec5558ede9856a not found: ID does not exist"
Sep 16 12:32:35.403912 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:35.403892    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l"]
Sep 16 12:32:35.407363 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:35.407341    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-65d8af-openshift-default-5cfc6c9d5d-9gd5l"]
Sep 16 12:32:35.938609 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:35.938569    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b515a3be-a1c2-457b-a82e-2367f9ccbcbd" path="/var/lib/kubelet/pods/b515a3be-a1c2-457b-a82e-2367f9ccbcbd/volumes"
Sep 16 12:32:40.790049 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:40.790013    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:32:40.811261 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:40.811225    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-f9133e-b5cf86585-gvs7f"]
Sep 16 12:32:40.812053 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:40.811999    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f9133e-b5cf86585-gvs7f" podUID="83176f10-ef21-4402-be73-5bde2906651c" containerName="payload-processing" containerID="cri-o://a925424b63424bdc4d75583937da8fce76925ec2b7db384afbe849da2dccb0bd" gracePeriod=30
Sep 16 12:32:40.893384 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:40.893331    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:32:40.993517 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:40.993472    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:32:41.080302 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:41.080268    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f9133e-b5cf86585-gvs7f"
Sep 16 12:32:41.091367 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:41.091296    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:32:41.191456 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:41.191420    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c4tld\" (UniqueName: \"kubernetes.io/projected/83176f10-ef21-4402-be73-5bde2906651c-kube-api-access-c4tld\") pod \"83176f10-ef21-4402-be73-5bde2906651c\" (UID: \"83176f10-ef21-4402-be73-5bde2906651c\") "
Sep 16 12:32:41.191456 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:41.191459    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/83176f10-ef21-4402-be73-5bde2906651c-plugins-config-volume\") pod \"83176f10-ef21-4402-be73-5bde2906651c\" (UID: \"83176f10-ef21-4402-be73-5bde2906651c\") "
Sep 16 12:32:41.191849 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:41.191825    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83176f10-ef21-4402-be73-5bde2906651c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "83176f10-ef21-4402-be73-5bde2906651c" (UID: "83176f10-ef21-4402-be73-5bde2906651c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:32:41.193558 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:41.193531    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83176f10-ef21-4402-be73-5bde2906651c-kube-api-access-c4tld" (OuterVolumeSpecName: "kube-api-access-c4tld") pod "83176f10-ef21-4402-be73-5bde2906651c" (UID: "83176f10-ef21-4402-be73-5bde2906651c"). InnerVolumeSpecName "kube-api-access-c4tld". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:32:41.292905 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:41.292856    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c4tld\" (UniqueName: \"kubernetes.io/projected/83176f10-ef21-4402-be73-5bde2906651c-kube-api-access-c4tld\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:32:41.292905 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:41.292888    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/83176f10-ef21-4402-be73-5bde2906651c-plugins-config-volume\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:32:41.381274 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:41.381195    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:32:41.414840 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:41.414810    2559 generic.go:356] "Generic (PLEG): container finished" podID="83176f10-ef21-4402-be73-5bde2906651c" containerID="a925424b63424bdc4d75583937da8fce76925ec2b7db384afbe849da2dccb0bd" exitCode=0
Sep 16 12:32:41.414975 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:41.414859    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f9133e-b5cf86585-gvs7f"
Sep 16 12:32:41.414975 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:41.414891    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f9133e-b5cf86585-gvs7f" event={"ID":"83176f10-ef21-4402-be73-5bde2906651c","Type":"ContainerDied","Data":"a925424b63424bdc4d75583937da8fce76925ec2b7db384afbe849da2dccb0bd"}
Sep 16 12:32:41.414975 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:41.414950    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f9133e-b5cf86585-gvs7f" event={"ID":"83176f10-ef21-4402-be73-5bde2906651c","Type":"ContainerDied","Data":"d6d99cc01574e518d38dd6d27c049af760909152444d352320ff578bfc6cb64e"}
Sep 16 12:32:41.414975 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:41.414975    2559 scope.go:117] "RemoveContainer" containerID="a925424b63424bdc4d75583937da8fce76925ec2b7db384afbe849da2dccb0bd"
Sep 16 12:32:41.424303 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:41.424282    2559 scope.go:117] "RemoveContainer" containerID="a925424b63424bdc4d75583937da8fce76925ec2b7db384afbe849da2dccb0bd"
Sep 16 12:32:41.424590 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:32:41.424567    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a925424b63424bdc4d75583937da8fce76925ec2b7db384afbe849da2dccb0bd\": container with ID starting with a925424b63424bdc4d75583937da8fce76925ec2b7db384afbe849da2dccb0bd not found: ID does not exist" containerID="a925424b63424bdc4d75583937da8fce76925ec2b7db384afbe849da2dccb0bd"
Sep 16 12:32:41.424656 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:41.424598    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a925424b63424bdc4d75583937da8fce76925ec2b7db384afbe849da2dccb0bd"} err="failed to get container status \"a925424b63424bdc4d75583937da8fce76925ec2b7db384afbe849da2dccb0bd\": rpc error: code = NotFound desc = could not find container \"a925424b63424bdc4d75583937da8fce76925ec2b7db384afbe849da2dccb0bd\": container with ID starting with a925424b63424bdc4d75583937da8fce76925ec2b7db384afbe849da2dccb0bd not found: ID does not exist"
Sep 16 12:32:41.437121 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:41.437100    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-f9133e-b5cf86585-gvs7f"]
Sep 16 12:32:41.440756 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:41.440732    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-f9133e-b5cf86585-gvs7f"]
Sep 16 12:32:41.499601 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:41.499567    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:32:41.943609 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:41.943568    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83176f10-ef21-4402-be73-5bde2906651c" path="/var/lib/kubelet/pods/83176f10-ef21-4402-be73-5bde2906651c/volumes"
Sep 16 12:32:42.261235 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:42.261143    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:32:43.002947 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:43.002908    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:32:44.931537 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:44.931506    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:32:45.698616 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:45.698579    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:32:47.193251 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:47.193220    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:32:47.263319 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:47.263274    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:32:47.534694 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:47.534611    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z"]
Sep 16 12:32:47.534838 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:47.534810    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z" podUID="e68e78d0-9fb4-477d-8e25-0ef8838b01ee" containerName="istio-proxy" containerID="cri-o://7f635ef8d379f5f8a1360f979563ec561dc1cb2eb5bae9711ae4eaeb06c27a48" gracePeriod=30
Sep 16 12:32:47.585474 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:47.585434    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:32:52.801625 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:52.801568    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z"
Sep 16 12:32:52.910731 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:52.910698    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e68e78d0-9fb4-477d-8e25-0ef8838b01ee-istio-envoy\") pod \"e68e78d0-9fb4-477d-8e25-0ef8838b01ee\" (UID: \"e68e78d0-9fb4-477d-8e25-0ef8838b01ee\") "
Sep 16 12:32:52.910731 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:52.910740    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e68e78d0-9fb4-477d-8e25-0ef8838b01ee-workload-certs\") pod \"e68e78d0-9fb4-477d-8e25-0ef8838b01ee\" (UID: \"e68e78d0-9fb4-477d-8e25-0ef8838b01ee\") "
Sep 16 12:32:52.910971 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:52.910761    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e68e78d0-9fb4-477d-8e25-0ef8838b01ee-credential-socket\") pod \"e68e78d0-9fb4-477d-8e25-0ef8838b01ee\" (UID: \"e68e78d0-9fb4-477d-8e25-0ef8838b01ee\") "
Sep 16 12:32:52.910971 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:52.910804    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e68e78d0-9fb4-477d-8e25-0ef8838b01ee-workload-socket\") pod \"e68e78d0-9fb4-477d-8e25-0ef8838b01ee\" (UID: \"e68e78d0-9fb4-477d-8e25-0ef8838b01ee\") "
Sep 16 12:32:52.910971 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:52.910850    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e68e78d0-9fb4-477d-8e25-0ef8838b01ee-istio-data\") pod \"e68e78d0-9fb4-477d-8e25-0ef8838b01ee\" (UID: \"e68e78d0-9fb4-477d-8e25-0ef8838b01ee\") "
Sep 16 12:32:52.910971 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:52.910877    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qpgnl\" (UniqueName: \"kubernetes.io/projected/e68e78d0-9fb4-477d-8e25-0ef8838b01ee-kube-api-access-qpgnl\") pod \"e68e78d0-9fb4-477d-8e25-0ef8838b01ee\" (UID: \"e68e78d0-9fb4-477d-8e25-0ef8838b01ee\") "
Sep 16 12:32:52.910971 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:52.910914    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e68e78d0-9fb4-477d-8e25-0ef8838b01ee-istio-token\") pod \"e68e78d0-9fb4-477d-8e25-0ef8838b01ee\" (UID: \"e68e78d0-9fb4-477d-8e25-0ef8838b01ee\") "
Sep 16 12:32:52.910971 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:52.910955    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e68e78d0-9fb4-477d-8e25-0ef8838b01ee-istio-podinfo\") pod \"e68e78d0-9fb4-477d-8e25-0ef8838b01ee\" (UID: \"e68e78d0-9fb4-477d-8e25-0ef8838b01ee\") "
Sep 16 12:32:52.911405 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:52.910999    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e68e78d0-9fb4-477d-8e25-0ef8838b01ee-istiod-ca-cert\") pod \"e68e78d0-9fb4-477d-8e25-0ef8838b01ee\" (UID: \"e68e78d0-9fb4-477d-8e25-0ef8838b01ee\") "
Sep 16 12:32:52.911405 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:52.911085    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e68e78d0-9fb4-477d-8e25-0ef8838b01ee-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e68e78d0-9fb4-477d-8e25-0ef8838b01ee" (UID: "e68e78d0-9fb4-477d-8e25-0ef8838b01ee"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:32:52.911405 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:52.911117    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e68e78d0-9fb4-477d-8e25-0ef8838b01ee-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e68e78d0-9fb4-477d-8e25-0ef8838b01ee" (UID: "e68e78d0-9fb4-477d-8e25-0ef8838b01ee"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:32:52.911405 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:52.911263    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e68e78d0-9fb4-477d-8e25-0ef8838b01ee-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e68e78d0-9fb4-477d-8e25-0ef8838b01ee" (UID: "e68e78d0-9fb4-477d-8e25-0ef8838b01ee"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:32:52.911608 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:52.911420    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e68e78d0-9fb4-477d-8e25-0ef8838b01ee-workload-socket\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:32:52.911608 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:52.911443    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e68e78d0-9fb4-477d-8e25-0ef8838b01ee-workload-certs\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:32:52.911608 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:52.911450    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e68e78d0-9fb4-477d-8e25-0ef8838b01ee-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e68e78d0-9fb4-477d-8e25-0ef8838b01ee" (UID: "e68e78d0-9fb4-477d-8e25-0ef8838b01ee"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:32:52.911608 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:52.911458    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e68e78d0-9fb4-477d-8e25-0ef8838b01ee-credential-socket\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:32:52.911608 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:52.911506    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e68e78d0-9fb4-477d-8e25-0ef8838b01ee-istio-data" (OuterVolumeSpecName: "istio-data") pod "e68e78d0-9fb4-477d-8e25-0ef8838b01ee" (UID: "e68e78d0-9fb4-477d-8e25-0ef8838b01ee"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:32:52.913004 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:52.912983    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e68e78d0-9fb4-477d-8e25-0ef8838b01ee-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e68e78d0-9fb4-477d-8e25-0ef8838b01ee" (UID: "e68e78d0-9fb4-477d-8e25-0ef8838b01ee"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:32:52.913223 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:52.913202    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e68e78d0-9fb4-477d-8e25-0ef8838b01ee-kube-api-access-qpgnl" (OuterVolumeSpecName: "kube-api-access-qpgnl") pod "e68e78d0-9fb4-477d-8e25-0ef8838b01ee" (UID: "e68e78d0-9fb4-477d-8e25-0ef8838b01ee"). InnerVolumeSpecName "kube-api-access-qpgnl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:32:52.913559 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:52.913535    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e68e78d0-9fb4-477d-8e25-0ef8838b01ee-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e68e78d0-9fb4-477d-8e25-0ef8838b01ee" (UID: "e68e78d0-9fb4-477d-8e25-0ef8838b01ee"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 12:32:52.913658 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:52.913557    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e68e78d0-9fb4-477d-8e25-0ef8838b01ee-istio-token" (OuterVolumeSpecName: "istio-token") pod "e68e78d0-9fb4-477d-8e25-0ef8838b01ee" (UID: "e68e78d0-9fb4-477d-8e25-0ef8838b01ee"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:32:53.012213 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:53.012171    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e68e78d0-9fb4-477d-8e25-0ef8838b01ee-istio-envoy\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:32:53.012213 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:53.012209    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e68e78d0-9fb4-477d-8e25-0ef8838b01ee-istio-data\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:32:53.012443 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:53.012225    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qpgnl\" (UniqueName: \"kubernetes.io/projected/e68e78d0-9fb4-477d-8e25-0ef8838b01ee-kube-api-access-qpgnl\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:32:53.012443 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:53.012240    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e68e78d0-9fb4-477d-8e25-0ef8838b01ee-istio-token\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:32:53.012443 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:53.012253    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e68e78d0-9fb4-477d-8e25-0ef8838b01ee-istio-podinfo\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:32:53.012443 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:53.012265    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e68e78d0-9fb4-477d-8e25-0ef8838b01ee-istiod-ca-cert\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:32:53.480192 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:53.480157    2559 generic.go:356] "Generic (PLEG): container finished" podID="e68e78d0-9fb4-477d-8e25-0ef8838b01ee" containerID="7f635ef8d379f5f8a1360f979563ec561dc1cb2eb5bae9711ae4eaeb06c27a48" exitCode=0
Sep 16 12:32:53.480353 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:53.480218    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z"
Sep 16 12:32:53.480353 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:53.480240    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z" event={"ID":"e68e78d0-9fb4-477d-8e25-0ef8838b01ee","Type":"ContainerDied","Data":"7f635ef8d379f5f8a1360f979563ec561dc1cb2eb5bae9711ae4eaeb06c27a48"}
Sep 16 12:32:53.480353 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:53.480317    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z" event={"ID":"e68e78d0-9fb4-477d-8e25-0ef8838b01ee","Type":"ContainerDied","Data":"70ac6cf0dc96c355ac5a85b8843f079cc335d1db0995c6cbe77026ab485ca47a"}
Sep 16 12:32:53.480353 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:53.480341    2559 scope.go:117] "RemoveContainer" containerID="7f635ef8d379f5f8a1360f979563ec561dc1cb2eb5bae9711ae4eaeb06c27a48"
Sep 16 12:32:53.489993 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:53.489977    2559 scope.go:117] "RemoveContainer" containerID="518934de02e1ad7347292b83427b639ecaa4e97e5e3e6100b72d21e825360ed6"
Sep 16 12:32:53.497840 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:53.497822    2559 scope.go:117] "RemoveContainer" containerID="7f635ef8d379f5f8a1360f979563ec561dc1cb2eb5bae9711ae4eaeb06c27a48"
Sep 16 12:32:53.498092 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:32:53.498073    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f635ef8d379f5f8a1360f979563ec561dc1cb2eb5bae9711ae4eaeb06c27a48\": container with ID starting with 7f635ef8d379f5f8a1360f979563ec561dc1cb2eb5bae9711ae4eaeb06c27a48 not found: ID does not exist" containerID="7f635ef8d379f5f8a1360f979563ec561dc1cb2eb5bae9711ae4eaeb06c27a48"
Sep 16 12:32:53.498178 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:53.498100    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f635ef8d379f5f8a1360f979563ec561dc1cb2eb5bae9711ae4eaeb06c27a48"} err="failed to get container status \"7f635ef8d379f5f8a1360f979563ec561dc1cb2eb5bae9711ae4eaeb06c27a48\": rpc error: code = NotFound desc = could not find container \"7f635ef8d379f5f8a1360f979563ec561dc1cb2eb5bae9711ae4eaeb06c27a48\": container with ID starting with 7f635ef8d379f5f8a1360f979563ec561dc1cb2eb5bae9711ae4eaeb06c27a48 not found: ID does not exist"
Sep 16 12:32:53.498178 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:53.498117    2559 scope.go:117] "RemoveContainer" containerID="518934de02e1ad7347292b83427b639ecaa4e97e5e3e6100b72d21e825360ed6"
Sep 16 12:32:53.498379 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:32:53.498365    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"518934de02e1ad7347292b83427b639ecaa4e97e5e3e6100b72d21e825360ed6\": container with ID starting with 518934de02e1ad7347292b83427b639ecaa4e97e5e3e6100b72d21e825360ed6 not found: ID does not exist" containerID="518934de02e1ad7347292b83427b639ecaa4e97e5e3e6100b72d21e825360ed6"
Sep 16 12:32:53.498419 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:53.498381    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"518934de02e1ad7347292b83427b639ecaa4e97e5e3e6100b72d21e825360ed6"} err="failed to get container status \"518934de02e1ad7347292b83427b639ecaa4e97e5e3e6100b72d21e825360ed6\": rpc error: code = NotFound desc = could not find container \"518934de02e1ad7347292b83427b639ecaa4e97e5e3e6100b72d21e825360ed6\": container with ID starting with 518934de02e1ad7347292b83427b639ecaa4e97e5e3e6100b72d21e825360ed6 not found: ID does not exist"
Sep 16 12:32:53.504667 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:53.504647    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z"]
Sep 16 12:32:53.511089 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:53.511068    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-f9133e-openshift-default-68949f88f8-tb95z"]
Sep 16 12:32:53.938017 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:53.937984    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e68e78d0-9fb4-477d-8e25-0ef8838b01ee" path="/var/lib/kubelet/pods/e68e78d0-9fb4-477d-8e25-0ef8838b01ee/volumes"
Sep 16 12:32:56.111252 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:32:56.111222    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:33:10.115280 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:10.115247    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:33:14.306005 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:14.305958    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:33:35.630287 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:35.630256    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:33:46.257486 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:46.257448    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7567-d2d572"]
Sep 16 12:33:46.258070 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:46.258025    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83176f10-ef21-4402-be73-5bde2906651c" containerName="payload-processing"
Sep 16 12:33:46.258070 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:46.258047    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="83176f10-ef21-4402-be73-5bde2906651c" containerName="payload-processing"
Sep 16 12:33:46.258070 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:46.258061    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e68e78d0-9fb4-477d-8e25-0ef8838b01ee" containerName="istio-proxy"
Sep 16 12:33:46.258070 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:46.258069    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e68e78d0-9fb4-477d-8e25-0ef8838b01ee" containerName="istio-proxy"
Sep 16 12:33:46.258327 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:46.258088    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bccc53b8-67ae-4dc6-8cde-76374d131e14" containerName="istio-proxy"
Sep 16 12:33:46.258327 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:46.258096    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="bccc53b8-67ae-4dc6-8cde-76374d131e14" containerName="istio-proxy"
Sep 16 12:33:46.258327 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:46.258105    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b515a3be-a1c2-457b-a82e-2367f9ccbcbd" containerName="istio-proxy"
Sep 16 12:33:46.258327 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:46.258115    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b515a3be-a1c2-457b-a82e-2367f9ccbcbd" containerName="istio-proxy"
Sep 16 12:33:46.258327 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:46.258124    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5de3fdb9-bed0-4c08-b68e-a68b2496a269" containerName="revoke-keys"
Sep 16 12:33:46.258327 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:46.258149    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5de3fdb9-bed0-4c08-b68e-a68b2496a269" containerName="revoke-keys"
Sep 16 12:33:46.258327 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:46.258174    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0396f9d0-6466-4e68-997e-f9df4f5ede4b" containerName="istio-proxy"
Sep 16 12:33:46.258327 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:46.258182    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0396f9d0-6466-4e68-997e-f9df4f5ede4b" containerName="istio-proxy"
Sep 16 12:33:46.258327 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:46.258190    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bccc53b8-67ae-4dc6-8cde-76374d131e14" containerName="istio-proxy"
Sep 16 12:33:46.258327 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:46.258198    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="bccc53b8-67ae-4dc6-8cde-76374d131e14" containerName="istio-proxy"
Sep 16 12:33:46.258327 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:46.258217    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0396f9d0-6466-4e68-997e-f9df4f5ede4b" containerName="istio-proxy"
Sep 16 12:33:46.258327 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:46.258225    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0396f9d0-6466-4e68-997e-f9df4f5ede4b" containerName="istio-proxy"
Sep 16 12:33:46.258885 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:46.258335    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b515a3be-a1c2-457b-a82e-2367f9ccbcbd" containerName="istio-proxy"
Sep 16 12:33:46.258885 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:46.258348    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e68e78d0-9fb4-477d-8e25-0ef8838b01ee" containerName="istio-proxy"
Sep 16 12:33:46.258885 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:46.258357    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="bccc53b8-67ae-4dc6-8cde-76374d131e14" containerName="istio-proxy"
Sep 16 12:33:46.258885 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:46.258366    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="bccc53b8-67ae-4dc6-8cde-76374d131e14" containerName="istio-proxy"
Sep 16 12:33:46.258885 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:46.258376    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b515a3be-a1c2-457b-a82e-2367f9ccbcbd" containerName="istio-proxy"
Sep 16 12:33:46.258885 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:46.258387    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e68e78d0-9fb4-477d-8e25-0ef8838b01ee" containerName="istio-proxy"
Sep 16 12:33:46.258885 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:46.258394    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="0396f9d0-6466-4e68-997e-f9df4f5ede4b" containerName="istio-proxy"
Sep 16 12:33:46.258885 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:46.258403    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="83176f10-ef21-4402-be73-5bde2906651c" containerName="payload-processing"
Sep 16 12:33:46.258885 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:46.258412    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="0396f9d0-6466-4e68-997e-f9df4f5ede4b" containerName="istio-proxy"
Sep 16 12:33:46.258885 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:46.258420    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5de3fdb9-bed0-4c08-b68e-a68b2496a269" containerName="revoke-keys"
Sep 16 12:33:46.261771 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:46.261751    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7567-d2d572"
Sep 16 12:33:46.264305 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:46.264286    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-h8vfr\""
Sep 16 12:33:46.271091 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:46.271070    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7567-d2d572"]
Sep 16 12:33:46.419598 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:46.419560    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52wb4\" (UniqueName: \"kubernetes.io/projected/49bf3bf0-838b-4288-88ba-5271d69bcf76-kube-api-access-52wb4\") pod \"test-curl-7567-d2d572\" (UID: \"49bf3bf0-838b-4288-88ba-5271d69bcf76\") " pod="opendatahub/test-curl-7567-d2d572"
Sep 16 12:33:46.520522 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:46.520435    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52wb4\" (UniqueName: \"kubernetes.io/projected/49bf3bf0-838b-4288-88ba-5271d69bcf76-kube-api-access-52wb4\") pod \"test-curl-7567-d2d572\" (UID: \"49bf3bf0-838b-4288-88ba-5271d69bcf76\") " pod="opendatahub/test-curl-7567-d2d572"
Sep 16 12:33:46.530087 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:46.530060    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-52wb4\" (UniqueName: \"kubernetes.io/projected/49bf3bf0-838b-4288-88ba-5271d69bcf76-kube-api-access-52wb4\") pod \"test-curl-7567-d2d572\" (UID: \"49bf3bf0-838b-4288-88ba-5271d69bcf76\") " pod="opendatahub/test-curl-7567-d2d572"
Sep 16 12:33:46.581087 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:46.581056    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7567-d2d572"
Sep 16 12:33:46.853157 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:46.853114    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7567-d2d572"]
Sep 16 12:33:46.855237 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:33:46.855214    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod49bf3bf0_838b_4288_88ba_5271d69bcf76.slice/crio-b1445239d82d860d60549c1520b196fedb27998f174f259c358719d11edba4b1 WatchSource:0}: Error finding container b1445239d82d860d60549c1520b196fedb27998f174f259c358719d11edba4b1: Status 404 returned error can't find the container with id b1445239d82d860d60549c1520b196fedb27998f174f259c358719d11edba4b1
Sep 16 12:33:46.857222 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:46.857206    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 12:33:47.763202 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:47.763163    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7567-d2d572" event={"ID":"49bf3bf0-838b-4288-88ba-5271d69bcf76","Type":"ContainerStarted","Data":"b1445239d82d860d60549c1520b196fedb27998f174f259c358719d11edba4b1"}
Sep 16 12:33:49.775564 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:49.775528    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7567-d2d572" event={"ID":"49bf3bf0-838b-4288-88ba-5271d69bcf76","Type":"ContainerStarted","Data":"398685fe45be55a022f58d1cd404b015271c3641bb67d5a83dcfa1b6a589e395"}
Sep 16 12:33:49.799503 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:49.799458    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7567-d2d572" podStartSLOduration=1.5228084549999998 podStartE2EDuration="3.799441125s" totalImagesPullingTime="2.27663267s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:33:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:33:49.797412694 +0000 UTC m=+1996.417732009" watchObservedRunningTime="2026-09-16 12:33:49.799441125 +0000 UTC m=+1996.419760441"
Sep 16 12:33:50.045161 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:50.045075    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:33:50.560300 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:50.560211    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7567-d2d572"]
Sep 16 12:33:50.565819 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:50.565792    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7567-d2d572"]
Sep 16 12:33:50.690155 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:50.690101    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7567-75fcf6"]
Sep 16 12:33:50.690548 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:50.690533    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e68e78d0-9fb4-477d-8e25-0ef8838b01ee" containerName="istio-proxy"
Sep 16 12:33:50.690589 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:50.690550    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e68e78d0-9fb4-477d-8e25-0ef8838b01ee" containerName="istio-proxy"
Sep 16 12:33:50.690589 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:50.690564    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b515a3be-a1c2-457b-a82e-2367f9ccbcbd" containerName="istio-proxy"
Sep 16 12:33:50.690589 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:50.690571    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b515a3be-a1c2-457b-a82e-2367f9ccbcbd" containerName="istio-proxy"
Sep 16 12:33:50.690701 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:50.690588    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49bf3bf0-838b-4288-88ba-5271d69bcf76" containerName="test-curl-7567-d2d572"
Sep 16 12:33:50.690701 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:50.690595    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="49bf3bf0-838b-4288-88ba-5271d69bcf76" containerName="test-curl-7567-d2d572"
Sep 16 12:33:50.690701 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:50.690651    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="49bf3bf0-838b-4288-88ba-5271d69bcf76" containerName="test-curl-7567-d2d572"
Sep 16 12:33:50.694010 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:50.693995    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7567-75fcf6"
Sep 16 12:33:50.702586 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:50.702563    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7567-75fcf6"]
Sep 16 12:33:50.780906 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:33:50.780875    2559 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7567-d2d572" container="test-curl-7567-d2d572"
Sep 16 12:33:50.864787 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:50.864684    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkrlw\" (UniqueName: \"kubernetes.io/projected/d08b534d-cbfe-40b4-a6f6-1e861d911a64-kube-api-access-qkrlw\") pod \"test-curl-7567-75fcf6\" (UID: \"d08b534d-cbfe-40b4-a6f6-1e861d911a64\") " pod="opendatahub/test-curl-7567-75fcf6"
Sep 16 12:33:50.965514 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:50.965478    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkrlw\" (UniqueName: \"kubernetes.io/projected/d08b534d-cbfe-40b4-a6f6-1e861d911a64-kube-api-access-qkrlw\") pod \"test-curl-7567-75fcf6\" (UID: \"d08b534d-cbfe-40b4-a6f6-1e861d911a64\") " pod="opendatahub/test-curl-7567-75fcf6"
Sep 16 12:33:50.974664 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:50.974639    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkrlw\" (UniqueName: \"kubernetes.io/projected/d08b534d-cbfe-40b4-a6f6-1e861d911a64-kube-api-access-qkrlw\") pod \"test-curl-7567-75fcf6\" (UID: \"d08b534d-cbfe-40b4-a6f6-1e861d911a64\") " pod="opendatahub/test-curl-7567-75fcf6"
Sep 16 12:33:51.004421 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:51.004396    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7567-75fcf6"
Sep 16 12:33:51.274711 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:51.274685    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7567-75fcf6"]
Sep 16 12:33:51.787575 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:51.787524    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7567-75fcf6" event={"ID":"d08b534d-cbfe-40b4-a6f6-1e861d911a64","Type":"ContainerStarted","Data":"1231f40d9fbaf904bed2d52c24d426b14835b67fcd59d3f350368cecff467cff"}
Sep 16 12:33:51.787575 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:51.787579    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7567-75fcf6" event={"ID":"d08b534d-cbfe-40b4-a6f6-1e861d911a64","Type":"ContainerStarted","Data":"d8985f6c0fa96c690adc2067ebd55638fb550654225849cda72b2f2119639602"}
Sep 16 12:33:51.788107 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:51.787610    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7567-d2d572" podUID="49bf3bf0-838b-4288-88ba-5271d69bcf76" containerName="test-curl-7567-d2d572" containerID="cri-o://398685fe45be55a022f58d1cd404b015271c3641bb67d5a83dcfa1b6a589e395" gracePeriod=2
Sep 16 12:33:51.790867 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:33:51.790842    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7567-d2d572\" is forbidden: User \"system:node:ip-10-0-138-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-251.ec2.internal' and this object" podUID="49bf3bf0-838b-4288-88ba-5271d69bcf76" pod="opendatahub/test-curl-7567-d2d572"
Sep 16 12:33:51.807562 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:51.807514    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7567-75fcf6" podStartSLOduration=1.807498663 podStartE2EDuration="1.807498663s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:33:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:33:51.805922841 +0000 UTC m=+1998.426242157" watchObservedRunningTime="2026-09-16 12:33:51.807498663 +0000 UTC m=+1998.427817980"
Sep 16 12:33:51.809935 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:33:51.809911    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7567-d2d572\" is forbidden: User \"system:node:ip-10-0-138-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-251.ec2.internal' and this object" podUID="49bf3bf0-838b-4288-88ba-5271d69bcf76" pod="opendatahub/test-curl-7567-d2d572"
Sep 16 12:33:52.446728 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:52.446691    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7567-75fcf6"]
Sep 16 12:33:52.449576 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:52.449550    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7567-75fcf6"]
Sep 16 12:33:52.793171 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:33:52.793123    2559 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7567-75fcf6" container="test-curl-7567-75fcf6"
Sep 16 12:33:53.798917 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:53.798856    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7567-75fcf6" podUID="d08b534d-cbfe-40b4-a6f6-1e861d911a64" containerName="test-curl-7567-75fcf6" containerID="cri-o://1231f40d9fbaf904bed2d52c24d426b14835b67fcd59d3f350368cecff467cff" gracePeriod=2
Sep 16 12:33:53.801575 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:33:53.801548    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7567-75fcf6\" is forbidden: User \"system:node:ip-10-0-138-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-251.ec2.internal' and this object" podUID="d08b534d-cbfe-40b4-a6f6-1e861d911a64" pod="opendatahub/test-curl-7567-75fcf6"
Sep 16 12:33:53.939289 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:33:53.939246    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7567-75fcf6\" is forbidden: User \"system:node:ip-10-0-138-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-251.ec2.internal' and this object" podUID="d08b534d-cbfe-40b4-a6f6-1e861d911a64" pod="opendatahub/test-curl-7567-75fcf6"
Sep 16 12:33:53.970652 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:53.970629    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7567-d2d572"
Sep 16 12:33:53.974812 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:33:53.974784    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7567-d2d572\" is forbidden: User \"system:node:ip-10-0-138-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-251.ec2.internal' and this object" podUID="49bf3bf0-838b-4288-88ba-5271d69bcf76" pod="opendatahub/test-curl-7567-d2d572"
Sep 16 12:33:54.096823 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:54.096733    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-52wb4\" (UniqueName: \"kubernetes.io/projected/49bf3bf0-838b-4288-88ba-5271d69bcf76-kube-api-access-52wb4\") pod \"49bf3bf0-838b-4288-88ba-5271d69bcf76\" (UID: \"49bf3bf0-838b-4288-88ba-5271d69bcf76\") "
Sep 16 12:33:54.098918 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:54.098883    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49bf3bf0-838b-4288-88ba-5271d69bcf76-kube-api-access-52wb4" (OuterVolumeSpecName: "kube-api-access-52wb4") pod "49bf3bf0-838b-4288-88ba-5271d69bcf76" (UID: "49bf3bf0-838b-4288-88ba-5271d69bcf76"). InnerVolumeSpecName "kube-api-access-52wb4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:33:54.197723 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:54.197692    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-52wb4\" (UniqueName: \"kubernetes.io/projected/49bf3bf0-838b-4288-88ba-5271d69bcf76-kube-api-access-52wb4\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:33:54.640116 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:54.640084    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:33:54.805434 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:54.805404    2559 generic.go:356] "Generic (PLEG): container finished" podID="49bf3bf0-838b-4288-88ba-5271d69bcf76" containerID="398685fe45be55a022f58d1cd404b015271c3641bb67d5a83dcfa1b6a589e395" exitCode=137
Sep 16 12:33:54.805876 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:54.805446    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7567-d2d572"
Sep 16 12:33:54.805876 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:54.805471    2559 scope.go:117] "RemoveContainer" containerID="398685fe45be55a022f58d1cd404b015271c3641bb67d5a83dcfa1b6a589e395"
Sep 16 12:33:54.808277 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:33:54.808249    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7567-d2d572\" is forbidden: User \"system:node:ip-10-0-138-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-251.ec2.internal' and this object" podUID="49bf3bf0-838b-4288-88ba-5271d69bcf76" pod="opendatahub/test-curl-7567-d2d572"
Sep 16 12:33:54.814519 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:54.814502    2559 scope.go:117] "RemoveContainer" containerID="398685fe45be55a022f58d1cd404b015271c3641bb67d5a83dcfa1b6a589e395"
Sep 16 12:33:54.814805 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:33:54.814781    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"398685fe45be55a022f58d1cd404b015271c3641bb67d5a83dcfa1b6a589e395\": container with ID starting with 398685fe45be55a022f58d1cd404b015271c3641bb67d5a83dcfa1b6a589e395 not found: ID does not exist" containerID="398685fe45be55a022f58d1cd404b015271c3641bb67d5a83dcfa1b6a589e395"
Sep 16 12:33:54.814858 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:54.814813    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"398685fe45be55a022f58d1cd404b015271c3641bb67d5a83dcfa1b6a589e395"} err="failed to get container status \"398685fe45be55a022f58d1cd404b015271c3641bb67d5a83dcfa1b6a589e395\": rpc error: code = NotFound desc = could not find container \"398685fe45be55a022f58d1cd404b015271c3641bb67d5a83dcfa1b6a589e395\": container with ID starting with 398685fe45be55a022f58d1cd404b015271c3641bb67d5a83dcfa1b6a589e395 not found: ID does not exist"
Sep 16 12:33:54.815899 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:33:54.815879    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7567-d2d572\" is forbidden: User \"system:node:ip-10-0-138-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-251.ec2.internal' and this object" podUID="49bf3bf0-838b-4288-88ba-5271d69bcf76" pod="opendatahub/test-curl-7567-d2d572"
Sep 16 12:33:55.707463 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:55.707429    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:33:55.939719 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:55.939683    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49bf3bf0-838b-4288-88ba-5271d69bcf76" path="/var/lib/kubelet/pods/49bf3bf0-838b-4288-88ba-5271d69bcf76/volumes"
Sep 16 12:33:56.012652 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:56.012628    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7567-75fcf6"
Sep 16 12:33:56.014431 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:56.014410    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qkrlw\" (UniqueName: \"kubernetes.io/projected/d08b534d-cbfe-40b4-a6f6-1e861d911a64-kube-api-access-qkrlw\") pod \"d08b534d-cbfe-40b4-a6f6-1e861d911a64\" (UID: \"d08b534d-cbfe-40b4-a6f6-1e861d911a64\") "
Sep 16 12:33:56.016374 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:56.016350    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d08b534d-cbfe-40b4-a6f6-1e861d911a64-kube-api-access-qkrlw" (OuterVolumeSpecName: "kube-api-access-qkrlw") pod "d08b534d-cbfe-40b4-a6f6-1e861d911a64" (UID: "d08b534d-cbfe-40b4-a6f6-1e861d911a64"). InnerVolumeSpecName "kube-api-access-qkrlw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:33:56.115814 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:56.115783    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qkrlw\" (UniqueName: \"kubernetes.io/projected/d08b534d-cbfe-40b4-a6f6-1e861d911a64-kube-api-access-qkrlw\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:33:56.819559 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:56.819524    2559 generic.go:356] "Generic (PLEG): container finished" podID="d08b534d-cbfe-40b4-a6f6-1e861d911a64" containerID="1231f40d9fbaf904bed2d52c24d426b14835b67fcd59d3f350368cecff467cff" exitCode=137
Sep 16 12:33:56.819735 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:56.819565    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7567-75fcf6"
Sep 16 12:33:56.819735 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:56.819622    2559 scope.go:117] "RemoveContainer" containerID="1231f40d9fbaf904bed2d52c24d426b14835b67fcd59d3f350368cecff467cff"
Sep 16 12:33:56.828769 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:56.828751    2559 scope.go:117] "RemoveContainer" containerID="1231f40d9fbaf904bed2d52c24d426b14835b67fcd59d3f350368cecff467cff"
Sep 16 12:33:56.829042 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:33:56.829023    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1231f40d9fbaf904bed2d52c24d426b14835b67fcd59d3f350368cecff467cff\": container with ID starting with 1231f40d9fbaf904bed2d52c24d426b14835b67fcd59d3f350368cecff467cff not found: ID does not exist" containerID="1231f40d9fbaf904bed2d52c24d426b14835b67fcd59d3f350368cecff467cff"
Sep 16 12:33:56.829088 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:56.829051    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1231f40d9fbaf904bed2d52c24d426b14835b67fcd59d3f350368cecff467cff"} err="failed to get container status \"1231f40d9fbaf904bed2d52c24d426b14835b67fcd59d3f350368cecff467cff\": rpc error: code = NotFound desc = could not find container \"1231f40d9fbaf904bed2d52c24d426b14835b67fcd59d3f350368cecff467cff\": container with ID starting with 1231f40d9fbaf904bed2d52c24d426b14835b67fcd59d3f350368cecff467cff not found: ID does not exist"
Sep 16 12:33:56.830585 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:33:56.830563    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7567-75fcf6\" is forbidden: User \"system:node:ip-10-0-138-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-251.ec2.internal' and this object" podUID="d08b534d-cbfe-40b4-a6f6-1e861d911a64" pod="opendatahub/test-curl-7567-75fcf6"
Sep 16 12:33:57.938448 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:57.938407    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d08b534d-cbfe-40b4-a6f6-1e861d911a64" path="/var/lib/kubelet/pods/d08b534d-cbfe-40b4-a6f6-1e861d911a64/volumes"
Sep 16 12:33:59.797839 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:33:59.797804    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:34:03.107576 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:34:03.107539    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:34:11.380502 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:34:11.380461    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:34:11.450326 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:34:11.450281    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:34:18.158096 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:34:18.158063    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:34:21.714540 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:34:21.714500    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:34:34.305409 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:34:34.305377    2559 scope.go:117] "RemoveContainer" containerID="b45bfe38feec49588a8267ec54c786bafdf7b0ddf4e2cb0fe065e890717ae177"
Sep 16 12:34:43.705463 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:34:43.705427    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:34:58.018216 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:34:58.018119    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:35:01.935385 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:01.935353    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:35:04.723355 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:04.723310    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:35:05.629034 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:05.629003    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:35:06.115406 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:06.115368    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:35:06.422175 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:06.422118    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j"]
Sep 16 12:35:06.422558 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:06.422544    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d08b534d-cbfe-40b4-a6f6-1e861d911a64" containerName="test-curl-7567-75fcf6"
Sep 16 12:35:06.422605 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:06.422560    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d08b534d-cbfe-40b4-a6f6-1e861d911a64" containerName="test-curl-7567-75fcf6"
Sep 16 12:35:06.422644 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:06.422635    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="d08b534d-cbfe-40b4-a6f6-1e861d911a64" containerName="test-curl-7567-75fcf6"
Sep 16 12:35:06.425682 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:06.425665    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j"
Sep 16 12:35:06.428309 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:06.428285    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-3ba9e7-openshift-default-dockercfg-mhp4w\""
Sep 16 12:35:06.437835 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:06.437812    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j"]
Sep 16 12:35:06.439869 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:06.439848    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:35:06.589942 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:06.589906    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/215357ee-56b2-47f2-a2e0-7ef1d1a27092-istio-data\") pod \"e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j\" (UID: \"215357ee-56b2-47f2-a2e0-7ef1d1a27092\") " pod="openshift-ingress/e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j"
Sep 16 12:35:06.589942 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:06.589943    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frvqf\" (UniqueName: \"kubernetes.io/projected/215357ee-56b2-47f2-a2e0-7ef1d1a27092-kube-api-access-frvqf\") pod \"e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j\" (UID: \"215357ee-56b2-47f2-a2e0-7ef1d1a27092\") " pod="openshift-ingress/e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j"
Sep 16 12:35:06.590186 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:06.589965    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/215357ee-56b2-47f2-a2e0-7ef1d1a27092-workload-certs\") pod \"e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j\" (UID: \"215357ee-56b2-47f2-a2e0-7ef1d1a27092\") " pod="openshift-ingress/e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j"
Sep 16 12:35:06.590186 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:06.590075    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/215357ee-56b2-47f2-a2e0-7ef1d1a27092-workload-socket\") pod \"e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j\" (UID: \"215357ee-56b2-47f2-a2e0-7ef1d1a27092\") " pod="openshift-ingress/e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j"
Sep 16 12:35:06.590186 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:06.590102    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/215357ee-56b2-47f2-a2e0-7ef1d1a27092-istio-envoy\") pod \"e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j\" (UID: \"215357ee-56b2-47f2-a2e0-7ef1d1a27092\") " pod="openshift-ingress/e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j"
Sep 16 12:35:06.590186 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:06.590127    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/215357ee-56b2-47f2-a2e0-7ef1d1a27092-istio-podinfo\") pod \"e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j\" (UID: \"215357ee-56b2-47f2-a2e0-7ef1d1a27092\") " pod="openshift-ingress/e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j"
Sep 16 12:35:06.590347 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:06.590220    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/215357ee-56b2-47f2-a2e0-7ef1d1a27092-credential-socket\") pod \"e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j\" (UID: \"215357ee-56b2-47f2-a2e0-7ef1d1a27092\") " pod="openshift-ingress/e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j"
Sep 16 12:35:06.590347 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:06.590243    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/215357ee-56b2-47f2-a2e0-7ef1d1a27092-istio-token\") pod \"e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j\" (UID: \"215357ee-56b2-47f2-a2e0-7ef1d1a27092\") " pod="openshift-ingress/e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j"
Sep 16 12:35:06.590347 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:06.590290    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/215357ee-56b2-47f2-a2e0-7ef1d1a27092-istiod-ca-cert\") pod \"e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j\" (UID: \"215357ee-56b2-47f2-a2e0-7ef1d1a27092\") " pod="openshift-ingress/e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j"
Sep 16 12:35:06.603765 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:06.603734    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:35:06.691202 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:06.691080    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/215357ee-56b2-47f2-a2e0-7ef1d1a27092-workload-socket\") pod \"e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j\" (UID: \"215357ee-56b2-47f2-a2e0-7ef1d1a27092\") " pod="openshift-ingress/e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j"
Sep 16 12:35:06.691202 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:06.691113    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/215357ee-56b2-47f2-a2e0-7ef1d1a27092-istio-envoy\") pod \"e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j\" (UID: \"215357ee-56b2-47f2-a2e0-7ef1d1a27092\") " pod="openshift-ingress/e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j"
Sep 16 12:35:06.691202 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:06.691151    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/215357ee-56b2-47f2-a2e0-7ef1d1a27092-istio-podinfo\") pod \"e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j\" (UID: \"215357ee-56b2-47f2-a2e0-7ef1d1a27092\") " pod="openshift-ingress/e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j"
Sep 16 12:35:06.691202 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:06.691195    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/215357ee-56b2-47f2-a2e0-7ef1d1a27092-credential-socket\") pod \"e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j\" (UID: \"215357ee-56b2-47f2-a2e0-7ef1d1a27092\") " pod="openshift-ingress/e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j"
Sep 16 12:35:06.691532 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:06.691214    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/215357ee-56b2-47f2-a2e0-7ef1d1a27092-istio-token\") pod \"e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j\" (UID: \"215357ee-56b2-47f2-a2e0-7ef1d1a27092\") " pod="openshift-ingress/e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j"
Sep 16 12:35:06.691532 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:06.691247    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/215357ee-56b2-47f2-a2e0-7ef1d1a27092-istiod-ca-cert\") pod \"e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j\" (UID: \"215357ee-56b2-47f2-a2e0-7ef1d1a27092\") " pod="openshift-ingress/e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j"
Sep 16 12:35:06.691532 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:06.691282    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/215357ee-56b2-47f2-a2e0-7ef1d1a27092-istio-data\") pod \"e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j\" (UID: \"215357ee-56b2-47f2-a2e0-7ef1d1a27092\") " pod="openshift-ingress/e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j"
Sep 16 12:35:06.691532 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:06.691307    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frvqf\" (UniqueName: \"kubernetes.io/projected/215357ee-56b2-47f2-a2e0-7ef1d1a27092-kube-api-access-frvqf\") pod \"e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j\" (UID: \"215357ee-56b2-47f2-a2e0-7ef1d1a27092\") " pod="openshift-ingress/e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j"
Sep 16 12:35:06.691532 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:06.691510    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/215357ee-56b2-47f2-a2e0-7ef1d1a27092-workload-certs\") pod \"e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j\" (UID: \"215357ee-56b2-47f2-a2e0-7ef1d1a27092\") " pod="openshift-ingress/e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j"
Sep 16 12:35:06.691785 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:06.691589    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/215357ee-56b2-47f2-a2e0-7ef1d1a27092-workload-socket\") pod \"e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j\" (UID: \"215357ee-56b2-47f2-a2e0-7ef1d1a27092\") " pod="openshift-ingress/e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j"
Sep 16 12:35:06.691785 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:06.691627    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/215357ee-56b2-47f2-a2e0-7ef1d1a27092-credential-socket\") pod \"e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j\" (UID: \"215357ee-56b2-47f2-a2e0-7ef1d1a27092\") " pod="openshift-ingress/e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j"
Sep 16 12:35:06.691898 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:06.691844    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/215357ee-56b2-47f2-a2e0-7ef1d1a27092-istio-data\") pod \"e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j\" (UID: \"215357ee-56b2-47f2-a2e0-7ef1d1a27092\") " pod="openshift-ingress/e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j"
Sep 16 12:35:06.692019 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:06.691959    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/215357ee-56b2-47f2-a2e0-7ef1d1a27092-workload-certs\") pod \"e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j\" (UID: \"215357ee-56b2-47f2-a2e0-7ef1d1a27092\") " pod="openshift-ingress/e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j"
Sep 16 12:35:06.692019 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:06.691993    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/215357ee-56b2-47f2-a2e0-7ef1d1a27092-istiod-ca-cert\") pod \"e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j\" (UID: \"215357ee-56b2-47f2-a2e0-7ef1d1a27092\") " pod="openshift-ingress/e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j"
Sep 16 12:35:06.693947 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:06.693925    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/215357ee-56b2-47f2-a2e0-7ef1d1a27092-istio-envoy\") pod \"e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j\" (UID: \"215357ee-56b2-47f2-a2e0-7ef1d1a27092\") " pod="openshift-ingress/e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j"
Sep 16 12:35:06.694063 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:06.694047    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/215357ee-56b2-47f2-a2e0-7ef1d1a27092-istio-podinfo\") pod \"e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j\" (UID: \"215357ee-56b2-47f2-a2e0-7ef1d1a27092\") " pod="openshift-ingress/e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j"
Sep 16 12:35:06.699057 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:06.699035    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/215357ee-56b2-47f2-a2e0-7ef1d1a27092-istio-token\") pod \"e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j\" (UID: \"215357ee-56b2-47f2-a2e0-7ef1d1a27092\") " pod="openshift-ingress/e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j"
Sep 16 12:35:06.699450 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:06.699430    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-frvqf\" (UniqueName: \"kubernetes.io/projected/215357ee-56b2-47f2-a2e0-7ef1d1a27092-kube-api-access-frvqf\") pod \"e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j\" (UID: \"215357ee-56b2-47f2-a2e0-7ef1d1a27092\") " pod="openshift-ingress/e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j"
Sep 16 12:35:06.736355 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:06.736328    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j"
Sep 16 12:35:07.015056 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:07.015031    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j"]
Sep 16 12:35:07.016469 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:35:07.016439    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod215357ee_56b2_47f2_a2e0_7ef1d1a27092.slice/crio-c7d43c2906adfc159f1aa56a4cc6d73d4158d3c31eba7f45a1e72d11109d4917 WatchSource:0}: Error finding container c7d43c2906adfc159f1aa56a4cc6d73d4158d3c31eba7f45a1e72d11109d4917: Status 404 returned error can't find the container with id c7d43c2906adfc159f1aa56a4cc6d73d4158d3c31eba7f45a1e72d11109d4917
Sep 16 12:35:07.018839 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:07.018803    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:35:07.018930 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:07.018893    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:35:07.018970 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:07.018935    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:35:07.191537 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:07.191501    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j" event={"ID":"215357ee-56b2-47f2-a2e0-7ef1d1a27092","Type":"ContainerStarted","Data":"88c06b4b9a0ddcdbe426cf8d1a7417ce1f545a7a3b8b57aabf26ef48265c11c5"}
Sep 16 12:35:07.191920 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:07.191552    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j" event={"ID":"215357ee-56b2-47f2-a2e0-7ef1d1a27092","Type":"ContainerStarted","Data":"c7d43c2906adfc159f1aa56a4cc6d73d4158d3c31eba7f45a1e72d11109d4917"}
Sep 16 12:35:07.217941 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:07.217894    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j" podStartSLOduration=1.217877834 podStartE2EDuration="1.217877834s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:35:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:35:07.214718395 +0000 UTC m=+2073.835037712" watchObservedRunningTime="2026-09-16 12:35:07.217877834 +0000 UTC m=+2073.838197150"
Sep 16 12:35:07.737437 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:07.737408    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j"
Sep 16 12:35:08.521483 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:08.521434    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:35:08.705320 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:08.705278    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:35:08.742308 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:08.742281    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j"
Sep 16 12:35:09.201851 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:09.201817    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j"
Sep 16 12:35:09.202839 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:09.202812    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j"
Sep 16 12:35:09.260450 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:09.260411    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:35:09.345227 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:09.345196    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:35:09.464505 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:09.464422    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:35:10.323428 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:10.323390    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:35:11.142444 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:11.142415    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:35:11.394594 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:11.394508    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:35:11.689600 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:11.689567    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:35:11.781495 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:11.781460    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:35:21.701981 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:21.701939    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:35:24.866801 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:24.866399    2559 patch_prober.go:28] interesting pod/e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": read tcp 10.132.0.2:43758->10.132.0.81:15021: read: connection reset by peer" start-of-body=
Sep 16 12:35:24.866801 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:24.866467    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j" podUID="215357ee-56b2-47f2-a2e0-7ef1d1a27092" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": read tcp 10.132.0.2:43758->10.132.0.81:15021: read: connection reset by peer"
Sep 16 12:35:25.295345 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:25.295312    2559 generic.go:356] "Generic (PLEG): container finished" podID="215357ee-56b2-47f2-a2e0-7ef1d1a27092" containerID="88c06b4b9a0ddcdbe426cf8d1a7417ce1f545a7a3b8b57aabf26ef48265c11c5" exitCode=0
Sep 16 12:35:25.295534 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:25.295392    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j" event={"ID":"215357ee-56b2-47f2-a2e0-7ef1d1a27092","Type":"ContainerDied","Data":"88c06b4b9a0ddcdbe426cf8d1a7417ce1f545a7a3b8b57aabf26ef48265c11c5"}
Sep 16 12:35:25.295876 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:25.295857    2559 scope.go:117] "RemoveContainer" containerID="88c06b4b9a0ddcdbe426cf8d1a7417ce1f545a7a3b8b57aabf26ef48265c11c5"
Sep 16 12:35:25.297026 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:25.296997    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:35:25.297087 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:25.297074    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:35:25.297143 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:25.297108    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:35:26.302753 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:26.302720    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j" event={"ID":"215357ee-56b2-47f2-a2e0-7ef1d1a27092","Type":"ContainerStarted","Data":"30570484e721eb88e8fd927dd83eae4a6b9988a28710b5111dd6f1c1026355f3"}
Sep 16 12:35:26.737172 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:26.737113    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j"
Sep 16 12:35:26.737388 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:26.737271    2559 patch_prober.go:28] interesting pod/e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Sep 16 12:35:26.737388 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:26.737316    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j" podUID="215357ee-56b2-47f2-a2e0-7ef1d1a27092" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Sep 16 12:35:27.737625 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:27.737576    2559 patch_prober.go:28] interesting pod/e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Sep 16 12:35:27.738150 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:27.737653    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j" podUID="215357ee-56b2-47f2-a2e0-7ef1d1a27092" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Sep 16 12:35:28.736815 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:28.736775    2559 patch_prober.go:28] interesting pod/e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Sep 16 12:35:28.737122 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:28.737088    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j" podUID="215357ee-56b2-47f2-a2e0-7ef1d1a27092" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Sep 16 12:35:29.737428 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:29.737379    2559 patch_prober.go:28] interesting pod/e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Sep 16 12:35:29.737941 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:29.737454    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j" podUID="215357ee-56b2-47f2-a2e0-7ef1d1a27092" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Sep 16 12:35:30.737678 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:30.737641    2559 patch_prober.go:28] interesting pod/e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Sep 16 12:35:30.738324 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:30.738284    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j" podUID="215357ee-56b2-47f2-a2e0-7ef1d1a27092" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Sep 16 12:35:31.740926 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:31.740898    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j"
Sep 16 12:35:31.741307 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:31.741244    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j"
Sep 16 12:35:31.741910 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:31.741890    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j"
Sep 16 12:35:33.056679 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:33.056638    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:35:33.790367 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:33.790334    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:35:34.034773 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:34.034746    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-hrvzp_63ee784a-3b40-4259-9923-74a24d0203a0/console-operator/5.log"
Sep 16 12:35:34.038837 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:34.038813    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-hrvzp_63ee784a-3b40-4259-9923-74a24d0203a0/console-operator/5.log"
Sep 16 12:35:34.335678 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:34.335619    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:35:34.436094 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:34.436055    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:35:35.143645 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:35.143602    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:35:35.245604 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:35.245570    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:35:35.417424 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:35.417389    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w"]
Sep 16 12:35:35.421203 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:35.421180    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w"
Sep 16 12:35:35.424008 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:35.423984    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-43ef83-openshift-default-dockercfg-lwtnf\""
Sep 16 12:35:35.435330 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:35.435306    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w"]
Sep 16 12:35:35.458254 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:35.458225    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:35:35.580651 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:35.580621    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/684f4bb5-2617-4db2-9955-cf5bda082db8-workload-certs\") pod \"e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w\" (UID: \"684f4bb5-2617-4db2-9955-cf5bda082db8\") " pod="openshift-ingress/e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w"
Sep 16 12:35:35.580884 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:35.580661    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/684f4bb5-2617-4db2-9955-cf5bda082db8-istio-token\") pod \"e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w\" (UID: \"684f4bb5-2617-4db2-9955-cf5bda082db8\") " pod="openshift-ingress/e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w"
Sep 16 12:35:35.580884 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:35.580724    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/684f4bb5-2617-4db2-9955-cf5bda082db8-credential-socket\") pod \"e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w\" (UID: \"684f4bb5-2617-4db2-9955-cf5bda082db8\") " pod="openshift-ingress/e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w"
Sep 16 12:35:35.580884 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:35.580749    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/684f4bb5-2617-4db2-9955-cf5bda082db8-istio-data\") pod \"e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w\" (UID: \"684f4bb5-2617-4db2-9955-cf5bda082db8\") " pod="openshift-ingress/e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w"
Sep 16 12:35:35.580884 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:35.580765    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/684f4bb5-2617-4db2-9955-cf5bda082db8-istio-envoy\") pod \"e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w\" (UID: \"684f4bb5-2617-4db2-9955-cf5bda082db8\") " pod="openshift-ingress/e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w"
Sep 16 12:35:35.580884 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:35.580793    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/684f4bb5-2617-4db2-9955-cf5bda082db8-istiod-ca-cert\") pod \"e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w\" (UID: \"684f4bb5-2617-4db2-9955-cf5bda082db8\") " pod="openshift-ingress/e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w"
Sep 16 12:35:35.580884 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:35.580828    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrxg8\" (UniqueName: \"kubernetes.io/projected/684f4bb5-2617-4db2-9955-cf5bda082db8-kube-api-access-zrxg8\") pod \"e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w\" (UID: \"684f4bb5-2617-4db2-9955-cf5bda082db8\") " pod="openshift-ingress/e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w"
Sep 16 12:35:35.581116 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:35.580885    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/684f4bb5-2617-4db2-9955-cf5bda082db8-workload-socket\") pod \"e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w\" (UID: \"684f4bb5-2617-4db2-9955-cf5bda082db8\") " pod="openshift-ingress/e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w"
Sep 16 12:35:35.581116 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:35.580921    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/684f4bb5-2617-4db2-9955-cf5bda082db8-istio-podinfo\") pod \"e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w\" (UID: \"684f4bb5-2617-4db2-9955-cf5bda082db8\") " pod="openshift-ingress/e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w"
Sep 16 12:35:35.682127 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:35.682037    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/684f4bb5-2617-4db2-9955-cf5bda082db8-istio-token\") pod \"e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w\" (UID: \"684f4bb5-2617-4db2-9955-cf5bda082db8\") " pod="openshift-ingress/e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w"
Sep 16 12:35:35.682127 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:35.682115    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/684f4bb5-2617-4db2-9955-cf5bda082db8-credential-socket\") pod \"e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w\" (UID: \"684f4bb5-2617-4db2-9955-cf5bda082db8\") " pod="openshift-ingress/e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w"
Sep 16 12:35:35.682393 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:35.682182    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/684f4bb5-2617-4db2-9955-cf5bda082db8-istio-data\") pod \"e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w\" (UID: \"684f4bb5-2617-4db2-9955-cf5bda082db8\") " pod="openshift-ingress/e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w"
Sep 16 12:35:35.682393 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:35.682209    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/684f4bb5-2617-4db2-9955-cf5bda082db8-istio-envoy\") pod \"e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w\" (UID: \"684f4bb5-2617-4db2-9955-cf5bda082db8\") " pod="openshift-ingress/e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w"
Sep 16 12:35:35.682393 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:35.682247    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/684f4bb5-2617-4db2-9955-cf5bda082db8-istiod-ca-cert\") pod \"e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w\" (UID: \"684f4bb5-2617-4db2-9955-cf5bda082db8\") " pod="openshift-ingress/e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w"
Sep 16 12:35:35.682393 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:35.682272    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrxg8\" (UniqueName: \"kubernetes.io/projected/684f4bb5-2617-4db2-9955-cf5bda082db8-kube-api-access-zrxg8\") pod \"e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w\" (UID: \"684f4bb5-2617-4db2-9955-cf5bda082db8\") " pod="openshift-ingress/e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w"
Sep 16 12:35:35.682393 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:35.682300    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/684f4bb5-2617-4db2-9955-cf5bda082db8-workload-socket\") pod \"e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w\" (UID: \"684f4bb5-2617-4db2-9955-cf5bda082db8\") " pod="openshift-ingress/e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w"
Sep 16 12:35:35.682393 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:35.682334    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/684f4bb5-2617-4db2-9955-cf5bda082db8-istio-podinfo\") pod \"e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w\" (UID: \"684f4bb5-2617-4db2-9955-cf5bda082db8\") " pod="openshift-ingress/e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w"
Sep 16 12:35:35.682697 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:35.682416    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/684f4bb5-2617-4db2-9955-cf5bda082db8-workload-certs\") pod \"e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w\" (UID: \"684f4bb5-2617-4db2-9955-cf5bda082db8\") " pod="openshift-ingress/e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w"
Sep 16 12:35:35.682697 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:35.682570    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/684f4bb5-2617-4db2-9955-cf5bda082db8-credential-socket\") pod \"e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w\" (UID: \"684f4bb5-2617-4db2-9955-cf5bda082db8\") " pod="openshift-ingress/e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w"
Sep 16 12:35:35.682697 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:35.682630    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/684f4bb5-2617-4db2-9955-cf5bda082db8-istio-data\") pod \"e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w\" (UID: \"684f4bb5-2617-4db2-9955-cf5bda082db8\") " pod="openshift-ingress/e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w"
Sep 16 12:35:35.682806 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:35.682782    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/684f4bb5-2617-4db2-9955-cf5bda082db8-workload-socket\") pod \"e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w\" (UID: \"684f4bb5-2617-4db2-9955-cf5bda082db8\") " pod="openshift-ingress/e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w"
Sep 16 12:35:35.682848 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:35.682811    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/684f4bb5-2617-4db2-9955-cf5bda082db8-workload-certs\") pod \"e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w\" (UID: \"684f4bb5-2617-4db2-9955-cf5bda082db8\") " pod="openshift-ingress/e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w"
Sep 16 12:35:35.682975 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:35.682956    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/684f4bb5-2617-4db2-9955-cf5bda082db8-istiod-ca-cert\") pod \"e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w\" (UID: \"684f4bb5-2617-4db2-9955-cf5bda082db8\") " pod="openshift-ingress/e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w"
Sep 16 12:35:35.684572 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:35.684554    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/684f4bb5-2617-4db2-9955-cf5bda082db8-istio-envoy\") pod \"e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w\" (UID: \"684f4bb5-2617-4db2-9955-cf5bda082db8\") " pod="openshift-ingress/e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w"
Sep 16 12:35:35.684897 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:35.684879    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/684f4bb5-2617-4db2-9955-cf5bda082db8-istio-podinfo\") pod \"e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w\" (UID: \"684f4bb5-2617-4db2-9955-cf5bda082db8\") " pod="openshift-ingress/e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w"
Sep 16 12:35:35.689889 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:35.689866    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/684f4bb5-2617-4db2-9955-cf5bda082db8-istio-token\") pod \"e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w\" (UID: \"684f4bb5-2617-4db2-9955-cf5bda082db8\") " pod="openshift-ingress/e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w"
Sep 16 12:35:35.690340 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:35.690317    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrxg8\" (UniqueName: \"kubernetes.io/projected/684f4bb5-2617-4db2-9955-cf5bda082db8-kube-api-access-zrxg8\") pod \"e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w\" (UID: \"684f4bb5-2617-4db2-9955-cf5bda082db8\") " pod="openshift-ingress/e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w"
Sep 16 12:35:35.732616 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:35.732587    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w"
Sep 16 12:35:35.904330 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:35.904295    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:35:36.009252 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:36.009223    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w"]
Sep 16 12:35:36.010380 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:35:36.010351    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod684f4bb5_2617_4db2_9955_cf5bda082db8.slice/crio-364aae29d0bd346fa3ba9c9262102cf97b6e25f2513c011c04679935227df094 WatchSource:0}: Error finding container 364aae29d0bd346fa3ba9c9262102cf97b6e25f2513c011c04679935227df094: Status 404 returned error can't find the container with id 364aae29d0bd346fa3ba9c9262102cf97b6e25f2513c011c04679935227df094
Sep 16 12:35:36.012592 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:36.012565    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:35:36.012655 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:36.012625    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:35:36.012696 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:36.012654    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:35:36.356641 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:36.356551    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w" event={"ID":"684f4bb5-2617-4db2-9955-cf5bda082db8","Type":"ContainerStarted","Data":"15a09a19b3e4c9cb1727a46a50decd7a88f288f9dffb8443c6c8298e32ea2245"}
Sep 16 12:35:36.356641 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:36.356611    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w" event={"ID":"684f4bb5-2617-4db2-9955-cf5bda082db8","Type":"ContainerStarted","Data":"364aae29d0bd346fa3ba9c9262102cf97b6e25f2513c011c04679935227df094"}
Sep 16 12:35:36.378225 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:36.378178    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w" podStartSLOduration=1.37815955 podStartE2EDuration="1.37815955s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:35:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:35:36.376251363 +0000 UTC m=+2102.996570678" watchObservedRunningTime="2026-09-16 12:35:36.37815955 +0000 UTC m=+2102.998478866"
Sep 16 12:35:36.733520 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:36.733487    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w"
Sep 16 12:35:37.645592 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:37.645554    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:35:37.737887 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:37.737857    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w"
Sep 16 12:35:38.282337 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:38.282304    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:35:38.368618 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:38.368580    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w"
Sep 16 12:35:38.369699 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:38.369679    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w"
Sep 16 12:35:38.389199 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:38.389175    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:35:38.481445 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:38.481415    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:35:39.139388 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:39.139352    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:35:39.893989 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:39.893952    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:35:40.625945 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:40.625914    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:35:40.685585 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:40.685552    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:35:40.914863 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:40.914829    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:35:41.167906 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:41.167821    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:35:41.263923 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:41.263893    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:35:45.302663 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:45.302631    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:35:54.411301 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:54.411263    2559 patch_prober.go:28] interesting pod/e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 16 12:35:54.411708 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:54.411347    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w" podUID="684f4bb5-2617-4db2-9955-cf5bda082db8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 16 12:35:55.460780 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:55.460747    2559 generic.go:356] "Generic (PLEG): container finished" podID="684f4bb5-2617-4db2-9955-cf5bda082db8" containerID="15a09a19b3e4c9cb1727a46a50decd7a88f288f9dffb8443c6c8298e32ea2245" exitCode=0
Sep 16 12:35:55.461220 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:55.460819    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w" event={"ID":"684f4bb5-2617-4db2-9955-cf5bda082db8","Type":"ContainerDied","Data":"15a09a19b3e4c9cb1727a46a50decd7a88f288f9dffb8443c6c8298e32ea2245"}
Sep 16 12:35:55.461286 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:55.461248    2559 scope.go:117] "RemoveContainer" containerID="15a09a19b3e4c9cb1727a46a50decd7a88f288f9dffb8443c6c8298e32ea2245"
Sep 16 12:35:55.462405 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:55.462365    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:35:55.462541 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:55.462449    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:35:55.462541 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:55.462498    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:35:56.468191 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:56.468156    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w" event={"ID":"684f4bb5-2617-4db2-9955-cf5bda082db8","Type":"ContainerStarted","Data":"b611a9bcee3467b53aa10cc3d52fd0f7d442678e20f2acabb767ad5f5892ff89"}
Sep 16 12:35:56.732975 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:56.732883    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w"
Sep 16 12:35:56.733156 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:56.733093    2559 patch_prober.go:28] interesting pod/e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Sep 16 12:35:56.733209 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:56.733188    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w" podUID="684f4bb5-2617-4db2-9955-cf5bda082db8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Sep 16 12:35:57.733770 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:57.733736    2559 patch_prober.go:28] interesting pod/e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Sep 16 12:35:57.734200 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:57.733788    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w" podUID="684f4bb5-2617-4db2-9955-cf5bda082db8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Sep 16 12:35:57.921581 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:57.921548    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:35:58.733442 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:58.733408    2559 patch_prober.go:28] interesting pod/e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Sep 16 12:35:58.733624 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:58.733458    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w" podUID="684f4bb5-2617-4db2-9955-cf5bda082db8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Sep 16 12:35:59.733669 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:59.733625    2559 patch_prober.go:28] interesting pod/e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Sep 16 12:35:59.734209 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:35:59.733691    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w" podUID="684f4bb5-2617-4db2-9955-cf5bda082db8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Sep 16 12:36:00.733199 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:36:00.733164    2559 patch_prober.go:28] interesting pod/e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Sep 16 12:36:00.733392 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:36:00.733222    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w" podUID="684f4bb5-2617-4db2-9955-cf5bda082db8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Sep 16 12:36:01.733930 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:36:01.733893    2559 patch_prober.go:28] interesting pod/e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Sep 16 12:36:01.734384 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:36:01.733945    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w" podUID="684f4bb5-2617-4db2-9955-cf5bda082db8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Sep 16 12:36:02.543844 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:36:02.543797    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:36:02.736327 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:36:02.736300    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w"
Sep 16 12:36:02.736773 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:36:02.736566    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w"
Sep 16 12:36:02.737218 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:36:02.737200    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w"
Sep 16 12:36:03.229063 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:36:03.229025    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:36:03.474632 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:36:03.474598    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:36:04.079869 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:36:04.079834    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:36:04.719582 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:36:04.719534    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:36:05.515222 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:36:05.515189    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:36:08.745959 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:36:08.745927    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-ltqcv_00903936-23e1-4ffe-a6ec-0bbe98320a3e/payload-processing/0.log"
Sep 16 12:36:16.610904 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:36:16.610817    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:36:27.281185 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:36:27.281077    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:36:31.623077 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:36:31.623049    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:36:34.129920 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:36:34.129885    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:36:34.341231 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:36:34.341202    2559 scope.go:117] "RemoveContainer" containerID="56ed3db761b157f80041c290f5f70f16b9a04ee0f46b378c3b59d45bbab6d05d"
Sep 16 12:36:35.208341 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:36:35.208306    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:36:49.013354 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:36:49.013315    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:36:53.507930 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:36:53.507888    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:36:55.238104 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:36:55.238075    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-ltqcv_00903936-23e1-4ffe-a6ec-0bbe98320a3e/payload-processing/0.log"
Sep 16 12:36:55.644520 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:36:55.644439    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:36:55.924455 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:36:55.924423    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp"]
Sep 16 12:36:55.927417 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:36:55.927393    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp"
Sep 16 12:36:55.930234 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:36:55.930209    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-6b0cae-openshift-default-dockercfg-9q7xw\""
Sep 16 12:36:55.938891 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:36:55.938866    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp"]
Sep 16 12:36:55.951481 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:36:55.951459    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:36:56.009584 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:36:56.009553    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ceb10b8-c5ff-497a-b41d-17895374e950-istio-data\") pod \"e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp\" (UID: \"1ceb10b8-c5ff-497a-b41d-17895374e950\") " pod="openshift-ingress/e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp"
Sep 16 12:36:56.009768 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:36:56.009595    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ceb10b8-c5ff-497a-b41d-17895374e950-istio-podinfo\") pod \"e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp\" (UID: \"1ceb10b8-c5ff-497a-b41d-17895374e950\") " pod="openshift-ingress/e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp"
Sep 16 12:36:56.009768 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:36:56.009617    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ceb10b8-c5ff-497a-b41d-17895374e950-istio-envoy\") pod \"e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp\" (UID: \"1ceb10b8-c5ff-497a-b41d-17895374e950\") " pod="openshift-ingress/e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp"
Sep 16 12:36:56.009768 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:36:56.009703    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ceb10b8-c5ff-497a-b41d-17895374e950-workload-socket\") pod \"e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp\" (UID: \"1ceb10b8-c5ff-497a-b41d-17895374e950\") " pod="openshift-ingress/e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp"
Sep 16 12:36:56.009768 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:36:56.009743    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ceb10b8-c5ff-497a-b41d-17895374e950-workload-certs\") pod \"e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp\" (UID: \"1ceb10b8-c5ff-497a-b41d-17895374e950\") " pod="openshift-ingress/e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp"
Sep 16 12:36:56.009913 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:36:56.009770    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ceb10b8-c5ff-497a-b41d-17895374e950-credential-socket\") pod \"e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp\" (UID: \"1ceb10b8-c5ff-497a-b41d-17895374e950\") " pod="openshift-ingress/e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp"
Sep 16 12:36:56.009913 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:36:56.009855    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ceb10b8-c5ff-497a-b41d-17895374e950-istio-token\") pod \"e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp\" (UID: \"1ceb10b8-c5ff-497a-b41d-17895374e950\") " pod="openshift-ingress/e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp"
Sep 16 12:36:56.009913 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:36:56.009899    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbjwc\" (UniqueName: \"kubernetes.io/projected/1ceb10b8-c5ff-497a-b41d-17895374e950-kube-api-access-tbjwc\") pod \"e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp\" (UID: \"1ceb10b8-c5ff-497a-b41d-17895374e950\") " pod="openshift-ingress/e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp"
Sep 16 12:36:56.010040 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:36:56.009954    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ceb10b8-c5ff-497a-b41d-17895374e950-istiod-ca-cert\") pod \"e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp\" (UID: \"1ceb10b8-c5ff-497a-b41d-17895374e950\") " pod="openshift-ingress/e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp"
Sep 16 12:36:56.111211 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:36:56.111174    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ceb10b8-c5ff-497a-b41d-17895374e950-istio-envoy\") pod \"e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp\" (UID: \"1ceb10b8-c5ff-497a-b41d-17895374e950\") " pod="openshift-ingress/e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp"
Sep 16 12:36:56.111211 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:36:56.111218    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ceb10b8-c5ff-497a-b41d-17895374e950-workload-socket\") pod \"e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp\" (UID: \"1ceb10b8-c5ff-497a-b41d-17895374e950\") " pod="openshift-ingress/e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp"
Sep 16 12:36:56.111471 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:36:56.111250    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ceb10b8-c5ff-497a-b41d-17895374e950-workload-certs\") pod \"e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp\" (UID: \"1ceb10b8-c5ff-497a-b41d-17895374e950\") " pod="openshift-ingress/e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp"
Sep 16 12:36:56.111471 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:36:56.111272    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ceb10b8-c5ff-497a-b41d-17895374e950-credential-socket\") pod \"e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp\" (UID: \"1ceb10b8-c5ff-497a-b41d-17895374e950\") " pod="openshift-ingress/e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp"
Sep 16 12:36:56.111471 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:36:56.111321    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ceb10b8-c5ff-497a-b41d-17895374e950-istio-token\") pod \"e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp\" (UID: \"1ceb10b8-c5ff-497a-b41d-17895374e950\") " pod="openshift-ingress/e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp"
Sep 16 12:36:56.111471 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:36:56.111366    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbjwc\" (UniqueName: \"kubernetes.io/projected/1ceb10b8-c5ff-497a-b41d-17895374e950-kube-api-access-tbjwc\") pod \"e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp\" (UID: \"1ceb10b8-c5ff-497a-b41d-17895374e950\") " pod="openshift-ingress/e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp"
Sep 16 12:36:56.111471 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:36:56.111402    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ceb10b8-c5ff-497a-b41d-17895374e950-istiod-ca-cert\") pod \"e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp\" (UID: \"1ceb10b8-c5ff-497a-b41d-17895374e950\") " pod="openshift-ingress/e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp"
Sep 16 12:36:56.111471 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:36:56.111430    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ceb10b8-c5ff-497a-b41d-17895374e950-istio-data\") pod \"e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp\" (UID: \"1ceb10b8-c5ff-497a-b41d-17895374e950\") " pod="openshift-ingress/e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp"
Sep 16 12:36:56.111471 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:36:56.111461    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ceb10b8-c5ff-497a-b41d-17895374e950-istio-podinfo\") pod \"e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp\" (UID: \"1ceb10b8-c5ff-497a-b41d-17895374e950\") " pod="openshift-ingress/e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp"
Sep 16 12:36:56.111811 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:36:56.111611    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ceb10b8-c5ff-497a-b41d-17895374e950-workload-socket\") pod \"e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp\" (UID: \"1ceb10b8-c5ff-497a-b41d-17895374e950\") " pod="openshift-ingress/e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp"
Sep 16 12:36:56.111811 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:36:56.111696    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ceb10b8-c5ff-497a-b41d-17895374e950-workload-certs\") pod \"e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp\" (UID: \"1ceb10b8-c5ff-497a-b41d-17895374e950\") " pod="openshift-ingress/e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp"
Sep 16 12:36:56.112213 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:36:56.112185    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ceb10b8-c5ff-497a-b41d-17895374e950-istio-data\") pod \"e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp\" (UID: \"1ceb10b8-c5ff-497a-b41d-17895374e950\") " pod="openshift-ingress/e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp"
Sep 16 12:36:56.112306 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:36:56.112209    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ceb10b8-c5ff-497a-b41d-17895374e950-credential-socket\") pod \"e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp\" (UID: \"1ceb10b8-c5ff-497a-b41d-17895374e950\") " pod="openshift-ingress/e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp"
Sep 16 12:36:56.112306 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:36:56.112264    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ceb10b8-c5ff-497a-b41d-17895374e950-istiod-ca-cert\") pod \"e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp\" (UID: \"1ceb10b8-c5ff-497a-b41d-17895374e950\") " pod="openshift-ingress/e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp"
Sep 16 12:36:56.113627 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:36:56.113606    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ceb10b8-c5ff-497a-b41d-17895374e950-istio-envoy\") pod \"e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp\" (UID: \"1ceb10b8-c5ff-497a-b41d-17895374e950\") " pod="openshift-ingress/e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp"
Sep 16 12:36:56.113946 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:36:56.113928    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ceb10b8-c5ff-497a-b41d-17895374e950-istio-podinfo\") pod \"e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp\" (UID: \"1ceb10b8-c5ff-497a-b41d-17895374e950\") " pod="openshift-ingress/e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp"
Sep 16 12:36:56.119305 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:36:56.119278    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ceb10b8-c5ff-497a-b41d-17895374e950-istio-token\") pod \"e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp\" (UID: \"1ceb10b8-c5ff-497a-b41d-17895374e950\") " pod="openshift-ingress/e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp"
Sep 16 12:36:56.119400 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:36:56.119345    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbjwc\" (UniqueName: \"kubernetes.io/projected/1ceb10b8-c5ff-497a-b41d-17895374e950-kube-api-access-tbjwc\") pod \"e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp\" (UID: \"1ceb10b8-c5ff-497a-b41d-17895374e950\") " pod="openshift-ingress/e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp"
Sep 16 12:36:56.194189 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:36:56.194066    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:36:56.238774 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:36:56.238750    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp"
Sep 16 12:36:56.515920 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:36:56.515889    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp"]
Sep 16 12:36:56.518093 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:36:56.518067    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ceb10b8_c5ff_497a_b41d_17895374e950.slice/crio-2145bb3ed7a1f2e84d2d2a3bb6f7c765d17ee5224aec0d353082b118b4fd9331 WatchSource:0}: Error finding container 2145bb3ed7a1f2e84d2d2a3bb6f7c765d17ee5224aec0d353082b118b4fd9331: Status 404 returned error can't find the container with id 2145bb3ed7a1f2e84d2d2a3bb6f7c765d17ee5224aec0d353082b118b4fd9331
Sep 16 12:36:56.520838 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:36:56.520804    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:36:56.520932 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:36:56.520880    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:36:56.520932 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:36:56.520922    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:36:56.789937 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:36:56.789849    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp" event={"ID":"1ceb10b8-c5ff-497a-b41d-17895374e950","Type":"ContainerStarted","Data":"964f357b5c7460c0fee93731786ffdfd7c7aba5f9dcd3c7df0a911bf707ed4f1"}
Sep 16 12:36:56.789937 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:36:56.789906    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp" event={"ID":"1ceb10b8-c5ff-497a-b41d-17895374e950","Type":"ContainerStarted","Data":"2145bb3ed7a1f2e84d2d2a3bb6f7c765d17ee5224aec0d353082b118b4fd9331"}
Sep 16 12:36:56.812981 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:36:56.812924    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp" podStartSLOduration=1.812908594 podStartE2EDuration="1.812908594s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:36:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:36:56.81050347 +0000 UTC m=+2183.430822779" watchObservedRunningTime="2026-09-16 12:36:56.812908594 +0000 UTC m=+2183.433227904"
Sep 16 12:36:57.239183 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:36:57.239126    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp"
Sep 16 12:36:57.244875 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:36:57.244842    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp"
Sep 16 12:36:57.796195 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:36:57.796163    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp"
Sep 16 12:36:57.797049 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:36:57.797028    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp"
Sep 16 12:36:58.112317 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:36:58.112224    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:36:58.747318 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:36:58.747276    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:36:58.842946 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:36:58.842912    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:36:59.643858 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:36:59.643824    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:37:00.313744 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:00.313702    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:37:00.968956 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:00.968922    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:37:01.722802 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:01.722768    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:37:01.783309 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:01.783275    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:37:01.883533 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:01.883497    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:37:02.168805 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:02.168777    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:37:02.269660 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:02.269632    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:37:08.909557 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:08.909526    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:37:17.516724 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:17.516694    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:37:18.919575 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:18.919544    2559 generic.go:356] "Generic (PLEG): container finished" podID="1ceb10b8-c5ff-497a-b41d-17895374e950" containerID="964f357b5c7460c0fee93731786ffdfd7c7aba5f9dcd3c7df0a911bf707ed4f1" exitCode=0
Sep 16 12:37:18.919978 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:18.919618    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp" event={"ID":"1ceb10b8-c5ff-497a-b41d-17895374e950","Type":"ContainerDied","Data":"964f357b5c7460c0fee93731786ffdfd7c7aba5f9dcd3c7df0a911bf707ed4f1"}
Sep 16 12:37:18.920048 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:18.920034    2559 scope.go:117] "RemoveContainer" containerID="964f357b5c7460c0fee93731786ffdfd7c7aba5f9dcd3c7df0a911bf707ed4f1"
Sep 16 12:37:18.921280 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:18.921249    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:37:18.921356 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:18.921327    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:37:18.921400 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:18.921388    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 12:37:19.928308 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:19.928273    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp" event={"ID":"1ceb10b8-c5ff-497a-b41d-17895374e950","Type":"ContainerStarted","Data":"7c6c677b9ec602d9a435f7409edd062a55bde371208c418952f9db07079c6dc6"}
Sep 16 12:37:20.245763 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:20.245650    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp"
Sep 16 12:37:20.245953 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:20.245831    2559 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Sep 16 12:37:20.245953 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:20.245881    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp" podUID="1ceb10b8-c5ff-497a-b41d-17895374e950" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Sep 16 12:37:21.239930 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:21.239884    2559 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Sep 16 12:37:21.240434 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:21.239967    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp" podUID="1ceb10b8-c5ff-497a-b41d-17895374e950" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Sep 16 12:37:22.239670 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:22.239632    2559 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Sep 16 12:37:22.239965 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:22.239936    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp" podUID="1ceb10b8-c5ff-497a-b41d-17895374e950" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Sep 16 12:37:22.311783 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:22.311749    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:37:23.129318 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:23.129280    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:37:23.240034 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:23.239347    2559 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Sep 16 12:37:23.240034 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:23.239417    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp" podUID="1ceb10b8-c5ff-497a-b41d-17895374e950" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Sep 16 12:37:24.239745 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:24.239697    2559 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Sep 16 12:37:24.239962 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:24.239788    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp" podUID="1ceb10b8-c5ff-497a-b41d-17895374e950" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Sep 16 12:37:24.417664 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:24.417630    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:37:25.117506 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:25.117474    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:37:25.357183 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:25.357085    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp"
Sep 16 12:37:25.357561 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:25.357535    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp"
Sep 16 12:37:25.358407 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:25.358388    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp"
Sep 16 12:37:25.942366 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:25.942330    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:37:26.565509 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:26.565474    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:37:27.330273 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:27.330239    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:37:27.956449 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:27.956416    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:37:28.939943 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:28.939912    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:37:29.674619 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:29.674576    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-6b0cae-dz4dn"]
Sep 16 12:37:29.677227 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:29.677202    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-6b0cae-dz4dn"
Sep 16 12:37:29.679757 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:29.679737    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hvtv7\""
Sep 16 12:37:29.685868 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:29.685845    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-6b0cae-dz4dn"]
Sep 16 12:37:29.758607 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:29.758569    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0694bf4b-22ee-49ac-8541-0776ee6836be-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-6b0cae-dz4dn\" (UID: \"0694bf4b-22ee-49ac-8541-0776ee6836be\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-6b0cae-dz4dn"
Sep 16 12:37:29.860284 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:29.860244    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0694bf4b-22ee-49ac-8541-0776ee6836be-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-6b0cae-dz4dn\" (UID: \"0694bf4b-22ee-49ac-8541-0776ee6836be\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-6b0cae-dz4dn"
Sep 16 12:37:29.860888 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:29.860868    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0694bf4b-22ee-49ac-8541-0776ee6836be-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-6b0cae-dz4dn\" (UID: \"0694bf4b-22ee-49ac-8541-0776ee6836be\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-6b0cae-dz4dn"
Sep 16 12:37:29.990192 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:29.990070    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-6b0cae-dz4dn"
Sep 16 12:37:30.268250 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:30.268222    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-6b0cae-dz4dn"]
Sep 16 12:37:30.270213 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:37:30.270180    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0694bf4b_22ee_49ac_8541_0776ee6836be.slice/crio-8a84faf8546a47c9f602ca18ae144a1a8dddce8864e3ead8ce698585779a7f83 WatchSource:0}: Error finding container 8a84faf8546a47c9f602ca18ae144a1a8dddce8864e3ead8ce698585779a7f83: Status 404 returned error can't find the container with id 8a84faf8546a47c9f602ca18ae144a1a8dddce8864e3ead8ce698585779a7f83
Sep 16 12:37:30.563591 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:30.563509    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:37:30.999564 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:30.999531    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-6b0cae-dz4dn" event={"ID":"0694bf4b-22ee-49ac-8541-0776ee6836be","Type":"ContainerStarted","Data":"8e9fc0c11a99893ae54e13486de10ddaec9283ad0b593c7c63a4d270c95b5d0b"}
Sep 16 12:37:30.999942 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:30.999579    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-6b0cae-dz4dn" event={"ID":"0694bf4b-22ee-49ac-8541-0776ee6836be","Type":"ContainerStarted","Data":"8a84faf8546a47c9f602ca18ae144a1a8dddce8864e3ead8ce698585779a7f83"}
Sep 16 12:37:31.016080 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:31.016035    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-6b0cae-dz4dn" podStartSLOduration=2.016020937 podStartE2EDuration="2.016020937s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:37:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:37:31.013572435 +0000 UTC m=+2217.633891751" watchObservedRunningTime="2026-09-16 12:37:31.016020937 +0000 UTC m=+2217.636340253"
Sep 16 12:37:31.216099 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:31.216069    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:37:31.849771 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:31.849742    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:37:32.006223 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:32.006187    2559 generic.go:356] "Generic (PLEG): container finished" podID="0694bf4b-22ee-49ac-8541-0776ee6836be" containerID="8e9fc0c11a99893ae54e13486de10ddaec9283ad0b593c7c63a4d270c95b5d0b" exitCode=0
Sep 16 12:37:32.006643 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:32.006235    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-6b0cae-dz4dn" event={"ID":"0694bf4b-22ee-49ac-8541-0776ee6836be","Type":"ContainerDied","Data":"8e9fc0c11a99893ae54e13486de10ddaec9283ad0b593c7c63a4d270c95b5d0b"}
Sep 16 12:37:32.741461 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:32.741428    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:37:33.151330 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:33.151305    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-6b0cae-dz4dn"
Sep 16 12:37:33.194074 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:33.194046    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0694bf4b-22ee-49ac-8541-0776ee6836be-maas-api-service-ca\") pod \"0694bf4b-22ee-49ac-8541-0776ee6836be\" (UID: \"0694bf4b-22ee-49ac-8541-0776ee6836be\") "
Sep 16 12:37:33.194461 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:33.194439    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0694bf4b-22ee-49ac-8541-0776ee6836be-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0694bf4b-22ee-49ac-8541-0776ee6836be" (UID: "0694bf4b-22ee-49ac-8541-0776ee6836be"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:37:33.295447 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:33.295372    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0694bf4b-22ee-49ac-8541-0776ee6836be-maas-api-service-ca\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:37:33.415576 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:33.415534    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:37:34.018874 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:34.018843    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-6b0cae-dz4dn"
Sep 16 12:37:34.019037 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:34.018887    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-6b0cae-dz4dn" event={"ID":"0694bf4b-22ee-49ac-8541-0776ee6836be","Type":"ContainerDied","Data":"8a84faf8546a47c9f602ca18ae144a1a8dddce8864e3ead8ce698585779a7f83"}
Sep 16 12:37:34.019037 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:34.018937    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8a84faf8546a47c9f602ca18ae144a1a8dddce8864e3ead8ce698585779a7f83"
Sep 16 12:37:34.066256 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:34.066203    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:37:34.363718 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:34.363639    2559 scope.go:117] "RemoveContainer" containerID="2400af9caf541e6fee3150943d38743efc375b9f16cf92250a9c078773dd721b"
Sep 16 12:37:34.372439 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:34.372411    2559 scope.go:117] "RemoveContainer" containerID="e56cd325a7bb1bf175c343a8107c5ca0aa71c2f978724218691aef5a51d4ba1d"
Sep 16 12:37:40.536419 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:40.536377    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:37:40.605957 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:40.605925    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:37:40.705403 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:40.705367    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:37:40.727985 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:40.727958    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-6b0cae-dz4dn"]
Sep 16 12:37:40.731285 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:40.731261    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-6b0cae-dz4dn"]
Sep 16 12:37:40.759520 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:40.759489    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:37:41.088357 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:41.088323    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:37:41.187170 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:41.187140    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:37:41.730289 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:41.730258    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:37:41.938460 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:41.938418    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0694bf4b-22ee-49ac-8541-0776ee6836be" path="/var/lib/kubelet/pods/0694bf4b-22ee-49ac-8541-0776ee6836be/volumes"
Sep 16 12:37:42.505195 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:42.505157    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:37:43.237024 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:43.236988    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:37:43.862409 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:43.862378    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:37:44.704949 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:44.704914    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:37:46.916432 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:46.916398    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:37:46.978431 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:46.978396    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:37:47.170486 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:47.170390    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp"]
Sep 16 12:37:47.170658 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:47.170627    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp" podUID="1ceb10b8-c5ff-497a-b41d-17895374e950" containerName="istio-proxy" containerID="cri-o://7c6c677b9ec602d9a435f7409edd062a55bde371208c418952f9db07079c6dc6" gracePeriod=30
Sep 16 12:37:47.194166 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:47.194115    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:37:50.971440 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:50.971405    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-3ba9e7-dq28c"]
Sep 16 12:37:50.971816 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:50.971808    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0694bf4b-22ee-49ac-8541-0776ee6836be" containerName="revoke-keys"
Sep 16 12:37:50.971858 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:50.971819    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0694bf4b-22ee-49ac-8541-0776ee6836be" containerName="revoke-keys"
Sep 16 12:37:50.971907 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:50.971897    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="0694bf4b-22ee-49ac-8541-0776ee6836be" containerName="revoke-keys"
Sep 16 12:37:50.975095 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:50.975077    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-3ba9e7-dq28c"
Sep 16 12:37:50.977581 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:50.977563    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hvtv7\""
Sep 16 12:37:50.982785 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:50.982763    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-3ba9e7-dq28c"]
Sep 16 12:37:51.072808 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:51.072770    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/59089220-b176-4418-be32-4089878de781-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-3ba9e7-dq28c\" (UID: \"59089220-b176-4418-be32-4089878de781\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-3ba9e7-dq28c"
Sep 16 12:37:51.173700 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:51.173664    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/59089220-b176-4418-be32-4089878de781-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-3ba9e7-dq28c\" (UID: \"59089220-b176-4418-be32-4089878de781\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-3ba9e7-dq28c"
Sep 16 12:37:51.174405 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:51.174381    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/59089220-b176-4418-be32-4089878de781-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-3ba9e7-dq28c\" (UID: \"59089220-b176-4418-be32-4089878de781\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-3ba9e7-dq28c"
Sep 16 12:37:51.286934 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:51.286842    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-3ba9e7-dq28c"
Sep 16 12:37:51.292960 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:51.292936    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:37:51.563391 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:51.563338    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-3ba9e7-dq28c"]
Sep 16 12:37:51.565652 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:37:51.565619    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59089220_b176_4418_be32_4089878de781.slice/crio-8f3f5ce3879909ba2ab9db05e85004b42c755bb4c2bde0d561ee16ffe8b7200e WatchSource:0}: Error finding container 8f3f5ce3879909ba2ab9db05e85004b42c755bb4c2bde0d561ee16ffe8b7200e: Status 404 returned error can't find the container with id 8f3f5ce3879909ba2ab9db05e85004b42c755bb4c2bde0d561ee16ffe8b7200e
Sep 16 12:37:52.117144 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:52.117043    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-3ba9e7-dq28c" event={"ID":"59089220-b176-4418-be32-4089878de781","Type":"ContainerStarted","Data":"2a94222e48f5737466e4f2cc225be14f401e70412a453b482c2528352fc0bb18"}
Sep 16 12:37:52.117144 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:52.117103    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-3ba9e7-dq28c" event={"ID":"59089220-b176-4418-be32-4089878de781","Type":"ContainerStarted","Data":"8f3f5ce3879909ba2ab9db05e85004b42c755bb4c2bde0d561ee16ffe8b7200e"}
Sep 16 12:37:52.132900 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:52.132815    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:37:52.134817 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:52.134772    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-3ba9e7-dq28c" podStartSLOduration=2.134755582 podStartE2EDuration="2.134755582s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:37:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:37:52.132078875 +0000 UTC m=+2238.752398191" watchObservedRunningTime="2026-09-16 12:37:52.134755582 +0000 UTC m=+2238.755074897"
Sep 16 12:37:52.434563 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:52.434531    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp"
Sep 16 12:37:52.587948 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:52.587920    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ceb10b8-c5ff-497a-b41d-17895374e950-istio-data\") pod \"1ceb10b8-c5ff-497a-b41d-17895374e950\" (UID: \"1ceb10b8-c5ff-497a-b41d-17895374e950\") "
Sep 16 12:37:52.588153 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:52.587965    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ceb10b8-c5ff-497a-b41d-17895374e950-workload-socket\") pod \"1ceb10b8-c5ff-497a-b41d-17895374e950\" (UID: \"1ceb10b8-c5ff-497a-b41d-17895374e950\") "
Sep 16 12:37:52.588153 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:52.587999    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ceb10b8-c5ff-497a-b41d-17895374e950-credential-socket\") pod \"1ceb10b8-c5ff-497a-b41d-17895374e950\" (UID: \"1ceb10b8-c5ff-497a-b41d-17895374e950\") "
Sep 16 12:37:52.588153 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:52.588100    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ceb10b8-c5ff-497a-b41d-17895374e950-istiod-ca-cert\") pod \"1ceb10b8-c5ff-497a-b41d-17895374e950\" (UID: \"1ceb10b8-c5ff-497a-b41d-17895374e950\") "
Sep 16 12:37:52.588303 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:52.588174    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tbjwc\" (UniqueName: \"kubernetes.io/projected/1ceb10b8-c5ff-497a-b41d-17895374e950-kube-api-access-tbjwc\") pod \"1ceb10b8-c5ff-497a-b41d-17895374e950\" (UID: \"1ceb10b8-c5ff-497a-b41d-17895374e950\") "
Sep 16 12:37:52.588303 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:52.588208    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ceb10b8-c5ff-497a-b41d-17895374e950-istio-token\") pod \"1ceb10b8-c5ff-497a-b41d-17895374e950\" (UID: \"1ceb10b8-c5ff-497a-b41d-17895374e950\") "
Sep 16 12:37:52.588303 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:52.588251    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ceb10b8-c5ff-497a-b41d-17895374e950-workload-certs\") pod \"1ceb10b8-c5ff-497a-b41d-17895374e950\" (UID: \"1ceb10b8-c5ff-497a-b41d-17895374e950\") "
Sep 16 12:37:52.588303 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:52.588272    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ceb10b8-c5ff-497a-b41d-17895374e950-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1ceb10b8-c5ff-497a-b41d-17895374e950" (UID: "1ceb10b8-c5ff-497a-b41d-17895374e950"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:37:52.588303 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:52.588293    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ceb10b8-c5ff-497a-b41d-17895374e950-istio-envoy\") pod \"1ceb10b8-c5ff-497a-b41d-17895374e950\" (UID: \"1ceb10b8-c5ff-497a-b41d-17895374e950\") "
Sep 16 12:37:52.588554 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:52.588329    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ceb10b8-c5ff-497a-b41d-17895374e950-istio-podinfo\") pod \"1ceb10b8-c5ff-497a-b41d-17895374e950\" (UID: \"1ceb10b8-c5ff-497a-b41d-17895374e950\") "
Sep 16 12:37:52.588554 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:52.588329    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ceb10b8-c5ff-497a-b41d-17895374e950-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1ceb10b8-c5ff-497a-b41d-17895374e950" (UID: "1ceb10b8-c5ff-497a-b41d-17895374e950"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:37:52.588554 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:52.588272    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ceb10b8-c5ff-497a-b41d-17895374e950-istio-data" (OuterVolumeSpecName: "istio-data") pod "1ceb10b8-c5ff-497a-b41d-17895374e950" (UID: "1ceb10b8-c5ff-497a-b41d-17895374e950"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:37:52.588554 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:52.588493    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ceb10b8-c5ff-497a-b41d-17895374e950-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1ceb10b8-c5ff-497a-b41d-17895374e950" (UID: "1ceb10b8-c5ff-497a-b41d-17895374e950"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:37:52.588554 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:52.588515    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ceb10b8-c5ff-497a-b41d-17895374e950-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1ceb10b8-c5ff-497a-b41d-17895374e950" (UID: "1ceb10b8-c5ff-497a-b41d-17895374e950"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:37:52.588807 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:52.588759    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ceb10b8-c5ff-497a-b41d-17895374e950-istiod-ca-cert\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:37:52.588807 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:52.588780    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ceb10b8-c5ff-497a-b41d-17895374e950-workload-certs\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:37:52.588807 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:52.588793    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ceb10b8-c5ff-497a-b41d-17895374e950-istio-data\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:37:52.588807 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:52.588804    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ceb10b8-c5ff-497a-b41d-17895374e950-workload-socket\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:37:52.589013 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:52.588817    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ceb10b8-c5ff-497a-b41d-17895374e950-credential-socket\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:37:52.590549 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:52.590523    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ceb10b8-c5ff-497a-b41d-17895374e950-istio-token" (OuterVolumeSpecName: "istio-token") pod "1ceb10b8-c5ff-497a-b41d-17895374e950" (UID: "1ceb10b8-c5ff-497a-b41d-17895374e950"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:37:52.590661 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:52.590581    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1ceb10b8-c5ff-497a-b41d-17895374e950-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1ceb10b8-c5ff-497a-b41d-17895374e950" (UID: "1ceb10b8-c5ff-497a-b41d-17895374e950"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 12:37:52.590661 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:52.590637    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ceb10b8-c5ff-497a-b41d-17895374e950-kube-api-access-tbjwc" (OuterVolumeSpecName: "kube-api-access-tbjwc") pod "1ceb10b8-c5ff-497a-b41d-17895374e950" (UID: "1ceb10b8-c5ff-497a-b41d-17895374e950"). InnerVolumeSpecName "kube-api-access-tbjwc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:37:52.590744 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:52.590654    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ceb10b8-c5ff-497a-b41d-17895374e950-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1ceb10b8-c5ff-497a-b41d-17895374e950" (UID: "1ceb10b8-c5ff-497a-b41d-17895374e950"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:37:52.689408 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:52.689335    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tbjwc\" (UniqueName: \"kubernetes.io/projected/1ceb10b8-c5ff-497a-b41d-17895374e950-kube-api-access-tbjwc\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:37:52.689408 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:52.689364    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ceb10b8-c5ff-497a-b41d-17895374e950-istio-token\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:37:52.689408 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:52.689373    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ceb10b8-c5ff-497a-b41d-17895374e950-istio-envoy\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:37:52.689408 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:52.689380    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ceb10b8-c5ff-497a-b41d-17895374e950-istio-podinfo\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:37:52.748476 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:52.748427    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:37:53.124504 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:53.124401    2559 generic.go:356] "Generic (PLEG): container finished" podID="59089220-b176-4418-be32-4089878de781" containerID="2a94222e48f5737466e4f2cc225be14f401e70412a453b482c2528352fc0bb18" exitCode=0
Sep 16 12:37:53.124504 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:53.124456    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-3ba9e7-dq28c" event={"ID":"59089220-b176-4418-be32-4089878de781","Type":"ContainerDied","Data":"2a94222e48f5737466e4f2cc225be14f401e70412a453b482c2528352fc0bb18"}
Sep 16 12:37:53.126467 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:53.126438    2559 generic.go:356] "Generic (PLEG): container finished" podID="1ceb10b8-c5ff-497a-b41d-17895374e950" containerID="7c6c677b9ec602d9a435f7409edd062a55bde371208c418952f9db07079c6dc6" exitCode=0
Sep 16 12:37:53.126596 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:53.126480    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp" event={"ID":"1ceb10b8-c5ff-497a-b41d-17895374e950","Type":"ContainerDied","Data":"7c6c677b9ec602d9a435f7409edd062a55bde371208c418952f9db07079c6dc6"}
Sep 16 12:37:53.126596 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:53.126493    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp"
Sep 16 12:37:53.126596 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:53.126519    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp" event={"ID":"1ceb10b8-c5ff-497a-b41d-17895374e950","Type":"ContainerDied","Data":"2145bb3ed7a1f2e84d2d2a3bb6f7c765d17ee5224aec0d353082b118b4fd9331"}
Sep 16 12:37:53.126596 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:53.126541    2559 scope.go:117] "RemoveContainer" containerID="7c6c677b9ec602d9a435f7409edd062a55bde371208c418952f9db07079c6dc6"
Sep 16 12:37:53.136609 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:53.136591    2559 scope.go:117] "RemoveContainer" containerID="964f357b5c7460c0fee93731786ffdfd7c7aba5f9dcd3c7df0a911bf707ed4f1"
Sep 16 12:37:53.145931 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:53.145882    2559 scope.go:117] "RemoveContainer" containerID="7c6c677b9ec602d9a435f7409edd062a55bde371208c418952f9db07079c6dc6"
Sep 16 12:37:53.146199 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:37:53.146177    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c6c677b9ec602d9a435f7409edd062a55bde371208c418952f9db07079c6dc6\": container with ID starting with 7c6c677b9ec602d9a435f7409edd062a55bde371208c418952f9db07079c6dc6 not found: ID does not exist" containerID="7c6c677b9ec602d9a435f7409edd062a55bde371208c418952f9db07079c6dc6"
Sep 16 12:37:53.146298 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:53.146206    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c6c677b9ec602d9a435f7409edd062a55bde371208c418952f9db07079c6dc6"} err="failed to get container status \"7c6c677b9ec602d9a435f7409edd062a55bde371208c418952f9db07079c6dc6\": rpc error: code = NotFound desc = could not find container \"7c6c677b9ec602d9a435f7409edd062a55bde371208c418952f9db07079c6dc6\": container with ID starting with 7c6c677b9ec602d9a435f7409edd062a55bde371208c418952f9db07079c6dc6 not found: ID does not exist"
Sep 16 12:37:53.146298 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:53.146224    2559 scope.go:117] "RemoveContainer" containerID="964f357b5c7460c0fee93731786ffdfd7c7aba5f9dcd3c7df0a911bf707ed4f1"
Sep 16 12:37:53.146485 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:37:53.146469    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"964f357b5c7460c0fee93731786ffdfd7c7aba5f9dcd3c7df0a911bf707ed4f1\": container with ID starting with 964f357b5c7460c0fee93731786ffdfd7c7aba5f9dcd3c7df0a911bf707ed4f1 not found: ID does not exist" containerID="964f357b5c7460c0fee93731786ffdfd7c7aba5f9dcd3c7df0a911bf707ed4f1"
Sep 16 12:37:53.146539 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:53.146489    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"964f357b5c7460c0fee93731786ffdfd7c7aba5f9dcd3c7df0a911bf707ed4f1"} err="failed to get container status \"964f357b5c7460c0fee93731786ffdfd7c7aba5f9dcd3c7df0a911bf707ed4f1\": rpc error: code = NotFound desc = could not find container \"964f357b5c7460c0fee93731786ffdfd7c7aba5f9dcd3c7df0a911bf707ed4f1\": container with ID starting with 964f357b5c7460c0fee93731786ffdfd7c7aba5f9dcd3c7df0a911bf707ed4f1 not found: ID does not exist"
Sep 16 12:37:53.152794 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:53.152772    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp"]
Sep 16 12:37:53.158406 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:53.158381    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-6b0cae-openshift-default-556df948b-l6jnp"]
Sep 16 12:37:53.512292 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:53.512260    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:37:53.938612 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:53.938581    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ceb10b8-c5ff-497a-b41d-17895374e950" path="/var/lib/kubelet/pods/1ceb10b8-c5ff-497a-b41d-17895374e950/volumes"
Sep 16 12:37:54.226185 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:54.226090    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:37:54.266453 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:54.266431    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-3ba9e7-dq28c"
Sep 16 12:37:54.405378 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:54.405345    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/59089220-b176-4418-be32-4089878de781-maas-api-service-ca\") pod \"59089220-b176-4418-be32-4089878de781\" (UID: \"59089220-b176-4418-be32-4089878de781\") "
Sep 16 12:37:54.405721 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:54.405693    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59089220-b176-4418-be32-4089878de781-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "59089220-b176-4418-be32-4089878de781" (UID: "59089220-b176-4418-be32-4089878de781"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:37:54.506708 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:54.506625    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/59089220-b176-4418-be32-4089878de781-maas-api-service-ca\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:37:54.883918 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:54.883822    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:37:55.140112 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:55.140025    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-3ba9e7-dq28c" event={"ID":"59089220-b176-4418-be32-4089878de781","Type":"ContainerDied","Data":"8f3f5ce3879909ba2ab9db05e85004b42c755bb4c2bde0d561ee16ffe8b7200e"}
Sep 16 12:37:55.140112 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:55.140059    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-3ba9e7-dq28c"
Sep 16 12:37:55.140112 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:55.140075    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8f3f5ce3879909ba2ab9db05e85004b42c755bb4c2bde0d561ee16ffe8b7200e"
Sep 16 12:37:59.202150 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:59.202059    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:37:59.302572 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:37:59.302539    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:38:03.909702 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:38:03.909670    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:38:06.411530 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:38:06.411491    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:38:06.482928 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:38:06.482894    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:38:06.542442 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:38:06.542399    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:38:06.596328 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:38:06.596283    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-3ba9e7-dq28c"]
Sep 16 12:38:06.601428 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:38:06.601397    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-3ba9e7-dq28c"]
Sep 16 12:38:06.605717 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:38:06.605689    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:38:06.669022 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:38:06.668931    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:38:06.977575 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:38:06.977483    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:38:07.078447 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:38:07.078414    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:38:07.731611 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:38:07.731570    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:38:07.938810 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:38:07.938773    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59089220-b176-4418-be32-4089878de781" path="/var/lib/kubelet/pods/59089220-b176-4418-be32-4089878de781/volumes"
Sep 16 12:38:08.419974 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:38:08.419938    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:38:08.588853 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:38:08.588821    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:38:08.691300 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:38:08.691208    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:38:09.054373 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:38:09.054285    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:38:12.021977 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:38:12.021944    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:38:17.009048 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:38:17.009018    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:38:34.396596 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:38:34.396565    2559 scope.go:117] "RemoveContainer" containerID="60295a1be70257dccebbaaa7b756df4d762c26fa7eb7ed196e5738a96477697b"
Sep 16 12:38:48.598417 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:38:48.598380    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:38:49.139726 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:38:49.139687    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:38:54.723883 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:38:54.723844    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:38:54.826733 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:38:54.826697    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:38:54.969512 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:38:54.969473    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j"]
Sep 16 12:38:54.969880 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:38:54.969774    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j" podUID="215357ee-56b2-47f2-a2e0-7ef1d1a27092" containerName="istio-proxy" containerID="cri-o://30570484e721eb88e8fd927dd83eae4a6b9988a28710b5111dd6f1c1026355f3" gracePeriod=30
Sep 16 12:38:54.988224 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:38:54.988123    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:38:55.342024 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:38:55.341931    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-43ef83-rnm8f"]
Sep 16 12:38:55.342500 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:38:55.342481    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ceb10b8-c5ff-497a-b41d-17895374e950" containerName="istio-proxy"
Sep 16 12:38:55.342599 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:38:55.342502    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ceb10b8-c5ff-497a-b41d-17895374e950" containerName="istio-proxy"
Sep 16 12:38:55.342599 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:38:55.342518    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ceb10b8-c5ff-497a-b41d-17895374e950" containerName="istio-proxy"
Sep 16 12:38:55.342599 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:38:55.342526    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ceb10b8-c5ff-497a-b41d-17895374e950" containerName="istio-proxy"
Sep 16 12:38:55.342599 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:38:55.342537    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59089220-b176-4418-be32-4089878de781" containerName="revoke-keys"
Sep 16 12:38:55.342599 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:38:55.342545    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="59089220-b176-4418-be32-4089878de781" containerName="revoke-keys"
Sep 16 12:38:55.342873 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:38:55.342686    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ceb10b8-c5ff-497a-b41d-17895374e950" containerName="istio-proxy"
Sep 16 12:38:55.342873 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:38:55.342701    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="59089220-b176-4418-be32-4089878de781" containerName="revoke-keys"
Sep 16 12:38:55.345797 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:38:55.345775    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-43ef83-rnm8f"
Sep 16 12:38:55.348328 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:38:55.348309    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hvtv7\""
Sep 16 12:38:55.352080 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:38:55.352056    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-43ef83-rnm8f"]
Sep 16 12:38:55.392468 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:38:55.392435    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ed740ac-c7a7-45f7-80c8-5faa1702c69c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-43ef83-rnm8f\" (UID: \"2ed740ac-c7a7-45f7-80c8-5faa1702c69c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-43ef83-rnm8f"
Sep 16 12:38:55.493922 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:38:55.493887    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ed740ac-c7a7-45f7-80c8-5faa1702c69c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-43ef83-rnm8f\" (UID: \"2ed740ac-c7a7-45f7-80c8-5faa1702c69c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-43ef83-rnm8f"
Sep 16 12:38:55.494554 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:38:55.494527    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ed740ac-c7a7-45f7-80c8-5faa1702c69c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-43ef83-rnm8f\" (UID: \"2ed740ac-c7a7-45f7-80c8-5faa1702c69c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-43ef83-rnm8f"
Sep 16 12:38:55.522103 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:38:55.522070    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:38:55.661197 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:38:55.661168    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-43ef83-rnm8f"
Sep 16 12:38:55.937154 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:38:55.937113    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ed740ac_c7a7_45f7_80c8_5faa1702c69c.slice/crio-26f1d14a3ef3c0f82deb9a2b460fa03f824c86e6ac2706aeedc2b9f8cecce8df WatchSource:0}: Error finding container 26f1d14a3ef3c0f82deb9a2b460fa03f824c86e6ac2706aeedc2b9f8cecce8df: Status 404 returned error can't find the container with id 26f1d14a3ef3c0f82deb9a2b460fa03f824c86e6ac2706aeedc2b9f8cecce8df
Sep 16 12:38:55.940893 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:38:55.940872    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-43ef83-rnm8f"]
Sep 16 12:38:56.221811 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:38:56.221705    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:38:56.461339 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:38:56.461300    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-43ef83-rnm8f" event={"ID":"2ed740ac-c7a7-45f7-80c8-5faa1702c69c","Type":"ContainerStarted","Data":"4b59f5fb068a439d1a551977d864fd11f83c009a48960ecf1d0ab24a91d76b4d"}
Sep 16 12:38:56.461509 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:38:56.461366    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-43ef83-rnm8f" event={"ID":"2ed740ac-c7a7-45f7-80c8-5faa1702c69c","Type":"ContainerStarted","Data":"26f1d14a3ef3c0f82deb9a2b460fa03f824c86e6ac2706aeedc2b9f8cecce8df"}
Sep 16 12:38:56.477795 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:38:56.477688    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-43ef83-rnm8f" podStartSLOduration=1.477671822 podStartE2EDuration="1.477671822s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:38:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:38:56.476243535 +0000 UTC m=+2303.096562864" watchObservedRunningTime="2026-09-16 12:38:56.477671822 +0000 UTC m=+2303.097991154"
Sep 16 12:38:56.933907 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:38:56.933878    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:38:57.468275 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:38:57.468240    2559 generic.go:356] "Generic (PLEG): container finished" podID="2ed740ac-c7a7-45f7-80c8-5faa1702c69c" containerID="4b59f5fb068a439d1a551977d864fd11f83c009a48960ecf1d0ab24a91d76b4d" exitCode=0
Sep 16 12:38:57.468658 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:38:57.468333    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-43ef83-rnm8f" event={"ID":"2ed740ac-c7a7-45f7-80c8-5faa1702c69c","Type":"ContainerDied","Data":"4b59f5fb068a439d1a551977d864fd11f83c009a48960ecf1d0ab24a91d76b4d"}
Sep 16 12:38:57.612148 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:38:57.612104    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:38:58.233512 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:38:58.233478    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:38:58.614848 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:38:58.614825    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-43ef83-rnm8f"
Sep 16 12:38:58.728944 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:38:58.728910    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ed740ac-c7a7-45f7-80c8-5faa1702c69c-maas-api-service-ca\") pod \"2ed740ac-c7a7-45f7-80c8-5faa1702c69c\" (UID: \"2ed740ac-c7a7-45f7-80c8-5faa1702c69c\") "
Sep 16 12:38:58.729325 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:38:58.729301    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ed740ac-c7a7-45f7-80c8-5faa1702c69c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2ed740ac-c7a7-45f7-80c8-5faa1702c69c" (UID: "2ed740ac-c7a7-45f7-80c8-5faa1702c69c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:38:58.830046 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:38:58.829957    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ed740ac-c7a7-45f7-80c8-5faa1702c69c-maas-api-service-ca\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:38:59.479901 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:38:59.479865    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-43ef83-rnm8f"
Sep 16 12:38:59.480084 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:38:59.479939    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-43ef83-rnm8f" event={"ID":"2ed740ac-c7a7-45f7-80c8-5faa1702c69c","Type":"ContainerDied","Data":"26f1d14a3ef3c0f82deb9a2b460fa03f824c86e6ac2706aeedc2b9f8cecce8df"}
Sep 16 12:38:59.480084 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:38:59.480012    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="26f1d14a3ef3c0f82deb9a2b460fa03f824c86e6ac2706aeedc2b9f8cecce8df"
Sep 16 12:39:00.220177 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:00.220153    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j"
Sep 16 12:39:00.347093 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:00.347010    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/215357ee-56b2-47f2-a2e0-7ef1d1a27092-istiod-ca-cert\") pod \"215357ee-56b2-47f2-a2e0-7ef1d1a27092\" (UID: \"215357ee-56b2-47f2-a2e0-7ef1d1a27092\") "
Sep 16 12:39:00.347093 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:00.347061    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/215357ee-56b2-47f2-a2e0-7ef1d1a27092-istio-envoy\") pod \"215357ee-56b2-47f2-a2e0-7ef1d1a27092\" (UID: \"215357ee-56b2-47f2-a2e0-7ef1d1a27092\") "
Sep 16 12:39:00.347313 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:00.347103    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/215357ee-56b2-47f2-a2e0-7ef1d1a27092-istio-token\") pod \"215357ee-56b2-47f2-a2e0-7ef1d1a27092\" (UID: \"215357ee-56b2-47f2-a2e0-7ef1d1a27092\") "
Sep 16 12:39:00.347313 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:00.347205    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/215357ee-56b2-47f2-a2e0-7ef1d1a27092-workload-certs\") pod \"215357ee-56b2-47f2-a2e0-7ef1d1a27092\" (UID: \"215357ee-56b2-47f2-a2e0-7ef1d1a27092\") "
Sep 16 12:39:00.347313 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:00.347253    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-frvqf\" (UniqueName: \"kubernetes.io/projected/215357ee-56b2-47f2-a2e0-7ef1d1a27092-kube-api-access-frvqf\") pod \"215357ee-56b2-47f2-a2e0-7ef1d1a27092\" (UID: \"215357ee-56b2-47f2-a2e0-7ef1d1a27092\") "
Sep 16 12:39:00.347313 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:00.347289    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/215357ee-56b2-47f2-a2e0-7ef1d1a27092-workload-socket\") pod \"215357ee-56b2-47f2-a2e0-7ef1d1a27092\" (UID: \"215357ee-56b2-47f2-a2e0-7ef1d1a27092\") "
Sep 16 12:39:00.347527 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:00.347354    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/215357ee-56b2-47f2-a2e0-7ef1d1a27092-credential-socket\") pod \"215357ee-56b2-47f2-a2e0-7ef1d1a27092\" (UID: \"215357ee-56b2-47f2-a2e0-7ef1d1a27092\") "
Sep 16 12:39:00.347527 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:00.347382    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/215357ee-56b2-47f2-a2e0-7ef1d1a27092-istio-podinfo\") pod \"215357ee-56b2-47f2-a2e0-7ef1d1a27092\" (UID: \"215357ee-56b2-47f2-a2e0-7ef1d1a27092\") "
Sep 16 12:39:00.347527 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:00.347465    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/215357ee-56b2-47f2-a2e0-7ef1d1a27092-istio-data\") pod \"215357ee-56b2-47f2-a2e0-7ef1d1a27092\" (UID: \"215357ee-56b2-47f2-a2e0-7ef1d1a27092\") "
Sep 16 12:39:00.347527 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:00.347511    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/215357ee-56b2-47f2-a2e0-7ef1d1a27092-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "215357ee-56b2-47f2-a2e0-7ef1d1a27092" (UID: "215357ee-56b2-47f2-a2e0-7ef1d1a27092"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:39:00.347728 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:00.347693    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/215357ee-56b2-47f2-a2e0-7ef1d1a27092-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "215357ee-56b2-47f2-a2e0-7ef1d1a27092" (UID: "215357ee-56b2-47f2-a2e0-7ef1d1a27092"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:39:00.347981 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:00.347872    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/215357ee-56b2-47f2-a2e0-7ef1d1a27092-workload-certs\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:39:00.347981 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:00.347894    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/215357ee-56b2-47f2-a2e0-7ef1d1a27092-credential-socket\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:39:00.347981 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:00.347949    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/215357ee-56b2-47f2-a2e0-7ef1d1a27092-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "215357ee-56b2-47f2-a2e0-7ef1d1a27092" (UID: "215357ee-56b2-47f2-a2e0-7ef1d1a27092"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:39:00.347981 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:00.347972    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/215357ee-56b2-47f2-a2e0-7ef1d1a27092-istio-data" (OuterVolumeSpecName: "istio-data") pod "215357ee-56b2-47f2-a2e0-7ef1d1a27092" (UID: "215357ee-56b2-47f2-a2e0-7ef1d1a27092"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:39:00.348295 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:00.347960    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/215357ee-56b2-47f2-a2e0-7ef1d1a27092-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "215357ee-56b2-47f2-a2e0-7ef1d1a27092" (UID: "215357ee-56b2-47f2-a2e0-7ef1d1a27092"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:39:00.349353 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:00.349331    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/215357ee-56b2-47f2-a2e0-7ef1d1a27092-istio-token" (OuterVolumeSpecName: "istio-token") pod "215357ee-56b2-47f2-a2e0-7ef1d1a27092" (UID: "215357ee-56b2-47f2-a2e0-7ef1d1a27092"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:39:00.349741 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:00.349720    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/215357ee-56b2-47f2-a2e0-7ef1d1a27092-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "215357ee-56b2-47f2-a2e0-7ef1d1a27092" (UID: "215357ee-56b2-47f2-a2e0-7ef1d1a27092"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 12:39:00.349854 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:00.349792    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/215357ee-56b2-47f2-a2e0-7ef1d1a27092-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "215357ee-56b2-47f2-a2e0-7ef1d1a27092" (UID: "215357ee-56b2-47f2-a2e0-7ef1d1a27092"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:39:00.349951 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:00.349931    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/215357ee-56b2-47f2-a2e0-7ef1d1a27092-kube-api-access-frvqf" (OuterVolumeSpecName: "kube-api-access-frvqf") pod "215357ee-56b2-47f2-a2e0-7ef1d1a27092" (UID: "215357ee-56b2-47f2-a2e0-7ef1d1a27092"). InnerVolumeSpecName "kube-api-access-frvqf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:39:00.448898 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:00.448866    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/215357ee-56b2-47f2-a2e0-7ef1d1a27092-istio-podinfo\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:39:00.448898 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:00.448893    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/215357ee-56b2-47f2-a2e0-7ef1d1a27092-istio-data\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:39:00.448898 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:00.448902    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/215357ee-56b2-47f2-a2e0-7ef1d1a27092-istiod-ca-cert\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:39:00.449115 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:00.448909    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/215357ee-56b2-47f2-a2e0-7ef1d1a27092-istio-envoy\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:39:00.449115 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:00.448918    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/215357ee-56b2-47f2-a2e0-7ef1d1a27092-istio-token\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:39:00.449115 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:00.448925    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-frvqf\" (UniqueName: \"kubernetes.io/projected/215357ee-56b2-47f2-a2e0-7ef1d1a27092-kube-api-access-frvqf\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:39:00.449115 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:00.448934    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/215357ee-56b2-47f2-a2e0-7ef1d1a27092-workload-socket\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:39:00.487676 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:00.487630    2559 generic.go:356] "Generic (PLEG): container finished" podID="215357ee-56b2-47f2-a2e0-7ef1d1a27092" containerID="30570484e721eb88e8fd927dd83eae4a6b9988a28710b5111dd6f1c1026355f3" exitCode=0
Sep 16 12:39:00.487828 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:00.487680    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j"
Sep 16 12:39:00.487828 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:00.487716    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j" event={"ID":"215357ee-56b2-47f2-a2e0-7ef1d1a27092","Type":"ContainerDied","Data":"30570484e721eb88e8fd927dd83eae4a6b9988a28710b5111dd6f1c1026355f3"}
Sep 16 12:39:00.487828 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:00.487768    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j" event={"ID":"215357ee-56b2-47f2-a2e0-7ef1d1a27092","Type":"ContainerDied","Data":"c7d43c2906adfc159f1aa56a4cc6d73d4158d3c31eba7f45a1e72d11109d4917"}
Sep 16 12:39:00.487828 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:00.487796    2559 scope.go:117] "RemoveContainer" containerID="30570484e721eb88e8fd927dd83eae4a6b9988a28710b5111dd6f1c1026355f3"
Sep 16 12:39:00.498071 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:00.498051    2559 scope.go:117] "RemoveContainer" containerID="88c06b4b9a0ddcdbe426cf8d1a7417ce1f545a7a3b8b57aabf26ef48265c11c5"
Sep 16 12:39:00.506114 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:00.506098    2559 scope.go:117] "RemoveContainer" containerID="30570484e721eb88e8fd927dd83eae4a6b9988a28710b5111dd6f1c1026355f3"
Sep 16 12:39:00.506415 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:39:00.506398    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30570484e721eb88e8fd927dd83eae4a6b9988a28710b5111dd6f1c1026355f3\": container with ID starting with 30570484e721eb88e8fd927dd83eae4a6b9988a28710b5111dd6f1c1026355f3 not found: ID does not exist" containerID="30570484e721eb88e8fd927dd83eae4a6b9988a28710b5111dd6f1c1026355f3"
Sep 16 12:39:00.506470 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:00.506422    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30570484e721eb88e8fd927dd83eae4a6b9988a28710b5111dd6f1c1026355f3"} err="failed to get container status \"30570484e721eb88e8fd927dd83eae4a6b9988a28710b5111dd6f1c1026355f3\": rpc error: code = NotFound desc = could not find container \"30570484e721eb88e8fd927dd83eae4a6b9988a28710b5111dd6f1c1026355f3\": container with ID starting with 30570484e721eb88e8fd927dd83eae4a6b9988a28710b5111dd6f1c1026355f3 not found: ID does not exist"
Sep 16 12:39:00.506470 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:00.506438    2559 scope.go:117] "RemoveContainer" containerID="88c06b4b9a0ddcdbe426cf8d1a7417ce1f545a7a3b8b57aabf26ef48265c11c5"
Sep 16 12:39:00.506640 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:39:00.506626    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88c06b4b9a0ddcdbe426cf8d1a7417ce1f545a7a3b8b57aabf26ef48265c11c5\": container with ID starting with 88c06b4b9a0ddcdbe426cf8d1a7417ce1f545a7a3b8b57aabf26ef48265c11c5 not found: ID does not exist" containerID="88c06b4b9a0ddcdbe426cf8d1a7417ce1f545a7a3b8b57aabf26ef48265c11c5"
Sep 16 12:39:00.506686 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:00.506641    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88c06b4b9a0ddcdbe426cf8d1a7417ce1f545a7a3b8b57aabf26ef48265c11c5"} err="failed to get container status \"88c06b4b9a0ddcdbe426cf8d1a7417ce1f545a7a3b8b57aabf26ef48265c11c5\": rpc error: code = NotFound desc = could not find container \"88c06b4b9a0ddcdbe426cf8d1a7417ce1f545a7a3b8b57aabf26ef48265c11c5\": container with ID starting with 88c06b4b9a0ddcdbe426cf8d1a7417ce1f545a7a3b8b57aabf26ef48265c11c5 not found: ID does not exist"
Sep 16 12:39:00.511630 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:00.511602    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j"]
Sep 16 12:39:00.513609 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:00.513589    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-3ba9e7-openshift-default-5c8d6cbdbd-k484j"]
Sep 16 12:39:01.938656 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:01.938623    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="215357ee-56b2-47f2-a2e0-7ef1d1a27092" path="/var/lib/kubelet/pods/215357ee-56b2-47f2-a2e0-7ef1d1a27092/volumes"
Sep 16 12:39:05.816927 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:05.816863    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:39:05.892259 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:05.892228    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:39:05.955588 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:05.955551    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:39:06.008449 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:06.008397    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-43ef83-rnm8f"]
Sep 16 12:39:06.010168 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:06.010148    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-43ef83-rnm8f"]
Sep 16 12:39:06.015892 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:06.015863    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:39:06.080643 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:06.080565    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:39:06.397421 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:06.397337    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:39:06.498224 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:06.498195    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:39:07.064486 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:07.064449    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:39:07.932662 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:07.932628    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:39:07.938629 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:07.938599    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ed740ac-c7a7-45f7-80c8-5faa1702c69c" path="/var/lib/kubelet/pods/2ed740ac-c7a7-45f7-80c8-5faa1702c69c/volumes"
Sep 16 12:39:09.105295 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:09.105265    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:39:12.281364 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:12.281325    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:39:12.381299 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:12.381268    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:39:12.537043 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:12.536962    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w"]
Sep 16 12:39:12.537246 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:12.537217    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w" podUID="684f4bb5-2617-4db2-9955-cf5bda082db8" containerName="istio-proxy" containerID="cri-o://b611a9bcee3467b53aa10cc3d52fd0f7d442678e20f2acabb767ad5f5892ff89" gracePeriod=30
Sep 16 12:39:12.561393 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:12.561360    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:39:12.922503 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:12.922465    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-72eee5-wpmnv"]
Sep 16 12:39:12.923172 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:12.923151    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ed740ac-c7a7-45f7-80c8-5faa1702c69c" containerName="revoke-keys"
Sep 16 12:39:12.923172 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:12.923172    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ed740ac-c7a7-45f7-80c8-5faa1702c69c" containerName="revoke-keys"
Sep 16 12:39:12.923293 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:12.923186    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="215357ee-56b2-47f2-a2e0-7ef1d1a27092" containerName="istio-proxy"
Sep 16 12:39:12.923293 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:12.923192    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="215357ee-56b2-47f2-a2e0-7ef1d1a27092" containerName="istio-proxy"
Sep 16 12:39:12.923293 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:12.923208    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="215357ee-56b2-47f2-a2e0-7ef1d1a27092" containerName="istio-proxy"
Sep 16 12:39:12.923293 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:12.923213    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="215357ee-56b2-47f2-a2e0-7ef1d1a27092" containerName="istio-proxy"
Sep 16 12:39:12.923293 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:12.923283    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="215357ee-56b2-47f2-a2e0-7ef1d1a27092" containerName="istio-proxy"
Sep 16 12:39:12.923293 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:12.923290    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ed740ac-c7a7-45f7-80c8-5faa1702c69c" containerName="revoke-keys"
Sep 16 12:39:12.923476 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:12.923298    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ceb10b8-c5ff-497a-b41d-17895374e950" containerName="istio-proxy"
Sep 16 12:39:12.926480 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:12.926465    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-72eee5-wpmnv"
Sep 16 12:39:12.929061 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:12.929032    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hvtv7\""
Sep 16 12:39:12.932170 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:12.932124    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-72eee5-wpmnv"]
Sep 16 12:39:13.040187 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:13.040150    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:39:13.071365 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:13.071335    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e5b2a7c-0228-4d78-8fcd-d4a8a24e6a8d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-72eee5-wpmnv\" (UID: \"5e5b2a7c-0228-4d78-8fcd-d4a8a24e6a8d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-72eee5-wpmnv"
Sep 16 12:39:13.172941 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:13.172850    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e5b2a7c-0228-4d78-8fcd-d4a8a24e6a8d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-72eee5-wpmnv\" (UID: \"5e5b2a7c-0228-4d78-8fcd-d4a8a24e6a8d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-72eee5-wpmnv"
Sep 16 12:39:13.173488 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:13.173467    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e5b2a7c-0228-4d78-8fcd-d4a8a24e6a8d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-72eee5-wpmnv\" (UID: \"5e5b2a7c-0228-4d78-8fcd-d4a8a24e6a8d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-72eee5-wpmnv"
Sep 16 12:39:13.239360 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:13.239330    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-72eee5-wpmnv"
Sep 16 12:39:13.512330 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:13.512238    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-72eee5-wpmnv"]
Sep 16 12:39:13.516116 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:39:13.516085    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e5b2a7c_0228_4d78_8fcd_d4a8a24e6a8d.slice/crio-f64c46b7ec821838ffaa9b3b5492065687ac9ba62763414b1b4b26611ff93f55 WatchSource:0}: Error finding container f64c46b7ec821838ffaa9b3b5492065687ac9ba62763414b1b4b26611ff93f55: Status 404 returned error can't find the container with id f64c46b7ec821838ffaa9b3b5492065687ac9ba62763414b1b4b26611ff93f55
Sep 16 12:39:13.559265 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:13.559238    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-72eee5-wpmnv" event={"ID":"5e5b2a7c-0228-4d78-8fcd-d4a8a24e6a8d","Type":"ContainerStarted","Data":"f64c46b7ec821838ffaa9b3b5492065687ac9ba62763414b1b4b26611ff93f55"}
Sep 16 12:39:13.801679 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:13.801597    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:39:14.528686 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:14.528593    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:39:14.565833 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:14.565804    2559 generic.go:356] "Generic (PLEG): container finished" podID="5e5b2a7c-0228-4d78-8fcd-d4a8a24e6a8d" containerID="2189e360a1b4d93208a87bb7b060b65c0365122ee7bff8c5e265091d8df39734" exitCode=0
Sep 16 12:39:14.566024 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:14.565889    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-72eee5-wpmnv" event={"ID":"5e5b2a7c-0228-4d78-8fcd-d4a8a24e6a8d","Type":"ContainerDied","Data":"2189e360a1b4d93208a87bb7b060b65c0365122ee7bff8c5e265091d8df39734"}
Sep 16 12:39:15.180400 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:15.180357    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:39:15.703988 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:15.703966    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-72eee5-wpmnv"
Sep 16 12:39:15.802506 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:15.802480    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e5b2a7c-0228-4d78-8fcd-d4a8a24e6a8d-maas-api-service-ca\") pod \"5e5b2a7c-0228-4d78-8fcd-d4a8a24e6a8d\" (UID: \"5e5b2a7c-0228-4d78-8fcd-d4a8a24e6a8d\") "
Sep 16 12:39:15.802834 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:15.802813    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e5b2a7c-0228-4d78-8fcd-d4a8a24e6a8d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5e5b2a7c-0228-4d78-8fcd-d4a8a24e6a8d" (UID: "5e5b2a7c-0228-4d78-8fcd-d4a8a24e6a8d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:39:15.903404 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:15.903375    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e5b2a7c-0228-4d78-8fcd-d4a8a24e6a8d-maas-api-service-ca\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:39:16.577553 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:16.577519    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-72eee5-wpmnv"
Sep 16 12:39:16.577728 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:16.577551    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-72eee5-wpmnv" event={"ID":"5e5b2a7c-0228-4d78-8fcd-d4a8a24e6a8d","Type":"ContainerDied","Data":"f64c46b7ec821838ffaa9b3b5492065687ac9ba62763414b1b4b26611ff93f55"}
Sep 16 12:39:16.577728 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:16.577621    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f64c46b7ec821838ffaa9b3b5492065687ac9ba62763414b1b4b26611ff93f55"
Sep 16 12:39:17.806117 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:17.806054    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w"
Sep 16 12:39:17.820779 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:17.820749    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/684f4bb5-2617-4db2-9955-cf5bda082db8-workload-socket\") pod \"684f4bb5-2617-4db2-9955-cf5bda082db8\" (UID: \"684f4bb5-2617-4db2-9955-cf5bda082db8\") "
Sep 16 12:39:17.820907 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:17.820803    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/684f4bb5-2617-4db2-9955-cf5bda082db8-istio-envoy\") pod \"684f4bb5-2617-4db2-9955-cf5bda082db8\" (UID: \"684f4bb5-2617-4db2-9955-cf5bda082db8\") "
Sep 16 12:39:17.820907 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:17.820828    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/684f4bb5-2617-4db2-9955-cf5bda082db8-istio-token\") pod \"684f4bb5-2617-4db2-9955-cf5bda082db8\" (UID: \"684f4bb5-2617-4db2-9955-cf5bda082db8\") "
Sep 16 12:39:17.820907 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:17.820862    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/684f4bb5-2617-4db2-9955-cf5bda082db8-istio-podinfo\") pod \"684f4bb5-2617-4db2-9955-cf5bda082db8\" (UID: \"684f4bb5-2617-4db2-9955-cf5bda082db8\") "
Sep 16 12:39:17.821074 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:17.820911    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/684f4bb5-2617-4db2-9955-cf5bda082db8-workload-certs\") pod \"684f4bb5-2617-4db2-9955-cf5bda082db8\" (UID: \"684f4bb5-2617-4db2-9955-cf5bda082db8\") "
Sep 16 12:39:17.821074 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:17.820939    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/684f4bb5-2617-4db2-9955-cf5bda082db8-istio-data\") pod \"684f4bb5-2617-4db2-9955-cf5bda082db8\" (UID: \"684f4bb5-2617-4db2-9955-cf5bda082db8\") "
Sep 16 12:39:17.821074 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:17.820973    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/684f4bb5-2617-4db2-9955-cf5bda082db8-credential-socket\") pod \"684f4bb5-2617-4db2-9955-cf5bda082db8\" (UID: \"684f4bb5-2617-4db2-9955-cf5bda082db8\") "
Sep 16 12:39:17.821074 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:17.821044    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/684f4bb5-2617-4db2-9955-cf5bda082db8-istiod-ca-cert\") pod \"684f4bb5-2617-4db2-9955-cf5bda082db8\" (UID: \"684f4bb5-2617-4db2-9955-cf5bda082db8\") "
Sep 16 12:39:17.821074 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:17.821070    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zrxg8\" (UniqueName: \"kubernetes.io/projected/684f4bb5-2617-4db2-9955-cf5bda082db8-kube-api-access-zrxg8\") pod \"684f4bb5-2617-4db2-9955-cf5bda082db8\" (UID: \"684f4bb5-2617-4db2-9955-cf5bda082db8\") "
Sep 16 12:39:17.821368 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:17.821072    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/684f4bb5-2617-4db2-9955-cf5bda082db8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "684f4bb5-2617-4db2-9955-cf5bda082db8" (UID: "684f4bb5-2617-4db2-9955-cf5bda082db8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:39:17.821368 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:17.821222    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/684f4bb5-2617-4db2-9955-cf5bda082db8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "684f4bb5-2617-4db2-9955-cf5bda082db8" (UID: "684f4bb5-2617-4db2-9955-cf5bda082db8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:39:17.821368 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:17.821338    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/684f4bb5-2617-4db2-9955-cf5bda082db8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "684f4bb5-2617-4db2-9955-cf5bda082db8" (UID: "684f4bb5-2617-4db2-9955-cf5bda082db8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:39:17.821523 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:17.821480    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/684f4bb5-2617-4db2-9955-cf5bda082db8-workload-certs\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:39:17.821523 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:17.821508    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/684f4bb5-2617-4db2-9955-cf5bda082db8-credential-socket\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:39:17.821612 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:17.821522    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/684f4bb5-2617-4db2-9955-cf5bda082db8-workload-socket\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:39:17.821612 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:17.821472    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/684f4bb5-2617-4db2-9955-cf5bda082db8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "684f4bb5-2617-4db2-9955-cf5bda082db8" (UID: "684f4bb5-2617-4db2-9955-cf5bda082db8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:39:17.821672 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:17.821639    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/684f4bb5-2617-4db2-9955-cf5bda082db8-istio-data" (OuterVolumeSpecName: "istio-data") pod "684f4bb5-2617-4db2-9955-cf5bda082db8" (UID: "684f4bb5-2617-4db2-9955-cf5bda082db8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:39:17.823022 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:17.822999    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/684f4bb5-2617-4db2-9955-cf5bda082db8-istio-token" (OuterVolumeSpecName: "istio-token") pod "684f4bb5-2617-4db2-9955-cf5bda082db8" (UID: "684f4bb5-2617-4db2-9955-cf5bda082db8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:39:17.823169 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:17.823115    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/684f4bb5-2617-4db2-9955-cf5bda082db8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "684f4bb5-2617-4db2-9955-cf5bda082db8" (UID: "684f4bb5-2617-4db2-9955-cf5bda082db8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 12:39:17.823328 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:17.823306    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/684f4bb5-2617-4db2-9955-cf5bda082db8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "684f4bb5-2617-4db2-9955-cf5bda082db8" (UID: "684f4bb5-2617-4db2-9955-cf5bda082db8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:39:17.823471 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:17.823454    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/684f4bb5-2617-4db2-9955-cf5bda082db8-kube-api-access-zrxg8" (OuterVolumeSpecName: "kube-api-access-zrxg8") pod "684f4bb5-2617-4db2-9955-cf5bda082db8" (UID: "684f4bb5-2617-4db2-9955-cf5bda082db8"). InnerVolumeSpecName "kube-api-access-zrxg8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:39:17.922571 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:17.922534    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/684f4bb5-2617-4db2-9955-cf5bda082db8-istio-data\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:39:17.922571 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:17.922563    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/684f4bb5-2617-4db2-9955-cf5bda082db8-istiod-ca-cert\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:39:17.922571 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:17.922572    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zrxg8\" (UniqueName: \"kubernetes.io/projected/684f4bb5-2617-4db2-9955-cf5bda082db8-kube-api-access-zrxg8\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:39:17.922571 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:17.922582    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/684f4bb5-2617-4db2-9955-cf5bda082db8-istio-envoy\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:39:17.922841 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:17.922590    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/684f4bb5-2617-4db2-9955-cf5bda082db8-istio-token\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:39:17.922841 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:17.922598    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/684f4bb5-2617-4db2-9955-cf5bda082db8-istio-podinfo\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:39:18.590565 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:18.590528    2559 generic.go:356] "Generic (PLEG): container finished" podID="684f4bb5-2617-4db2-9955-cf5bda082db8" containerID="b611a9bcee3467b53aa10cc3d52fd0f7d442678e20f2acabb767ad5f5892ff89" exitCode=0
Sep 16 12:39:18.590736 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:18.590571    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w"
Sep 16 12:39:18.590736 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:18.590579    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w" event={"ID":"684f4bb5-2617-4db2-9955-cf5bda082db8","Type":"ContainerDied","Data":"b611a9bcee3467b53aa10cc3d52fd0f7d442678e20f2acabb767ad5f5892ff89"}
Sep 16 12:39:18.590736 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:18.590627    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w" event={"ID":"684f4bb5-2617-4db2-9955-cf5bda082db8","Type":"ContainerDied","Data":"364aae29d0bd346fa3ba9c9262102cf97b6e25f2513c011c04679935227df094"}
Sep 16 12:39:18.590736 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:18.590649    2559 scope.go:117] "RemoveContainer" containerID="b611a9bcee3467b53aa10cc3d52fd0f7d442678e20f2acabb767ad5f5892ff89"
Sep 16 12:39:18.599573 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:18.599555    2559 scope.go:117] "RemoveContainer" containerID="15a09a19b3e4c9cb1727a46a50decd7a88f288f9dffb8443c6c8298e32ea2245"
Sep 16 12:39:18.608180 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:18.608114    2559 scope.go:117] "RemoveContainer" containerID="b611a9bcee3467b53aa10cc3d52fd0f7d442678e20f2acabb767ad5f5892ff89"
Sep 16 12:39:18.608560 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:39:18.608528    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b611a9bcee3467b53aa10cc3d52fd0f7d442678e20f2acabb767ad5f5892ff89\": container with ID starting with b611a9bcee3467b53aa10cc3d52fd0f7d442678e20f2acabb767ad5f5892ff89 not found: ID does not exist" containerID="b611a9bcee3467b53aa10cc3d52fd0f7d442678e20f2acabb767ad5f5892ff89"
Sep 16 12:39:18.608664 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:18.608567    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b611a9bcee3467b53aa10cc3d52fd0f7d442678e20f2acabb767ad5f5892ff89"} err="failed to get container status \"b611a9bcee3467b53aa10cc3d52fd0f7d442678e20f2acabb767ad5f5892ff89\": rpc error: code = NotFound desc = could not find container \"b611a9bcee3467b53aa10cc3d52fd0f7d442678e20f2acabb767ad5f5892ff89\": container with ID starting with b611a9bcee3467b53aa10cc3d52fd0f7d442678e20f2acabb767ad5f5892ff89 not found: ID does not exist"
Sep 16 12:39:18.608664 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:18.608586    2559 scope.go:117] "RemoveContainer" containerID="15a09a19b3e4c9cb1727a46a50decd7a88f288f9dffb8443c6c8298e32ea2245"
Sep 16 12:39:18.608884 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:39:18.608866    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15a09a19b3e4c9cb1727a46a50decd7a88f288f9dffb8443c6c8298e32ea2245\": container with ID starting with 15a09a19b3e4c9cb1727a46a50decd7a88f288f9dffb8443c6c8298e32ea2245 not found: ID does not exist" containerID="15a09a19b3e4c9cb1727a46a50decd7a88f288f9dffb8443c6c8298e32ea2245"
Sep 16 12:39:18.608943 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:18.608890    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15a09a19b3e4c9cb1727a46a50decd7a88f288f9dffb8443c6c8298e32ea2245"} err="failed to get container status \"15a09a19b3e4c9cb1727a46a50decd7a88f288f9dffb8443c6c8298e32ea2245\": rpc error: code = NotFound desc = could not find container \"15a09a19b3e4c9cb1727a46a50decd7a88f288f9dffb8443c6c8298e32ea2245\": container with ID starting with 15a09a19b3e4c9cb1727a46a50decd7a88f288f9dffb8443c6c8298e32ea2245 not found: ID does not exist"
Sep 16 12:39:18.609351 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:18.609337    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w"]
Sep 16 12:39:18.611180 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:18.611157    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w"]
Sep 16 12:39:18.737620 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:18.737590    2559 patch_prober.go:28] interesting pod/e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 16 12:39:18.737789 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:18.737650    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-43ef83-openshift-default-dcfcd4c4b-vf62w" podUID="684f4bb5-2617-4db2-9955-cf5bda082db8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 16 12:39:19.938384 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:19.938343    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="684f4bb5-2617-4db2-9955-cf5bda082db8" path="/var/lib/kubelet/pods/684f4bb5-2617-4db2-9955-cf5bda082db8/volumes"
Sep 16 12:39:23.513153 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:23.513094    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-72eee5-29826030-5shzd"]
Sep 16 12:39:23.519942 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:23.519899    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:39:23.522267 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:23.522240    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-72eee5-29826030-5shzd"]
Sep 16 12:39:23.586701 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:23.586667    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:39:23.646363 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:23.646328    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:39:23.692878 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:23.692845    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-72eee5-wpmnv"]
Sep 16 12:39:23.694726 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:23.694710    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-72eee5-wpmnv"]
Sep 16 12:39:23.709550 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:23.709505    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:39:23.939072 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:23.939033    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e5b2a7c-0228-4d78-8fcd-d4a8a24e6a8d" path="/var/lib/kubelet/pods/5e5b2a7c-0228-4d78-8fcd-d4a8a24e6a8d/volumes"
Sep 16 12:39:23.939494 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:23.939474    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0d3aeed-ce39-45c7-9e99-7af15b6877ae" path="/var/lib/kubelet/pods/e0d3aeed-ce39-45c7-9e99-7af15b6877ae/volumes"
Sep 16 12:39:24.095848 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:24.095811    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:39:24.186170 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:24.186119    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:39:24.751348 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:24.751304    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:39:26.405432 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:26.405336    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:39:30.045640 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:30.045588    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:39:30.143206 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:30.143161    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:39:30.301174 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:30.301083    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw"]
Sep 16 12:39:30.301429 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:30.301375    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw" podUID="6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea" containerName="istio-proxy" containerID="cri-o://01d1b893d44c6a77c95ad83573f9d112b87cc8c7f831400e0a682447b819ad93" gracePeriod=30
Sep 16 12:39:30.333823 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:30.333795    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:39:31.629343 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:31.629306    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:39:32.417657 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:32.417603    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:39:34.421352 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:34.421322    2559 scope.go:117] "RemoveContainer" containerID="57f227d83e28c31047818a087161cd3186fc33cc221057990f950a206df973ce"
Sep 16 12:39:35.564474 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:35.564414    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw"
Sep 16 12:39:35.687400 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:35.687370    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea-credential-socket\") pod \"6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea\" (UID: \"6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea\") "
Sep 16 12:39:35.687592 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:35.687409    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea-istio-data\") pod \"6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea\" (UID: \"6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea\") "
Sep 16 12:39:35.687592 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:35.687443    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea-istio-token\") pod \"6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea\" (UID: \"6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea\") "
Sep 16 12:39:35.687592 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:35.687503    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea-istiod-ca-cert\") pod \"6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea\" (UID: \"6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea\") "
Sep 16 12:39:35.687592 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:35.687531    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea-istio-envoy\") pod \"6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea\" (UID: \"6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea\") "
Sep 16 12:39:35.687592 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:35.687563    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea-istio-podinfo\") pod \"6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea\" (UID: \"6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea\") "
Sep 16 12:39:35.687592 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:35.687592    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z4sgd\" (UniqueName: \"kubernetes.io/projected/6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea-kube-api-access-z4sgd\") pod \"6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea\" (UID: \"6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea\") "
Sep 16 12:39:35.687944 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:35.687615    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea-workload-certs\") pod \"6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea\" (UID: \"6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea\") "
Sep 16 12:39:35.687944 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:35.687661    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea-workload-socket\") pod \"6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea\" (UID: \"6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea\") "
Sep 16 12:39:35.687944 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:35.687733    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea" (UID: "6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:39:35.687944 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:35.687753    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea-istio-data" (OuterVolumeSpecName: "istio-data") pod "6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea" (UID: "6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:39:35.687944 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:35.687903    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea" (UID: "6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:39:35.687944 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:35.687935    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea-credential-socket\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:39:35.687944 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:35.687950    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea-istio-data\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:39:35.688357 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:35.687962    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea" (UID: "6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:39:35.688357 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:35.688124    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea" (UID: "6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:39:35.689496 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:35.689466    2559 generic.go:356] "Generic (PLEG): container finished" podID="6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea" containerID="01d1b893d44c6a77c95ad83573f9d112b87cc8c7f831400e0a682447b819ad93" exitCode=0
Sep 16 12:39:35.689648 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:35.689523    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw"
Sep 16 12:39:35.689648 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:35.689563    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw" event={"ID":"6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea","Type":"ContainerDied","Data":"01d1b893d44c6a77c95ad83573f9d112b87cc8c7f831400e0a682447b819ad93"}
Sep 16 12:39:35.689648 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:35.689636    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw" event={"ID":"6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea","Type":"ContainerDied","Data":"b8b6ecd13e21fb1d6318a9dd2774615ed9b53f77b007ee90ff4a461d7a5a10ef"}
Sep 16 12:39:35.689834 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:35.689665    2559 scope.go:117] "RemoveContainer" containerID="01d1b893d44c6a77c95ad83573f9d112b87cc8c7f831400e0a682447b819ad93"
Sep 16 12:39:35.690188 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:35.690103    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea-istio-token" (OuterVolumeSpecName: "istio-token") pod "6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea" (UID: "6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:39:35.690408 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:35.690379    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea" (UID: "6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 12:39:35.690511 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:35.690447    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea" (UID: "6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:39:35.690619 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:35.690601    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea-kube-api-access-z4sgd" (OuterVolumeSpecName: "kube-api-access-z4sgd") pod "6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea" (UID: "6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea"). InnerVolumeSpecName "kube-api-access-z4sgd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:39:35.708591 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:35.708570    2559 scope.go:117] "RemoveContainer" containerID="3b7665a9fbdb46a1592e068611f7a1f2cdd2ae07e2c06002d8ad2b75c1e2d694"
Sep 16 12:39:35.716214 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:35.716197    2559 scope.go:117] "RemoveContainer" containerID="01d1b893d44c6a77c95ad83573f9d112b87cc8c7f831400e0a682447b819ad93"
Sep 16 12:39:35.716506 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:39:35.716482    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01d1b893d44c6a77c95ad83573f9d112b87cc8c7f831400e0a682447b819ad93\": container with ID starting with 01d1b893d44c6a77c95ad83573f9d112b87cc8c7f831400e0a682447b819ad93 not found: ID does not exist" containerID="01d1b893d44c6a77c95ad83573f9d112b87cc8c7f831400e0a682447b819ad93"
Sep 16 12:39:35.716580 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:35.716515    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01d1b893d44c6a77c95ad83573f9d112b87cc8c7f831400e0a682447b819ad93"} err="failed to get container status \"01d1b893d44c6a77c95ad83573f9d112b87cc8c7f831400e0a682447b819ad93\": rpc error: code = NotFound desc = could not find container \"01d1b893d44c6a77c95ad83573f9d112b87cc8c7f831400e0a682447b819ad93\": container with ID starting with 01d1b893d44c6a77c95ad83573f9d112b87cc8c7f831400e0a682447b819ad93 not found: ID does not exist"
Sep 16 12:39:35.716580 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:35.716534    2559 scope.go:117] "RemoveContainer" containerID="3b7665a9fbdb46a1592e068611f7a1f2cdd2ae07e2c06002d8ad2b75c1e2d694"
Sep 16 12:39:35.716776 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:39:35.716763    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b7665a9fbdb46a1592e068611f7a1f2cdd2ae07e2c06002d8ad2b75c1e2d694\": container with ID starting with 3b7665a9fbdb46a1592e068611f7a1f2cdd2ae07e2c06002d8ad2b75c1e2d694 not found: ID does not exist" containerID="3b7665a9fbdb46a1592e068611f7a1f2cdd2ae07e2c06002d8ad2b75c1e2d694"
Sep 16 12:39:35.716813 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:35.716779    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b7665a9fbdb46a1592e068611f7a1f2cdd2ae07e2c06002d8ad2b75c1e2d694"} err="failed to get container status \"3b7665a9fbdb46a1592e068611f7a1f2cdd2ae07e2c06002d8ad2b75c1e2d694\": rpc error: code = NotFound desc = could not find container \"3b7665a9fbdb46a1592e068611f7a1f2cdd2ae07e2c06002d8ad2b75c1e2d694\": container with ID starting with 3b7665a9fbdb46a1592e068611f7a1f2cdd2ae07e2c06002d8ad2b75c1e2d694 not found: ID does not exist"
Sep 16 12:39:35.789532 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:35.789499    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea-workload-socket\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:39:35.789532 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:35.789526    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea-istio-token\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:39:35.789532 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:35.789537    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea-istiod-ca-cert\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:39:35.789763 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:35.789551    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea-istio-envoy\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:39:35.789763 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:35.789561    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea-istio-podinfo\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:39:35.789763 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:35.789569    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z4sgd\" (UniqueName: \"kubernetes.io/projected/6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea-kube-api-access-z4sgd\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:39:35.789763 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:35.789579    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea-workload-certs\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:39:36.007042 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:36.007009    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw"]
Sep 16 12:39:36.013224 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:36.013200    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-72eee5-openshift-default-5dbdc4d6bb-w86pw"]
Sep 16 12:39:37.939128 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:37.939094    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea" path="/var/lib/kubelet/pods/6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea/volumes"
Sep 16 12:39:41.203642 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:41.203613    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:39:41.287088 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:41.287057    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:39:41.388160 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:41.388087    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:39:41.488031 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:41.487951    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:39:41.816850 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:41.816769    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:39:41.943228 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:41.943196    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:39:43.824490 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:43.824452    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:39:47.940515 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:47.940483    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:39:48.040784 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:48.040753    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:39:48.194058 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:48.193960    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j"]
Sep 16 12:39:48.194302 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:48.194254    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j" podUID="aa03a336-756b-4ebc-97b3-20873ffac1cd" containerName="istio-proxy" containerID="cri-o://3b5580cef30ac0f88cb6f204f70ecf8ec8680a1dbff04dfb11c65fff12910b69" gracePeriod=30
Sep 16 12:39:48.215322 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:48.215290    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:39:49.015700 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:49.015660    2559 patch_prober.go:28] interesting pod/e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 16 12:39:49.016068 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:49.015734    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j" podUID="aa03a336-756b-4ebc-97b3-20873ffac1cd" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 12:39:49.873840 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:49.873805    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:39:49.975053 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:49.975020    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:39:52.753742 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:52.753702    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7fb697d85d-nwqzj"]
Sep 16 12:39:52.754320 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:52.753952    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7fb697d85d-nwqzj" podUID="3867ffc4-e220-4c14-9981-1a586fb4bd70" containerName="manager" containerID="cri-o://0bc1a559f0ef4d53c58e36cf9959902fa624c57f736721b8d19ddf822dbdd1d2" gracePeriod=30
Sep 16 12:39:52.995902 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:52.995878    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7fb697d85d-nwqzj"
Sep 16 12:39:53.056898 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:53.056799    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3867ffc4-e220-4c14-9981-1a586fb4bd70-webhook-cert\") pod \"3867ffc4-e220-4c14-9981-1a586fb4bd70\" (UID: \"3867ffc4-e220-4c14-9981-1a586fb4bd70\") "
Sep 16 12:39:53.056898 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:53.056854    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v9qqs\" (UniqueName: \"kubernetes.io/projected/3867ffc4-e220-4c14-9981-1a586fb4bd70-kube-api-access-v9qqs\") pod \"3867ffc4-e220-4c14-9981-1a586fb4bd70\" (UID: \"3867ffc4-e220-4c14-9981-1a586fb4bd70\") "
Sep 16 12:39:53.057145 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:53.056912    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3867ffc4-e220-4c14-9981-1a586fb4bd70-metrics-certs\") pod \"3867ffc4-e220-4c14-9981-1a586fb4bd70\" (UID: \"3867ffc4-e220-4c14-9981-1a586fb4bd70\") "
Sep 16 12:39:53.059382 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:53.059345    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3867ffc4-e220-4c14-9981-1a586fb4bd70-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "3867ffc4-e220-4c14-9981-1a586fb4bd70" (UID: "3867ffc4-e220-4c14-9981-1a586fb4bd70"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 12:39:53.059542 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:53.059463    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3867ffc4-e220-4c14-9981-1a586fb4bd70-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "3867ffc4-e220-4c14-9981-1a586fb4bd70" (UID: "3867ffc4-e220-4c14-9981-1a586fb4bd70"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 12:39:53.059608 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:53.059584    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3867ffc4-e220-4c14-9981-1a586fb4bd70-kube-api-access-v9qqs" (OuterVolumeSpecName: "kube-api-access-v9qqs") pod "3867ffc4-e220-4c14-9981-1a586fb4bd70" (UID: "3867ffc4-e220-4c14-9981-1a586fb4bd70"). InnerVolumeSpecName "kube-api-access-v9qqs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:39:53.158335 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:53.158297    2559 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3867ffc4-e220-4c14-9981-1a586fb4bd70-webhook-cert\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:39:53.158531 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:53.158349    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v9qqs\" (UniqueName: \"kubernetes.io/projected/3867ffc4-e220-4c14-9981-1a586fb4bd70-kube-api-access-v9qqs\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:39:53.158531 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:53.158365    2559 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3867ffc4-e220-4c14-9981-1a586fb4bd70-metrics-certs\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:39:53.440399 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:53.440372    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j"
Sep 16 12:39:53.460492 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:53.460457    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa03a336-756b-4ebc-97b3-20873ffac1cd-istio-data\") pod \"aa03a336-756b-4ebc-97b3-20873ffac1cd\" (UID: \"aa03a336-756b-4ebc-97b3-20873ffac1cd\") "
Sep 16 12:39:53.460735 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:53.460511    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa03a336-756b-4ebc-97b3-20873ffac1cd-workload-certs\") pod \"aa03a336-756b-4ebc-97b3-20873ffac1cd\" (UID: \"aa03a336-756b-4ebc-97b3-20873ffac1cd\") "
Sep 16 12:39:53.460735 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:53.460542    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa03a336-756b-4ebc-97b3-20873ffac1cd-istiod-ca-cert\") pod \"aa03a336-756b-4ebc-97b3-20873ffac1cd\" (UID: \"aa03a336-756b-4ebc-97b3-20873ffac1cd\") "
Sep 16 12:39:53.460735 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:53.460581    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa03a336-756b-4ebc-97b3-20873ffac1cd-istio-podinfo\") pod \"aa03a336-756b-4ebc-97b3-20873ffac1cd\" (UID: \"aa03a336-756b-4ebc-97b3-20873ffac1cd\") "
Sep 16 12:39:53.460735 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:53.460617    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa03a336-756b-4ebc-97b3-20873ffac1cd-workload-socket\") pod \"aa03a336-756b-4ebc-97b3-20873ffac1cd\" (UID: \"aa03a336-756b-4ebc-97b3-20873ffac1cd\") "
Sep 16 12:39:53.461049 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:53.460834    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa03a336-756b-4ebc-97b3-20873ffac1cd-istio-envoy\") pod \"aa03a336-756b-4ebc-97b3-20873ffac1cd\" (UID: \"aa03a336-756b-4ebc-97b3-20873ffac1cd\") "
Sep 16 12:39:53.461049 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:53.460855    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa03a336-756b-4ebc-97b3-20873ffac1cd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "aa03a336-756b-4ebc-97b3-20873ffac1cd" (UID: "aa03a336-756b-4ebc-97b3-20873ffac1cd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:39:53.461049 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:53.460865    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa03a336-756b-4ebc-97b3-20873ffac1cd-istio-token\") pod \"aa03a336-756b-4ebc-97b3-20873ffac1cd\" (UID: \"aa03a336-756b-4ebc-97b3-20873ffac1cd\") "
Sep 16 12:39:53.461049 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:53.460933    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-84fpx\" (UniqueName: \"kubernetes.io/projected/aa03a336-756b-4ebc-97b3-20873ffac1cd-kube-api-access-84fpx\") pod \"aa03a336-756b-4ebc-97b3-20873ffac1cd\" (UID: \"aa03a336-756b-4ebc-97b3-20873ffac1cd\") "
Sep 16 12:39:53.461049 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:53.460961    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa03a336-756b-4ebc-97b3-20873ffac1cd-credential-socket\") pod \"aa03a336-756b-4ebc-97b3-20873ffac1cd\" (UID: \"aa03a336-756b-4ebc-97b3-20873ffac1cd\") "
Sep 16 12:39:53.462068 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:53.461428    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa03a336-756b-4ebc-97b3-20873ffac1cd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "aa03a336-756b-4ebc-97b3-20873ffac1cd" (UID: "aa03a336-756b-4ebc-97b3-20873ffac1cd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:39:53.462068 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:53.461732    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa03a336-756b-4ebc-97b3-20873ffac1cd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "aa03a336-756b-4ebc-97b3-20873ffac1cd" (UID: "aa03a336-756b-4ebc-97b3-20873ffac1cd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:39:53.462068 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:53.461907    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa03a336-756b-4ebc-97b3-20873ffac1cd-credential-socket\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:39:53.462068 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:53.462019    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa03a336-756b-4ebc-97b3-20873ffac1cd-workload-certs\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:39:53.462068 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:53.462032    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa03a336-756b-4ebc-97b3-20873ffac1cd-istiod-ca-cert\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:39:53.462068 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:53.461968    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa03a336-756b-4ebc-97b3-20873ffac1cd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "aa03a336-756b-4ebc-97b3-20873ffac1cd" (UID: "aa03a336-756b-4ebc-97b3-20873ffac1cd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:39:53.462068 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:53.461984    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa03a336-756b-4ebc-97b3-20873ffac1cd-istio-data" (OuterVolumeSpecName: "istio-data") pod "aa03a336-756b-4ebc-97b3-20873ffac1cd" (UID: "aa03a336-756b-4ebc-97b3-20873ffac1cd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:39:53.463432 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:53.463401    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa03a336-756b-4ebc-97b3-20873ffac1cd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "aa03a336-756b-4ebc-97b3-20873ffac1cd" (UID: "aa03a336-756b-4ebc-97b3-20873ffac1cd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:39:53.463650 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:53.463618    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa03a336-756b-4ebc-97b3-20873ffac1cd-istio-token" (OuterVolumeSpecName: "istio-token") pod "aa03a336-756b-4ebc-97b3-20873ffac1cd" (UID: "aa03a336-756b-4ebc-97b3-20873ffac1cd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:39:53.463739 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:53.463663    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa03a336-756b-4ebc-97b3-20873ffac1cd-kube-api-access-84fpx" (OuterVolumeSpecName: "kube-api-access-84fpx") pod "aa03a336-756b-4ebc-97b3-20873ffac1cd" (UID: "aa03a336-756b-4ebc-97b3-20873ffac1cd"). InnerVolumeSpecName "kube-api-access-84fpx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:39:53.464073 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:53.464048    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/aa03a336-756b-4ebc-97b3-20873ffac1cd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "aa03a336-756b-4ebc-97b3-20873ffac1cd" (UID: "aa03a336-756b-4ebc-97b3-20873ffac1cd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 12:39:53.563303 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:53.563231    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa03a336-756b-4ebc-97b3-20873ffac1cd-istio-envoy\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:39:53.563303 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:53.563257    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa03a336-756b-4ebc-97b3-20873ffac1cd-istio-token\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:39:53.563303 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:53.563266    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-84fpx\" (UniqueName: \"kubernetes.io/projected/aa03a336-756b-4ebc-97b3-20873ffac1cd-kube-api-access-84fpx\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:39:53.563303 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:53.563275    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa03a336-756b-4ebc-97b3-20873ffac1cd-istio-data\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:39:53.563303 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:53.563284    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa03a336-756b-4ebc-97b3-20873ffac1cd-istio-podinfo\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:39:53.563578 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:53.563313    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa03a336-756b-4ebc-97b3-20873ffac1cd-workload-socket\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:39:53.781829 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:53.781794    2559 generic.go:356] "Generic (PLEG): container finished" podID="aa03a336-756b-4ebc-97b3-20873ffac1cd" containerID="3b5580cef30ac0f88cb6f204f70ecf8ec8680a1dbff04dfb11c65fff12910b69" exitCode=0
Sep 16 12:39:53.782306 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:53.781849    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j"
Sep 16 12:39:53.782306 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:53.781883    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j" event={"ID":"aa03a336-756b-4ebc-97b3-20873ffac1cd","Type":"ContainerDied","Data":"3b5580cef30ac0f88cb6f204f70ecf8ec8680a1dbff04dfb11c65fff12910b69"}
Sep 16 12:39:53.782306 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:53.781956    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j" event={"ID":"aa03a336-756b-4ebc-97b3-20873ffac1cd","Type":"ContainerDied","Data":"c8d295733982267752550a5704bb280359a42a51bbe80ba0a1175631df3ea401"}
Sep 16 12:39:53.782306 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:53.781991    2559 scope.go:117] "RemoveContainer" containerID="3b5580cef30ac0f88cb6f204f70ecf8ec8680a1dbff04dfb11c65fff12910b69"
Sep 16 12:39:53.783374 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:53.783295    2559 generic.go:356] "Generic (PLEG): container finished" podID="3867ffc4-e220-4c14-9981-1a586fb4bd70" containerID="0bc1a559f0ef4d53c58e36cf9959902fa624c57f736721b8d19ddf822dbdd1d2" exitCode=0
Sep 16 12:39:53.783374 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:53.783330    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7fb697d85d-nwqzj" event={"ID":"3867ffc4-e220-4c14-9981-1a586fb4bd70","Type":"ContainerDied","Data":"0bc1a559f0ef4d53c58e36cf9959902fa624c57f736721b8d19ddf822dbdd1d2"}
Sep 16 12:39:53.783374 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:53.783358    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7fb697d85d-nwqzj"
Sep 16 12:39:53.783558 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:53.783366    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7fb697d85d-nwqzj" event={"ID":"3867ffc4-e220-4c14-9981-1a586fb4bd70","Type":"ContainerDied","Data":"77bc08bb28708c15377d21ce415481ab5a180351ec64ba56763720138114ab72"}
Sep 16 12:39:53.801621 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:53.801604    2559 scope.go:117] "RemoveContainer" containerID="1c63581c92a925e00ced5616dadab5f0c56de5e372103efbdb1a788a5303d897"
Sep 16 12:39:53.809391 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:53.809374    2559 scope.go:117] "RemoveContainer" containerID="3b5580cef30ac0f88cb6f204f70ecf8ec8680a1dbff04dfb11c65fff12910b69"
Sep 16 12:39:53.809656 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:39:53.809638    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b5580cef30ac0f88cb6f204f70ecf8ec8680a1dbff04dfb11c65fff12910b69\": container with ID starting with 3b5580cef30ac0f88cb6f204f70ecf8ec8680a1dbff04dfb11c65fff12910b69 not found: ID does not exist" containerID="3b5580cef30ac0f88cb6f204f70ecf8ec8680a1dbff04dfb11c65fff12910b69"
Sep 16 12:39:53.809702 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:53.809664    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b5580cef30ac0f88cb6f204f70ecf8ec8680a1dbff04dfb11c65fff12910b69"} err="failed to get container status \"3b5580cef30ac0f88cb6f204f70ecf8ec8680a1dbff04dfb11c65fff12910b69\": rpc error: code = NotFound desc = could not find container \"3b5580cef30ac0f88cb6f204f70ecf8ec8680a1dbff04dfb11c65fff12910b69\": container with ID starting with 3b5580cef30ac0f88cb6f204f70ecf8ec8680a1dbff04dfb11c65fff12910b69 not found: ID does not exist"
Sep 16 12:39:53.809702 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:53.809681    2559 scope.go:117] "RemoveContainer" containerID="1c63581c92a925e00ced5616dadab5f0c56de5e372103efbdb1a788a5303d897"
Sep 16 12:39:53.809919 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:39:53.809905    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c63581c92a925e00ced5616dadab5f0c56de5e372103efbdb1a788a5303d897\": container with ID starting with 1c63581c92a925e00ced5616dadab5f0c56de5e372103efbdb1a788a5303d897 not found: ID does not exist" containerID="1c63581c92a925e00ced5616dadab5f0c56de5e372103efbdb1a788a5303d897"
Sep 16 12:39:53.809962 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:53.809924    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c63581c92a925e00ced5616dadab5f0c56de5e372103efbdb1a788a5303d897"} err="failed to get container status \"1c63581c92a925e00ced5616dadab5f0c56de5e372103efbdb1a788a5303d897\": rpc error: code = NotFound desc = could not find container \"1c63581c92a925e00ced5616dadab5f0c56de5e372103efbdb1a788a5303d897\": container with ID starting with 1c63581c92a925e00ced5616dadab5f0c56de5e372103efbdb1a788a5303d897 not found: ID does not exist"
Sep 16 12:39:53.809962 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:53.809936    2559 scope.go:117] "RemoveContainer" containerID="0bc1a559f0ef4d53c58e36cf9959902fa624c57f736721b8d19ddf822dbdd1d2"
Sep 16 12:39:53.815272 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:53.815229    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j"]
Sep 16 12:39:53.818040 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:53.818020    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-3be0c5-openshift-default-6db58895f4-g267j"]
Sep 16 12:39:53.819092 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:53.819077    2559 scope.go:117] "RemoveContainer" containerID="0bc1a559f0ef4d53c58e36cf9959902fa624c57f736721b8d19ddf822dbdd1d2"
Sep 16 12:39:53.819418 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:39:53.819400    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0bc1a559f0ef4d53c58e36cf9959902fa624c57f736721b8d19ddf822dbdd1d2\": container with ID starting with 0bc1a559f0ef4d53c58e36cf9959902fa624c57f736721b8d19ddf822dbdd1d2 not found: ID does not exist" containerID="0bc1a559f0ef4d53c58e36cf9959902fa624c57f736721b8d19ddf822dbdd1d2"
Sep 16 12:39:53.819475 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:53.819426    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bc1a559f0ef4d53c58e36cf9959902fa624c57f736721b8d19ddf822dbdd1d2"} err="failed to get container status \"0bc1a559f0ef4d53c58e36cf9959902fa624c57f736721b8d19ddf822dbdd1d2\": rpc error: code = NotFound desc = could not find container \"0bc1a559f0ef4d53c58e36cf9959902fa624c57f736721b8d19ddf822dbdd1d2\": container with ID starting with 0bc1a559f0ef4d53c58e36cf9959902fa624c57f736721b8d19ddf822dbdd1d2 not found: ID does not exist"
Sep 16 12:39:53.828922 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:53.828893    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7fb697d85d-nwqzj"]
Sep 16 12:39:53.838163 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:53.838145    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7fb697d85d-nwqzj"]
Sep 16 12:39:53.937892 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:53.937863    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3867ffc4-e220-4c14-9981-1a586fb4bd70" path="/var/lib/kubelet/pods/3867ffc4-e220-4c14-9981-1a586fb4bd70/volumes"
Sep 16 12:39:53.938323 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:53.938310    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa03a336-756b-4ebc-97b3-20873ffac1cd" path="/var/lib/kubelet/pods/aa03a336-756b-4ebc-97b3-20873ffac1cd/volumes"
Sep 16 12:39:54.215366 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:39:54.215329    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:40:34.065488 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:40:34.065460    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-hrvzp_63ee784a-3b40-4259-9923-74a24d0203a0/console-operator/5.log"
Sep 16 12:40:34.071442 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:40:34.071422    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-hrvzp_63ee784a-3b40-4259-9923-74a24d0203a0/console-operator/5.log"
Sep 16 12:40:54.728041 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:40:54.728004    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7fb697d85d-6hcgn"]
Sep 16 12:40:54.728644 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:40:54.728625    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea" containerName="istio-proxy"
Sep 16 12:40:54.728690 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:40:54.728647    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea" containerName="istio-proxy"
Sep 16 12:40:54.728690 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:40:54.728664    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e5b2a7c-0228-4d78-8fcd-d4a8a24e6a8d" containerName="revoke-keys"
Sep 16 12:40:54.728690 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:40:54.728672    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e5b2a7c-0228-4d78-8fcd-d4a8a24e6a8d" containerName="revoke-keys"
Sep 16 12:40:54.728789 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:40:54.728700    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3867ffc4-e220-4c14-9981-1a586fb4bd70" containerName="manager"
Sep 16 12:40:54.728789 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:40:54.728709    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3867ffc4-e220-4c14-9981-1a586fb4bd70" containerName="manager"
Sep 16 12:40:54.728789 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:40:54.728723    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa03a336-756b-4ebc-97b3-20873ffac1cd" containerName="istio-proxy"
Sep 16 12:40:54.728789 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:40:54.728731    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa03a336-756b-4ebc-97b3-20873ffac1cd" containerName="istio-proxy"
Sep 16 12:40:54.728789 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:40:54.728748    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="684f4bb5-2617-4db2-9955-cf5bda082db8" containerName="istio-proxy"
Sep 16 12:40:54.728789 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:40:54.728755    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="684f4bb5-2617-4db2-9955-cf5bda082db8" containerName="istio-proxy"
Sep 16 12:40:54.728789 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:40:54.728767    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa03a336-756b-4ebc-97b3-20873ffac1cd" containerName="istio-proxy"
Sep 16 12:40:54.728789 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:40:54.728775    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa03a336-756b-4ebc-97b3-20873ffac1cd" containerName="istio-proxy"
Sep 16 12:40:54.728789 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:40:54.728786    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="684f4bb5-2617-4db2-9955-cf5bda082db8" containerName="istio-proxy"
Sep 16 12:40:54.729061 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:40:54.728794    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="684f4bb5-2617-4db2-9955-cf5bda082db8" containerName="istio-proxy"
Sep 16 12:40:54.729061 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:40:54.728875    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="684f4bb5-2617-4db2-9955-cf5bda082db8" containerName="istio-proxy"
Sep 16 12:40:54.729061 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:40:54.728885    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa03a336-756b-4ebc-97b3-20873ffac1cd" containerName="istio-proxy"
Sep 16 12:40:54.729061 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:40:54.728896    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e5b2a7c-0228-4d78-8fcd-d4a8a24e6a8d" containerName="revoke-keys"
Sep 16 12:40:54.729061 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:40:54.728906    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3867ffc4-e220-4c14-9981-1a586fb4bd70" containerName="manager"
Sep 16 12:40:54.729061 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:40:54.728915    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea" containerName="istio-proxy"
Sep 16 12:40:54.729061 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:40:54.728924    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa03a336-756b-4ebc-97b3-20873ffac1cd" containerName="istio-proxy"
Sep 16 12:40:54.729061 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:40:54.728935    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea" containerName="istio-proxy"
Sep 16 12:40:54.729061 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:40:54.728944    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="215357ee-56b2-47f2-a2e0-7ef1d1a27092" containerName="istio-proxy"
Sep 16 12:40:54.732233 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:40:54.732216    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7fb697d85d-6hcgn"
Sep 16 12:40:54.736048 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:40:54.736023    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 16 12:40:54.736205 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:40:54.736059    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-57f78\""
Sep 16 12:40:54.736205 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:40:54.736119    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 16 12:40:54.736205 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:40:54.736060    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 16 12:40:54.741314 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:40:54.741278    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7fb697d85d-6hcgn"]
Sep 16 12:40:54.827311 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:40:54.827268    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcm8p\" (UniqueName: \"kubernetes.io/projected/1e328adb-5a81-4521-a663-b2919e2b50f6-kube-api-access-gcm8p\") pod \"maas-controller-7fb697d85d-6hcgn\" (UID: \"1e328adb-5a81-4521-a663-b2919e2b50f6\") " pod="opendatahub/maas-controller-7fb697d85d-6hcgn"
Sep 16 12:40:54.827490 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:40:54.827394    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1e328adb-5a81-4521-a663-b2919e2b50f6-webhook-cert\") pod \"maas-controller-7fb697d85d-6hcgn\" (UID: \"1e328adb-5a81-4521-a663-b2919e2b50f6\") " pod="opendatahub/maas-controller-7fb697d85d-6hcgn"
Sep 16 12:40:54.827490 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:40:54.827453    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e328adb-5a81-4521-a663-b2919e2b50f6-metrics-certs\") pod \"maas-controller-7fb697d85d-6hcgn\" (UID: \"1e328adb-5a81-4521-a663-b2919e2b50f6\") " pod="opendatahub/maas-controller-7fb697d85d-6hcgn"
Sep 16 12:40:54.928507 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:40:54.928472    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e328adb-5a81-4521-a663-b2919e2b50f6-metrics-certs\") pod \"maas-controller-7fb697d85d-6hcgn\" (UID: \"1e328adb-5a81-4521-a663-b2919e2b50f6\") " pod="opendatahub/maas-controller-7fb697d85d-6hcgn"
Sep 16 12:40:54.928507 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:40:54.928516    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcm8p\" (UniqueName: \"kubernetes.io/projected/1e328adb-5a81-4521-a663-b2919e2b50f6-kube-api-access-gcm8p\") pod \"maas-controller-7fb697d85d-6hcgn\" (UID: \"1e328adb-5a81-4521-a663-b2919e2b50f6\") " pod="opendatahub/maas-controller-7fb697d85d-6hcgn"
Sep 16 12:40:54.928720 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:40:54.928583    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1e328adb-5a81-4521-a663-b2919e2b50f6-webhook-cert\") pod \"maas-controller-7fb697d85d-6hcgn\" (UID: \"1e328adb-5a81-4521-a663-b2919e2b50f6\") " pod="opendatahub/maas-controller-7fb697d85d-6hcgn"
Sep 16 12:40:54.931124 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:40:54.931086    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1e328adb-5a81-4521-a663-b2919e2b50f6-webhook-cert\") pod \"maas-controller-7fb697d85d-6hcgn\" (UID: \"1e328adb-5a81-4521-a663-b2919e2b50f6\") " pod="opendatahub/maas-controller-7fb697d85d-6hcgn"
Sep 16 12:40:54.931276 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:40:54.931126    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e328adb-5a81-4521-a663-b2919e2b50f6-metrics-certs\") pod \"maas-controller-7fb697d85d-6hcgn\" (UID: \"1e328adb-5a81-4521-a663-b2919e2b50f6\") " pod="opendatahub/maas-controller-7fb697d85d-6hcgn"
Sep 16 12:40:54.938043 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:40:54.938015    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcm8p\" (UniqueName: \"kubernetes.io/projected/1e328adb-5a81-4521-a663-b2919e2b50f6-kube-api-access-gcm8p\") pod \"maas-controller-7fb697d85d-6hcgn\" (UID: \"1e328adb-5a81-4521-a663-b2919e2b50f6\") " pod="opendatahub/maas-controller-7fb697d85d-6hcgn"
Sep 16 12:40:55.043652 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:40:55.043570    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7fb697d85d-6hcgn"
Sep 16 12:40:55.314354 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:40:55.314330    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7fb697d85d-6hcgn"]
Sep 16 12:40:55.317100 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:40:55.317070    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e328adb_5a81_4521_a663_b2919e2b50f6.slice/crio-4067fb9a2d582f74775f1a20fb83f4abff944a7a0ff83b354ba324c3eebe5b1e WatchSource:0}: Error finding container 4067fb9a2d582f74775f1a20fb83f4abff944a7a0ff83b354ba324c3eebe5b1e: Status 404 returned error can't find the container with id 4067fb9a2d582f74775f1a20fb83f4abff944a7a0ff83b354ba324c3eebe5b1e
Sep 16 12:40:55.318434 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:40:55.318411    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 12:40:56.099964 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:40:56.099894    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7fb697d85d-6hcgn" event={"ID":"1e328adb-5a81-4521-a663-b2919e2b50f6","Type":"ContainerStarted","Data":"4067fb9a2d582f74775f1a20fb83f4abff944a7a0ff83b354ba324c3eebe5b1e"}
Sep 16 12:40:57.106585 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:40:57.106547    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7fb697d85d-6hcgn" event={"ID":"1e328adb-5a81-4521-a663-b2919e2b50f6","Type":"ContainerStarted","Data":"5274261b865d100aef06a7b4b71bbd5c80926d815a5168082adcb97f6abe7ad2"}
Sep 16 12:40:57.106969 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:40:57.106625    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7fb697d85d-6hcgn"
Sep 16 12:40:57.128787 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:40:57.128735    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7fb697d85d-6hcgn" podStartSLOduration=2.388405102 podStartE2EDuration="3.128719303s" totalImagesPullingTime="740.314201ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:40:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:40:57.127167304 +0000 UTC m=+2423.747486617" watchObservedRunningTime="2026-09-16 12:40:57.128719303 +0000 UTC m=+2423.749038619"
Sep 16 12:41:08.113877 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:41:08.113845    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7fb697d85d-6hcgn"
Sep 16 12:41:15.306827 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:41:15.306780    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:41:15.377562 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:41:15.377528    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:15.484969 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:41:15.484933    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7fb697d85d-6hcgn"]
Sep 16 12:41:15.485257 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:41:15.485201    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7fb697d85d-6hcgn" podUID="1e328adb-5a81-4521-a663-b2919e2b50f6" containerName="manager" containerID="cri-o://5274261b865d100aef06a7b4b71bbd5c80926d815a5168082adcb97f6abe7ad2" gracePeriod=30
Sep 16 12:41:15.723549 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:41:15.723526    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7fb697d85d-6hcgn"
Sep 16 12:41:15.730541 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:41:15.730520    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gcm8p\" (UniqueName: \"kubernetes.io/projected/1e328adb-5a81-4521-a663-b2919e2b50f6-kube-api-access-gcm8p\") pod \"1e328adb-5a81-4521-a663-b2919e2b50f6\" (UID: \"1e328adb-5a81-4521-a663-b2919e2b50f6\") "
Sep 16 12:41:15.730662 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:41:15.730574    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e328adb-5a81-4521-a663-b2919e2b50f6-metrics-certs\") pod \"1e328adb-5a81-4521-a663-b2919e2b50f6\" (UID: \"1e328adb-5a81-4521-a663-b2919e2b50f6\") "
Sep 16 12:41:15.732540 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:41:15.732518    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e328adb-5a81-4521-a663-b2919e2b50f6-kube-api-access-gcm8p" (OuterVolumeSpecName: "kube-api-access-gcm8p") pod "1e328adb-5a81-4521-a663-b2919e2b50f6" (UID: "1e328adb-5a81-4521-a663-b2919e2b50f6"). InnerVolumeSpecName "kube-api-access-gcm8p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:41:15.732631 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:41:15.732542    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e328adb-5a81-4521-a663-b2919e2b50f6-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "1e328adb-5a81-4521-a663-b2919e2b50f6" (UID: "1e328adb-5a81-4521-a663-b2919e2b50f6"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 12:41:15.831033 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:41:15.830998    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1e328adb-5a81-4521-a663-b2919e2b50f6-webhook-cert\") pod \"1e328adb-5a81-4521-a663-b2919e2b50f6\" (UID: \"1e328adb-5a81-4521-a663-b2919e2b50f6\") "
Sep 16 12:41:15.831230 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:41:15.831205    2559 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e328adb-5a81-4521-a663-b2919e2b50f6-metrics-certs\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:41:15.831230 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:41:15.831218    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gcm8p\" (UniqueName: \"kubernetes.io/projected/1e328adb-5a81-4521-a663-b2919e2b50f6-kube-api-access-gcm8p\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:41:15.832996 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:41:15.832976    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e328adb-5a81-4521-a663-b2919e2b50f6-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "1e328adb-5a81-4521-a663-b2919e2b50f6" (UID: "1e328adb-5a81-4521-a663-b2919e2b50f6"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 12:41:15.931662 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:41:15.931632    2559 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1e328adb-5a81-4521-a663-b2919e2b50f6-webhook-cert\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:41:16.203567 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:41:16.203469    2559 generic.go:356] "Generic (PLEG): container finished" podID="1e328adb-5a81-4521-a663-b2919e2b50f6" containerID="5274261b865d100aef06a7b4b71bbd5c80926d815a5168082adcb97f6abe7ad2" exitCode=0
Sep 16 12:41:16.203567 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:41:16.203517    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7fb697d85d-6hcgn"
Sep 16 12:41:16.203824 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:41:16.203565    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7fb697d85d-6hcgn" event={"ID":"1e328adb-5a81-4521-a663-b2919e2b50f6","Type":"ContainerDied","Data":"5274261b865d100aef06a7b4b71bbd5c80926d815a5168082adcb97f6abe7ad2"}
Sep 16 12:41:16.203824 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:41:16.203625    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7fb697d85d-6hcgn" event={"ID":"1e328adb-5a81-4521-a663-b2919e2b50f6","Type":"ContainerDied","Data":"4067fb9a2d582f74775f1a20fb83f4abff944a7a0ff83b354ba324c3eebe5b1e"}
Sep 16 12:41:16.203824 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:41:16.203655    2559 scope.go:117] "RemoveContainer" containerID="5274261b865d100aef06a7b4b71bbd5c80926d815a5168082adcb97f6abe7ad2"
Sep 16 12:41:16.212247 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:41:16.212232    2559 scope.go:117] "RemoveContainer" containerID="5274261b865d100aef06a7b4b71bbd5c80926d815a5168082adcb97f6abe7ad2"
Sep 16 12:41:16.212539 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:41:16.212521    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5274261b865d100aef06a7b4b71bbd5c80926d815a5168082adcb97f6abe7ad2\": container with ID starting with 5274261b865d100aef06a7b4b71bbd5c80926d815a5168082adcb97f6abe7ad2 not found: ID does not exist" containerID="5274261b865d100aef06a7b4b71bbd5c80926d815a5168082adcb97f6abe7ad2"
Sep 16 12:41:16.212604 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:41:16.212548    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5274261b865d100aef06a7b4b71bbd5c80926d815a5168082adcb97f6abe7ad2"} err="failed to get container status \"5274261b865d100aef06a7b4b71bbd5c80926d815a5168082adcb97f6abe7ad2\": rpc error: code = NotFound desc = could not find container \"5274261b865d100aef06a7b4b71bbd5c80926d815a5168082adcb97f6abe7ad2\": container with ID starting with 5274261b865d100aef06a7b4b71bbd5c80926d815a5168082adcb97f6abe7ad2 not found: ID does not exist"
Sep 16 12:41:16.220869 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:41:16.220848    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7fb697d85d-6hcgn"]
Sep 16 12:41:16.226035 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:41:16.226013    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7fb697d85d-6hcgn"]
Sep 16 12:41:16.960882 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:41:16.960855    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:17.090096 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:41:17.090064    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7fb697d85d-85dzv"]
Sep 16 12:41:17.090467 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:41:17.090454    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e328adb-5a81-4521-a663-b2919e2b50f6" containerName="manager"
Sep 16 12:41:17.090467 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:41:17.090468    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e328adb-5a81-4521-a663-b2919e2b50f6" containerName="manager"
Sep 16 12:41:17.090541 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:41:17.090482    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea" containerName="istio-proxy"
Sep 16 12:41:17.090541 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:41:17.090488    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a3cbeea-f54c-4b2c-bbff-3e92a4fda2ea" containerName="istio-proxy"
Sep 16 12:41:17.090541 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:41:17.090540    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e328adb-5a81-4521-a663-b2919e2b50f6" containerName="manager"
Sep 16 12:41:17.090639 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:41:17.090551    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="684f4bb5-2617-4db2-9955-cf5bda082db8" containerName="istio-proxy"
Sep 16 12:41:17.093488 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:41:17.093468    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7fb697d85d-85dzv"
Sep 16 12:41:17.097398 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:41:17.097374    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 16 12:41:17.097553 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:41:17.097379    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-57f78\""
Sep 16 12:41:17.097553 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:41:17.097385    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 16 12:41:17.097803 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:41:17.097783    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 16 12:41:17.104812 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:41:17.104789    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7fb697d85d-85dzv"]
Sep 16 12:41:17.140392 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:41:17.140358    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nqhp\" (UniqueName: \"kubernetes.io/projected/4d1a1655-3f87-49ec-8826-88cbed7da6b6-kube-api-access-6nqhp\") pod \"maas-controller-7fb697d85d-85dzv\" (UID: \"4d1a1655-3f87-49ec-8826-88cbed7da6b6\") " pod="opendatahub/maas-controller-7fb697d85d-85dzv"
Sep 16 12:41:17.140566 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:41:17.140413    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d1a1655-3f87-49ec-8826-88cbed7da6b6-metrics-certs\") pod \"maas-controller-7fb697d85d-85dzv\" (UID: \"4d1a1655-3f87-49ec-8826-88cbed7da6b6\") " pod="opendatahub/maas-controller-7fb697d85d-85dzv"
Sep 16 12:41:17.140566 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:41:17.140513    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4d1a1655-3f87-49ec-8826-88cbed7da6b6-webhook-cert\") pod \"maas-controller-7fb697d85d-85dzv\" (UID: \"4d1a1655-3f87-49ec-8826-88cbed7da6b6\") " pod="opendatahub/maas-controller-7fb697d85d-85dzv"
Sep 16 12:41:17.241436 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:41:17.241355    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4d1a1655-3f87-49ec-8826-88cbed7da6b6-webhook-cert\") pod \"maas-controller-7fb697d85d-85dzv\" (UID: \"4d1a1655-3f87-49ec-8826-88cbed7da6b6\") " pod="opendatahub/maas-controller-7fb697d85d-85dzv"
Sep 16 12:41:17.241436 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:41:17.241408    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nqhp\" (UniqueName: \"kubernetes.io/projected/4d1a1655-3f87-49ec-8826-88cbed7da6b6-kube-api-access-6nqhp\") pod \"maas-controller-7fb697d85d-85dzv\" (UID: \"4d1a1655-3f87-49ec-8826-88cbed7da6b6\") " pod="opendatahub/maas-controller-7fb697d85d-85dzv"
Sep 16 12:41:17.241436 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:41:17.241436    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d1a1655-3f87-49ec-8826-88cbed7da6b6-metrics-certs\") pod \"maas-controller-7fb697d85d-85dzv\" (UID: \"4d1a1655-3f87-49ec-8826-88cbed7da6b6\") " pod="opendatahub/maas-controller-7fb697d85d-85dzv"
Sep 16 12:41:17.244069 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:41:17.244044    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4d1a1655-3f87-49ec-8826-88cbed7da6b6-webhook-cert\") pod \"maas-controller-7fb697d85d-85dzv\" (UID: \"4d1a1655-3f87-49ec-8826-88cbed7da6b6\") " pod="opendatahub/maas-controller-7fb697d85d-85dzv"
Sep 16 12:41:17.244228 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:41:17.244044    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d1a1655-3f87-49ec-8826-88cbed7da6b6-metrics-certs\") pod \"maas-controller-7fb697d85d-85dzv\" (UID: \"4d1a1655-3f87-49ec-8826-88cbed7da6b6\") " pod="opendatahub/maas-controller-7fb697d85d-85dzv"
Sep 16 12:41:17.250992 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:41:17.250969    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nqhp\" (UniqueName: \"kubernetes.io/projected/4d1a1655-3f87-49ec-8826-88cbed7da6b6-kube-api-access-6nqhp\") pod \"maas-controller-7fb697d85d-85dzv\" (UID: \"4d1a1655-3f87-49ec-8826-88cbed7da6b6\") " pod="opendatahub/maas-controller-7fb697d85d-85dzv"
Sep 16 12:41:17.406936 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:41:17.406901    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7fb697d85d-85dzv"
Sep 16 12:41:17.686486 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:41:17.686458    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7fb697d85d-85dzv"]
Sep 16 12:41:17.688398 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:41:17.688362    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d1a1655_3f87_49ec_8826_88cbed7da6b6.slice/crio-6e3c453ebc143c413ae1bbc2f18ebca3c5966387fcece088cb715c1043d9d6eb WatchSource:0}: Error finding container 6e3c453ebc143c413ae1bbc2f18ebca3c5966387fcece088cb715c1043d9d6eb: Status 404 returned error can't find the container with id 6e3c453ebc143c413ae1bbc2f18ebca3c5966387fcece088cb715c1043d9d6eb
Sep 16 12:41:17.937584 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:41:17.937501    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e328adb-5a81-4521-a663-b2919e2b50f6" path="/var/lib/kubelet/pods/1e328adb-5a81-4521-a663-b2919e2b50f6/volumes"
Sep 16 12:41:18.216569 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:41:18.216493    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7fb697d85d-85dzv" event={"ID":"4d1a1655-3f87-49ec-8826-88cbed7da6b6","Type":"ContainerStarted","Data":"f8df28485c51e8e304beabf4a2dd7270b9b636257c1bde529a6de75474b9ad24"}
Sep 16 12:41:18.216569 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:41:18.216549    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7fb697d85d-85dzv" event={"ID":"4d1a1655-3f87-49ec-8826-88cbed7da6b6","Type":"ContainerStarted","Data":"6e3c453ebc143c413ae1bbc2f18ebca3c5966387fcece088cb715c1043d9d6eb"}
Sep 16 12:41:18.216944 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:41:18.216578    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7fb697d85d-85dzv"
Sep 16 12:41:18.235562 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:41:18.235517    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7fb697d85d-85dzv" podStartSLOduration=0.874148092 podStartE2EDuration="1.235499013s" totalImagesPullingTime="361.350921ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:41:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:41:18.23524525 +0000 UTC m=+2444.855564566" watchObservedRunningTime="2026-09-16 12:41:18.235499013 +0000 UTC m=+2444.855818330"
Sep 16 12:41:29.224576 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:41:29.224541    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7fb697d85d-85dzv"
Sep 16 12:41:41.767556 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:41:41.767519    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:41:49.636270 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:41:49.636236    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:41:56.898665 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:41:56.898632    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:42:02.832235 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:42:02.832196    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:42:10.636386 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:42:10.636345    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:42:16.669757 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:42:16.669713    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:42:26.235530 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:42:26.235440    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:42:34.644336 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:42:34.644300    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:42:49.690900 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:42:49.690866    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:43:32.549642 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:43:32.549590    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:43:34.485209 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:43:34.485172    2559 scope.go:117] "RemoveContainer" containerID="8e9fc0c11a99893ae54e13486de10ddaec9283ad0b593c7c63a4d270c95b5d0b"
Sep 16 12:43:59.814953 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:43:59.814872    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:44:07.602886 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:44:07.602856    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:44:13.317153 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:44:13.317103    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:44:23.208375 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:44:23.208343    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:44:34.504487 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:44:34.504433    2559 scope.go:117] "RemoveContainer" containerID="2a94222e48f5737466e4f2cc225be14f401e70412a453b482c2528352fc0bb18"
Sep 16 12:44:38.744612 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:44:38.744574    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:44:41.501345 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:44:41.501306    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:44:42.121956 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:44:42.121914    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:44:49.998546 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:44:49.998511    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:45:06.587257 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:06.587220    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:45:07.516939 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:07.516906    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:45:09.635347 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:09.635314    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:45:17.697636 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:17.697596    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:45:26.613726 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:26.613619    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:45:26.994110 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:26.994075    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-74767d9c48-nwllp"]
Sep 16 12:45:26.997869 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:26.997844    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-74767d9c48-nwllp"
Sep 16 12:45:27.000715 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:27.000694    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-wwdn8\""
Sep 16 12:45:27.001943 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:27.001921    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 16 12:45:27.001943 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:27.001938    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 16 12:45:27.013740 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:27.013718    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-74767d9c48-nwllp"]
Sep 16 12:45:27.048880 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:27.048846    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d05dfd28-8304-4deb-8598-729d1f23985e-openshift-service-ca\") pod \"maas-api-74767d9c48-nwllp\" (UID: \"d05dfd28-8304-4deb-8598-729d1f23985e\") " pod="odh-ai-gateway-infra/maas-api-74767d9c48-nwllp"
Sep 16 12:45:27.049025 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:27.048906    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d05dfd28-8304-4deb-8598-729d1f23985e-metrics-certs\") pod \"maas-api-74767d9c48-nwllp\" (UID: \"d05dfd28-8304-4deb-8598-729d1f23985e\") " pod="odh-ai-gateway-infra/maas-api-74767d9c48-nwllp"
Sep 16 12:45:27.049093 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:27.049017    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8lvn\" (UniqueName: \"kubernetes.io/projected/d05dfd28-8304-4deb-8598-729d1f23985e-kube-api-access-p8lvn\") pod \"maas-api-74767d9c48-nwllp\" (UID: \"d05dfd28-8304-4deb-8598-729d1f23985e\") " pod="odh-ai-gateway-infra/maas-api-74767d9c48-nwllp"
Sep 16 12:45:27.049093 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:27.049054    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d05dfd28-8304-4deb-8598-729d1f23985e-maas-api-tls\") pod \"maas-api-74767d9c48-nwllp\" (UID: \"d05dfd28-8304-4deb-8598-729d1f23985e\") " pod="odh-ai-gateway-infra/maas-api-74767d9c48-nwllp"
Sep 16 12:45:27.149853 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:27.149809    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d05dfd28-8304-4deb-8598-729d1f23985e-metrics-certs\") pod \"maas-api-74767d9c48-nwllp\" (UID: \"d05dfd28-8304-4deb-8598-729d1f23985e\") " pod="odh-ai-gateway-infra/maas-api-74767d9c48-nwllp"
Sep 16 12:45:27.150070 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:27.149897    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8lvn\" (UniqueName: \"kubernetes.io/projected/d05dfd28-8304-4deb-8598-729d1f23985e-kube-api-access-p8lvn\") pod \"maas-api-74767d9c48-nwllp\" (UID: \"d05dfd28-8304-4deb-8598-729d1f23985e\") " pod="odh-ai-gateway-infra/maas-api-74767d9c48-nwllp"
Sep 16 12:45:27.150070 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:27.149919    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d05dfd28-8304-4deb-8598-729d1f23985e-maas-api-tls\") pod \"maas-api-74767d9c48-nwllp\" (UID: \"d05dfd28-8304-4deb-8598-729d1f23985e\") " pod="odh-ai-gateway-infra/maas-api-74767d9c48-nwllp"
Sep 16 12:45:27.150070 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:27.149961    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d05dfd28-8304-4deb-8598-729d1f23985e-openshift-service-ca\") pod \"maas-api-74767d9c48-nwllp\" (UID: \"d05dfd28-8304-4deb-8598-729d1f23985e\") " pod="odh-ai-gateway-infra/maas-api-74767d9c48-nwllp"
Sep 16 12:45:27.150631 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:27.150613    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d05dfd28-8304-4deb-8598-729d1f23985e-openshift-service-ca\") pod \"maas-api-74767d9c48-nwllp\" (UID: \"d05dfd28-8304-4deb-8598-729d1f23985e\") " pod="odh-ai-gateway-infra/maas-api-74767d9c48-nwllp"
Sep 16 12:45:27.152459 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:27.152434    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d05dfd28-8304-4deb-8598-729d1f23985e-maas-api-tls\") pod \"maas-api-74767d9c48-nwllp\" (UID: \"d05dfd28-8304-4deb-8598-729d1f23985e\") " pod="odh-ai-gateway-infra/maas-api-74767d9c48-nwllp"
Sep 16 12:45:27.152559 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:27.152440    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d05dfd28-8304-4deb-8598-729d1f23985e-metrics-certs\") pod \"maas-api-74767d9c48-nwllp\" (UID: \"d05dfd28-8304-4deb-8598-729d1f23985e\") " pod="odh-ai-gateway-infra/maas-api-74767d9c48-nwllp"
Sep 16 12:45:27.159224 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:27.159202    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8lvn\" (UniqueName: \"kubernetes.io/projected/d05dfd28-8304-4deb-8598-729d1f23985e-kube-api-access-p8lvn\") pod \"maas-api-74767d9c48-nwllp\" (UID: \"d05dfd28-8304-4deb-8598-729d1f23985e\") " pod="odh-ai-gateway-infra/maas-api-74767d9c48-nwllp"
Sep 16 12:45:27.309513 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:27.309437    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-74767d9c48-nwllp"
Sep 16 12:45:27.591710 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:27.591631    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-74767d9c48-nwllp"]
Sep 16 12:45:27.595732 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:45:27.595699    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd05dfd28_8304_4deb_8598_729d1f23985e.slice/crio-3823b5224a0cb5e5d8645f7adce55239c7d812a7120d4077a2268460359d02ad WatchSource:0}: Error finding container 3823b5224a0cb5e5d8645f7adce55239c7d812a7120d4077a2268460359d02ad: Status 404 returned error can't find the container with id 3823b5224a0cb5e5d8645f7adce55239c7d812a7120d4077a2268460359d02ad
Sep 16 12:45:28.440042 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:28.440002    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-74767d9c48-nwllp" event={"ID":"d05dfd28-8304-4deb-8598-729d1f23985e","Type":"ContainerStarted","Data":"3823b5224a0cb5e5d8645f7adce55239c7d812a7120d4077a2268460359d02ad"}
Sep 16 12:45:29.446785 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:29.446745    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-74767d9c48-nwllp" event={"ID":"d05dfd28-8304-4deb-8598-729d1f23985e","Type":"ContainerStarted","Data":"3152d30b3c248cb0bff5ba740add0a3df0ede59ac1795df61ffcd3c91ce4600d"}
Sep 16 12:45:29.447243 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:29.446871    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-74767d9c48-nwllp"
Sep 16 12:45:29.473664 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:29.473596    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-74767d9c48-nwllp" podStartSLOduration=1.813819891 podStartE2EDuration="3.473579142s" totalImagesPullingTime="1.659759251s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:45:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:45:29.472258657 +0000 UTC m=+2696.092577973" watchObservedRunningTime="2026-09-16 12:45:29.473579142 +0000 UTC m=+2696.093898457"
Sep 16 12:45:34.102089 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:34.102059    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-hrvzp_63ee784a-3b40-4259-9923-74a24d0203a0/console-operator/5.log"
Sep 16 12:45:34.106696 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:34.106673    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-hrvzp_63ee784a-3b40-4259-9923-74a24d0203a0/console-operator/5.log"
Sep 16 12:45:34.305305 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:34.305267    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:45:34.523286 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:34.523254    2559 scope.go:117] "RemoveContainer" containerID="2189e360a1b4d93208a87bb7b060b65c0365122ee7bff8c5e265091d8df39734"
Sep 16 12:45:34.531541 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:34.531524    2559 scope.go:117] "RemoveContainer" containerID="4b59f5fb068a439d1a551977d864fd11f83c009a48960ecf1d0ab24a91d76b4d"
Sep 16 12:45:35.103074 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:35.103040    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-74767d9c48-nwllp"]
Sep 16 12:45:35.103473 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:35.103284    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-74767d9c48-nwllp" podUID="d05dfd28-8304-4deb-8598-729d1f23985e" containerName="maas-api" containerID="cri-o://3152d30b3c248cb0bff5ba740add0a3df0ede59ac1795df61ffcd3c91ce4600d" gracePeriod=30
Sep 16 12:45:35.108609 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:35.108586    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-74767d9c48-nwllp"
Sep 16 12:45:35.156327 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:35.156297    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-64757c48b8-6hqf4"]
Sep 16 12:45:35.159770 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:35.159750    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-64757c48b8-6hqf4"
Sep 16 12:45:35.170904 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:35.170880    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-64757c48b8-6hqf4"]
Sep 16 12:45:35.225889 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:35.225856    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23f75df2-20eb-4d24-8782-e7bb2d0aa3e8-metrics-certs\") pod \"maas-api-64757c48b8-6hqf4\" (UID: \"23f75df2-20eb-4d24-8782-e7bb2d0aa3e8\") " pod="odh-ai-gateway-infra/maas-api-64757c48b8-6hqf4"
Sep 16 12:45:35.226019 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:35.225938    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/23f75df2-20eb-4d24-8782-e7bb2d0aa3e8-maas-api-tls\") pod \"maas-api-64757c48b8-6hqf4\" (UID: \"23f75df2-20eb-4d24-8782-e7bb2d0aa3e8\") " pod="odh-ai-gateway-infra/maas-api-64757c48b8-6hqf4"
Sep 16 12:45:35.226077 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:35.226058    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nr2w2\" (UniqueName: \"kubernetes.io/projected/23f75df2-20eb-4d24-8782-e7bb2d0aa3e8-kube-api-access-nr2w2\") pod \"maas-api-64757c48b8-6hqf4\" (UID: \"23f75df2-20eb-4d24-8782-e7bb2d0aa3e8\") " pod="odh-ai-gateway-infra/maas-api-64757c48b8-6hqf4"
Sep 16 12:45:35.226128 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:35.226112    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/23f75df2-20eb-4d24-8782-e7bb2d0aa3e8-openshift-service-ca\") pod \"maas-api-64757c48b8-6hqf4\" (UID: \"23f75df2-20eb-4d24-8782-e7bb2d0aa3e8\") " pod="odh-ai-gateway-infra/maas-api-64757c48b8-6hqf4"
Sep 16 12:45:35.326961 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:35.326924    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nr2w2\" (UniqueName: \"kubernetes.io/projected/23f75df2-20eb-4d24-8782-e7bb2d0aa3e8-kube-api-access-nr2w2\") pod \"maas-api-64757c48b8-6hqf4\" (UID: \"23f75df2-20eb-4d24-8782-e7bb2d0aa3e8\") " pod="odh-ai-gateway-infra/maas-api-64757c48b8-6hqf4"
Sep 16 12:45:35.327192 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:35.327003    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/23f75df2-20eb-4d24-8782-e7bb2d0aa3e8-openshift-service-ca\") pod \"maas-api-64757c48b8-6hqf4\" (UID: \"23f75df2-20eb-4d24-8782-e7bb2d0aa3e8\") " pod="odh-ai-gateway-infra/maas-api-64757c48b8-6hqf4"
Sep 16 12:45:35.327192 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:35.327043    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23f75df2-20eb-4d24-8782-e7bb2d0aa3e8-metrics-certs\") pod \"maas-api-64757c48b8-6hqf4\" (UID: \"23f75df2-20eb-4d24-8782-e7bb2d0aa3e8\") " pod="odh-ai-gateway-infra/maas-api-64757c48b8-6hqf4"
Sep 16 12:45:35.327192 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:35.327101    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/23f75df2-20eb-4d24-8782-e7bb2d0aa3e8-maas-api-tls\") pod \"maas-api-64757c48b8-6hqf4\" (UID: \"23f75df2-20eb-4d24-8782-e7bb2d0aa3e8\") " pod="odh-ai-gateway-infra/maas-api-64757c48b8-6hqf4"
Sep 16 12:45:35.327768 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:35.327739    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/23f75df2-20eb-4d24-8782-e7bb2d0aa3e8-openshift-service-ca\") pod \"maas-api-64757c48b8-6hqf4\" (UID: \"23f75df2-20eb-4d24-8782-e7bb2d0aa3e8\") " pod="odh-ai-gateway-infra/maas-api-64757c48b8-6hqf4"
Sep 16 12:45:35.329658 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:35.329637    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23f75df2-20eb-4d24-8782-e7bb2d0aa3e8-metrics-certs\") pod \"maas-api-64757c48b8-6hqf4\" (UID: \"23f75df2-20eb-4d24-8782-e7bb2d0aa3e8\") " pod="odh-ai-gateway-infra/maas-api-64757c48b8-6hqf4"
Sep 16 12:45:35.329806 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:35.329783    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/23f75df2-20eb-4d24-8782-e7bb2d0aa3e8-maas-api-tls\") pod \"maas-api-64757c48b8-6hqf4\" (UID: \"23f75df2-20eb-4d24-8782-e7bb2d0aa3e8\") " pod="odh-ai-gateway-infra/maas-api-64757c48b8-6hqf4"
Sep 16 12:45:35.335373 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:35.335242    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nr2w2\" (UniqueName: \"kubernetes.io/projected/23f75df2-20eb-4d24-8782-e7bb2d0aa3e8-kube-api-access-nr2w2\") pod \"maas-api-64757c48b8-6hqf4\" (UID: \"23f75df2-20eb-4d24-8782-e7bb2d0aa3e8\") " pod="odh-ai-gateway-infra/maas-api-64757c48b8-6hqf4"
Sep 16 12:45:35.357417 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:35.357353    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-74767d9c48-nwllp"
Sep 16 12:45:35.428369 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:35.428332    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p8lvn\" (UniqueName: \"kubernetes.io/projected/d05dfd28-8304-4deb-8598-729d1f23985e-kube-api-access-p8lvn\") pod \"d05dfd28-8304-4deb-8598-729d1f23985e\" (UID: \"d05dfd28-8304-4deb-8598-729d1f23985e\") "
Sep 16 12:45:35.428535 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:35.428423    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d05dfd28-8304-4deb-8598-729d1f23985e-metrics-certs\") pod \"d05dfd28-8304-4deb-8598-729d1f23985e\" (UID: \"d05dfd28-8304-4deb-8598-729d1f23985e\") "
Sep 16 12:45:35.428535 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:35.428469    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d05dfd28-8304-4deb-8598-729d1f23985e-maas-api-tls\") pod \"d05dfd28-8304-4deb-8598-729d1f23985e\" (UID: \"d05dfd28-8304-4deb-8598-729d1f23985e\") "
Sep 16 12:45:35.428535 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:35.428496    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d05dfd28-8304-4deb-8598-729d1f23985e-openshift-service-ca\") pod \"d05dfd28-8304-4deb-8598-729d1f23985e\" (UID: \"d05dfd28-8304-4deb-8598-729d1f23985e\") "
Sep 16 12:45:35.428897 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:35.428857    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d05dfd28-8304-4deb-8598-729d1f23985e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d05dfd28-8304-4deb-8598-729d1f23985e" (UID: "d05dfd28-8304-4deb-8598-729d1f23985e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:45:35.430723 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:35.430690    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d05dfd28-8304-4deb-8598-729d1f23985e-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "d05dfd28-8304-4deb-8598-729d1f23985e" (UID: "d05dfd28-8304-4deb-8598-729d1f23985e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 12:45:35.430723 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:35.430701    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d05dfd28-8304-4deb-8598-729d1f23985e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d05dfd28-8304-4deb-8598-729d1f23985e" (UID: "d05dfd28-8304-4deb-8598-729d1f23985e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 12:45:35.430850 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:35.430688    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d05dfd28-8304-4deb-8598-729d1f23985e-kube-api-access-p8lvn" (OuterVolumeSpecName: "kube-api-access-p8lvn") pod "d05dfd28-8304-4deb-8598-729d1f23985e" (UID: "d05dfd28-8304-4deb-8598-729d1f23985e"). InnerVolumeSpecName "kube-api-access-p8lvn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:45:35.478587 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:35.478558    2559 generic.go:356] "Generic (PLEG): container finished" podID="d05dfd28-8304-4deb-8598-729d1f23985e" containerID="3152d30b3c248cb0bff5ba740add0a3df0ede59ac1795df61ffcd3c91ce4600d" exitCode=0
Sep 16 12:45:35.478769 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:35.478603    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-74767d9c48-nwllp"
Sep 16 12:45:35.478769 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:35.478639    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-74767d9c48-nwllp" event={"ID":"d05dfd28-8304-4deb-8598-729d1f23985e","Type":"ContainerDied","Data":"3152d30b3c248cb0bff5ba740add0a3df0ede59ac1795df61ffcd3c91ce4600d"}
Sep 16 12:45:35.478769 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:35.478695    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-74767d9c48-nwllp" event={"ID":"d05dfd28-8304-4deb-8598-729d1f23985e","Type":"ContainerDied","Data":"3823b5224a0cb5e5d8645f7adce55239c7d812a7120d4077a2268460359d02ad"}
Sep 16 12:45:35.478769 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:35.478730    2559 scope.go:117] "RemoveContainer" containerID="3152d30b3c248cb0bff5ba740add0a3df0ede59ac1795df61ffcd3c91ce4600d"
Sep 16 12:45:35.489859 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:35.489843    2559 scope.go:117] "RemoveContainer" containerID="3152d30b3c248cb0bff5ba740add0a3df0ede59ac1795df61ffcd3c91ce4600d"
Sep 16 12:45:35.490174 ip-10-0-138-251 kubenswrapper[2559]: E0916 12:45:35.490154    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3152d30b3c248cb0bff5ba740add0a3df0ede59ac1795df61ffcd3c91ce4600d\": container with ID starting with 3152d30b3c248cb0bff5ba740add0a3df0ede59ac1795df61ffcd3c91ce4600d not found: ID does not exist" containerID="3152d30b3c248cb0bff5ba740add0a3df0ede59ac1795df61ffcd3c91ce4600d"
Sep 16 12:45:35.490228 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:35.490184    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3152d30b3c248cb0bff5ba740add0a3df0ede59ac1795df61ffcd3c91ce4600d"} err="failed to get container status \"3152d30b3c248cb0bff5ba740add0a3df0ede59ac1795df61ffcd3c91ce4600d\": rpc error: code = NotFound desc = could not find container \"3152d30b3c248cb0bff5ba740add0a3df0ede59ac1795df61ffcd3c91ce4600d\": container with ID starting with 3152d30b3c248cb0bff5ba740add0a3df0ede59ac1795df61ffcd3c91ce4600d not found: ID does not exist"
Sep 16 12:45:35.495099 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:35.495083    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-64757c48b8-6hqf4"
Sep 16 12:45:35.502294 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:35.502267    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-74767d9c48-nwllp"]
Sep 16 12:45:35.506010 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:35.505990    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-74767d9c48-nwllp"]
Sep 16 12:45:35.529593 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:35.529562    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p8lvn\" (UniqueName: \"kubernetes.io/projected/d05dfd28-8304-4deb-8598-729d1f23985e-kube-api-access-p8lvn\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:45:35.529593 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:35.529587    2559 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d05dfd28-8304-4deb-8598-729d1f23985e-metrics-certs\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:45:35.529593 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:35.529598    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d05dfd28-8304-4deb-8598-729d1f23985e-maas-api-tls\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:45:35.529815 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:35.529607    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d05dfd28-8304-4deb-8598-729d1f23985e-openshift-service-ca\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\""
Sep 16 12:45:35.770427 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:35.770405    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-64757c48b8-6hqf4"]
Sep 16 12:45:35.772343 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:45:35.772321    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23f75df2_20eb_4d24_8782_e7bb2d0aa3e8.slice/crio-c11c1162a31a02f36436aaa73113c5ca568c0531528b69643bb31280c54b0467 WatchSource:0}: Error finding container c11c1162a31a02f36436aaa73113c5ca568c0531528b69643bb31280c54b0467: Status 404 returned error can't find the container with id c11c1162a31a02f36436aaa73113c5ca568c0531528b69643bb31280c54b0467
Sep 16 12:45:35.937574 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:35.937541    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d05dfd28-8304-4deb-8598-729d1f23985e" path="/var/lib/kubelet/pods/d05dfd28-8304-4deb-8598-729d1f23985e/volumes"
Sep 16 12:45:36.212654 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:36.212551    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:45:36.486266 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:36.486226    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-64757c48b8-6hqf4" event={"ID":"23f75df2-20eb-4d24-8782-e7bb2d0aa3e8","Type":"ContainerStarted","Data":"9d5d2c2cc22d099b72f191bbaa68c2bf359a6e5b3e349b749934c20bd97c7660"}
Sep 16 12:45:36.486468 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:36.486295    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-64757c48b8-6hqf4" event={"ID":"23f75df2-20eb-4d24-8782-e7bb2d0aa3e8","Type":"ContainerStarted","Data":"c11c1162a31a02f36436aaa73113c5ca568c0531528b69643bb31280c54b0467"}
Sep 16 12:45:36.486468 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:36.486408    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-64757c48b8-6hqf4"
Sep 16 12:45:36.504185 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:36.503990    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-64757c48b8-6hqf4" podStartSLOduration=1.205599683 podStartE2EDuration="1.503971503s" totalImagesPullingTime="298.37182ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:45:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:45:36.503588862 +0000 UTC m=+2703.123908195" watchObservedRunningTime="2026-09-16 12:45:36.503971503 +0000 UTC m=+2703.124290820"
Sep 16 12:45:41.006631 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:41.006589    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:45:42.497333 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:42.497303    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-64757c48b8-6hqf4"
Sep 16 12:45:46.613833 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:46.613799    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:45:53.403686 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:45:53.403653    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-ssnhk"]
Sep 16 12:46:02.393152 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:02.393098    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7fb697d85d-85dzv_4d1a1655-3f87-49ec-8826-88cbed7da6b6/manager/0.log"
Sep 16 12:46:02.992823 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:02.992796    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7887d7f7b8-k6cfq_edbebcfc-39ad-476f-b879-c85d843ef191/manager/0.log"
Sep 16 12:46:02.999082 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:02.999063    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7887d7f7b8-k6cfq_edbebcfc-39ad-476f-b879-c85d843ef191/copy-manifests/0.log"
Sep 16 12:46:03.344638 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:03.344563    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-64757c48b8-6hqf4_23f75df2-20eb-4d24-8782-e7bb2d0aa3e8/maas-api/0.log"
Sep 16 12:46:03.569470 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:03.569441    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29826030-kpl2h_53a5d543-93ef-473d-80ff-b9c81bcb8d80/cleanup/0.log"
Sep 16 12:46:03.801468 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:03.801437    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-dmzkd_fde3f460-e4ce-46b4-b08c-d61c2b5400e9/postgres/0.log"
Sep 16 12:46:04.718563 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:04.718533    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-74vxx_f0e06372-a6f9-41bf-8f9a-59cceec9e6ec/manager/0.log"
Sep 16 12:46:04.834444 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:04.834414    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-wvxcn_1265b402-10a5-4c22-b004-30c116fa3556/manager/0.log"
Sep 16 12:46:05.189109 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:05.189078    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-ssnhk_48634b09-3960-4620-a20d-5a8ee4907fe0/limitador/0.log"
Sep 16 12:46:05.314738 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:05.314696    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-6mfcs_7c2f6b89-cbba-4cb3-afaa-abd3da15579f/manager/0.log"
Sep 16 12:46:06.359491 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:06.359458    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-ltqcv_00903936-23e1-4ffe-a6ec-0bbe98320a3e/payload-processing/0.log"
Sep 16 12:46:06.645898 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:06.645808    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:46:07.081926 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:07.081893    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-zgrfj_b7ac3e55-00b1-4e00-8d74-79884ccad3a1/main/0.log"
Sep 16 12:46:07.193826 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:07.193799    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-jnvh5_1755a474-204d-4cce-ab32-a3bc95066cf5/main/0.log"
Sep 16 12:46:12.849585 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:12.849547    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:46:12.943638 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:12.943603    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log" limit=1024
Sep 16 12:46:15.833070 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:15.833040    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-tbc79_28222687-d3b4-4c0c-81f3-cc24fdc912e8/global-pull-secret-syncer/0.log"
Sep 16 12:46:15.882939 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:15.882909    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-rsjgc_6b817e44-5083-4c23-8480-340e10041f8f/konnectivity-agent/0.log"
Sep 16 12:46:16.001925 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:16.001896    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-251.ec2.internal_9111bdadcd9657efb2af1c537a733d27/haproxy/0.log"
Sep 16 12:46:20.466412 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:20.466315    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-74vxx_f0e06372-a6f9-41bf-8f9a-59cceec9e6ec/manager/0.log"
Sep 16 12:46:20.493658 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:20.493626    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-wvxcn_1265b402-10a5-4c22-b004-30c116fa3556/manager/0.log"
Sep 16 12:46:20.590239 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:20.590209    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-ssnhk_48634b09-3960-4620-a20d-5a8ee4907fe0/limitador/0.log"
Sep 16 12:46:20.642932 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:20.642885    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-6mfcs_7c2f6b89-cbba-4cb3-afaa-abd3da15579f/manager/0.log"
Sep 16 12:46:22.548643 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:22.548609    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cd954b897-dk9qm_3c5a71bb-e6d1-45d8-8872-4165a3aa09e2/cluster-monitoring-operator/0.log"
Sep 16 12:46:22.646848 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:22.646821    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-9484849cb-qjktm_195630ed-aaf5-4295-a92f-6d554450bd98/metrics-server/0.log"
Sep 16 12:46:22.721690 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:22.721659    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mmggg_cd7a3585-5624-4e47-8ac5-cbe16dc117c2/node-exporter/0.log"
Sep 16 12:46:22.736721 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:22.736683    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mmggg_cd7a3585-5624-4e47-8ac5-cbe16dc117c2/kube-rbac-proxy/0.log"
Sep 16 12:46:22.755625 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:22.755596    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mmggg_cd7a3585-5624-4e47-8ac5-cbe16dc117c2/init-textfile/0.log"
Sep 16 12:46:23.022454 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:23.022423    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_543fa5fc-eba3-4856-8b96-ab7ceb0b2843/prometheus/0.log"
Sep 16 12:46:23.044957 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:23.044932    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_543fa5fc-eba3-4856-8b96-ab7ceb0b2843/config-reloader/0.log"
Sep 16 12:46:23.066412 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:23.066390    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_543fa5fc-eba3-4856-8b96-ab7ceb0b2843/thanos-sidecar/0.log"
Sep 16 12:46:23.090267 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:23.090244    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_543fa5fc-eba3-4856-8b96-ab7ceb0b2843/kube-rbac-proxy-web/0.log"
Sep 16 12:46:23.117763 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:23.117736    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_543fa5fc-eba3-4856-8b96-ab7ceb0b2843/kube-rbac-proxy/0.log"
Sep 16 12:46:23.144947 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:23.144920    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_543fa5fc-eba3-4856-8b96-ab7ceb0b2843/kube-rbac-proxy-thanos/0.log"
Sep 16 12:46:23.168649 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:23.168625    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_543fa5fc-eba3-4856-8b96-ab7ceb0b2843/init-config-reloader/0.log"
Sep 16 12:46:23.233574 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:23.233534    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-rqht4_2ec6019f-4aa8-4bd8-ac53-8510a5cfcf6b/prometheus-operator/0.log"
Sep 16 12:46:23.252079 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:23.252052    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-rqht4_2ec6019f-4aa8-4bd8-ac53-8510a5cfcf6b/kube-rbac-proxy/0.log"
Sep 16 12:46:24.990400 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:24.990370    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-5dcbc7df6b-48mv7_895f0b5d-bd3c-4065-8681-43f68ef87d04/networking-console-plugin/0.log"
Sep 16 12:46:25.633348 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:25.633285    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-hrvzp_63ee784a-3b40-4259-9923-74a24d0203a0/console-operator/5.log"
Sep 16 12:46:25.637521 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:25.637501    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-hrvzp_63ee784a-3b40-4259-9923-74a24d0203a0/console-operator/6.log"
Sep 16 12:46:26.182777 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:26.182749    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-76f99584f4-5hnxh_3e7df9eb-85be-4e46-9d5a-0d490c9b267f/download-server/0.log"
Sep 16 12:46:26.347312 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:26.347278    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mv6dr/perf-node-gather-daemonset-nrxc2"]
Sep 16 12:46:26.347691 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:26.347678    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d05dfd28-8304-4deb-8598-729d1f23985e" containerName="maas-api"
Sep 16 12:46:26.347745 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:26.347692    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d05dfd28-8304-4deb-8598-729d1f23985e" containerName="maas-api"
Sep 16 12:46:26.347791 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:26.347758    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="d05dfd28-8304-4deb-8598-729d1f23985e" containerName="maas-api"
Sep 16 12:46:26.351098 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:26.351076    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mv6dr/perf-node-gather-daemonset-nrxc2"
Sep 16 12:46:26.354275 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:26.354240    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mv6dr\"/\"openshift-service-ca.crt\""
Sep 16 12:46:26.354585 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:26.354567    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mv6dr\"/\"default-dockercfg-ww4vd\""
Sep 16 12:46:26.355624 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:26.355607    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mv6dr\"/\"kube-root-ca.crt\""
Sep 16 12:46:26.359866 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:26.359847    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mv6dr/perf-node-gather-daemonset-nrxc2"]
Sep 16 12:46:26.406627 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:26.406591    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e21c531e-16e5-441b-83eb-f0e794132a05-podres\") pod \"perf-node-gather-daemonset-nrxc2\" (UID: \"e21c531e-16e5-441b-83eb-f0e794132a05\") " pod="openshift-must-gather-mv6dr/perf-node-gather-daemonset-nrxc2"
Sep 16 12:46:26.406821 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:26.406636    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e21c531e-16e5-441b-83eb-f0e794132a05-lib-modules\") pod \"perf-node-gather-daemonset-nrxc2\" (UID: \"e21c531e-16e5-441b-83eb-f0e794132a05\") " pod="openshift-must-gather-mv6dr/perf-node-gather-daemonset-nrxc2"
Sep 16 12:46:26.406821 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:26.406688    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9t7x\" (UniqueName: \"kubernetes.io/projected/e21c531e-16e5-441b-83eb-f0e794132a05-kube-api-access-k9t7x\") pod \"perf-node-gather-daemonset-nrxc2\" (UID: \"e21c531e-16e5-441b-83eb-f0e794132a05\") " pod="openshift-must-gather-mv6dr/perf-node-gather-daemonset-nrxc2"
Sep 16 12:46:26.406821 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:26.406802    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e21c531e-16e5-441b-83eb-f0e794132a05-proc\") pod \"perf-node-gather-daemonset-nrxc2\" (UID: \"e21c531e-16e5-441b-83eb-f0e794132a05\") " pod="openshift-must-gather-mv6dr/perf-node-gather-daemonset-nrxc2"
Sep 16 12:46:26.406979 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:26.406850    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e21c531e-16e5-441b-83eb-f0e794132a05-sys\") pod \"perf-node-gather-daemonset-nrxc2\" (UID: \"e21c531e-16e5-441b-83eb-f0e794132a05\") " pod="openshift-must-gather-mv6dr/perf-node-gather-daemonset-nrxc2"
Sep 16 12:46:26.507779 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:26.507690    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e21c531e-16e5-441b-83eb-f0e794132a05-podres\") pod \"perf-node-gather-daemonset-nrxc2\" (UID: \"e21c531e-16e5-441b-83eb-f0e794132a05\") " pod="openshift-must-gather-mv6dr/perf-node-gather-daemonset-nrxc2"
Sep 16 12:46:26.507779 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:26.507734    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e21c531e-16e5-441b-83eb-f0e794132a05-lib-modules\") pod \"perf-node-gather-daemonset-nrxc2\" (UID: \"e21c531e-16e5-441b-83eb-f0e794132a05\") " pod="openshift-must-gather-mv6dr/perf-node-gather-daemonset-nrxc2"
Sep 16 12:46:26.507779 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:26.507764    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9t7x\" (UniqueName: \"kubernetes.io/projected/e21c531e-16e5-441b-83eb-f0e794132a05-kube-api-access-k9t7x\") pod \"perf-node-gather-daemonset-nrxc2\" (UID: \"e21c531e-16e5-441b-83eb-f0e794132a05\") " pod="openshift-must-gather-mv6dr/perf-node-gather-daemonset-nrxc2"
Sep 16 12:46:26.508023 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:26.507842    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e21c531e-16e5-441b-83eb-f0e794132a05-proc\") pod \"perf-node-gather-daemonset-nrxc2\" (UID: \"e21c531e-16e5-441b-83eb-f0e794132a05\") " pod="openshift-must-gather-mv6dr/perf-node-gather-daemonset-nrxc2"
Sep 16 12:46:26.508023 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:26.507878    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e21c531e-16e5-441b-83eb-f0e794132a05-sys\") pod \"perf-node-gather-daemonset-nrxc2\" (UID: \"e21c531e-16e5-441b-83eb-f0e794132a05\") " pod="openshift-must-gather-mv6dr/perf-node-gather-daemonset-nrxc2"
Sep 16 12:46:26.508023 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:26.507884    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e21c531e-16e5-441b-83eb-f0e794132a05-lib-modules\") pod \"perf-node-gather-daemonset-nrxc2\" (UID: \"e21c531e-16e5-441b-83eb-f0e794132a05\") " pod="openshift-must-gather-mv6dr/perf-node-gather-daemonset-nrxc2"
Sep 16 12:46:26.508023 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:26.507879    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e21c531e-16e5-441b-83eb-f0e794132a05-podres\") pod \"perf-node-gather-daemonset-nrxc2\" (UID: \"e21c531e-16e5-441b-83eb-f0e794132a05\") " pod="openshift-must-gather-mv6dr/perf-node-gather-daemonset-nrxc2"
Sep 16 12:46:26.508023 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:26.507922    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e21c531e-16e5-441b-83eb-f0e794132a05-proc\") pod \"perf-node-gather-daemonset-nrxc2\" (UID: \"e21c531e-16e5-441b-83eb-f0e794132a05\") " pod="openshift-must-gather-mv6dr/perf-node-gather-daemonset-nrxc2"
Sep 16 12:46:26.508023 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:26.507965    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e21c531e-16e5-441b-83eb-f0e794132a05-sys\") pod \"perf-node-gather-daemonset-nrxc2\" (UID: \"e21c531e-16e5-441b-83eb-f0e794132a05\") " pod="openshift-must-gather-mv6dr/perf-node-gather-daemonset-nrxc2"
Sep 16 12:46:26.516125 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:26.516103    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9t7x\" (UniqueName: \"kubernetes.io/projected/e21c531e-16e5-441b-83eb-f0e794132a05-kube-api-access-k9t7x\") pod \"perf-node-gather-daemonset-nrxc2\" (UID: \"e21c531e-16e5-441b-83eb-f0e794132a05\") " pod="openshift-must-gather-mv6dr/perf-node-gather-daemonset-nrxc2"
Sep 16 12:46:26.662443 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:26.662406    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mv6dr/perf-node-gather-daemonset-nrxc2"
Sep 16 12:46:26.933993 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:26.933969    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mv6dr/perf-node-gather-daemonset-nrxc2"]
Sep 16 12:46:26.936205 ip-10-0-138-251 kubenswrapper[2559]: W0916 12:46:26.936172    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode21c531e_16e5_441b_83eb_f0e794132a05.slice/crio-69b58482eee0b4eb40924f6867de015bbd58cfc571d36eaf9a220854b748c970 WatchSource:0}: Error finding container 69b58482eee0b4eb40924f6867de015bbd58cfc571d36eaf9a220854b748c970: Status 404 returned error can't find the container with id 69b58482eee0b4eb40924f6867de015bbd58cfc571d36eaf9a220854b748c970
Sep 16 12:46:27.735705 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:27.735665    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mv6dr/perf-node-gather-daemonset-nrxc2" event={"ID":"e21c531e-16e5-441b-83eb-f0e794132a05","Type":"ContainerStarted","Data":"936e0590364197ea5ad58b171f514ea9618a371ace3395ccb7200fffcac3a412"}
Sep 16 12:46:27.736212 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:27.735754    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mv6dr/perf-node-gather-daemonset-nrxc2" event={"ID":"e21c531e-16e5-441b-83eb-f0e794132a05","Type":"ContainerStarted","Data":"69b58482eee0b4eb40924f6867de015bbd58cfc571d36eaf9a220854b748c970"}
Sep 16 12:46:27.736212 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:27.735776    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mv6dr/perf-node-gather-daemonset-nrxc2"
Sep 16 12:46:27.757487 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:27.757429    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mv6dr/perf-node-gather-daemonset-nrxc2" podStartSLOduration=1.757413343 podStartE2EDuration="1.757413343s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:46:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:46:27.755033145 +0000 UTC m=+2754.375352463" watchObservedRunningTime="2026-09-16 12:46:27.757413343 +0000 UTC m=+2754.377732659"
Sep 16 12:46:28.170673 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:28.170645    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bcrqz_b153e4d5-33a6-4e3f-aa63-8aec2c778bb7/dns/0.log"
Sep 16 12:46:28.193069 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:28.193042    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bcrqz_b153e4d5-33a6-4e3f-aa63-8aec2c778bb7/kube-rbac-proxy/0.log"
Sep 16 12:46:28.354457 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:28.354423    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ch8pr_a826335e-773e-48e2-aa35-099d7466304b/dns-node-resolver/0.log"
Sep 16 12:46:28.940117 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:28.940086    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-85b77c8745-q88bz_21d9dd2a-7747-4c79-8a50-e021bded662c/registry/0.log"
Sep 16 12:46:29.014590 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:29.014562    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-l5cpd_94671c96-5c56-42f8-b7f7-f6f93b27dac0/node-ca/0.log"
Sep 16 12:46:30.455617 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:30.455579    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-ltqcv_00903936-23e1-4ffe-a6ec-0bbe98320a3e/payload-processing/0.log"
Sep 16 12:46:31.389625 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:31.389594    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ptchc_0f5e5b43-7b68-4940-bba6-36238146b79d/serve-healthcheck-canary/0.log"
Sep 16 12:46:31.975481 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:31.975454    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dd4bl_ce3f4812-de43-4d0e-9ba6-b00f862ce514/kube-rbac-proxy/0.log"
Sep 16 12:46:31.993648 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:31.993623    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dd4bl_ce3f4812-de43-4d0e-9ba6-b00f862ce514/exporter/0.log"
Sep 16 12:46:32.012118 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:32.012088    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dd4bl_ce3f4812-de43-4d0e-9ba6-b00f862ce514/extractor/0.log"
Sep 16 12:46:33.750040 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:33.750010    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mv6dr/perf-node-gather-daemonset-nrxc2"
Sep 16 12:46:34.499046 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:34.499011    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7fb697d85d-85dzv_4d1a1655-3f87-49ec-8826-88cbed7da6b6/manager/0.log"
Sep 16 12:46:34.769873 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:34.769786    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7887d7f7b8-k6cfq_edbebcfc-39ad-476f-b879-c85d843ef191/manager/0.log"
Sep 16 12:46:34.783926 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:34.783907    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7887d7f7b8-k6cfq_edbebcfc-39ad-476f-b879-c85d843ef191/copy-manifests/0.log"
Sep 16 12:46:36.289416 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:36.289389    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-c7f7d6d7f-g866v_ae1d3547-f8ba-4536-8440-62227e3d9d28/manager/0.log"
Sep 16 12:46:37.425493 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:37.425467    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-ltqcv_00903936-23e1-4ffe-a6ec-0bbe98320a3e/payload-processing/0.log"
Sep 16 12:46:39.603706 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:39.603674    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-ltqcv_00903936-23e1-4ffe-a6ec-0bbe98320a3e/payload-processing/0.log"
Sep 16 12:46:41.655349 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:41.655319    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-bvlvm_8ef70f87-8024-4b34-9c17-d9d275b5feb2/migrator/0.log"
Sep 16 12:46:41.673366 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:41.673339    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-bvlvm_8ef70f87-8024-4b34-9c17-d9d275b5feb2/graceful-termination/0.log"
Sep 16 12:46:42.025853 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:42.025768    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-8r45z_1a31434c-3312-4330-bf77-681bb7bdb281/kube-storage-version-migrator-operator/1.log"
Sep 16 12:46:42.026598 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:42.026575    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-8r45z_1a31434c-3312-4330-bf77-681bb7bdb281/kube-storage-version-migrator-operator/0.log"
Sep 16 12:46:43.054750 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:43.054722    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-swz2v_e0181d86-c266-426e-a18d-0f0241e252a9/kube-multus-additional-cni-plugins/0.log"
Sep 16 12:46:43.075468 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:43.075443    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-swz2v_e0181d86-c266-426e-a18d-0f0241e252a9/egress-router-binary-copy/0.log"
Sep 16 12:46:43.097346 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:43.097323    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-swz2v_e0181d86-c266-426e-a18d-0f0241e252a9/cni-plugins/0.log"
Sep 16 12:46:43.118340 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:43.118317    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-swz2v_e0181d86-c266-426e-a18d-0f0241e252a9/bond-cni-plugin/0.log"
Sep 16 12:46:43.136604 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:43.136580    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-swz2v_e0181d86-c266-426e-a18d-0f0241e252a9/routeoverride-cni/0.log"
Sep 16 12:46:43.156603 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:43.156582    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-swz2v_e0181d86-c266-426e-a18d-0f0241e252a9/whereabouts-cni-bincopy/0.log"
Sep 16 12:46:43.175845 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:43.175820    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-swz2v_e0181d86-c266-426e-a18d-0f0241e252a9/whereabouts-cni/0.log"
Sep 16 12:46:43.550206 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:43.550177    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-rhx78_bc31abf4-e8c6-4be6-87b3-f412930ffa32/kube-multus/0.log"
Sep 16 12:46:43.573988 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:43.573960    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6tsgc_e261eb8b-bfaa-491d-afbe-6eb8fbc57324/network-metrics-daemon/0.log"
Sep 16 12:46:43.590106 ip-10-0-138-251 kubenswrapper[2559]: I0916 12:46:43.590086    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6tsgc_e261eb8b-bfaa-491d-afbe-6eb8fbc57324/kube-rbac-proxy/0.log"